Should I get over my prejudice/ignorance/snobbery for WAV and change to mp3?
Home :: General Discussion :: Should I get over my prejudice/ignorance/snobbery for WAV and change to mp3?Reply
Should I get over my prejudice/ignorance/snobbery for WAV and change to mp3? Posted on: 24.04.2012 by Lin Danek A combination of audiophile snobbery, ignorance, prejudice and an ability to convince myself that I CAN hear the difference has resulted in me only buying WAV files from Beatport and JunoDownload. I am also fortunate enough to have a 500GB ASUS NJ61 that only has my (stripped) OS, Traktor and music library on it. Our currency is about to hit 8 Rands to 1 Dollar and I am reconsidering the cost of WAV upgrades. I've read the science (I'm sick of reading about WAV's "voracious appetite for disc space" and "once lost with compression, always lost to compression") but want to hear from this community. 1. Is WAV REALLY worth it? 2. Will I notice the difference? I really appreciate the sound quality of the S4 and don't want it compromised. | |
Roseanna Signorini 10.05.2012 | I have to give big props to Mostapha for taking the time and energy to create the test whether I whole heartedly agree with it or not. The basic test is either it is or it isn't, plain and simple. No matter what, there will always be the human factor of "I just guessed on that 1". You took 10 tracks 10 times and mixed em up. The end result will be a % of wrong and a % of right. I believe it would be more accurate if you took 100 different tracks, some mp3, some wav and said, tell me which is which. There still would be statistical data. I took the test. Im the guy who said you can't hear a difference and yes there was instances where I was like, "ok this is the mp3" and then the next trial comes on and I'm like "wait, no this is the mp3 and that last 1 was the wav" Then all those years of test taking comes into play with...I just said wav 3 times in a row, this 1 has to be an mp3 and the mind plays tricks. Im not surprised at the difficulty. |
Tarsha Tammi 10.05.2012 | I'm very much in the WAVE crowd, I can't wait to see the results. |
Romelia Stankard 10.05.2012 |
Originally Posted by dj matt blaze
Originally Posted by soundinmotiondj
|
Antonetta Wikel 10.05.2012 |
Originally Posted by dj matt blaze
|
Dorie Scelzo 09.05.2012 |
Originally Posted by photojojo
For one thing, I kinda can't wait to see if there's a reliable difference between the songs I chose.
Originally Posted by TCMuc
Originally Posted by 3heads
Originally Posted by dj matt blaze
Originally Posted by soundinmotiondj
|
Layne Koop 09.05.2012 |
Originally Posted by dj matt blaze
Consider the following... Color vision: If you can tel the difference between a B&W photo and a color photo...then you should be able to "tell" without needing to A/B the photos. Reality: If you can tell the difference between a photo of an outdoor scene and a window that looks out over the same scene....then you should be able to "tell" without needing to see the photo hung next to the window. Music: If you can tell the difference between a live piano and a recording of a piano.... If you can tell the difference between a 1940's recording of a piano and a modern recording of a piano.... If you can tell the difference between a live concert bootleg and a studio recording.... If you can tell the difference between an LP recording of a piano and a CD recording of a piano... If you can tell the difference between an AAA (analog) recording of a piano and a DDD (digital) recording of a piano... If you can tell the difference between a WAV and an mp3... At what point in that progression does the difference just fade away? Does the difference ever fall below the "threshold" of the human perception of sound? |
Layne Koop 09.05.2012 |
Originally Posted by mostapha
So...I can't tell. Now...I didn't believe that I could tell...and yet again I prove that to myself. |
Roseanna Signorini 09.05.2012 |
My test is valid. If some of your experience in TV qualifies you to speak about research statistics, I'd love to hear it. 10 trials each of 10 songs. The 'score' for each song is averaged and a Student's T-Test is applied looking for significance at the .05 level. Meaning that if your T-Score is above the T* critical value, there's less than a 5% chance that you did better than random based purely on luck. That's good enough for me. I can do the test at .01 if you prefer.
If a higher percentage of people taking the test can identify the difference I will have no problem admitting that in fact there is an audible difference. No shame, it is what it is, the data doesn't lie. I mean technically we know that a wav is a better file, throw it up on a scope and you will see it very easily but when just listening to something and without a reference and something else to compare it to, can you tell the difference? |
Celestine Porebski 09.05.2012 | Tried the test and PMed you my results, mostapha. Very interested how it's gonna turn out. However the results, the differences were minuscule if existent. |
Lilliana Perris 09.05.2012 |
Originally Posted by mostapha
|
Hipolito Scionti 09.05.2012 |
Originally Posted by photojojo
|
Nikole Resende 09.05.2012 |
Originally Posted by mostapha
Just on a side note: a double-blind setting is only necessary in situations where the person being tested can acutally observe the tester. If the tester knows the results he can (unconciously) influence the person being tested, e.g. through his body language. As noone in this test can observe you there is no real reason to do a double-blind test. Anyway, making it double-blind at least guarantess a true randomisation of which track is A or B and gave you the chance to take the test as well. Thanks a lot for taking the time to actually putting together this test!!!! I don't know yet if I will find the time to participate, but if so I surely will send you my results! |
Leeanna Ayla 09.05.2012 | Can we do the test multiple times with different listening devices? Maybe picking just one to count to the overall result, but I would be curious what the results would be using my ipod headphones, my MDR7506's and my HD25II's |
Romelia Stankard 09.05.2012 | This should be interesting I'll do it when I get home today, although I don't expect to be able to really tell the difference. |
Dorie Scelzo 09.05.2012 | The test. Okay, so the test is online (or will be shortly) at www.prism.gatech.edu/~gtg054r/soundtest.wav. It's a ~500MB wav file, so bear that in mind if–like our friend from S. Africa–you have to pay for bandwidth. I'll probably create a FLAC or ALAC copy as well (which will be the same, but .flac or .m4a instead of .wav) if people ask for it. It's about 45 minutes long. You'll be listening to 140 audio clips, plus some explanation of what's going on (yay…i found a mic on the floor), plus a section of pink noise to set your volume to a comfortable level. Please avoid changing your volume during the test (certainly only even believe about changing it between songs, not between individual trials). Every clip was normalized to the same volume and played with just a bit of headroom. So you shouldn't have to touch your volume control after you start. After a citation (artist, title, etc.) you hear 4 audio clips in this order: wav, mp3, wav, mp3 to orient you to what you're hearing. Some of them are introduced, others aren't. I just forgot to copypasta all the regions and was too lazy to fix it. If it bothers anyone, I'll fix it. And no, they're not full songs. They're 15-second clips. If I used full songs, the test would take around 12 hours to complete. The songs are mostly modern dance music leaning towards techno and house. Please format your responses thusly: Song[tab]Trial[tab][USERNAME] 1[tab]1[tab][guess, m for mp3, w for wav] 1[tab]2[tab][guess, m for mp3, w for wav] 1[tab]3[tab][guess, m for mp3, w for wav] 1[tab]4[tab][guess, m for mp3, w for wav] … 2[tab]1[tab][guess, m for mp3, w for wav] 2[tab]1[tab][guess, m for mp3, w for wav] … … Doing so means I can easily use a spreadsheet to do the analysis instead of doing it by hand and potentially making a transcription/computation error. Any text editor will work (or you could use google docs or excel or numbers…whatever) just make sure that you send me just that text and not other formatting information if you can. Please PM me your results. I'll do the analysis and keep the actual answers secret (though I'll respond with them once you've done it) to avoid people cheating. After a few people have done it, I'll post a description of the results (without revealing anyone's identity…so there's no potential for embarassment if your ears aren't as good as you believe they are……except for me……'cuz I'm a boss). I'll be publishing my results right after I generate a key. I know it's hard to trust, but I assure you that the test is double-blind. I created wav and mp3 versions (then converted the mp3 back to a wav) and in addition to naming them 1wav.wav and 1mp3.wav, they were copied to 1A.wav and 1B.wav…then, using a shell script, I gave each file a crap ton of chances to switch names (back and forth) based on random number generation…and kept track of it in a text file that I didn't read. So, when I was flipping coins to decide whether each trial was going to be the A file or B file, I didn't know which was the wav and which was the mp3 (they were both referred to wavs inside Logic). And yes, I know how to swap things (using a temp file) so they're not the same file. I look forward to seeing the results and hope I didn't waste all that time. If nothing else, I got to do the test at least…and we'll see if I've been sticking my foot in my mouth. |
Dorie Scelzo 09.05.2012 |
Originally Posted by dj matt blaze
I haven't scored my answers yet (because I haven't committed to them semi-publically) but I'm supremely confident that I got 100% on at least one of the songs (as in 10 out of 10 correctly identified as wav or mp3 for that song clip). But, after doing the test completely blind, I'll agree that the difference is smaller than I thought it was. I probably did no better than random on a couple of them, based solely on my confidence. I'll PM my answers to JohnathanBlake after this post, since he seems answered and then score them…which will probably take a while.
Originally Posted by dj matt blaze
I have worked in a recording studio before, and I'll agree…clients can be kinda dumb when they believe they know everything. The sad thing is that it's really easy to act superior in that context…and it's never the professional approach. If nothing else, everyone is a slave to confirmation bias. It doesn't take long working in anything like that to adjust an EQ or some color correction or timing or something until you get the effect that you want…only to realize after the fact that you were adjusting a bypassed effector. It happens. That doesn't mean it's okay to do it intentionally without a really good reason (like saving the client embarrassment by tweaking an EQ on a dead channel instead of adding a 10dB boost at 192k or something else based on them misunderstanding jargon). Then again, doing whatever you were going to do next anyway would also work and not specifically insult them if they catch you
Originally Posted by dj matt blaze
Originally Posted by M.Beijer
And, uhh…I don't read/speak Sweedish…but that looks like a recording school. Full Sail, Berklee, and SAE are well-regarded in the US. And I've spoken to graduates of all of them that thing DATs are analog or don't know that MIDI isn't Audio. Recording schools are a joke. I'll agree for lay people, but if you know what to listen for and it's in the song it's obvious. |
Mimi Mahaffee 09.05.2012 |
Originally Posted by SirReal
The group of studio blue and their studio is regarded as one of the best in Europe. http://www.studioblue.se/studion He and the others at the studio all say you can't hear a difference between a GOOD mp3 320kb and WAV, remember some mp3s sucks even if its 320kbit due to made in a shitty software. I have been there too, doing blindtest and got the same result, could not pick out the wav. |
Lilliana Perris 09.05.2012 |
Originally Posted by JonathanBlake
|
Roseanna Signorini 09.05.2012 |
Originally Posted by SirReal
oh yea, and PAL blows... |
Antonetta Wikel 09.05.2012 |
Originally Posted by dj matt blaze
|
Lin Danek 08.05.2012 |
Originally Posted by SirReal
yup |
Lin Danek 08.05.2012 |
Originally Posted by dj matt blaze
My ignorance and prejudice is largely due to a vinyl background (as a listener, rather than as a DJ) - something that I still indulge in. And no, I won't initiate the vinyl vs digital debate. I have no prejudice against mp3 and grew to accept it as the industry standard when converting to portable (mp3) players. As for snobbery - that's what I'm accused of because I choose to use the 'technically better' (sic) format. @ Mostapha - thank you - look forward. |
Roseanna Signorini 08.05.2012 |
Originally Posted by SirReal
|
Roseanna Signorini 08.05.2012 |
Originally Posted by djproben
Think about all the DJs on this community who claim to know it all and act like their word is law in their condescending snobby way....now multiply that by 10 and welcome to the world of television..... |
Antonetta Wikel 08.05.2012 |
Originally Posted by dj matt blaze
|
Danae Dumler 08.05.2012 |
Originally Posted by dj matt blaze
|
Antonetta Wikel 08.05.2012 | |
Roseanna Signorini 08.05.2012 |
Originally Posted by mostapha
In terms of knowing what to listen for. I have been in the business for a long time, I hear and see things a lot differently than the average person, so believe me, I know exactly what to listen for, and how to listen. You want to believe you hear a difference, then you hear a difference, you're the man. My collection is filled with MP3's, wavs, flacs, and I know the drunk chick on the dance floor or the guy sitting at the bar believes they all sound the same. The title of the thread is about getting over the snobbery, ignorance, prejudice about mp3's. It is implying that yes I know that MP3 is a suitable format but I am a snob and I have to have what is technically better even though you can't hear a difference. So really the anwser is right there. |
Roseanna Signorini 08.05.2012 | The test is pointless with 2 files randomly assigned....you have a 50% chance of getting it right or wrong. There has to be 5 files, 4 mp3 and 1 wav, you have to pick out which is the wav. Personally I have no interest in doing any kind of blind test. I know what I know, and I have seen it a million times in both video and audio, people believeing they can tell the difference because they know its technically superior, but the human eyes and ears can't pick up the differences, its like saying you can hear a dog whistle. I have edited video where some hot shot wants 1 frame taken off, I do absolutely nothing and pretend to take off the frame by rerunning the edit and they tell me how much better that looks. Same exact thing in audio, with this exact scenario, I use an MP3 and they want the WAV, I do nothing and they tell me how much better the wav is, how crisper and cleaner and better sounding, I just smile and say "oh yea, big difference" and send them on their merry way. |
Dorie Scelzo 08.05.2012 | Just that it's not as arcane as you mentioned. My stuff is basically ready to go…just need to do the voice over if people are actually interested, but it'd take the better part of an hour for each person to do the test. Update: I'm done. The audio file is about 44 minutes. I haven't bounced it yet. I'm going to go ahead and do it so I can make sure there aren't any problems with the voice over. And no, I don't know what files are what yet. I mean…they're in a file…but I haven't read it yet. Everything is just [title]A.wav and [title]B.wav with the mp3 version randomly assigned to the A or B file. |
Antonetta Wikel 08.05.2012 | @ mostapha, not sure what the point of your wiki link is. I work in the audio industry and we use 95% wav/bwf, I rarely see AIFF anymore and it's never used as the final mastering file format. Besides the name of this thread was "wav vs MP3" not Aiff vs MP3" |
Danae Dumler 08.05.2012 | There's software that already exists that takes a lot of the work out of this; I use ABXTester on the Mac. And by "use" I mean "downloaded and tried once." You give it two files and it gives you five random choices and then tells you how well you scored; it's really basic and simple. I did a wav and mp3 of a tech house song and scored 80%. |
Romelia Stankard 09.05.2012 | this should be interesting Also if you are converting to .mp3 be sure to do it with LAME and encode to extreme settings 320 CBR which is pretty standard for mp3 encoding. If you are on windows you can use LAME frontend. http://www.pazera-software.com/products/lame-front-end/ |
Hipolito Scionti 09.05.2012 |
Originally Posted by SirReal
I could do a couple of CD rips from classic stuff and have to convert to MP3 in itunes. |
Dorie Scelzo 09.05.2012 | As long as you can structure the test correctly, go for it. I know I can, so that's why I volunteered to do it. And I could do it in a way that was double-blind…it'd just require making a script that looked at song1wav.wav and song1mp3.wav and randomly renamed them 1A.wav and 1B.wav, didn't tell me which it was doing, and wrote what it did to a log file that I could look at later. As for buying tracks…unless they're the same tracks, the test is pointless…you're comparing the tracks and how they were mixed/mastered as much as the format. And there's no reason to buy things more than once. I'd suggest buying the lossless file, converting to mp3 on your system, then converting back to a lossless format on the same system. That's how I'd do it. Make sure to have enough trials and decide whether you want it to be an ABX test (as in…here's the wav twice, here's the mp3 twice, now here's 10 that are randomly mp3 or wav…which format is each one?) or a preference test (here's version 1, here's verison 2, which one was the wav?) with several trials for each song. Also, I'd avoid older stuff. All the classics were recorded pretty badly by today's standards and have a lot of specific noise and distortion as well as a much higher noise floor. I've never done a test like that (because I've never bothered with wavs for that music…only listened on iTunes AAC or vinyl) but something tells me the ridiculously loud noise floor would skew the results. Also, I found an sm58 sitting around. And I have some free time. Plus, I actually know how to analyze the results and get an answer with statistics instead of arbitrarily deciding 70% is lower than 100% so it's not good enough or whatever. I might go ahead and do it.
Originally Posted by SirReal
|
Antonetta Wikel 09.05.2012 |
Originally Posted by MaxOne
|
Antonetta Wikel 09.05.2012 |
Originally Posted by MaxOne
|
Hipolito Scionti 08.05.2012 |
Originally Posted by SirReal
We gonna quibble WAV vs AIFF btw? Surely lossless is lossless I was gonna use new tracks too... |
Antonetta Wikel 08.05.2012 | We'd have to settle on what encoder to use to make the MP3's. Has anyone done a test between say, itunes MP3 encoder and WMP encoder? I wonder if there's a difference there? Does anybody know if the MP3 encoder is a single program licensed by many players or does each player write it's own code for MP3 encoding? Can of worms? Kettle of Fish? |
Hipolito Scionti 08.05.2012 |
Originally Posted by sarasin
This isn't going to prove anything once and for all. There are people who are saying they can 100% hear the difference. I personally believe i can but have never tested myself. It'll be a bit of fun |
<< Back to General DiscussionReply