Jump to content
  • The Computer Audiophile
    The Computer Audiophile

    Is It Time To Rethink Lossless?

     

     

        

        Audio: Listen to this article.

     

     

    I never thought I’d title an article, Is It Time To Rethink Lossless. I’ve always understood the definition of lossless and found solace in the fact that everyone from the audiophile community to the more mainstream audio community and from the subjective to the objective communities, spoke a common language with respect to lossless. Now it seems the term lossless is being stretched and twisted and applied to situations where it may not be indicative of what people think when they hear lossless. Let me explain. 

     

    Lossless compression has always meant that an audio file is compressed from its original size to something smaller, and at a later time can be uncompressed to the exact same original file. Nothing is lost. 

     

    A CD is delivered to the consumer, the consumer rips the CD to FLAC, WAV, ALAC, etc… Notice I had to throw WAV in the mix. That’s lossless as well, but uncompressed. It’s lossless in the sense that nothing is lost from the original CD. FLAC and ALAC files could be uncompressed to the identical files on the CDs, without loss of any music. For the sake of this discussion, let’s stick to lossless in the compression sense. 

     

    Quoting a rather dry Wikipedia article:

     

    “Lossless compression is a class of data compression that allows the original data to be perfectly reconstructed from the compressed data with no loss of information. Lossless compression is possible because most real-world data exhibits statistical redundancy. By contrast, lossy compression permits reconstruction only of an approximation of the original data, though usually with greatly improved compression rates (and therefore reduced media sizes).”

     

     

    Why Rethink This Basic Concept?

     

    It may be time to rethink how we use the term lossless. In order to be lossless, there has to be an original source and compressed version that could be turned back into the original source. That CD, turned into FLAC files, could be turned back into the identical CD. Sounds pretty pedestrian. 

     

    Loosening up the usage of the term lossless started when high resolution audio was released. We no longer had a physical product to rip. We were presented with 24/96, 24/192, etc… files and we just called them lossless. In a way, we took the term for granted because we had no source to which we could compare. Sure, if we wanted to convert the high resolution download into something else, we would consider our download the source and turn it into FLAC or ALAC etc… But in a way, that’s like getting an MP3 from Napster and calling it one’s source because that’s one’s original file. I guess one could do that, but it isn’t the wisest move. 

     

    Thinking more about high resolution files / streams and the original source, we would be crazy to think that all of this high resolution audio is a lossless version of the original source. The works both ways up and down the sample rate scale. For example, NativeDSD sells albums at 24/96, 24/192, 24/384, DSD, DSD128, DSD256, DSD512, etc… Some times all these resolutions are available for the same album. I’m not complaining or singling NativeDSD out for doing anything negative whatsoever. The store is just an example that comes to mind because I frequently browse the site. Anyway, it’s incredibly likely that only a single one of the available rates is lossless to the original. Yet, we don’t think of calling the others lossy. At least I don’t think of doing that, but should I? Probably not, but perhaps a more nuanced description is needed. 

     

    On the other hand we have files and streams at 16/44.1, 24/48, 24/96 and 24/192 from almost every record label. The likelihood that these are truly lossless to the original source is, unknown. It’s likely unknown to the artist, the label, and most everyone involved in creating the album. We can set aside the digital watermarking in streaming as that’s an entire different can of worms. But, we should think about the murkiness of calling this music lossless when we don’t really have an idea if it’s true. We know it’s delivered in a lossless container, but then again, so was MQA. 

     

    Many professionals use higher sample rates when working with music in their digital audio workstations, then output to a lower resolution delivery format. The extra headroom is seen as necessary for the processing, but unnecessary for delivery/playback. Think of all the CDs and 16/44.1 albums available for streaming. Many originated at, god forbid, 24/48 before being downsampled for delivery. Yet, my CDs were lossless dang it. 

     

    Now we venture into immersive audio, where the highest quality files ever released by most labels are, to date, 24/48 768 kbps Dolby Digital Plus Atmos (keep in mind that many of us have stereo FLAC files at 400-500 kbps, but that’s neither here nor there for this discussion). Dolby workstation tools accept up through 24/96 audio, and many audiophile labels work with music as high as 32 bit / 384 kHz before creating the Atmos version. 

     

    Is it appropriate to call the streaming Atmos albums lossy, when they are the highest resolution ever released to the public? Are they lossy only because they were delivered in a lossy DD+ container? What about a downsampled CD delivered in a lossless container? Neither could be used to recreate the original, using a strict definition of lossless compression. 

     

    Must we consider losslessness in the context of the original or the version released to the public? In other words, lossless compared to what? Discrete immersive audio, the holy grail of immersive music, is usually released at 24/352.8 in ten to twelve channels. These are output from a digital audio workstation, with some parameters, to WAV files and considered lossless by everyone. The same workstation usually outputs a 24/96 version to be used in creating the TrueHD Dolby Atmos version that’s delivered at 24/48. These albums are also considered lossless by everyone. 

     

    The same workstation, using the same 24/96 Atmos master as above, also uploads the 24/48 ADMBWF Atmos Master to Apple. Apple then encodes is using Dolby Digital Plus, for delivery through Apple Music. For 99% of releases, this Dolby Digital Plus version is the highest resolution ever released. 

     

    Working backward we can see neither the streaming Dolby Digital Plus 24/48 version, the TrueHD 24/48, nor the Atmos master at 24/96, could be used to recreate the original 24/352.8 files losslessly. Yet, we only consider the highest resolution released to the public as lossy. Using this logic, we should retroactively call most CDs lossy and most 16/44.1 streams lossy. We’d also need a lot more information about other albums, which could mean changing the definition of an album from lossless to lossy, even though nothing in the musical data has changed. It’s a bit crazy.  

     


    Yes, We Should Rethink Lossless

     

    The term lossless has always been seen as black and white. A simple concept used to label our favorite music. For the most part, subjective and objective audiophiles have all agreed on what’s lossless and what isn’t (save for the short period of time when some believed MQA was lossless). However, I believe we need to rethink usage of the term lossless. We should never alter the definition. After all, lossless to a specific source is a very real and valuable concept. We should rethink when and where we use the term lossless. Lossless to what, the one original master of the recording or a studio working version at a slightly different sample rate or the highest resolution released to the public or something else entirely? 

     

    It’s even possible that the best use of the term only applies to situations in which we know everything about a recording or it’s very obvious. For example, Spotify delivers lossy OGG music. That’s easy. No matter what definition of lossless we use, I’ll bet the farm that 99.999% of the albums didn’t originate with a 320 kbps Ogg Vorbis master and we have higher resolution versions released in lossless containers available elsewhere. Another day one is vinyl. It’s lossy, unless it’s a direct to disc album. Period. After this, it gets really sticky, and inaccurate to apply the term lossless to all but one’s own format conversions and those rare albums about which we know everything. 

     

    Lastly, I didn’t write this to be controversial. I honestly think we should rethink lossless and have a lively discussion about when and where we as music lovers use the term lossless. Lossless has a definition. Let’s use it accurately.

     

     




    User Feedback

    Recommended Comments



    I like your train of thought here.  It is imperative to have common ground, even more so as new formats come and go.  We do not need another ongoing corporate controversy.

     

    I know that delivery systems are in flux right now.   How does that change things?  What if Apple figures out how to deliver TrueHD?  (I can dream)

     

    Can we get this down to one descriptive sentence or two?  The old elevator speech thing...  

     

    Share this comment


    Link to comment
    Share on other sites

    From my point of view, the term "lossless" or "bitperfect" is relative to the "transport from the source" before arriving at the decoding point. And yes, the logic inherits that sources could be perceptionally lossless or lossy, too.
    That's why the source and often also the provenance are important for many of us.
    Thus, it's nothing worth without a quality transport (lossless, bitperfect) and decoding. The transport (stream / streamer / audio transport) in my opinion should be as transparent, free of alteration and noise, bitperfect and lossless as it could be.
    If you call it "lossless" or "ducktolled" doesn' matter for me, as long as it is as close to the source quality I bought once or will buy in the future.
     

    Share this comment


    Link to comment
    Share on other sites

    I think my conception of lossy vs lossless is a bit different. Yes, mastering, mixing, sample rate conversion would all cause changes in the integrity of the original recorded signal and have some sonic effects like subtle losses of timing/transient accuracy or subtle losses of detail.

     

    But to me, a true lossy compression scheme, be it mp3 or Dolby Digital Plus or MQA generally have ways to purposely "throw out" sonic information based on psychoacoustic models of hearing thresholds and /or sound masking. Even though they are meant to be perceptually lossless, for me, as an audiophile who loves listening to orchestral classical music, I often find there is always an obvious loss of subtle details if you're listening for it, and much more significant changes to timing/transient accuracy.

     

    To me, the bigger question at hand it sounds like is that if you have a master that was in lossless Dolby Atmos, is it better to hear it in lossy Dolby Digital Plus Atmos with the preserved spatial audio design or is it better to hear it in lossless stereo where you lose the spatial audio information that was originally intended in the master. I presume that'll depend on the music and the listener. Because the philosophical question becomes: are stereo recordings "lossy" because it doesn't capture the spatial audio information.

     

    That said, I listen to music for music first. So I'd always prefer lossy music to no music at all.

    Share this comment


    Link to comment
    Share on other sites

    6 minutes ago, ecwl said:

    I often find there is always an obvious loss of subtle details if you're listening for it, and much more significant changes to timing/transient accuracy.

     

    This is of course if you have a known version that's then converted using a lossy codec. I'm right there with you. For example, a CD to 16/44.1 WAV to 128 kbps MP3. 

     

    When there is no original source or we don't know which version is considered the original, things get sticky. 

     

     

    11 minutes ago, ecwl said:

    To me, the bigger question at hand it sounds like is that if you have a master that was in lossless Dolby Atmos, is it better to hear it in lossy Dolby Digital Plus Atmos with the preserved spatial audio design or is it better to hear it in lossless stereo where you lose the spatial audio information that was originally intended in the master. I presume that'll depend on the music and the listener. Because the philosophical question becomes: are stereo recordings "lossy" because it doesn't capture the spatial audio information.

     

    I certainly hear you on this one, and thank you for bringing it up. I've done this listening countless times in the last couple years. As a music loving audiophile, I want the "best" version! 

     

    You are 100% correct in that it depends on the music and the listener, and I'll add the playback system. I've even hear albums that sound best, to me, on headphones in Atmos. Yes, the headphone Atmos mix was better than the speaker Atmos and all of the high resolution stereo mixes. Crazy. 

     

    The theoretical question about stereo being lossy without the spatial info is interesting as well. What I've found is that stereo sounds synthetically crammed into the confines to two channels compared to an immersive soundstage. So, in a way it isn't lossy because all the elements are present, but they are all coming from the front two channels. 

     

    I look at it this way: stereo and Atmos are different ways to experience the wonders of music. As much as I love Atmos, I would never advocate for it to replace stereo because I know people that love stereo more than anything. 

     

    I could discuss this stuff for days. It's interesting and I value all the perspectives. 

     

     

    11 minutes ago, ecwl said:

    That said, I listen to music for music first. So I'd always prefer lossy music to no music at all.

     

    Absolutely. In addition, I'll take my favorite music on an AM radio over something I dislike at 24/384. 

    Share this comment


    Link to comment
    Share on other sites

    48 minutes ago, bbosler said:

     

    this is a good one. It is unknown but it is highly doubtful....  All of the sudden one day Amazon announces streams available at  24/192  BETTER THAN CD 

     

    when it came out I saw Led Zeppelin titles as 24/192 and though GREAT !! But then I thought, where the hell did they get original 24/192 files for stuff that was never recorded that way? So I bought one and downloaded it , or at least tried to,  only to find out that they won't allow you to  download the 24/192 files. At least they wouldn't. I never tried after the initial try

     

    In any case, many if not most are  obviously upsampled. Like HDtracks got caught doing early on and maybe still does. I gave up on them too.

     

    So is upsampled  lossless? Can the original 16/44.1 be reconstructed from a 24/192 upsample? I doubt it. And now that I think about it, where did the 16/44.1 files come from? Some originally converted  from 16/48  DAT tapes

     

     

    In the case of Led Zeppelin, I think the "originals" would be analog tapes which can be digitized at any resolution supported by the A/D converter. 

    Share this comment


    Link to comment
    Share on other sites

    1 hour ago, kumakuma said:

    In the case of Led Zeppelin, I think the "originals" would be analog tapes which can be digitized at any resolution supported by the A/D converter. 

    agreed, they can be, but were they?

     

    HDtracks has them at 24/96 from 2014, but they never say where they came from either. If original 24/192 existed it seems they would be  available from other than Amazon streaming,  so what are the chances that Amazon  got 24/192 files of the  tapes? I'm going with zero.

    Share this comment


    Link to comment
    Share on other sites

    I used to fret on these distinctions myself for the longest time. Now I just call it HiFi because of the fanciness in the playback chain, not the source media itself. I would go crazy trying to guess how the original one was made.

     

    I sort of also learned not to trust online music stores, even the audiophile ones. Case in point, I remember for us rock fans it was kind of a big thing when Metallica's black album was released in "HiRes" from a store I will not name. In forums most agreed the CD sounded better; some dug deeper and apparently the HiRes 24/96 FLAC was based on the already diluted one made for the 5.1 from the A-DVD that was sold some time ago.

     

    So what's the true source? It all comes down to this, right?

     

    The only thing I can think of is that Studio's make the master recording information public, if that's the one the artist/ Studio is releasing, and have it displayed in the streaming services and such.

     

    Or maybe showing a screenshot of the Pro Tools working file? 😉

    Share this comment


    Link to comment
    Share on other sites

    3 hours ago, bbosler said:

    Can the original 16/44.1 be reconstructed from a 24/192 upsample? I doubt it.

    It depends on a few things so it's not something impossible in principle:

    # upsample
    sox "02. Fast Car.flac" -b24 "up.wav" rate -s 192000
    
    # downsample
    sox -D "up.wav" -b16 "down.wav" rate -s 44100
    
    # compare (subtract one from the other)
    sox -m -v 1 "02. Fast Car.flac" -v -1 "down.wav" -n stats
                 Overall     Left      Right
    ..
    Pk lev dB       -inf      -inf      -inf
    RMS lev dB      -inf      -inf      -inf
    

     

    Share this comment


    Link to comment
    Share on other sites

    Anything that has an analogue form can be considered lossy - even the very best master, analogue tape, as per the direct capture of the microphones, is lossy - because the tape material degrades over time. Only anything digital can be considered lossless - because a perfect replica can be recreated at any time, ad infinitum, over as long a time period as you want; even the worst MP3 version of something is lossless in this sense.

     

    If one deliberately discards digital information from some, 'master', digital version, in a conversion, then this is also lossy, in an absolute sense. The question then is whether anyone can hear a significant difference between the original, and the 'lossy' variant, under any circumstances. The final touch would be, can the lossy digital variant be converted back to the format of the original, using best methods, and the original and the reconstructed lossy copy then be indistinguishable under any listening conditions - if so, then IMO the 'lesser' version is indeed lossless.

    Share this comment


    Link to comment
    Share on other sites

    1 hour ago, danadam said:

    It depends on a few things so it's not something impossible in principle:

    # upsample
    sox "02. Fast Car.flac" -b24 "up.wav" rate -s 192000
    
    # downsample
    sox -D "up.wav" -b16 "down.wav" rate -s 44100
    
    # compare (subtract one from the other)
    sox -m -v 1 "02. Fast Car.flac" -v -1 "down.wav" -n stats
                 Overall     Left      Right
    ..
    Pk lev dB       -inf      -inf      -inf
    RMS lev dB      -inf      -inf      -inf
    

     

     

    same peak and rms levels does not mean the files are identical.

    I don't see how it is mathematically possible to go from 16/44.1 to 24/192 and back to 16/44.1 and have a file  identical to the original.

     

    to get a 24 bit sample 192,000 times a second in between 16 bit samples 44,100 times a second , you have to extrapolate (estimate) what those levels are. Then you have to extrapolate (estimate) 16 bit levels 44,100 times each second. Especially since the rates are not evenly divisible, you just can't get that to be exactly the same in each direction 

    Share this comment


    Link to comment
    Share on other sites

    21 minutes ago, bbosler said:

    same peak and rms levels does not mean the files are identical.

    Sure, but that's not what the example is showing. It shows that the result of subtracting the up- and downsampled version from the original file is a digital silence. This means that each and every sample in the up- and downsampled version is the same as in the original file.

    Share this comment


    Link to comment
    Share on other sites

    4 minutes ago, danadam said:

    Sure, but that's not what the example is showing. It shows that the result of subtracting the up- and downsampled version from the original file is a digital silence. This means that each and every sample in the up- and downsampled version is the same as in the original file.

    In essence, it’s like you added a paragraph to the end of a text file then removed it. Not that your example is wrong, it’s just a very simple, if not unrealistic, exercise. 

    Share this comment


    Link to comment
    Share on other sites

    21 minutes ago, The Computer Audiophile said:

    Not that your example is wrong, it’s just a very simple, if not unrealistic, exercise. 

    I believe the example is definitely wrong. Peak and rms is not the equivalent of comparing each and every sample. 

     

    if you were using integer multiples (like 48K to 192K) and just padding 16 to 24 bits with zeros, then yes. But 44.1K to 192K is different since the 192K samples are in between the 44.1K samples at odd intervals. The program has to extrapolate and round off going in both directions. How can it possibly end up exactly where  it started?

     

    doesn't most playback software recommend even integer conversions for this very reason? That going from 44.1 to 192 instead of 44.1 x 4 to  176.4 introduces errors?

     

    i am willing to admit I am wrong, but peak and rms levels is no proof. 

     

     

    Share this comment


    Link to comment
    Share on other sites

    6 hours ago, Audiophile Neuroscience said:

    WAV is lossless because it was never compressed

    Lossless to what? What about an album that available as 24/192 and 16/44.1 WAV, where high frequency content from the 24/192 version couldn’t be contained in the CD quality version? Both WAV files. 
     

     

    6 hours ago, Audiophile Neuroscience said:

    So, is it too simplistic to think that lossless means no loss of information due to a compression process and relative to the source being compressed?


    What source? 
     

    Is loss of information due to resampling OK?

     

    Are CDs lossless, even though by definition they can’t be if the source contained information above 22.05 kHz?

     

    I’m not asking to be confrontational, just asking to see where you loosen the definition from its strict meaning. All with good intentions and interest in your answers. 

    Share this comment


    Link to comment
    Share on other sites

    13 hours ago, The Computer Audiophile said:

    In essence, it’s like you added a paragraph to the end of a text file then removed it. Not that your example is wrong, it’s just a very simple, if not unrealistic, exercise.

    I thought that was the premise of the question, can you get back the 16/44 original from the 24/192 upsample. The assertion was (and apparently still is) that it's never possible, I showed that it sometimes is. I can agree that steep anti-imaging filter (99% bandwidth, the "-s" option) is probably not something that would be usually used, but I'm not sure if that's what you meant by calling it simple.

     

    13 hours ago, bbosler said:

    I believe the example is definitely wrong. Peak and rms is not the equivalent of comparing each and every sample. 

    Could you explain what makes you think that I only compared peak and rms values of the 2 files? Because once again, that operation did compare each and every sample. Maybe if I split it into separate commands it will be more visible:

    # create null file
    sox -m -v 1 "02. Fast Car.flac" -v -1 "down.wav" "null.wav"
    
    # show statistics of the null
    sox "null.wav" -n stats
                 Overall     Left      Right
    ..
    Pk lev dB       -inf      -inf      -inf
    RMS lev dB      -inf      -inf      -inf

    I can also decompress the flac to wav and compare the files directly:

    flac -d "02. Fast Car.flac"
    
    md5sum "02. Fast Car.wav" "down.wav"
    efcb88d3e5be874902f03bddac953086  02. Fast Car.wav
    efcb88d3e5be874902f03bddac953086  down.wav
    
    diff -s "02. Fast Car.wav" "down.wav"
    Files 02. Fast Car.wav and down.wav are identical

     

    Share this comment


    Link to comment
    Share on other sites




    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!

    Register a new account

    Sign in

    Already have an account? Sign in here.

    Sign In Now




×
×
  • Create New...