A Audio, hi-fi and car audio  forum. Audio Banter

Go Back   Home » Audio Banter forum » UK Audio Newsgroups » uk.rec.audio (General Audio and Hi-Fi)
Site Map Home Register Authors List Search Today's Posts Mark Forums Read Web Partners

uk.rec.audio (General Audio and Hi-Fi) (uk.rec.audio) Discussion and exchange of hi-fi audio equipment.

Analogue vs Digital



 
 
LinkBack Thread Tools Display Modes
  #211 (permalink)  
Old October 16th 04, 03:38 PM posted to uk.rec.audio
Stewart Pinkerton
external usenet poster
 
Posts: 3,367
Default Analogue vs Digital

On Sat, 16 Oct 2004 10:50:53 +0100, Ian Bell
wrote:

Jim Lesurf wrote:

In article , Ian Bell
wrote:
Jim Lesurf wrote:


snip

Indeed, if you look back at many HiFi magazines you will find that
many of them in the past plotted the output from a test tone whose
level was reduced down to about -120dB or less. i.e. about 30dB below
the nominal quantisation level of CD. You can also hear tones at this
level if you record them correctly onto a CD.


Unfortunately they neglect to mention that the resolution improvements
of dither are highly frequency dependent.


Not sure what you mean. You may be mixing up dither and noise shaping, but
I may be misunderstanding your point.

Once you apply dither correctly then the level at which signals can be
resolved is limited by the duration of the signal and/or its
coherence/predictability. If the noise is white then this would be the
same across the band. If the noise is shaped it may depend upon the
relative spectra of the noise and the coherent signal.


No problem so far but the resolution that can be obtained below the ls bit
depends on the number of samples taken per cycle. For a 1KHz tone this is
about 44 or equivalent to another 5 or so bits. At 20KHz it's 2 samples
equivalent to about 1 extra bit.


Please show your evidence for this extraordinary claim.
--

Stewart Pinkerton | Music is Art - Audio is Engineering
  #212 (permalink)  
Old October 16th 04, 03:54 PM posted to uk.rec.audio
Jim Lesurf
external usenet poster
 
Posts: 3,051
Default Analogue vs Digital

In article , Ian Bell
wrote:
Jim Lesurf wrote:


Once you apply dither correctly then the level at which signals can be
resolved is limited by the duration of the signal and/or its
coherence/predictability. If the noise is white then this would be the
same across the band. If the noise is shaped it may depend upon the
relative spectra of the noise and the coherent signal.


No problem so far but the resolution that can be obtained below the ls
bit depends on the number of samples taken per cycle.


The question here is, why are you assuming we have to impose a duration in
each case which is limited to just one cycle? Also a secondary question
about your unstated definition of "resolution". Please see below...

For a 1KHz tone this is about 44 or equivalent to another 5 or so bits.
At 20KHz it's 2 samples equivalent to about 1 extra bit.


Yes *if* you are assuming that dither, etc, only works over one cycle.
However this isn't the case.

Lets consider two different situations/arguments which I think will show
what I mean.

Case one is where we have a low level sinewave whose level is fixed, but
whose frequency can be either 1 kHz or 20kHz and we sample this, with
'random' dither for one second. Here we assume the dither pattern also has
a white power spectral density ('white noise').

No matter which signal frequency we have chosen, we now have 44,1000
samples over which we can perform detection processes (e.g. correlation or
Fourier Transformation, etc). It is correct that each individual 20kHz
cycle is only 1/20th of the length of each 1kHz cycle - however this is
balanced by having 20 times as many of them in the total duration.

We have to avoid using the 'same' added random dither in each cycle. i.e.
we must have dither which shows no patterns across our total duration of 1
second (44,100 samples). If we do so, and correlate/ detect/ filter/
Fourier/ whatever we end up with the same level of recovery from the
'noise' of the dither irrespective of the choice of the signal frequency
buried in the 'noise'. This follows from the usual correlation gain
arguments against the white noise.

In terms of normal spectral arguments we have the same noise power density,
uniformly cut up into 1 Hz bins by having a 1 seond total duration for our
process. Thus in both the 1 kHz bin and in the 20 kHz bin we have only have
1/20,000'th of the noise power from the dither above which our signal can
now poke.

Case two is a different argument based upon the properties of human
perception. Here we allow for a specific detection process where hearing
essentially divides the incoming signal into frequency bins whose bandwidth
varies with frequency. If you use Bob Stewart's arguments these are of the
order of about tenth of an octave (but depend upon the signal level, which
I'll ignore here).

As the bandwidth scales with the center frequency for each hearing sensor
'bin' we find that the background noise hitting each sensor rises with
frequency if we have white noise. Thus in this case we would need a bigger
signal in the first place at higher frequency to be noticable against a
white background. This can be argued to be one of the mechanisms that lead
to our hearing sensivity degrading as we go above a few kHz.

However the key point I wish to make is that "case two" is not really
anything specifically to do with CD or digital. It relates to having a
quite specific detection system (hearing) that has a specific property.

In fact we can now add:

Case three. Here the dither noise does not have a white spectrum. This is
because of a different property of human hearing, namely that the actual
sensitivity falls rapidly as we move above a few kHz. (In some ways this is
a sensible adaptation given the above as otherwise the higher noise power
in the wider bins would tend to become an annoyance. Having lower
sensitivity drops this back down again.)

This means it makes sense to fiddle the spectrum of the dither so that most
of the dither power is at the frequencies where our perception is least
sensitive. It still works OK as dither. It still gives the same correlation
gain, so it improves the detection SNR by the same amount at 1kHz and at
20kHz. However now we have more noise at 20kHz, Hence we may find that
although the improvement in SNR is the same in both cases, for the 1kHz
case the signal may now poke above the noise in the 1kHz bin, but the 20kHz
signal may not against the higher noise spectral density at 20kHz.

However this result is a cosequence of choosing to have dither with a
non-white spectrum.

Since the noise is spectrally shaped to be as inaudible as possible, if we
can't hear the noise, then the 20kHz would be too low in level to be
audible as well. Hence in a sense this does not matter, although this is a
different point to the one I am making above.

For the above reasons your statements may be at cross purposes with mine as
you are making different assumptions about what we are discussing. But it
leads me back to repeating my initial statement at the top of this message
as being correct for CD or any other general signal system. The
implications depend upon what you are applying the system for, though,
hence cases two and three. :-)

Slainte,

Jim

--
Electronics http://www.st-and.ac.uk/~www_pa/Scot...o/electron.htm
Audio Misc http://www.st-and.demon.co.uk/AudioMisc/index.html
Armstrong Audio http://www.st-and.demon.co.uk/Audio/armstrong.html
Barbirolli Soc. http://www.st-and.demon.co.uk/JBSoc/JBSoc.html
  #213 (permalink)  
Old October 16th 04, 08:20 PM posted to uk.rec.audio
John Phillips
external usenet poster
 
Posts: 294
Default Analogue vs Digital

In article , Ian Bell wrote:
Stewart Pinkerton wrote:

On Sat, 16 Oct 2004 10:50:53 +0100, Ian Bell
wrote:

Jim Lesurf wrote:

In article , Ian Bell
wrote:
Jim Lesurf wrote:

snip

Indeed, if you look back at many HiFi magazines you will find that
many of them in the past plotted the output from a test tone whose
level was reduced down to about -120dB or less. i.e. about 30dB below
the nominal quantisation level of CD. You can also hear tones at this
level if you record them correctly onto a CD.

Unfortunately they neglect to mention that the resolution improvements
of dither are highly frequency dependent.

Not sure what you mean. You may be mixing up dither and noise shaping,
but I may be misunderstanding your point.

Once you apply dither correctly then the level at which signals can be
resolved is limited by the duration of the signal and/or its
coherence/predictability. If the noise is white then this would be the
same across the band. If the noise is shaped it may depend upon the
relative spectra of the noise and the coherent signal.

No problem so far but the resolution that can be obtained below the ls bit
depends on the number of samples taken per cycle. For a 1KHz tone this is
about 44 or equivalent to another 5 or so bits. At 20KHz it's 2 samples
equivalent to about 1 extra bit.


Please show your evidence for this extraordinary claim.


Simple really. Waveforms of a level below the quantisation of the
undithered system are preserved by dither as duty cycle modulation of the
sampling frequency. The additional resolution provided by the dither
therefore depends on the the number of opportunities the random dither has
to represent the waveform which in turn depends directly on the sample
frequency and the signal frequency.


I wonder if we may be getting into definition overload issues here.

If "resolution" means "the limit of the ability to resolve" then I believe
a dithered ADC has infinite resolution (in theory). This "resolution"
is not dependent on frequency as far as I can see.

However small the input signal, the statistics of the dither noise ensure
that the signal will influence the LSB at some rate. The smaller the
signal the less often the LSB gets influenced. However you could still
(in theory) recover the smallest signal from below the noise floor
by appropriate filtering (which will depend on the signal frequency).
That is (I think) precisely what is explained above - but I cannot see
the relationship with "resolution" as I understand it.

Of course I might just be misunderstanding the whole point ...

--
John Phillips
  #214 (permalink)  
Old October 16th 04, 08:31 PM posted to uk.rec.audio
Stewart Pinkerton
external usenet poster
 
Posts: 3,367
Default Analogue vs Digital

On Sat, 16 Oct 2004 19:15:28 +0100, Ian Bell
wrote:

Stewart Pinkerton wrote:

On Sat, 16 Oct 2004 10:50:53 +0100, Ian Bell
wrote:

Jim Lesurf wrote:

In article , Ian Bell
wrote:
Jim Lesurf wrote:

snip

Indeed, if you look back at many HiFi magazines you will find that
many of them in the past plotted the output from a test tone whose
level was reduced down to about -120dB or less. i.e. about 30dB below
the nominal quantisation level of CD. You can also hear tones at this
level if you record them correctly onto a CD.


Unfortunately they neglect to mention that the resolution improvements
of dither are highly frequency dependent.

Not sure what you mean. You may be mixing up dither and noise shaping,
but I may be misunderstanding your point.

Once you apply dither correctly then the level at which signals can be
resolved is limited by the duration of the signal and/or its
coherence/predictability. If the noise is white then this would be the
same across the band. If the noise is shaped it may depend upon the
relative spectra of the noise and the coherent signal.


No problem so far but the resolution that can be obtained below the ls bit
depends on the number of samples taken per cycle. For a 1KHz tone this is
about 44 or equivalent to another 5 or so bits. At 20KHz it's 2 samples
equivalent to about 1 extra bit.


Please show your evidence for this extraordinary claim.


Simple really. Waveforms of a level below the quantisation of the
undithered system are preserved by dither as duty cycle modulation of the
sampling frequency. The additional resolution provided by the dither
therefore depends on the the number of opportunities the random dither has
to represent the waveform which in turn depends directly on the sample
frequency and the signal frequency.


Hmmm. Sounds right intuitively, but sampling theory is often anything
but. Oi reckons that this here needs someone wot has better maffs than
wot oi've got. Jim? It must be too cold for le surfing off St Andrews
by now..........................
--

Stewart Pinkerton | Music is Art - Audio is Engineering
  #215 (permalink)  
Old October 17th 04, 05:56 AM posted to uk.rec.audio
Tat Chan
external usenet poster
 
Posts: 418
Default Analogue vs Digital

Keith G wrote:
"Tat Chan" wrote in message
...

Btw, your town gets a mention here!

http://www.chavtowns.co.uk/modules.p...rticle&sid=505




Yep - I actually posted that link myself a week or two ago!!


whoops, I must have missed that post.

I wonder how long it would take for every town in the country to have an entry
on that web site?
  #216 (permalink)  
Old October 17th 04, 07:45 AM posted to uk.rec.audio
Jim Lesurf
external usenet poster
 
Posts: 3,051
Default Analogue vs Digital

In article , Ian Bell
wrote:
Stewart Pinkerton wrote:



No problem so far but the resolution that can be obtained below the ls
bit depends on the number of samples taken per cycle. For a 1KHz tone
this is about 44 or equivalent to another 5 or so bits. At 20KHz it's
2 samples equivalent to about 1 extra bit.


Please show your evidence for this extraordinary claim.


Simple really. Waveforms of a level below the quantisation of the
undithered system are preserved by dither as duty cycle modulation of
the sampling frequency. The additional resolution provided by the
dither therefore depends on the the number of opportunities the random
dither has to represent the waveform which in turn depends directly on
the sample frequency and the signal frequency.


The flaw seems to me to be in your last phrase. There is no universal
requirement for a sinusoid to only be one cycle long. Indeed, for a
waveform to be a sinewave it has to persist over whatever duration we
observe/have.

Hence your concusion is based upon a restirctive assumption (only one cycle
being considered) that is unneccessary and irrappropriate in most cases.

If you were specifically talking about a 'one cycle burst' then your view
might be valid. However a one cycle burst at some time during a longer
interval is *not* a sinewave of a single frequency during that duration.
Nor will its spectrum show as a single frequency component in such
circumstances.

Slainte,

Jim

--
Electronics http://www.st-and.ac.uk/~www_pa/Scot...o/electron.htm
Audio Misc http://www.st-and.demon.co.uk/AudioMisc/index.html
Armstrong Audio http://www.st-and.demon.co.uk/Audio/armstrong.html
Barbirolli Soc. http://www.st-and.demon.co.uk/JBSoc/JBSoc.html
  #217 (permalink)  
Old October 17th 04, 07:57 AM posted to uk.rec.audio
Jim Lesurf
external usenet poster
 
Posts: 3,051
Default Analogue vs Digital

In article , John Phillips
wrote:


I wonder if we may be getting into definition overload issues here.


You don't program in C++ do you? :-)

Yes, I'd agree, 'resolution' is used with more than one definition, so we
need to define it carefully here.

If "resolution" means "the limit of the ability to resolve" then I
believe a dithered ADC has infinite resolution (in theory). This
"resolution" is not dependent on frequency as far as I can see.


*In principle* the above is correct according to my understand from the
texts I have read and from the work I have done. The ability of a system to
detect/indentify a specific signal pattern against noise rises with the
total obervation/signal duration if the noise is 'random' and has the usual
properties. (This may fail with 1/f noise, though. :-] )

In practice we may end up with other limits. 1/f will get us in the end,
but before that other imperfections in the system.

Astronomers routinely do this over observation periods running into hours
or days. Indeed, I used to work in co-operation with a group that did this
who used 1-bit correlators with dither to drag signals from well below
noise.

However small the input signal, the statistics of the dither noise
ensure that the signal will influence the LSB at some rate. The smaller
the signal the less often the LSB gets influenced.


I am not sure the above is correct. The point is that the dither *alone*
should be enough to 'randomise' the resulting series of sampled values and
stop them all coming out identical. Once you do this any deterministing or
repetitive signal pattern will be included in the sampled results and
become recoverable (in principle). Here we are (I think) talking about
sinewaves, but the same result applies for any predefined or deterministic
pattern of 'signal'.

FWIW another of my past activities was using such methods to 'hide' signals
below noise so they could be communicated in a covert manner, then use
correlation methods to detect them at the desired receiver. The result was
transmissions that the 'bad guys' could not event detect as a radiated
signal, let along decypher. But detectable and useable by the 'good guys'.
:-)

However you could still (in theory) recover the smallest signal from
below the noise floor by appropriate filtering (which will depend on the
signal frequency). That is (I think) precisely what is explained above -
but I cannot see the relationship with "resolution" as I understand it.


If you generalise 'filtering' to include correlation/comparison against
whatever target patter you are interested in then the results still apply
in general. Fourier Tranformation and 'sinewave' spectra are just a subset
of a wider argument using orthogonal functions, correlation, etc, etc.

Of course I might just be misunderstanding the whole point ...


Don't think so. Your comments seem spot-on to me. So we're either both
correct or both wrong. ;-

Slainte,

Jim

--
Electronics http://www.st-and.ac.uk/~www_pa/Scot...o/electron.htm
Audio Misc http://www.st-and.demon.co.uk/AudioMisc/index.html
Armstrong Audio http://www.st-and.demon.co.uk/Audio/armstrong.html
Barbirolli Soc. http://www.st-and.demon.co.uk/JBSoc/JBSoc.html
  #218 (permalink)  
Old October 17th 04, 08:09 AM posted to uk.rec.audio
Jim Lesurf
external usenet poster
 
Posts: 3,051
Default Analogue vs Digital

In article , Stewart Pinkerton
wrote:
On Sat, 16 Oct 2004 19:15:28 +0100, Ian Bell
wrote:



No problem so far but the resolution that can be obtained below the
ls bit depends on the number of samples taken per cycle. For a 1KHz
tone this is about 44 or equivalent to another 5 or so bits. At
20KHz it's 2 samples equivalent to about 1 extra bit.

Please show your evidence for this extraordinary claim.


Simple really. Waveforms of a level below the quantisation of the
undithered system are preserved by dither as duty cycle modulation of
the sampling frequency. The additional resolution provided by the
dither therefore depends on the the number of opportunities the random
dither has to represent the waveform which in turn depends directly on
the sample frequency and the signal frequency.


Hmmm. Sounds right intuitively, but sampling theory is often anything
but. Oi reckons that this here needs someone wot has better maffs than
wot oi've got. Jim? It must be too cold for le surfing off St Andrews by
now..........................


I've commented in more detail in other postings. However I think Ian is
(needlessly) assuming we can only have a single cycle of each 'sinewave'.
If you decide to limit yourself like this then for a given amplitude the
duration and total energy of the signal go as 1/frequency. In that
*specific* situation what he says is correct.

However in general his restriction does not apply. So if we take, say, a
100ms long signal we'd have more cycles at 20kHz than at 1kHz and the
amount of 'resolution' sic? improvement would be the same in both cases
if the dither/noise has a uniform power spectral density (i.e. 'white
noise'). [1]

This links to the problem I've become resigned to seeing turn up regularly
in spectral plots in audio mags. The plots show the power 'per frequency
bin'. If they transform a signal of duration 100ms this means the 'noise'
level shown is the power per 10Hz bandwidth. But if they'd grabbed and
transformed a 1s signal it would be per 1Hz bandwidth. Hence the two plots
would show *different* apparent noise levels. In effect, the same noise
power is being divided up into more 'bins' after a 1s tranform than after a
100ms one (assuming the sample rate and signal bandwidth were kept the
same).

For this reason, you can't make sense of the noise levels in these plots
*unless* they tell you the length of the signal they grabbed and
transformed. Alas, they never seem to tell you this. Hence the noise levels
shown are meaningless.

Guesswork seems to show that they often grab 32k or 64k samples, and for CD
you can then deduce a binwidth, and then work out the actual noise power.

FWIW I have on three occasions raised this with audio journalists in
private discussions. One knew exactly what I was talking about and accepted
my point. One knew what I was saying but seemed to feel that it didn't
matter to the people who read the mags. (The implication being that the
readers would not care or understand, but just used the plots as "this one
looks better than that one" diagrams.). The other simply had no idea what I
was talking about.

None of the above is rocket science. You can find it in the standard texts,
and it also crops up in the handbooks for kit like the nicer HP digital
spectrum analysers. So these guys do use the kit, but apparently often
don't understand what the screen is showing them. :-/

Slainte,

Jim

[1] In general, I'd tent to refer to this as 'correlation gain' since
it is the increase in SNR/detectability/identifiability we get
from correlating the input signal+noise with our 'target' signal
pattern. In effect Fourier Transformation (or using filters) are
just ways of doing this for specific target patterns - e.g.
sinusoids of specific frequencies.

--
Electronics http://www.st-and.ac.uk/~www_pa/Scot...o/electron.htm
Audio Misc http://www.st-and.demon.co.uk/AudioMisc/index.html
Armstrong Audio http://www.st-and.demon.co.uk/Audio/armstrong.html
Barbirolli Soc. http://www.st-and.demon.co.uk/JBSoc/JBSoc.html
  #219 (permalink)  
Old October 17th 04, 10:34 AM posted to uk.rec.audio
Ian Bell
external usenet poster
 
Posts: 300
Default Analogue vs Digital

Jim Lesurf wrote:

In article , Ian Bell
wrote:
Stewart Pinkerton wrote:



No problem so far but the resolution that can be obtained below the ls
bit depends on the number of samples taken per cycle. For a 1KHz tone
this is about 44 or equivalent to another 5 or so bits. At 20KHz it's
2 samples equivalent to about 1 extra bit.

Please show your evidence for this extraordinary claim.


Simple really. Waveforms of a level below the quantisation of the
undithered system are preserved by dither as duty cycle modulation of
the sampling frequency. The additional resolution provided by the
dither therefore depends on the the number of opportunities the random
dither has to represent the waveform which in turn depends directly on
the sample frequency and the signal frequency.


The flaw seems to me to be in your last phrase. There is no universal
requirement for a sinusoid to only be one cycle long. Indeed, for a
waveform to be a sinewave it has to persist over whatever duration we
observe/have.


I don't think so,any more than there is a flaw in the statement that the
highest frequency must be less than half the sampling frequency.

Ian.




--
Ian Bell
  #220 (permalink)  
Old October 17th 04, 10:38 AM posted to uk.rec.audio
Ian Bell
external usenet poster
 
Posts: 300
Default Analogue vs Digital

Jim Lesurf wrote:

In article , John Phillips
wrote:


I wonder if we may be getting into definition overload issues here.


You don't program in C++ do you? :-)

Yes, I'd agree, 'resolution' is used with more than one definition, so we
need to define it carefully here.

If "resolution" means "the limit of the ability to resolve" then I
believe a dithered ADC has infinite resolution (in theory). This
"resolution" is not dependent on frequency as far as I can see.


*In principle* the above is correct according to my understand from the
texts I have read and from the work I have done. The ability of a system
to detect/indentify a specific signal pattern against noise rises with the
total obervation/signal duration if the noise is 'random' and has the
usual
properties. (This may fail with 1/f noise, though. :-] )


Whilst this is true, noise and resolution are not in general related,
although the act of dithering does make then related.



--
Ian Bell
 




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT. The time now is 04:39 AM.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.SEO by vBSEO 3.0.0
Copyright ©2004-2025 Audio Banter.
The comments are property of their posters.