A Audio, hi-fi and car audio  forum. Audio Banter

Go Back   Home » Audio Banter forum » UK Audio Newsgroups » uk.rec.audio (General Audio and Hi-Fi)
Site Map Home Register Authors List Search Today's Posts Mark Forums Read Web Partners

uk.rec.audio (General Audio and Hi-Fi) (uk.rec.audio) Discussion and exchange of hi-fi audio equipment.

DBT a flawed method for evaluating Hi-Fi ?



 
 
LinkBack Thread Tools Display Modes
  #51 (permalink)  
Old January 10th 05, 01:14 PM posted to uk.rec.audio
Jim Lesurf
external usenet poster
 
Posts: 3,051
Default DBT a flawed method for evaluating Hi-Fi ?

In article , Richard Wall
wrote:


Cheap CD/DVD players usually are cheap, and are compromised. I wouild
assume the same to be true of cheap amps vs better built products.


That seems to me to be a reasonable assumption. However I'd also expect
this to depend on the conditions of use. e.g. a cheap amp might sound fine
(and similar/indistinguishable from) a more expensive/better one if the
required power/current levels were modest, but sound very different when
asked to play at high levels into a speaker tha was a 'nasty' load.

I think amplifiers and CD/DVD players etc. sound different because we
have not yet achieved perfect reproduction of the recorded medium.


Well, if the recording has an imperfection, then I'd expect that to show as
a 'common mode' effect when comparing amps or players.


So called "good" componants are very close to perfect and
differentiating by any method will be difficult.


That may be so. Indeed, it may well mean that the differences become so
small that they either become inaudible, or not worth bothering about given
much larger variations - e.g. due to slight head movements or changes in
the dampness of the air in the listening room.

Rather than the image of a straight line with amplification from source
to speakers I view a system as a filter with amplification between
source and speakers. The better the filter the less it removes/adds and
the closer to perfection it gets. It is still possible to measure
electronicly differences in amplifiers and also to make them react to
inputs in in different ways ( e.g. slew rate (?))


I'd agree. However with decent components my experience is that the main
'filter' effects (to use your analogy) tend to end up residing in:

1) Choice of the specific CD (or LP or whatever medium of choice)

2) Choice of loudspeaker, their placement, the listening position, and the
room acoustic.

What interests me about that is the way magazines devote thousands of pages
to discussing (relatively tiny) differences between amps, yet almost zero
space to questions of improving your room acoustics, etc.


There are even different topographies Class A, AB and I think C and D.
DBT should and I am sure can differentiate some of these classes of
products if it cannot then the testing method must surely be faulty ?


No. Your deduction does not follow from your comment. It may be that when a
test shows no difference, that the reason is simply that any difference is
too slight to be audible, or perhaps of any practical significance.

Thus if such a test 'fails' (a judgemental word, so should be used with
care) to show a difference, it may be due to there being no audible
difference.

In such circumstances you can propose two possible hypotheses.

1) That the difference is so small as to be inaudible in the circumstances
of the test

2) That the test 'hides' the difference in some way due to the
circumstances in which it was carried out.

However the normal scientific method then requires us to either propose a
test whose results would discriminate between the above two hypotheses, or
if we cannot, then simply use the one which follows 'Occam' and requires
the least number of assumed unknown or hidden effects/variables. This
implies that we are safe to choose (1) *unless* someone can propose and
carry out a test that will discriminate between (1) and (2) by providing
results that would 'falsify' (i.e. show results inconsistent with) one
hypothesis.

Alternatively, you can propose the hypothesis that the circumstances of the
test make it 'inappropriate' for the real listening conditions. But to
establish this, once again, you need a test that could be carried out to
falsify this or its converse.

FWIW I can't comment on class C or D, but I've built and tested/listened to
various A and AB amps over the years, and my experience is that although
some sound 'different' to the others, many sound indistinguishable to me in
normal use. Provided they meet a fairly basic set of requirements and are
used within conditions they are designed to operate under.


The one area where none of the above applies is the loudspeaker, which
is still frankly a disgrace. You don't need a DBT to reveal the
differences between speakers,


Indeed. Such differences are also often easily observable using a
microphone and some simple measurements.


My critism of DBT is that it is not simple to set up in a domestic
enviroment


I would agree. Carefully designed tests like these can be extremly
difficult to carry out in a reliable manner. But this does not make them
impossible.

and of the few test I have heard of that finds differences
(recent issue of Hi-Fi Plus on cables ?) the conditions of the test are
then questioned.


Can't comment on the HFP tests you mention as I don't know anything about
them. But, yes, if the tests are not carried out with appropriate care and
rigour, then their results may be questioned. Indeed, this is normal
practice in measurement science as all measurements will be of finite
accuracy, limited relaibility, etc. But - depending on the details - that
may be adequate for some stated purpose.

The advocates of DBT/ABX all seem convinced that
there are no differences between CD players, cables and amps,


I have no idea where your "all" comes from. However I have personally never
thought or written such a thing. That said, the only way I "advocate"
DBT/ABX is that it seems to me that it represents a test approach which may
be useful for some purposes. It may help reduce some confusing effects, and
make it easier to do a reliable statistical analysis where any response is
slight rather than obvious.

those more open qualify this with a definition of "good" componants.


Even here I would be wary as two 'bad' items may have flaws that produce
similar effects, so lead to the two souding similar or indistinguishable.


I am happy to agree that when talking about "good" components any
differences will be minor and most likely built in by a manufacturer
looking to differentiate their product from the rest. Hearing a
difference in a blind test will be unlikely. What I question is that a
lot of current equipment does not meet the "good" criteria and it does
not take a blind test to prove this.


That may well be so in some cases. Indeed some 'good' items sound different
(speakers). However in such cases I would expect a BDT/ABX to also show
differences, although such a tedious method may be felt not to be worth the
effort.


If DBT/ABX does fail to differentiate products that sound different


I note the "If" that starts your statement here...

then why does it fail,


.... I think that you will first need to catch your rabbit. Only then think
about making a rabbit pie. :-)

i.e. first you will need to address the test of mutually exclusive
hypotheses outlined above. This means first proposing a test that shows
that a given DBT/ABX test *has* 'failed' to show a difference which some
other non-DBT/ABX can be *established* to 'detect'. The problem, though,
then becomes how to establish that the non-DBT/ABX test result *is* a real
and reliable 'detection' rather than an error or a fluke.

my suggestion is that the detection method used (the listener) is too
subjective and without a massive sampling set any results are no better
at providing proof than simple A-B.


For all I know you might be correct in some cases. But I think you will
need to catch your rabbit, first... ;-

Having done that, you could then examine the conditions of the tests, and
ways to check which might be having an effect.

Until, then, though, the simplest course seems to me to work on the basis
that any 'difference' that was not detected was too small to be noticed,
and hence really may not matter one way or the other if all you want to do
is sit back and enjoy the music. :-)

Slainte,

Jim

--
Electronics http://www.st-and.ac.uk/~www_pa/Scot...o/electron.htm
Audio Misc http://www.st-and.demon.co.uk/AudioMisc/index.html
Armstrong Audio http://www.st-and.demon.co.uk/Audio/armstrong.html
Barbirolli Soc. http://www.st-and.demon.co.uk/JBSoc/JBSoc.html
  #52 (permalink)  
Old January 10th 05, 01:38 PM posted to uk.rec.audio
Arny Krueger
external usenet poster
 
Posts: 3,850
Default DBT a flawed method for evaluating Hi-Fi ?

"Don Pearce" wrote in message

On Sun, 09 Jan 2005 17:30:06 +0000, Eiron wrote:

Don Pearce wrote:

On Sun, 9 Jan 2005 16:30:51 -0000, "Richard Wall"
wrote:


choices. I have recently compared my Vocale SET, a Pass Labs
Aleph 3 and a Prototype amp that may soon be sold by Revolver.
The prototype sounded dreadful until we found that the volume pot
used degraded the sound at its highest attenuation essential for
my 103dB efficient speakers. Once the prototype was properly
attenated I would not be certain that I could consistantly spot
the difference between the three.



No - it is merely revealing your faulty assumptions. The test is
working perfectly. However you should be able to discern the
appalling sound of a SET in any kind of test - blind or not.


And the appalling sound of "103dB efficient speakers"


Hee hee.... I didn't actually want to go there.


If you back off a bit to "97 dB efficient speakers", there is actually quite
a bit happening.

97 dB/w is really way short of 103 dB/w but it is quite a ways North of 86
dB/w which where you find a lot of popular home hifi speakers.


  #53 (permalink)  
Old January 10th 05, 03:30 PM posted to uk.rec.audio
Arny Krueger
external usenet poster
 
Posts: 3,850
Default DBT a flawed method for evaluating Hi-Fi ?

"Jim Lesurf" wrote in message

In article , Richard Wall
wrote:


Cheap CD/DVD players usually are cheap, and are compromised. I wouild
assume the same to be true of cheap amps vs better built products.


That seems to me to be a reasonable assumption.


In the sense of a similar effect of global forces, yes.

Basically, both cheap amps and cheap optical players can, due to the
positive effects of technological change, perform in a nearly ideal fashion.

However I'd also
expect this to depend on the conditions of use. e.g. a cheap amp
might sound fine (and similar/indistinguishable from) a more
expensive/better one if the required power/current levels were
modest, but sound very different when asked to play at high levels
into a speaker tha was a 'nasty' load.


If you pick cheap amps carefully, not even relatively high levels (for the
actual size of the amp) into nasty loads are much of a problem. The most
common problem with cheap amps is that their actual maximum power output is
often grotesquely overstated. If you derate them to what they really are,
they are often really pretty good. And, I'm not talking about special
derating for nasty loads. I'm talking simply about calling an amp that can
put 50 watts into a resistive load, a 50 watt amp and not a 200 watt amp. It
will also put gobs of power into a nasty load, within its actual capacity.

What drives all this technical goodness? Mostly, the lack of desire to see
returned goods.


  #54 (permalink)  
Old January 10th 05, 04:13 PM posted to uk.rec.audio
Iain M Churches
external usenet poster
 
Posts: 1,061
Default DBT a flawed method for evaluating Hi-Fi ?


"Stewart Pinkerton" wrote in message
...
On Sun, 9 Jan 2005 18:04:10 -0000, "Richard Wall"
wrote:

No - it is merely revealing your faulty assumptions. The test is
working perfectly. However you should be able to discern the appalling
sound of a SET in any kind of test - blind or not.


Here you show both your ignorance and your bias !! A opinion back by no
facts at all just an opinion of poorly designed SET systems you have heard
before.


The problem is that there's no such thing as a *well* designed SET amp
- by definition! :-)

That's why push-pull operation was invented in the '20s, and only
audiofools want to go back to before those days...............


Interesting that most of the well informed members of RAT tended to
disagree with you vehently on this point. They if anyone have experience
with SET. Have you actually taken the trouble to listen to a good SET
(for example Andre's Kiss amplifier) playing Shostokovich ¨
String Quartets or a small chamber ensemble? Quite remarkable:-)
Your Krell, and most other amplifiers, I am told, fade in comparison.

Not recommended though for fans of Metalica:-)

Iain


  #55 (permalink)  
Old January 10th 05, 04:43 PM posted to uk.rec.audio
Don Pearce
external usenet poster
 
Posts: 1,412
Default DBT a flawed method for evaluating Hi-Fi ?

On Mon, 10 Jan 2005 19:13:04 +0200, "Iain M Churches"
wrote:


"Stewart Pinkerton" wrote in message
.. .
On Sun, 9 Jan 2005 18:04:10 -0000, "Richard Wall"
wrote:

No - it is merely revealing your faulty assumptions. The test is
working perfectly. However you should be able to discern the appalling
sound of a SET in any kind of test - blind or not.

Here you show both your ignorance and your bias !! A opinion back by no
facts at all just an opinion of poorly designed SET systems you have heard
before.


The problem is that there's no such thing as a *well* designed SET amp
- by definition! :-)

That's why push-pull operation was invented in the '20s, and only
audiofools want to go back to before those days...............


Interesting that most of the well informed members of RAT tended to
disagree with you vehently on this point. They if anyone have experience
with SET. Have you actually taken the trouble to listen to a good SET
(for example Andre's Kiss amplifier) playing Shostokovich ¨
String Quartets or a small chamber ensemble? Quite remarkable:-)
Your Krell, and most other amplifiers, I am told, fade in comparison.

Not recommended though for fans of Metalica:-)

Iain


A SET amplifier is an effects box - nothing more or less. If you
happen to enjoy the effect it produces, then that is fine. But please
don't imagine that it has anything to do with high fidelity
reproduction of music.

d

Pearce Consulting
http://www.pearce.uk.com
  #56 (permalink)  
Old January 10th 05, 04:56 PM posted to uk.rec.audio
Rob
external usenet poster
 
Posts: 127
Default DBT a flawed method for evaluating Hi-Fi ?

Don Pearce wrote:
On Mon, 10 Jan 2005 19:13:04 +0200, "Iain M Churches"
wrote:


"Stewart Pinkerton" wrote in message
. ..

On Sun, 9 Jan 2005 18:04:10 -0000, "Richard Wall"
wrote:


No - it is merely revealing your faulty assumptions. The test is
working perfectly. However you should be able to discern the appalling
sound of a SET in any kind of test - blind or not.

Here you show both your ignorance and your bias !! A opinion back by no
facts at all just an opinion of poorly designed SET systems you have heard
before.

The problem is that there's no such thing as a *well* designed SET amp
- by definition! :-)

That's why push-pull operation was invented in the '20s, and only
audiofools want to go back to before those days...............


Interesting that most of the well informed members of RAT tended to
disagree with you vehently on this point. They if anyone have experience
with SET. Have you actually taken the trouble to listen to a good SET
(for example Andre's Kiss amplifier) playing Shostokovich ¨
String Quartets or a small chamber ensemble? Quite remarkable:-)
Your Krell, and most other amplifiers, I am told, fade in comparison.

Not recommended though for fans of Metalica:-)

Iain



A SET amplifier is an effects box - nothing more or less. If you
happen to enjoy the effect it produces, then that is fine. But please
don't imagine that it has anything to do with high fidelity
reproduction of music.

d

Pearce Consulting
http://www.pearce.uk.com


Disagree - heard music through one recently, stunning.

Rob
  #57 (permalink)  
Old January 10th 05, 09:11 PM posted to uk.rec.audio
Tat Chan
external usenet poster
 
Posts: 418
Default DBT a flawed method for evaluating Hi-Fi ?

Jim Lesurf wrote:



What interests me about that is the way magazines devote thousands of pages
to discussing (relatively tiny) differences between amps, yet almost zero
space to questions of improving your room acoustics, etc.



That is because you can't walk into a hi-fi shop and say "I'll have 50
cubic metres of good acoustics for my room, please. Do I get a discount
if I pay in cash?"



  #58 (permalink)  
Old January 10th 05, 10:05 PM posted to uk.rec.audio
Arny Krueger
external usenet poster
 
Posts: 3,850
Default DBT a flawed method for evaluating Hi-Fi ?

"Rob" wrote in message

Don Pearce wrote:
On Mon, 10 Jan 2005 19:13:04 +0200, "Iain M Churches"
wrote:


"Stewart Pinkerton" wrote in message
...

On Sun, 9 Jan 2005 18:04:10 -0000, "Richard Wall"
wrote:


No - it is merely revealing your faulty assumptions. The test is
working perfectly. However you should be able to discern the
appalling sound of a SET in any kind of test - blind or not.

Here you show both your ignorance and your bias !! A opinion
back by no facts at all just an opinion of poorly designed SET
systems you have heard before.

The problem is that there's no such thing as a *well* designed SET
amp - by definition! :-)


That's why push-pull operation was invented in the '20s, and only
audiofools want to go back to before those days...............


Interesting that most of the well informed members of RAT tended to
disagree with you vehently on this point.


Which point?

Do they disagree with the idea that P-P was invented in the 1920s?

Do they disagree with the idea that P-P can completely cancel even order
nonlinear distortion?

They if anyone have experience with SET.


No surprise that people who like the sound of audible nonlinear distortion
would object to P-P.

Have you actually taken the trouble to listen
to a good SET (for example Andre's Kiss amplifier) playing
Shostokovich ¨ String Quartets or a small chamber ensemble?


Letsee, I'm supposed to get turned on by good clasical music being played
through an EFX box?

How about playing classical music through one of those amplifiers with
attached speakers that says "Fender" on it?

Added reverb, anyone? ;-)

Quite
remarkable:-) Your Krell, and most other amplifiers, I am told,
fade in comparison.


Sad how it is that they are sonically accurate amplifiers.

Not recommended though for fans of Metalica:-)


A SET amplifier is an effects box - nothing more or less.


Agreed.

If you
happen to enjoy the effect it produces, then that is fine. But please
don't imagine that it has anything to do with high fidelity
reproduction of music.


Agreed.

Pearce Consulting
http://www.pearce.uk.com


Disagree - heard music through one recently, stunning.


Only proves Don's point.


  #59 (permalink)  
Old January 10th 05, 10:45 PM posted to uk.rec.audio
Ian Bell
external usenet poster
 
Posts: 300
Default DBT a flawed method for evaluating Hi-Fi ?

Arny Krueger wrote:


Do they disagree with the idea that P-P can completely cancel even order
nonlinear distortion?


I may be wrong but I thought P-P intrinsically *only* produces even ordered
harmonics.

Ian

--
Ian Bell
  #60 (permalink)  
Old January 11th 05, 01:28 AM posted to uk.rec.audio
Arny Krueger
external usenet poster
 
Posts: 3,850
Default DBT a flawed method for evaluating Hi-Fi ?

"Ian Bell" wrote in message

Arny Krueger wrote:


Do they disagree with the idea that P-P can completely cancel even
order nonlinear distortion?


I may be wrong but I thought P-P intrinsically *only* produces even
ordered harmonics.


You do have it wrong. P-P intrinsically *only* produces odd ordered
harmonics.



 




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT. The time now is 05:25 PM.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.SEO by vBSEO 3.0.0
Copyright ©2004-2025 Audio Banter.
The comments are property of their posters.