Independent Studies

[TrishB]

Do you believe that Independent Studies are truly independent? If a study is initiated and financed by an interested company - can it be independent of that company’s influence? Can the laboratory be un-influenced by those who are signing on the dotted line?

This can apply to dog food companies, flea products, training methods, training tools, chew toys ... you name it!

Personally, I would like to see multiple studies, financed by multiple companies and from different industries. I would then accept the general consensus of those studies. I would not be able to accept one single study, although I would take their findings into account.

Your thoughts?

[spidey]

I think if a study is performed by an independent group, regardless of who finances it, it can be truly independent (can be, not will be), especially if it's allowed to be published in a peer-reviewed journal (because then you have the benefit of other experts in the field assessing your study). If the makers of Bob's Flea-B-Gon commission an independent study which they hope proves that their product is the most effective flea spray, and the study actually shows that Sammy's Flee-Flea is the most effective spray, Bob's Flea-B-Gon probably won't use the study as advertising, but the value of the study itself isn't negated.

[Judi W]

Well, if research criteria is followed, it doesn't matter who is paying for the study. Scientific research has rules that must be followed, so does statistical research. That is what methodology is all about.

[Jamie & Odin]

Judi W, absolutely. I am just begining work on my graduate thesis, and recently took a class in research methodology.

There are rules to doing research. If the methodoloy is sound the results will be sound. If the methodoly is unsound, that will be discovered in the peer review process. It does not matter who funds the research.

[emorgan49]

Ahhhh, but who funds the Publication of the research. If the research turns out unfavorable to the funder perhaps we never see it. So isn't that a form of bias?

[Judi W]

Genuine research makes all findings and methodology available. Evaluate the sample size and any bias sample selection might affect as well as the application methods. It is the "quotes" from research usually given by the novice that I always question. Also, confusing small sample statistical correlation with cause and effect is a common error. I have found it is very easy to write and request complete data if summaries are all that have been quoted.

[TrishB]

Originally posted by Judi W
Genuine research makes all findings and methodology available. Evaluate the sample size and any bias sample selection might affect as well as the application methods. It is the "quotes" from research usually given by the novice that I always question. Also, confusing small sample statistical correlation with cause and effect is a common error. I have found it is very easy to write and request complete data if summaries are all that have been quoted.

Very true Judi!

It's very important to keep things in mind when reading excerpts from studies:

1) They may be taken out of context
2) You lack the perspective required

The only way to ensure that you understand what was intended is to read the study, in it's entirety. ;) Anything that is taken out of context can be interpreted in thousands of ways - however, only within the context of the study itself, is it correct and truthful. :)

[frontierrots]

I do not think that research paid for by XX company on their own product is at all unbiased. The company being commisioned to do the study knows darn well that if the study comes to an unfavorable finding that XX company will never hire them again.

However if a study is funded by an organization not related to the manufacturer etc then yes it can be unbiased

[abraxas]

hi,

[abraxas]

research is NEVER completely unbiased...there are simply too many variables. even the researchers perception of what is being studied will have an influence. i am currently doing research (ethological) and i can tell you that what one is taught in psych courses concerning "how to conduct research" and how the research is ACTUALLY conducted may greatly differ. i do not wish to imply that research is deceptive, but this is one of the reasons why the scientific approach (observation, hypothesis, experiment, conclusion, and replication) includes repetition. if i REALLY want to come to a conclusion in regard to a finding, i find it best to consult several journal articles including similar research that has been conducted from various investigators.