PeterB said:
King Boonen said:
I had a quick look. There are a fair few problems but the biggest is that there is no baseline data for the groups. Without it it's impossible to draw the conclusions they have done.
Why you do not like those conclusions? You say there are no baselines but their approach is not comparing measurements against the baselines. It is important to realise that CNAC and NAC are the same people. They took 15 people and did the first test during 8 days. Then they allowed for "wash-out" 3-week period and did the second test. They do not mention whether the first test was with NAC and the second with placebo, or vice versa, but let's assume results are not affected by the sequence.
So what they actually measured was that the same people had different blood values after taking NAC than they had after taking placebo. Isn't it then a fair conclusion that NAC had some effect on the blood? The measurements they did after trial with placebo can in fact be considered as the baseline you were missing, no?
No, they can't, for several reasons:
1) You cannot use the same participants for case and control in a double blind study, it's impossible and means that either it was singly blind, open or they don't actually know what they were doing.
2) They do not specifically state the order but they state the wash out period occurred between thiol and placebo treatment. This implies that the thiol treatment happened first and as such they have no baseline data.
3) They have no baseline data for the control/placebo study and you can't just assume it has no effect, you actually have to show that. Again, this means they have no baseline data for their NAC experiment.
These three things alone completely invalidate the conclusions. There is also the small size of the groups to take into account.
The numbers they report seem strange too, although this isn't my area. They show a higher hematocrit and EPO but lower RBC counts which doesn't make sense based on my understanding. The MCV has increased which is what has increased the hematocrit, but at they haven't assessed the Hb-O2 we have not idea if that would even have an effect on exercise (not the point of the study but it is the conclusion people are drawing). They don't address the change in MCV in the discussion. If these are the same people that would be something that really needs addressing.
They haven't assessed the exercise performance so I don't really understand the point of including it, maybe I'm missing it?
Honestly, it reads like a final year project that was written up as a paper. This isn't a problem, the problem is people taking the results and drawing conclusions that really can't be drawn. This is compounded when a respected scientist highlights the work as people who don't really understand it will assume it's right.