JamesCun said:
You make so many assumptions here. No one can challenge their assumptions because no one has any of the data they used.
What was their training before the intervention?
What level were they at and how long have they been training?
Was the first test a true max test, were they rested for the test?
Was the training with PC relative to the training they did prior to intervention, or was it standard across all riders?
The fact that they calculated p-values doesn't mean they rejected the bull hypothesis, it just means they calculated some values based on assumptions. If you make the wrong assumptions, the statistics are meaningless. The fact that CSEP accepted it for oral presentation doesn't mean anything at all, and you know that.
Your questions are all valid questions. I doubt all those questions would be answered even if you had the full study as few studies (in my experience) go into such detail. Sometimes you have to trust the researcher to have done his or her job. If you don't believe the result you can always choose to repeat the study to confirm or refute (remember cold fusion?).
Further, I haven't made many assumptions here. I didn't design this study. I didn't do this study. I didn't write this study up. The senior author on the study is a quite experienced researcher so one might assume he knows what he is doing when it comes to study design and statistical computation and I would assume he wouldn't put his name on a study he didn't think was reasonably well done and valid but that is about it when it comes to assumptions. While it is true we do not have access to the raw data to check their results this is the case with many studies, even when one has the entire write-up. Lots of stuff is left out of even the most detailed published study because, even if it is initially put in by the authors, it will be sent back by the editors to be cut down as there is only so much room in the journal and other studies deserve to be published also. Choosing which of the many submissions they get to publish is one of the more difficult jobs of the editors. Those that don't make the cut for the journal tend to make an annual supplement to the journal where hundreds of study abstracts get published, and that is all you get. Want more on one of these and you have to contact the author.
I have made the assumption that the authors intended to do the best study they could with the resources and time available to them (why would they do anything else?) which resulted in the choices they made. I have simply tried to explain the study design and the basis of the statistical analysis such that one might understand the study was not completely without merit. Do you really believe the CSEP would choose a study for oral presentation at their annual meeting that they believed had zero merit? That such a choice by them means NOTHING? Really, NOTHING?!!!
You may not like the study design. You may not like the study results. But, the study exists, "published" by a reputable organization. It is the only study out there that has looked at immersion training and PowerCranks and it showed a benefit. Probably just a coincidence, I know. Anyhow, if you believe that then it would probably be more effective to repeat the study with a "real" control group to prove the null hypothesis than say come here and call me names for pointing out the study exists. (edit:Burns also used an immersion design but it only lasted 5 weeks and a careful analysis suggests that there actually was a positive result compared to their control. The problem with Burns was the control group got worse and this couldn't be explained by the authors although I think it might be explained by a careful analysis of their study design)
Essentially every choice you make in training has zero scientific basis. Essentially every choice you make in training and racing is based upon anecdotal reports and "gut" feeling of "experts." The reason for this is that it is very difficult to conduct any study (let alone an excellent study) in this area. At least people are trying to study PowerCranks. Dixon is the only one who has attempted to follow the manufacturers instructions for best benefit and has shown a benefit. You (and others) choose to ignore this result because it doesn't fit with your bias because you can criticize the design. Instead, you choose to believe "studies" that ignore the manufactures instructions, don't last very long, but have a control group and don't show a statistical difference.
The most difficult part of science is not in the collecting of the data but in the interpretation of the data. And, one can always use more data.