And while I'm ranting let me add a couple of more comments and criticism on the evidence from this Stade 2 documentary.
1) No context given, no baseline comparison
In my last post I suggested that an investigative documentary about motors should only aim at either physically revealing a motor in a race bike or catching somebody off guard who is trying to hide something that couldn't really be anything else than a motor. But let's assume for a moment that both is not possible and we have to settle for pieces of evidence only. Even then this Stade 2 film is awful.
They showed a couple of seconds of footage (out of many many recorded minutes I suppose) where something looks kinda suspicious - sometimes more, sometimes less so. How does this compare to context? They compared it to a bike with a motor in it. But this thermal image was a completely different ball game then the ones from the peloton. You could argue that pros would probably use a much more sophisticated system that wasn't so obvious and that they couldn't get hold of for the documentary. Fair enough.
But then, how does their suspicious footage compare to a bunch of known "clean" bikes that are filmed while racing? Does anybody know how these different bikes would normally look in thermal images like these? I have no idea! And I don't mean in a sterile laboratory setting with a static camera but in such messy, fast moving race conditions. They show other bikes in the race that are not glowing, but (technical flaws discussed below aside) that's not what I'm talking about.
To convincingly label it "suspicious" they should at least have made some effort to demonstrate that this is not something you would ever observe with clean bikes under identical circumstances. Simple comparison to baseline.
2) Color scale of thermal images
These color scales that are used in heatmaps (I mean heatmaps as general graphics type and not just the ones that are literally about heat) are usually designed in a way to have maximal contrast, i.e. so that even small differences are clearly visible. As a consequence they are not at all suited for visual judgements about absolute or relative magnitudes. They're fine for a first exploration. But at some point you necessarily have to stick numbers to it and stop interpreting colors and color differences, or be prepared to fool yourself mightily.
In this case the colors are particularly misleading as the interesting regions we're discussing appear in this bright orange, melted metal color, that suggests "glowing" to everybody who looks at it. Nothing is glowing here, these regions are not even warm, the measured temperature is just slightly higher than in the vicinity. Because of a motor inside? Maybe, maybe not.
3) Dynamic color scale of thermal images
It gets worse. The color scale that the camera provides is not static, it is self-adjusting based on the currently measured temperature range. You can see in the video on the right side how the upper and lower limits fluctuate constantly and considerably. And whenever an very warm object like a motorbike or the front of a car comes into sight, the upper temperature limit shoots up, the colors in the image go crazy and they have to cut quickly. These cases are no problem because the effect is so obviously disruptive that it renders the image completely useless. But the very same effect comes into play all the time in a subtle way that is (especially in combination with the characteristics of the color scale discussed above) extremely damaging!
As a result you can't reliably compare two different thermal images that are shot with a (even slightly) different color scale range. You could see a glowing hub in one shot and hardly any difference in color in an other shot although the temperature differences were exactly the same for both bikes. Just a purely artificial visual effect because in the first shot the temperatures of the two areas happened to correspond to a region in the color scale with a large gradient while in the other shot they didn't.
These guys just took a thermal camera off the shelf and went with its default settings that are not really suitable to answer the kind of questions they were interested in under the given circumstances. With just a little bit of thought they could have customized the settings to produce actually useful material. But they didn't.
4) Thermal cameras and their precision
Never forget: What we're seeing in a thermal image is not "the truth" but a measurement followed by software processing the signal to produce the final image. There are obviously different sources of uncertainty that come into play and might distort the result. How precise is it? I don't know, but I certainly would imagine it to be quite accurate when the thermal camera is static and the measured object and the temperatures involved are static as well. But how precise is it in a scenario like this where the camera itself, the measured objects and the termperature ranges are moving fast? I've seen other forum members interpreting details in screenshots like homogeneity of color (heat) in the rear hub to discuss things like a point source of heat or effects of air-cooling. Are you guys really confident that the error bars on these images given the circumstances are small enough such that an in-depth break down is warranted? I'm not. And I don't trust the guys who filmed it that they even thought about potential issues like these. Because, see point 3) above. They did show their footage to an expert in thermal imaging but this leads me straight to the next point:
5) Post hoc expert endorsement
This engineer in the film (not Varjas) clearly does not look comfortable at all to make bold statements. He just vaguely formulates the obvious that literally every layman can see ("this regions seems a bit warmer than this"). And the journalist pushes for confirmation. (If that's the most enthusiastic quote they could squeeze out of him then he probably wasn't terribly impressed with the material anyway. But that's really just guessing.)
I don't know the background of this interview but I guess everybody working at an university (or an otherwise exposed position) immediately recognizes this. It's probably one of these common situations where a journalist asks for your input on a matter that apparently touches your field of expertise. He then quickly shows you something, sticks a camera or microphone in your face and expects you to comment without further thought or checks because, well, you're an "expert", right? And they don't have much time anyway. And most often he isn't really interested in what you have to say at all, he just wants you to kinda confirm what he already has concluded. You try to avoid stupid quotes and everybody is happy when they're gone again. That's how it works, I call it fishing for expert endorsement.
That's probably too speculative here. But having an expert appear in your documentary who really does not add anything (because he's either not familiar or not comfortable enough with your material) just to add authority to your story really is a characteristic of bad journalism.
6) The right way of utilizing experts
What they haven't done, judging from their deeply flawed material, is to include an expert in thermal imaging from the beginning of the project. Somebody who is able to set up proper measurements tailored to the questions that the journalists wanted to have answered. And guarantees reliable and high-quality results. Just putting a thermal camera into somebodies hand and start filming is not good enough.
I've been involved in statistical consultancy for all sorts of clients. Far too often clients worked on their own, collected some data, tried to analyze it, got stuck and turned to us to rescue them. And while the most honest advice would have been: "Your setup is broken beyond repair, trash everything, start over again but this time do it the right way", it was clearly not a workable solution for the client and it resulted in some sort of hack as a compromise.
And I feel it might be very similar with this evidence presented in the documentary. Yes, it would have been more work to do it the right way and they probably would have had to pay some consultancy fees. But this looks like they just went for the "quick buck" and the spicy headlines. And didn't really try to produce a good piece of investigative journalism that has an impact. That truly annoys me.