Yes, it was very different forty years ago.
[...]
What has changed is that the science community itself seems no longer to be able to distinguish between the good and the bad.
This is a huge problem. It's one thing I read that stuff and think: "Well, okay", it's another if a scientist in this field has the problem to say whether it's substantiated or not.
My diploma thesis had its basis in a paper by a "big name" mathematician. My job was to implement it and develop it a tiny bit further. It wouldn't simply work. Of course I thought I made an error - I am not a brilliant programer. After discussing this with my supervisor, he implemented it himself (again) and agreed. The results weren't reproducible. So we developed a new algorithm which resulted in another paper. Of course we didn't say anything about the other one - never mess with "big names" in science as a beginner.
I learned something then: Never ever trust a paper. Don't care about "big names". Understand it.
But, in general, it will take a pretty while to understand a paper properly.
This leaves me with certain problems, as already
@large donner pointed to: If you cannot say "good" from "bad", you are being left with believing (not my choice), not believing (hm...) or coming to no conclusion at all (preferred choice) - which actually means: no progress, no findings, no realizing etc. It's unsatisfactory.
[...] I remember thinking that the whole idea of a retrovirus causing ME was totally implausible. The reason has to do with the way diseases play out over time.
Virus infections follow certain understandable patterns.
That's one possible direction, to take into account what we already know. That's something one should always do, I agree.
Regarding ME, it must be something we don't know yet - that's what you say, too, isn't it? As a researcher one should be willing to think in other directions, too; implausible sounding ones, crazy ones...everything. Big scientific findings occurred when the "impossible was thought and later found". In the history of science, often new theories were discarded (and laughed about, at best) because they didn't fit the existing conviction.
One big problem in research is money - strictly, research is not about "is it useful, i.e. does it produce money?", it's about understanding. Today, many research projects (if not most) are financed via third parties. Often companies are involved. They are not interested in understanding, they want findings that produce money.
Next is the question of time. Proper research takes time. But funding may not cover that needed time.
Third come personal things, like egocentrism, status, power, riches...
And there remains one philosophic hypothesis

"Humankind gets regularly new problems in order to not get bored."
Which could mean: ME could be something completely new, there could be an unknown, new infectious agent that calls for a completely different reaction in the body, one we don't know yet. - Or not.
It could be exactly as you say, too.
I think the outcome will be surprising.
In the past, everything was about bacteria, and illness due to bacteria.
Then, the "virus age" - there is still so much to be understood. That's why I am disappointed the XMRV/retrovirus line wasn't further developed. (There are incountable infectious agents; I am sure we haven't found everything.)
And who knows what will come next? Maybe ME will be "this next". I don't know.
The open and creative mind - that's what we should keep, I would say.