Sister blog of Physicists of the Caribbean in which I babble about non-astronomy stuff, because everyone needs a hobby

Monday, 26 October 2015

How to prevent a false consensus

Another long and rambling article I'm afraid. Concision isn't my strong point. There's just something about the idea that scientists are closed-mined that really winds me up the wrong way.

This time I look at the idea that a scientific consensus doesn't mean anything because scientists all want to / have to agree with each other. In astronomy at least, this isn't true. There's an abundance of examples, past and present, of people publishing very non-mainstream ideas in reputable journals. One reason it might appear so is that there is a media obsession with making things exciting. This tends to happen at the slightest provocation without good evidence. It's great for generating enthusiasm, but that turns sour if astronomers have to keep saying, "nope, that's not true" all the time.

There's nothing wrong with being excited, it's just that scientists hate getting excited about things which aren't true.

On the other hand there are some scientific trends which should start warning bells ringing. Astronomy is a competitive subject made of many different small groups each trying to outdo the other. This means there's very little incentive for everyone to agree and lots of incentive to claim new, unexpected discoveries. With projects that requires hundreds of people, this rivalry is by necessity much reduced. We don't need to eliminate huge project groups by any means, but it would be a mistake to rely exclusively on large groups.

There's also a "publish or perish culture" which is potentially more serious. You cannot sensibly evaluate someone's abilities in a multifarious subject like astronomy using only the number of papers they've published. If your ranking as an astronomer depends only on this, there's a strong motivation to publish a lot of mediocre papers rather than a few good ones. Which encourages you to go for small, easy, boring projects.

Finally, the "research grant" funding system. It doesn't exactly encourage a false consensus, but it comes close. Grants typically expect a certain number of publications relating to their given topic. This is hardly a sensible way to encourage original thinking and innovation. The postdoctoral system (which is where most of the research is done) is ever-more reliant on this model of funding, and that's dangerous.

19 comments:

  1. A wise person does not "believe" in the results of scientific inquiry anyway.

    That term irritates me in this context.

    ReplyDelete
  2. The recent 'peer review' scandals illustrate the pitfalls of politicized/crony science culture. Science per se isn't the issue; academia is.

    ReplyDelete
  3. James Karaganis Dunno, I don't have a problem using belief as a synonym for "provisionally accept". E.g. I can "believe" in dark matter since we aren't certain it exists; that doesn't imply I'm devoted to it or can't change my mind about it.

    ReplyDelete
  4. James Karaganis First you have " to believe" because is the way your teachers opened for you when you was a child.
    Aftermath, you MUST get understanding on the scientific approach to knowledge.
    Beyond that you MUST understand that science does not cover the whole field of knowledge.

    ReplyDelete
  5. Rhys Taylor Oh, I understand that, and for those who grasp the distinction it is a valuable shorthand. I use it that way myself, but I try to be aware of context.

    For the bulk of humanity, the word has a very different meaning. You know what I mean: "oh, you believe in science, I believe in God. What's the difference?", in much the same way you hear "evolution is just a theory" and my perennial favorite "miracle of science."

    ReplyDelete
  6. Rhys Taylor
    Oughtn't you rather say 'I posit the hypothetical possibility of the existence of dark matter'?

    ReplyDelete
  7. Someone once said, "Belief is not an idea the mind possesses. It is an idea that possess the mind."

    Unfortunately we don't have good English words that can differentiate between this highly devout, unquestioning belief, and simple opinions (well, not without making sentences more clumsy, at any rate). "Belief" is used interchangeably with "opinion". I suppose "faith" covers things pretty well, no-one in their right mind would have "faith" in dark matter, but most of those who are rational and religious would accept that belief in deities requires faith. Language is tricksy.

    ReplyDelete
  8. +Rhys Taylor

    tricksssy...falsssse...we hates it forever!!!

    ReplyDelete
  9. James Karaganis Rhys Taylor I  think that even the most trivial, basic and taken for granted things in our reality, those that form a belief system are provisional in a scientific context.  For example I believe there is a floor under my feet, ...until some new evidence comes about that places some doubt in the existence of the floor...  I believe I am typing on a keyboard...until some new evidence comes about that places that into question...My point is that the use of  the word "belief" should never be taken as an absolute from a scientific stand point.  My philosophical belief is that there is absolutely nothing that we can attribute a 100% certainty to.  There will always be a tiny, even almost infinitesimal statistical chance that something might turn out to be not what it seems...of course that absolute is not 100% either.. ;-)

    ReplyDelete
  10. Ciro Villa Well, I would say more that you accept them as being true (to a certain quantifiable degree of accuracy) until and unless new evidence (or a more accurate scientific model) becomes available. Newton's Laws of Motion come to mind: they work very well for most things, but it turns out they aren't actually universal.

    We're playing with semantics here, but the key is recognizing that words can be used differently in certain contexts. To the religious, the word belief doesn't mean the same thing to someone who is more scientifically minded.

    ReplyDelete
  11. James Karaganis Totally agree.

    ReplyDelete
  12. Totally agree. No scientist should ever be close mined.

    ReplyDelete
  13. Ciro Villa I agree, but I would argue that there comes a point where questioning everything becomes unscientific. Maybe everything is an illusion or controlled directly by the will of God. It's perfectly possible, but we can't analyse that using science.
    http://astrorhysy.blogspot.cz/2015/10/not-so-open.html

    ReplyDelete
  14. Rhys Taylor I think that mine was more of an extrapolated philosophical/statistical observation than a scientific one.

    I don't think questioning everything necessarily becomes unscientific, insomuch that I think that there are things that we can question and try to find a scientific answer to, and there are other things that we can question but we cannot find a scientific answer to (at least based on what's currently understood about the nature of physical reality)...

    But, again, my point was more of a philosophical extrapolation based on the word "belief".  There are some controversial theories, however at the boundary between physics and philosophy regarding the nature of reality that do indeed bring forward the question of whether or not reality as we perceive it is not completely illusory or at a minimum some sort of "construct" but, this is not my argument, I am merely mentioning.

    I do realize that the proper scientific method rejects certain fringe notions on the basis of their lack of falsifiability...

    ReplyDelete
  15. Rhys Taylor re:"we don't have good English words", I would submit: "strong views, weakly held."

    ReplyDelete
  16. Ciro Villa
    Also consider: a priori v a posteriori reasoning. Complimentary methodologies that can provide 'parralax', if you will.

    ReplyDelete
  17. Rhys Taylor 
    I agree with much of what you said.  I encourage you to read a post I made about science being in trouble (it's actually mostly non-original commentary about some studies done on how science operates in the real world by famous science popularizer Jerry Coyne  .) There are some serious flaws in how science is being doing https://plus.google.com/116787953580208997251/posts/2zAr8E2UEXp

    ReplyDelete

Due to a small but consistent influx of spam, comments will now be checked before publishing. Only egregious spam/illegal/racist crap will be disapproved, everything else will be published.

Review : Pagan Britain

Having read a good chunk of the original stories, I turn away slightly from mythological themes and back to something more academical : the ...