Buy

Books
Click images for more details

Twitter
Support

 

Recent posts
Recent comments
Currently discussing
Links

A few sites I've stumbled across recently....

Powered by Squarespace

Discussion > Do computer models provide 'evidence'?

"Please tell me what you propose in place of models. Crossed fingers?"

It is perfectly understandable that if one believes in ghosts then one's frightened of them and expect them to appear at any time. It is also perfectly understandable that if one believes in ghosts one assumes everyone else does. Hence the totally understandable question that assumes bad things are going to happen and models can tell us what they are and when they'll happen.

Try taking a step make and try to understand that humans have coped with all sorts of climatic conditions and climatic change over thousands of years without the aid of computers. We still have people who believe in ghosts, but technology and education, and belief in ghosts is confined to really daft people now. But for large numbers of people there is still the need to have something to frighten them. Global warming is the current scare. Whereas the superstitious in the past relied upon clerics shaking bones or examining birds entrails today's superstitious rely upon scientists and computers as a replacement for clerics and bird's entrails.

I don't need a model to tell me about the future because I don't believe there will be anything like the catastrophes forecast from the models, because the models are crap at forecasting. You are making the mistake of assuming that everyone has the same basic beliefs as you do. I don't.

However, if you were to ask me what I would do if I really believed that CO2 was going to cause untold disasters in the future, it would have been to abandon funding climate science once we'd accepted the science and diverted the money and much more into research into fusion reactors.

By the way your confusing "clues" with "evidence", evidence is what provides proof, clues do not.

Jul 9, 2014 at 11:39 AM | Unregistered Commentergeronimo

We know that climate is changing and will continue to change. This itself is a risk for our nations' future wellbeings, yet you give me no idea of how you intend to try to assess that risk, let alone to mitigate. Please tell me what you propose in place of models. Crossed fingers?

Jul 9, 2014 at 9:51 AM | Unregistered CommenterRaff

Raff - there is clearly a communication gulf here. Please take a breath, take a step back and attempt (for a short time) to see things from our viewpoint. After that, feel free to see things once again as you currently do.

It is clear that you believe deeply that man-made climate change exists and is a significant threat that needs to be taken seriously.

As you may have gathered, many commenters here have seen no evidence for this and so do not believe in it. So far as we have been able to ascertain, the only 'evidence' comes from unvalidated models programmed by people who are convinced AGW is a reality. I said before, an unvalidated model is no more than an illustration of somebody's hypothesis. That's why we see no reason to believe in it.

Note that everybody here is in agreement that the climate has changed in the past, is probably changing now and will do so into the indefinite future.

We know that climate is changing and will continue to change. This itself is a risk for our nations' future wellbeings, yet you give me no idea of how you intend to try to assess that risk, let alone to mitigate. Please tell me what you propose in place of models. Crossed fingers?

Is the "Crossed fingers?" there to make us feel foolish? That doesn't work (but it does give the impression you are not paying attention to what has been said, rather than listening attentively and pointing out any misconceptions).

I have said before, if you believe the output of an unvalidated model, you are putting yourself in a worse position than saying "We simply don't know. That's all there is to it". We'd suggest not using models and being honest about our lack of understanding.

We differ fundamentally from your viewpoint which (I infer) is "Models are all we have so we'll use them as a better alternative to guessing". We think that using climate models is worse than guessing.

[My opinions are partly formed by a career involving (amongst many other things) constructing, testing and using models of physical systems of one sort and another. And having anxious high level managers insisting on having to answers to things for which the only honest answer is "sorry, we simply can't say". I say that not in the belief it will convince you of what I say but to help you understand why I hold such views.]

Jul 9, 2014 at 1:08 PM | Registered CommenterMartin A

For me the whole business of climate modelling was massively tainted by the many failings of the climateprediction.net public relations exercise. If that project is any where close to typical then I will continue to have real difficulties with the way model results are portrayed. I would not regard them as evidence of anything other than the biases of the modellers.

http://www.climateprediction.net/

"In February 2006, the project moved on to more realistic climate models. A BBC Climate Change Experiment[17] was launched, attracting around 23,000 participants on the first day. The transient climate simulation introduced realistic oceans. This allowed the experiment to investigate changes in the climate response as the climate forcings are changed, rather than an equilibrium response to a significant change like doubling the carbon dioxide level".

http://en.wikipedia.org/wiki/Climateprediction.net

Again from wiki

The first results of the experiment were published in Nature in January 2005 and show that with only slight changes to the parameters within plausible ranges, the models can show climate sensitivities ranging from less than 2 °C to more than 11 °C (see [20] and explanation[21]). The higher climate sensitivities have been challenged as implausible. For example by Gavin Schmidt (a climate modeler with the NASA Goddard Institute for Space Studies in New York).

The program churned out a vast range of results some of which were "acceptable" but some were wrong because either the program contained bugs or it produced unphysical results.

http://climateaudit.org/2006/04/18/earths-climate-crashes-in-2013/

The modellers obviously had to sift out the wrong results but how do we know those left in are any more correct than those taken out?

Then we find that the modellers present the results that they found "acceptable" but which really just reflect their own personal view and biases.

http://ccgi.newbery1.plus.com/blog/?p=70

Jul 9, 2014 at 1:15 PM | Unregistered Commenterclivere

Rhoda, Ridley's reported formulation is all about semantics. He's quibbling about the meaning of words, redefining 'model' and 'evidence' as he would prefer them rather than as they are used. Models are perfectly able to provide evidence. They are used all the time for that purpose, even by Ridley.

Ridley has in the past written about the economic benefits he expects from climate change and even used Prof Tol's research as evidence in his argument. Tol's study used the results from 14 models and predicted, I'm sure you know, that there would be positive results from warming up to 2 degrees. I don't remember Ridley saying that he actually had no evidence for what he wrote because it was all based upon models. Nor have I seen him withdrawing what he wrote when it became evident that demons had written Tol's paper, not Tol himself, and that the actual updated result was negative for all levels of warming.

In other words Ridley is happy to use model output as evidence when it suits him. His words are worthless.

"What would we prefer to bad models? Good models."

Have you ever watched Miss Congeniality? Your sentence reminds me of the banal statement of desires from the contestants. What do you want? Peace and happiness on Earth. Or was it motherhood and apple pie?

We all want better models, you no more than me or Gavin Schmidt. There are many teams working towards that, just as there probably are in economic models. But what climate models have over economic ones is that they are based on physics. Yet people like Ridley are all too willing to believe favourable output from economic models which have no such foundation and yet they reject the physical. Did you object to the economic models Tol/Ridley promoted?

Models are tools.


geronimo, you say "I don't need a model to tell me about the future because I don't believe..." but where does that belief come from? You are forecasting and as such you must be using a model, whether mental, physical or virtual. The difference is that you are unable to express that model in any rigourous way. That is not much use when trying to assess risk and determine a course of action.

Martin, models are a way of investigating the climate system, just like your models were a way of representing and investigating your systems. Even if you had had no way of validting your models, I expect you would have produced them nevertheless. You would doubtless have given them less credence but they would still have given useful insights into the system. Models are tools, climate models no less.

What you are effectively saying is that unlike Rhoda, who at least wants better models, despite rising sea levels, air and ocean temperatures, acidifying oceans, shrinking ice sheets and glaciers, degrading permafrost, changing species distributions (all of which you claim not to know), and despite our understanding that rising CO2 levels are the most likely cause of all that, nevertheless trying to model this system and taking notice of what these models say is more harmful than ignoring it and hoping for the best (i.e. crossing fingers and guessing that it will all be ok). The crossed fingers bit makes you feel foolish because it is foolish.

Unless your own model (mental presumably) of the world can show that the effect of changing CO2 levels has a probability distribution that is infinitely narrow (in other words, your model tells you exactly what will happen with no doubt), there will always be a tail of uncertainty. In other words there is a non-zero probability that temperature will change as a result of extra CO2 by 4 degrees (say), or -4 degrees. The latter is comparable to entering a new glaciation. What does the former equate to? How big is the risk? Should we try to understand it and mitigate it? You seem just to know the answer already without studying the problem. To me that does seem foolish.

Jul 9, 2014 at 4:23 PM | Unregistered CommenterRaff

"Even if you had had no way of validting your models, I expect you would have produced them nevertheless."

Why would you?

It would be a complete and utter waste of time and energy.

Jul 9, 2014 at 4:31 PM | Unregistered CommenterNial

Models are tools. OK. Leaving aside semantics, I discard bad tools, and if the models are wrong, and wrong in concert, I have to question whether the criteria involved in building them are flawed. Like, for instance, if the climate sensitivity is wrong. Now, CS is not exactly an emergent property of the climate model suite. There is a set of assumptions on the input, procedure and parameter selection, possibly common to all, which leads them all to be wrong. I am not personally inclined to give the modellers another chance. Why not? Because they will not acknowledge in public just how dodgy these models are. Let's say I'm right that there is a problem with the assumptions. The proper reaction of a modeller is to fix the damn thing. Not say it's nearly right, use these results while I refine it. Or worse, I need a better computer. I want the modeller to say 'This model is not fit for policy use'. If you don't say that, I have a problem that you aren't being quite honest.

And I don't bloody care about something Matt Ridley might write, or economic models (worse even than GCMs IMHO) or in semantics about what the meaning of is is.

Jul 9, 2014 at 4:47 PM | Registered Commenterrhoda

"We simply don't know. That's all there is to it". Martin A

"You seem just to know the answer already without studying the problem. " Raff

Raff - not wanting to be rude but you don't seem to pay attention to what is said.

Jul 9, 2014 at 4:56 PM | Registered CommenterMartin A

Anyone want to buy a second hand polar-bear model?

Jul 9, 2014 at 5:57 PM | Unregistered Commentermichael hart

Arguing about what the meaning of the word 'evidence' is doesn't come into it. That's just semantics. Raff argues a straw man. What would we prefer to bad models? Good models. But we'd still know that we are looking at the prejudice of the programmer, even if he happened to be right.

Jul 9, 2014 at 10:18 AM | rhoda

Avoids answering the question in the same way as Chandra, and again schoolboy (13?) argument.

Jul 9, 2014 at 7:37 PM | Unregistered CommenterSandyS

Jul 9, 2014 at 4:31 PM | Nial
Not to mention large amounts of research money leading to huge waste in renewable energy.

Jul 9, 2014 at 11:01 PM | Unregistered CommenterSandyS

Sandy, which question did I avoid? There is none there except mine. The title of the thread is "Do computer models provide 'evidence'?" - not evidence but 'evidence'. The word and its meaning are obviously central. Martin quotes Ridley questioning the word, claiming that models cannot provide evidence and yet he (Ridley) uses model output as evidence in articles he writes - where the evidence fits his objective. Ridley is clearly talking nonsense. You should be able to recognise it by the fact that he is inconsistent.

Rhoda, this thread is largely related to what Ridley has written. If you don't bloody care about what he writes or the inaccuracy thereof, why comment?

Nial, if doing a job properly requires the estimation the value of something, that is generally what is done. Even if the model produced cannot be validated (and all estimates use models of some form, if only mental), people still do their best to produce a result and they give confidence levels. That is how it is.

Martin, you are rewriting your own words. You didn't just say,"We simply don't know. That's all there is to it", you said, "I have said before, if you believe the output of an unvalidated model, you are putting yourself in a worse position than saying "We simply don't know. That's all there is to it". We'd suggest not using models and being honest about our lack of understanding. In other words you did not state your position but that of some other posited person. Possibly that is too subtle a distinction for this forum.

However, if you really characterise your own position as "We simply don't know", then I still cannot believe you mean "we know nothing". That would imply that you think the probability of any outcome is equal - that two decades from now global temperatures have an equal chance of being zero Kelvin or infinite. I imagine you would agree that those are impossible extremes, so I have to assume you would consider some values more likely than others - you have some sort of probability distribution in mind.

So to repeat myself, as you have stated that your own mental model of the world cannot show that the effect of changing CO2 levels has a probability distribution that is infinitely narrow (in other words, that your model tells you exactly what will happen with no doubt), there is inevitably some sort of probability distribution to what your model actually predicts. And hence there will be tails of uncertainty. There is hence a non-zero probability that temperature will change as a result of extra CO2 by 4 degrees (say), or -4 degrees. The latter is comparable to entering a new glaciation. What does the former equate to? How big is the risk? Should we try to understand it and mitigate it? You don't know the probability of a 4C rise and it is difficult to see how you can argue that the risk is zero. How do you suggest we determine that probability - whether we have a problem - without models or paleo studies? Or do we just say, "its too difficult, let's ignore it"?

Jul 9, 2014 at 11:07 PM | Unregistered CommenterRaff

Raff
Sandy, which question did I avoid?

rhoda
Arguing about what the meaning of the word 'evidence' is doesn't come into it. That's just semantics. Raff argues a straw man. What would we prefer to bad models? Good models. But we'd still know that we are looking at the prejudice of the programmer, even if he happened to be right.

Allows you to avoid answering any question and is a common feature on threads like this as well as disappearing off onto another one leaving questions in limbo.

Jul 10, 2014 at 7:47 AM | Unregistered CommenterSandyS

Sandy, it is really unclear to me which question you think I avoided and which threads I have disappeared from leaving questions in limbo. From activity today on this thread I'd say that Nial, Rhoda, geronimo and Martin have 'disappeared' from this thread - is that what you are referring to? I agree that Martin for one has outstanding issues to answer, but the same issues apply to you all really, not just him. See my 11:07 - the logic is that we need to assess the likelihood and effects of a significant rise in temps and the rhetoric here indicates that you all think models are not to be used. In other words, the only tools at our disposal are to be rejected because the evidence they produce cannot be proven beyond doubt. That is beyond my comprehension, but you do seem to believe it - so what do we use instead?

Jul 10, 2014 at 11:26 AM | Unregistered CommenterRaff

"That is beyond my comprehension"

Yeah. The models are wrong. Or, if you like, not right enough for prime time. If you are a modeller, you ought to be cringing to your funder saying 'Sorry Sir, we will try to do better.' Not, use this output, flawed though it is, to decide policy.

If I were one of those engineer types, and my aero model said a Tiger Moth was going to go at Mach 2, I'd would have cause to doubt the model. I would not consider that output as evidence that the tiger would go mach 2, but rather that we had a duff model. I modify my stance. It IS evidence, but only of the prejudice of the model-building process. Not to mention evidence that the climate establishment was quite prepared to stop and declare the debate over as soon as the models fit their desired result and ignore indications that more work, a lot more work, needs to be done.

Jul 10, 2014 at 11:38 AM | Registered Commenterrhoda

> Nial, if doing a job properly requires the estimation the value of something, that is generally what
> is done. Even if the model produced cannot be validated (and all estimates use models of some
> form, if only mental), people still do their best to produce a result and they give
> confidence levels. That is how it is.

If you're basing your results on a model that cannot be validated the confidence level is 0.

You might as well use chicken entrails.

In the real world of Engineering 'evidence' that something occurs is confirmed by measurement. How many aircraft manufaturers sign off air worthiness based on model predctions? You can't get a PCB through emc testing by showing simulation results, you have to test it.

How much effort has climate science committed to measure the CO2 hypothesis?

Jul 10, 2014 at 11:46 AM | Unregistered CommenterNial

Rhoda, you at least seem to accept that models would be useful if 'better'. What criteria would you use to judge them to be so?

Nial, do you accept that there is a non-zero probability of temperatures changing significantly due to CO2? If not, what 'model' (mental, physical, virtual, etc) are you using to give you such confidence. If you do, how do you think we should respond - by ignoring it or my modeling it?

Jul 10, 2014 at 12:09 PM | Unregistered CommenterRaff

> Nial, do you accept that there is a non-zero probability of temperatures changing significantly due to CO2?

No (depending on your definition of 'significanly').

The 'model' I'm using to come to this conclusion is a comparison of historical measurements of CO2 and temperature.

Jul 10, 2014 at 12:31 PM | Unregistered CommenterNial

Raff
Having quoted what Rhoda said twice and my interpretation of what that means it should be clear that putting up strawmen and arguing semantics avoids answering all difficult questions.

Malcolm The Maiden put avoiding the issue more clearly when he alledgedly said to Henry II "I came in peace and not to answer difficult questions".

Jul 10, 2014 at 12:41 PM | Unregistered CommenterSandyS

" I agree that Martin for one has outstanding issues to answer, but the same issues apply to you all really, not just him.

Raff - I said before that there is a communication gap here.

I say things as clearly as I can and you come back and tell me I mean something different from what I said. That's not something that is worth responding to.

But just to re-emphasise. I believe that climate models are *worse* than useless. We know they are wrong, both from fundamentals of what sort of physical systems can and cannot be modelled and the empirical evidence.

______________________________________________________________________________

Jul 10, 2014 at 11:38 AM | Registered Commenterrhoda

As I said somewhere previously, GCMs *do* provide evidence. They provide evidence that the climate system is not understood well enough that anybody can make usable predictions of its future behaviour.

Jul 10, 2014 at 12:48 PM | Registered CommenterMartin A

Nial, can you describe or illustrate the probability distribution function produced by your model?

Sandy, as I said once before, the title of the thread is "Do computer models provide 'evidence'?" - not evidence but 'evidence'. The word and its meaning are obviously central. So duscussing the word is not evading the 'question'. I don't know why you cannot get this, but it is your problem, I guess.

Jul 10, 2014 at 12:51 PM | Unregistered CommenterRaff

Nial
That's my position and has been for a number of years, I did have a slight wait and see caveat in the early days of Global Warming™, but having waited I'm in my default position.

The Climate isn't changing merely behaving as it has always done, there isn't a single parameter outside previously experienced limits.

How can it be said to have changed? /rhetorical

From that position we can plan for events that historically have caused Britain most problems, in my view these are
1. Extended cold - the LIA for example
2. Severe storms as in the LIA for example
3. Mismanagement by politicians - this is up to the individual.

Jul 10, 2014 at 12:52 PM | Unregistered CommenterSandyS

Yeah sure Martin. But why not answer the question? Your mental model (which is a model of sorts just like a climate model - and you seem to be happy to trust its output despite it not being 'validated') cannot say exactly what effect changing CO2 levels will have, so even there there is a chance that temperature will change as a result of extra CO2 by several degrees. How big is the risk that this will happen? Shouldn't we try to understand it? How do you suggest we do this?

Jul 10, 2014 at 1:08 PM | Unregistered CommenterRaff

" How do you suggest we do this?"

With a model that works? With a model ensemble which does not include demonstrably bad models for political reason of not offending the national met outfit or university which produced them?

It is my impression, and correct me if I'm wrong, that for every model in the ensemble the IPCC uses, the way to handle the effects of CO2 is prescribed, and it is done by applying the Myrhe formula to the existing or forecast CO2 proportion and adding that figure in watts/sqm as a forcing. Is that true? If it is, we don't have an ensemble of independent models.

Jul 10, 2014 at 1:21 PM | Registered Commenterrhoda

Has anybody noticed the parallels between Raff on this thread and And Then There is Physics on


http://www.bishop-hill.net/blog/2014/7/3/where-there-is-harmony-let-us-create-discord.html
?

Both seem to have difficulty understanding points that have been clearly made . Both return to ask essentially the same question again and again.

Jul 10, 2014 at 1:27 PM | Registered CommenterMartin A

If I may, I'll repeat what I said in reply to Anon's rather lengthy post on the original Ridley thread:

You cannot provide evidence for something that has not yet happened.
You can provide a compelling argument up to and including as close to a 100% likelihood as your model is capable of.
Ask anyone who has ever devised a system for backing horses!
You are entitled to draw conclusions from model output if (and only if) your original programming has been good enough to cover all possible bases, and if (and only if) your model's predictions have a decent track record. But any number of things can intervene between the date you make the prediction and the date when the event is due to occur.
I would have thought that was fairly obvious — unless I'm missing something even more obvious!

Jul 10, 2014 at 1:29 PM | Registered CommenterMike Jackson