Discussion > Hypothesis testing in climatology
Jamesp
What I propose is to derive the increase in energy content of the land, ocean atmosphere from the CO2 hypothesis and show that it matches the measurements, using two independent approaches.
It will take a little while to assemble all the bits of paper, bear with me.
EM, this is what I had largely written before you said you were going to start a discussion thread.
Michael hartYou insistance that the only valid science is done by controlled experiments eliminates all observational science. For example, the only fact you can accept from astronomy is that the Earth rotates. ( Foucault pendulum )..
Nov 9, 2014 at 10:18 AM | Unregistered CommenterEntropic man
EM, the “facts” that you choose to accept will depend on the standards you choose to accept.
I deliberately chose my words to avoid slurring other scientific disciplines, but you've managed to interpret them the wrong way. Other fields have their own specific issues, and judgements can be made about how the practitioners take steps to mitigate those problems. For example, the search for the Higgs Boson reportedly required 'five standard deviations quality' data before it became publishable. Much other published research only requires a lower 'two SDs' (the "95% confidence level") before it is considered 'acceptable'.
These are, of course, completely arbitrary choices within the respective disciplines. Arguments to tighten-up such standards can be made, and are.
Now, let us look at IPCC 'climate-science': When the IPCC model ensemble failed their own '95% confidence level[*]', what did they do? They went in the other direction! They downgraded the pass level to 90% and then claimed an increased level of certainty! By continuously lowering standards they could make the models 'correct' from the beginning of the solar system until the end of eternity, if they wanted to or were allowed.
I put it to you that those are not standards that pertain in most of the physical sciences. Some might say that lowering standards in the face of hypothesis-breaking results is tantamount to having no standards at all.
[*As RGB at Duke frequently points out at WUWT, the IPCC model ensemble mean and associated confidence levels is a scientific abomination, but here I'll take it as a genuine attempt to convey uncertainty to an audience]
Michael hart
Feel free to go elsewhere. Your denial of the validity of the measurements I intend to use means that anything I say here will be irrelevant to you.
I'm not michael hart nor geronimo but, off the top of my head, here is my assessment, as a casual onlooker, of my confidence in the (accuracy) × (reliability) of of the things in that list:
IR absorbtion and emission spectra of CO2, water methane and atmospheric air measured under laboratory conditions.
95%
IR absorbtion and emission spectra and intensities of outward longwave radiation by satellite and downwelling longwave radiation measured from the surface.
75%
Global average temperature measurements averaged from stations, satellite measurements, ship measurements etc.
27% [perhaps I'm being too charitable here in view of the inherent nonsense in the idea that temperatures can averaged, the coming and going of measuring stations over time and their haphazard spatial distribution]
Measurements of deep ocean temperature by ARGO and earlier techniques.
30%
Laboratory measurement of coefficients of expansion, heat content and latent heat for seawater and freshwater.
95% [heat content? (= specific heat?). For "seawater", how representative will be the sample(s)? ]
Measurement of sea level rise using satellites and tide guages.
55%
Measurement of volumes and volume losses of ice sheets by survey, satellite surface profiling and gravimetry.
45%
Trenberth's energy budget and updates.
10%
EM: "If you can't explain your theory to a barmaid, it probably isn't good physics." Kelvin.
Let's get on the same page shall we, I accept that CO2 is a GHG and that there could be AGW. Without catastrophic bit it would be interesting but not worth arguing about. So here's what I think the theory your talking about is:
CO2 is a GHG, it has increased in the atmosphere because of human emissions, and temperatures have risen. Ergo CO2 causes temperatures to rise (or it used to). The rise in temperatures will cause untold catastrophes.
I'm not asking you to prove anything to me, we've spent $100s bn on climate science research and you are unable to point me to the simple tests that would prove the theory put forward by the scientific community. Moreover when a theory is proposed the criteria that would prove it wrong should be stated, so we don't have to argue it here, it must already be in the scientific literature if it's a proper scientific theory. But what falsifies the above theory as expounded by me?
As it happens I believe that CO2 causes an increase in the heat retained in the atmosphere. Whether this extra heat will manifest itself in the climate system is more complicated, and I'm pleased to see that the entire climate scientific community are as ignorant as I am, given the 55 (?) explanations for the pause.
What I don't believe is that anyone is equipped to foretell the future of a complex system that is interacting with at least two other chaotic systems.
JamesP
Let the fun begin. I haven't tried quite this path before, so it will be fun to see how it works out. :-)
Prediction.
The physics of AGW theory predicts a radiative forcing imbalance due to GHGs of 2.706W/M2 for 2007, increasing to 2.916 for 2013 (Radiative forcing table, Wikipedia). Average for those seven years comes out at 2.8WW/M2.
(I chose 2007 as a start point because this is the year ARGOS became fully operational. More on this later. )
How does prediction compare with observation?
The observed aerosol forcing is between -0.3 and -1.8 ( IPCC2007) .Put them together and one would expect a maximum forcing of 2.8-0.3= 2.5. The minimum would be 2.8-1.8 =1.0. (Other positive and negative forcings such as cloud also play a part, but wwe'll keep it simple.)
Satellite measurement of insolation and outward radiation give an imbalance of 0.7+/-0.3 (Murphy 2009) to 90% confidence.
For this first test the maximum probable observed value and the minimum prediction meet. Not bad for a quick calculation.
Next I'll start playing with energies.
Martin A, Geronimo
As I said to michael hart, if you don't believe the measurements, this thread won't be relevant to you. I take the data and their confidence limits at face value and calculate accordingly. They tell a coherent story, which ,I would not expect from bad data.
Martin, do climate scientific publications claim that the values they calculate or measure are 100% accurate? Or do they give likely error margins? How do your % numbers relate to these error margins. If they don't, what do they mean? How are they derived and what do they really signify. Do they have error margins themselves? I mean 27% is awfully specific for something so nebulous as your degree of confidence in global average temperature measurements. How did you come to 27 and not 26 or 28? These look like numbers plucked from the air. And only 95% for lab measurements? Does that mean that there's a 1 in 20 chance that any of them might be out by a smidgen or out by a significant amount? I'd have thought there was a near 100% chance that they might be very slightly wrong to a minuscule degree. But what of it?
Raff, you are looking for things that are not there.
These look like numbers plucked from the air.
That's exactly right. As I said "off the top of my head, here is my assessment".
I'm not sure why you think 27% seems any more awfully specific than any of my other guesses, for example, 30% or 45%. They are all given to two figures.
As I tried to explain, I was giving a figure for my off-the-cuff guess about both the accuracy and the reliability of the things that EM mentioned. I didn't define what I meant by accuracy and reliability and I suppose that they can't really be considered as separate things.
But something that has been measured to a precision of ±10% and where you can have complete confidence in how the measurement was conducted, and the reliability of the reporting of the value, would show up as 90% on my subjective estimate.
Whereas something that has been measured with a precision of ±5% but where problems in gathering the samples, recording the results, using the wrong formula and so on meant that the result might (50:50) be very far from the true value might show up as "45%" on my subjective scale.
I hope that makes sense, even if you don't agree with my guesses.
Michael hartFeel free to go elsewhere. Your denial of the validity of the measurements I intend to use means that anything I say here will be irrelevant to you.
Nov 9, 2014 at 6:19 PM | Unregistered CommenterEntropic man
??? Most peculiar. Even by your standards.
When you deign to tell us about "the measurements I intend to use", then I'll consider reading them. I don't even see anything worth denying at the moment.
Martin, it is not that I disagree about any particular number (27 was just an example), but that they seem to combine accuracy and precision into a percentage (of what?) in a way that is not useful. Some of those quantities are highly accurate and highly precise (emission spectra). Others might be quite inaccurate (like ocean levels) but reasonably precise (i.e. repeatable). And of course, even inaccurate/imprecise values can still be useful, as trends can still be determined.
And you start a "discussion" thread with my name, and a bald assertion about what I think. You then invite me to go elsewhere because what I think will make the thread irrelevant to me? Have you been drinking (excessively), EM?
"As I said to michael hart, if you don't believe the measurements, this thread won't be relevant to you. I take the data and their confidence limits at face value and calculate accordingly. They tell a coherent story, which ,I would not expect from bad data."
If you find it difficult to address the points I've made to you, that's fine. But I've asked you two simple questions, one is what test would prove global warming - I don't need the measurements just what it is that would prove it for you.
On unthreaded you, quite rightly, said a hypothesis could be confirmed by its ability to forecast future events. Naturally, I'd assumed that the less than glorious performance of the climate models would have deterred you from quoting them, and you didn't. For my second question it's easy, you believe in a theory, 9000% of the scientists on the planet agree with you (I might have exaggerated), so please tell us what you and the 9000% of the scientists on the planet would regard as falsifying the theory. It's not that difficult, but I have to show some sympathy for your predicament because the real experts are waffling more than you are.
Falsifying AGW is easy. If CO2 levels were to start falling despite BAU emissions, or if global average temperatures were to fall for a few decades, or glaciers were to start advancing instead of retreating - any of these would mean that the idea that human CO2 emissions would cause temperatures to rise was seriously wrong. You can probably think of (or google for) others.
geronimo
This thread started with the question of hypothesis testing in climatology. I have already made one simple test and demonstrated that one prediction from theory is not falsified by observation.
I'm interested here in continuing that theme rather than getting sidetracked by more general discussion.
Note that I took one specific prediction from theory and tested it against observation. I am not testing the whole thing at once. You asked what convinced me. It is the way my own calculations confirm that individual lines of evidence from climatology form a consistent whole. My future calculations here will illustrate this.
It would be much more useful to this discussion if you could critique my 8.33 post.
Raff
Falsifying AGW is easy. If CO2 levels were to start falling despite BAU emissions, or if global average temperatures were to fall for a few decades, or glaciers were to start advancing instead of retreating - any of these would mean that the idea that human CO2 emissions would cause temperatures to rise was seriously wrong
How about not rising for a couple of decades? You realise the implications of using OR rather than AND?
SandyS
The pause, if it ever existed, may be over. There is a flat spot n the GISS 5-year average. Every year since 2003 has a 5-year anomaly average of 0.57 0.58 or 0.59.
After 9 months the 2014 average is at 0.68 and rising. This would make the most recent 5-year average 0.61. Both are record values.
The topic of this thread is hypothesis testing. The "sceptic" hypothesis is that warming has stopped. AGW predict an ongoing long term rise underlying short term variation.
If the pause is ending, this would support AGW.
This would make the most recent 5-year average 0.61. Both are record values.
So 0.02C over the 0.59 C in 2003 to 2011 Anomaly with Base: 1951-1980 is an increase worth saying the pause is over !!!!!
EM you have surpassed yourself in crass comments with this one.
Breath of fresh air
The 5 year average centred on 1998, the first of the"18 year pause" was 0.44; the 5- year average centred on 2012 will exceed 0.61.
I would say that a change from 0.44 to 0.61 would be sufficient to falsify the pause hypothesis.
Geronimo
Hans Custer suggests ten ways to falsify AGW here .
Something for which there is no evidence does not require falsifying.
There is of course an easy way to test the AGW hypothesis - continue the so-called 'BAU' and look back after ~100-150 years. Even here, the IPCC has made up its range of projections to encompass such a wide range that even if natural variability were to result in an amount of change that is co-incidentally the same as predicted, the prediction would take credit.
The only surefire method of prediction success would be to see a temperature change that is both substantial and rapid - sort of like a true hockey stick - within the instrumental record.
The "sceptic" hypothesis is that warming has stopped. AGW predict an ongoing long term rise underlying short term variation.If the pause is ending, this would support AGW.
Nov 10, 2014 at 10:06 AM | Unregistered CommenterEntropic man
You still don't get it. There is no single "sceptic's" hypothesis. Temperatures could easily resume warming at a gentle rate and the model predictions would still be wrong. Of course, if they had predicted only gentle warming at the out-set nobody would have been alarmed.
Entropic man
Maybe, possibly, might be.
If ifs and ands were pots and pans there''d be no need for tinkers.
Maybe is not is over. Therefore it is just as likely to continue, or even become a decline. Therefore the questions to Raff are still valid, and do you think it is an OR or An AND?
Michael hart, exactly.
This started on Unthreaded on November 9th.
Michael hart rejects the validity of any science not done using controlled experiments which excludes all observational science. Geronimo says that hypothesis testing and falsification cannot be done in climatology for similar reasons.
I contend that they are mistaken.
Firstly we need to establish what we agree on.
Michael hart, geronimo,; can you indicate which of the following do you accept as valid evidence. There is no point doing this if you do not accept measurements taken outside the laboratory.
IR absorbtion and emission spectra of CO2, water methane and atmospheric air measured under laboratory conditions.
IR absorbtion and emission spectra and intensities of outward longwave radiation by satellite and downwelling longwave radiation measured from the surface.
Global average temperature measurements averaged from stations, satellite measurements, ship measurements etc.
Measurements of deep ocean temperature by ARGO and earlier techniques.
Laboratory measurement of coefficients of expansion, heat content and latent heat for seawater and freshwater.
Measurement of sea level rise using satellites and tide guages.
Measurement of volumes and volume losses of ice sheets by survey, satellite surface profiling and gravimetry.
Trenberth's energy budget and updates.