Carlin Economics and Science

Applications of economics and science for rational public policy by Alan Carlin
  • rss
  • Home
  • About
  • Publications
    • An Evaluation of U.S. Government Aid to India, June 1964
    • Environmentally Responsible Energy Pricing, 1993
    • The United States Experience with Economic Incentives to Control Environmental Pollution 1992
    • Environmental Investments, The Cost of a Clean Environment, A Summary, 1990
    • Environmental Investments, Cost of a Clean Environment, Report by the Administrator of the Environmental Protection Agency to the Congress of the United States, 1991
    • Implementation and Utilization of Geoengineering for Global Climate Change Control, 2007
    • Mr. Udall’s Analysis, An Unrepentant Rejoinder
    • Risky Gamble
    • Vehicle Safety, Why the Market Did Not Encourage It and How It Might be Made to Do So, 1968
    • Why a Different Approach Is Required if Global Climate Change Is to Be Controlled Efficiently or Even at All
  • Added Sources

Why Peer Review Is No Substitute for the Scientific Method

Alan Carlin | April 3, 2010

Given the the apparent death of cap and trade legislation in the US Senate, the short-term outcome of the US debate on action that allegedly might reduce climate change may rest primarily on what the USEPA manages to actually do. So it is of some importance what criteria EPA claims to be using in determining the scientific merits of its endangerment finding. In US EPA’s view the UN IPCC reports and other assessments based on it are so satisfactory an assessement of current climate science that no independent EPA analysis was necessary, primarily because of the IPCC’s “rigorous” policy on peer review. EPA cites this review policy as the reason it accepts these reports rather than others, such as the NIPCC report. Recent reports show that as actually carried out the UN IPCC AR4 assessment was much less than rigorous in the application of its peer review guidelines, however. Lost in this exchange, however, is whether the yardsticks being used by the UN and the EPA are reasonable. Both organizations appear to assume that peer review is the important characteristic of valid science included in scientific assessment reports.

I maintain, on the contrary, that the important characteristic should be how well the hypotheses proposed by the UN IPCC corresponds with real world evidence. It is only this crucial correspondence that determines the scientific validity of a hypothesis, not how many or how distinguished the reviewers may be who agree with the relevant hypotheses. This should be evident since any widely held scientific view (such as that the Earth is flat some centuries ago) would have easily qualified as valid science using a peer review standard since the supporters could easily have gotten a large number of favorable reviews of their hypotheses. This is what has happened in the case of the AGW hypothesis. There are enough global warming supporters among climate scientists so that with a little careful selection favorable peer reviews can be obtained for any desired warmist hypothesis. Hence such views can pass the peer review standard whether a hypothesis really stands up to comparisons with real world data or not.

For example, the EPA claims in Response 1-12 to the public comments on the EPA proposed endangerment finding that the 880 page NIPCC report stands in sharp contrast to the IPCC and related reports:

    “The [NIPCC] organization does not appear to have established any procedures for author selection and provides no evidence that a transparent and open public or expert review was conducted. Thus, the NIPCC’s approach stands in sharp contrast to the clear, transparent, and open procedures of the IPCC, CCSP, USGCRP, and NRC.”

So although there is some discussion of the arguments raised by the NIPCC report, no real effort appears to have been made to consider using the NIPCC report at least in part on the basis of whether the report had “adequate” peer-review guidelines. According to the EPA, only the IPCC and similar reports including such peer review meet EPA’s “exacting” review standards. How accurate or how closely the NIPCC and other skeptic reports correspond with real world evidence appears not to be of any real importance to the EPA–just how comprehensive the stated review process was supposed to be. Yet when deviations from these standards are detailed EPA maintains that the IPCC conclusions would not have been materially affected rather than admitting that their expressed confidence in the UN procedures was misplaced. This is also an argument that the substantive scientific merits of the non-IPCC assessments do matter, but only when the procedural aspects have not been comprehensively implemented. The reverse should be the case.

The Purposes of Peer Review

The basis for the underlying argument is what is fundamental to the scientific method: Correspondence with real world data or procedural review requirements. In examining this issue it is useful to recall the history of scientific peer review. It was basically introduced so as to decide which papers submitted to printed journals should be included and whether there might be improvements that could be made in those selected, primarily for the purpose of saving then precious journal space. This may have actually been useful in the days when journals were of limited size based on the printing and mailing costs.

Peer review subsequently served an added purpose–to provide a basis for discriminating between the output of various authors/professors and thus providing a basis for conferring academic tenure on some but not on others. The second purpose is still a rationale argument for using peer review, but the first purpose is technologically obsolete since Web publication of added papers is very low cost and may be almost free. Use of Web-based journals has the added advantage that they are normally free to all users rather than limited to the select few who can afford often very expensive subscriptions. And peer review of papers for journal publication has many very important disadvantages, of which the most important is that it often prevents publication of non-conventional ideas that may have great merit. This appears to have been too often the case with regard to the consideration of skeptic contributions to climate science in recent years.

So the extension of journal-based peer review to determining the scientific merit of competing hypotheses is a very important policy issue since it may lead to reducing the importance of comparisons of competing scientific hypotheses against real world data. This is exactly what appears to have happened in the case of the AGW hypothesis of global warming. In fact, warmists have widely cited better peer review as an important reason to support their hypothesis; according to the Climategate emails, leading warmist scientists actively conspired to prevent skeptic-oriented papers from being published in major climate-related journals.

The Fundamental Issue: How Should Scientific Hypotheses Be Judged?

All this highlights the fundamental issue of whether scientific hypotheses should be judged on the basis of whether they have appeared in peer-reviewed journal publications or on the basis of correspondence with observed real world data. I believe very strongly that it is the latter rather than the former that should be used. One important reason is that peer-review is subject to the same “group think” that science should seek to avoid in order to be objective and useful. And that is exactly what has happened in the case of the AGW hypothesis. Despite the absense of any relevant real world data comparisons to support their case, warmists try to use the widespread support (the so-called “consensus”) among sympathetic scientists for their hypothesis to argue that it should be accepted. Obviously if this was the standard, we would still believe that the Earth was flat and that the Earth was the center of the universe, to mention just two widely supported hypotheses disproved by their lack of correspondence with real world data.

It is very unfortunate and may even prove disastrous that EPA and other environmental regulatory institutions appear to have made peer review procedures of much more importance than correspondence with real world data. Scientific assessments need to determine the correspondence between hypotheses on the basis of real world data, not relative “peer review” procedures. This needs to be corrected before immense damage is done to our crucial criteria for judging scientific hypotheses and to our economy as a result of using faulty science for public policy purposes.

Comments
5 Comments »
Categories
Environmental Protection Agency, Peer review, Scientific method
Comments rss Comments rss
Trackback Trackback

Why the UN GHG Hypothesis Should Be Rejected on Scientific Grounds

Alan Carlin | August 9, 2009

(Updated August 11, 2010 to include added sources)

In a previous post I explained why I believe that the United Nations GHG hypothesis that significant global warming will occur as a result of increasing greenhouse gas (such as CO2) levels is implausible.  In this post I will explain why I believe that the best available evidence indicates that the hypothesis is not just implausible but rather should and can be rejected on scientific grounds.

For a broader view of how science progresses see here. Clearly I am in the Popper camp in this regard. Kuhn’s view may more accurately describe how science has unfortunately sometimes been historically conducted, but certainly not how it should be.

Before going further, it is important to explain that the important word in the definition of the UN GHG hypothesis is “significant.” There is little doubt that higher levels of greenhouse gases are likely to lead to slightly higher global temperatures since that is why they are called greenhouse gases. The United Nations, however, claims that increases in the levels of these gases in the atmosphere are the predominant influence on global temperatures. Hence the qualification “significant” in order to include the UN claims while excluding the minor warming that has probably been caused by increasing levels of greenhouse gases in the atmosphere.

As explained in my Comments, the models relied on so heavily by the UN do not prove anything scientifically one way or the other.  They simply show what the model builders believe would happen if the hypothesis and all their other assumptions were correct. The model results are interesting, perhaps even useful, but irrelevant in deciding whether their AGW hypothesis should be accepted or rejected. This is because they do not compare the implications of the hypothesis with real world data other than past temperature data which the models have been modified to emulate. 

The Critical Role Played by the Scientific Method

According to the scientific method, a scientific hypothesis must be tested by comparing real world data with the implications of the hypothesis.  This is how Albert Einstein was able to persuade the world that his ideas on relativity had merit.  Scientists kept proposing real world tests of his hypothesis but each test confirmed its validity. After a number of these tests, the opposition conceded that his hypothesis was valid. (For a description of this extended process see, for example, Jeffrey Crelinsten’s Einstein’s Jury: The Race to Test Relativity). A similar process resulted in the acceptance of Newtonian mechanics and other hypotheses which gradually assumed the status of theories.

If the comparison with real world data does not confirm the hypothesis, the hypothesis should be rejected. There are only two alternatives from a scientific viewpoint when this happens: Discard or at least modify the hypothesis or discover an error in the data used to reject it.  From a scientific viewpoint, it is totally irrelevant how many public officials or scientific organizations–or how prominent they may be–support a particular hypothesis.  A hypothesis has scientific validity only by comparison with real world data. Joanne Nova has expressed this very well in her Handbook downloaded here.

There are numerous inconsistencies between the UN CO2 hypothesis and observed data.  Gregory explicitly compares the explanatory power of the UN hypothesis with the competing Svensmark hypothesis and finds the UN hypothesis wanting.  Idso and Singer provide extensive scientific evidence against the UN hypothesis.

But perhaps the most fundamental comparisons are between the major physical effects of the UN hypothesis and available real world data.  There are four particularly telling physically-based basic comparisons in this regard.  According to the scientific method an inconsistency even in one of these comparisons means that the hypothesis should be rejected from a scientific viewpoint.  It is important to deal with the uncertainty introduced by the word “significant,” however. This uncertainty increases the likelihood that a few of the comparisons may prove positive. Hence it increases the strength of any negative finding. In fact, if a number of tests should prove negative it makes the tests very powerful evidence against the hypothesis.

Four Critical Comparisons with Real World Data

Acceptance of the hypothesis requires that each of the following four observations are present:

  1. There is a hot spot in the upper troposphere in the tropics as predicted by the UN. If greenhouse gases are significantly warming the Earth the first signs of it are supposed to appear about 10 kilometers above the tropics. The lack of such a hotspot is discussed in my Comments in Section 2.9 as well as by Joanne Nova downloaded here. She discusses the major objections that have been raised to this comparison and why she believes they are not credible. For a further update see here. For more detailed information see here.
  2. There is heating of the oceans.  The added heat generated by increasing greenhouse gas levels in the atmosphere must be stored somewhere. It has not been showing up in the atmosphere in the last decade, so if the hypothesis is valid it must be going into the oceans. But in the last few years this has not been the case. An extensive discussion of the evidence can be found here. The bottom line is that the AGW hypothesis fails this test as well.
  3. The observed outgoing radiation fluxes from the Earth decrease with increases in sea surface temperatures. Satellite data, however, shows an increase, which is inconsistent with the high climate sensitivities to increases in CO2 and positive feedback so crucial to the UN’s case. A new peer reviewed paper accepted for publication on this subject can be found here. For a video of Christopher Monckton’s presentation on this study on the Glenn Beck program see here. For a more up-to-date but considerably more technical presentation, see starting at slide 28 here or in the corresponding Richard Lidzen video found here.
  4. The atmospheric response times for volcanic sequences would be longer than they would be without the UN hypothesis. If climate sensitivity is as high as the UN claims, it should show up in the atmosphere’s response time from volcanic eruptions. The reason for this is that climate sensitivity is also a measure of how tightly air and sea temperatures are coupled. High sensitivity is associated with weak coupling, allowing the establishment of significant disequilibration of the sea surface temperature. A discussion of this can be found in a 1997 report from the National Academy of Sciences here.  The discussion may be a little technical, but the conclusion that the data “is consistent with low [climate] sensitivity,” which is inconsistent with one of the UN’s crucial conclusions, is clear.

The conclusions are the same in each of these four cases: The UN hypothesis is not supported or even partially supported by these comparisons with real world data.  As Professor Richard Lindzen of MIT has recently observed with regard to his findings on comparison 3 above, “In a normal field, these results would pretty much wrap things up, but global warming/climate change has developed so much momentum that it has a life of its own – quite removed from science.”

The data are far from perfect, of course, perhaps in part because of a lack of effort to gather it.  But they all tell the same story.  This means that the hypothesis should be rejected scientifically based on current information. Future testing could lead to other conclusions, of course, but for now rejection is the rational course of action.

Implications

Accordingly, using this hypothesis has no scientific basis based on current knowledge concerning these four comparisons.  Attempts to argue that it is anything more than a religious or superstitious belief must show that the data used in each and every one of these tests (as well as others that may be proposed in the future) is wrong.

Accordingly, using the UN hypothesis as a basis for formulating policy is not useful or relevant from a scientific viewpoint.  Attempts to do so are likely to lead to scientifically unsound policy. Given that the current proposed “solution”–radically reducing CO2 emissions–would cost many tens of trillions of dollars, it is particularly incumbent on those advocating this very large expenditure (for which there are many other uses if it should actually become available) to show that their solution should not also be rejected since it is based on a hypothesis that should be rejected.

The UN reports issued to date do not show that the data used in these four important comparisons is incorrect, and therefore the reports should not be used as a basis for policy in my view. Reports substantially based on the UN reports, such as the draft EPA Endangerment Technical Support Document reviewed in my Comments, should also not be used for policy purposes for the same reason in my view.

Comments
13 Comments »
Categories
GHG hypothesis, Scientific method
Comments rss Comments rss
Trackback Trackback

Recent Posts

  • Warmists’ Meager Hopes for a Climate Bill in 2010 Dashed by Lack of Votes for Even Drastically Scaled Down Energy Bill
  • July 22 May Well Mark the End for Major U.S. Climate Legislation and Global “Climate Control”
  • Why Congress Should Reject Preferences for Particular Fuel Sources as Well as Cap and Trade/tax
  • First Congressional Test of EPA’s Endangerment Finding Expected June 10
  • EPA: The Administration’s High Risk but Pivotal Climate Gamble
  • Why Peer Review Is No Substitute for the Scientific Method
  • Phil Jones May Still Have Some More Reflecting To Do
  • Why the Whole AGW/Warmist Narrative Is Even Weaker than Its Components
  • How EPA Seeks to Unilaterally Impose GHG Emission Regulations Using UN “Science” Whether Anyone Likes It or Not
  • The Politicization of EPA: The Administration’s Radical Endangerment Gamble

Search

Archive

Recent Comments

  • Bill on Why Peer Review Is No Substitute for the Scientific Method
  • JumboShrimp on Warmists’ Meager Hopes for a Climate Bill in 2010 Dashed by Lack of Votes for Even Drastically Scaled Down Energy Bill
  • Carlin Economics and Science » Warmists’ Meager Hopes for a Climate Bill in 2010 Dashed by Lack of Votes for Even Drastically Scaled Down Energy Bill on First Congressional Test of EPA’s Endangerment Finding Expected June 10
rss Comments rss valid xhtml 1.1 design by jide powered by Wordpress get firefox