11.07.2015 Views

Connections between simulations and observation in climate ...

Connections between simulations and observation in climate ...

Connections between simulations and observation in climate ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252Contents lists available at ScienceDirectStudies <strong>in</strong> History <strong>and</strong> Philosophyof Modern Physicsjournal homepage: www.elsevier.com/locate/shpsb<strong>Connections</strong> <strong>between</strong> <strong>simulations</strong> <strong>and</strong> <strong>observation</strong> <strong>in</strong> <strong>climate</strong> computermodel<strong>in</strong>g. Scientist’s practices <strong>and</strong> ‘‘bottom-up epistemology’’ lessonsHélene GuillemotCentre Alex<strong>and</strong>re Koyré, EHESS—CNRS, Pavillon Chevreul, 57, rue Cuvier, 75005 Paris, Francearticle <strong>in</strong>foKeywords:Climate modelsModel<strong>in</strong>gComputer simulationObservation dataScientific practicesValidationEvaluationabstractClimate model<strong>in</strong>g is closely tied, through its <strong>in</strong>stitutions <strong>and</strong> practices, to <strong>observation</strong>s from satellites<strong>and</strong> to the field sciences. The validity, quality <strong>and</strong> scientific credibility of models are based on<strong>in</strong>teraction <strong>between</strong> models <strong>and</strong> <strong>observation</strong> data. In the case of numerical model<strong>in</strong>g of <strong>climate</strong> <strong>and</strong><strong>climate</strong> change, validation is not solely a scientific <strong>in</strong>terest: the legitimacy of computer model<strong>in</strong>g, as atool of knowledge, has been called <strong>in</strong>to question <strong>in</strong> order to deny the reality of any anthropogenic<strong>climate</strong> change; model validations thereby br<strong>in</strong>g political issues <strong>in</strong>to play as well. There is no systematicprotocol of validation: one never validates a model <strong>in</strong> general, but the capacity of a model to account fora def<strong>in</strong>ed climatic phenomenon or characteristic. From practices observed <strong>in</strong> the two research centersdevelop<strong>in</strong>g <strong>and</strong> us<strong>in</strong>g a <strong>climate</strong> model <strong>in</strong> France, this paper reviews different ways <strong>in</strong> which theresearchers establish l<strong>in</strong>ks <strong>between</strong> models <strong>and</strong> empirical data (which are not reduced to the lattervalidat<strong>in</strong>g the former) <strong>and</strong> conv<strong>in</strong>ce themselves that their models are valid. The analysis of validationpractices—relat<strong>in</strong>g to parametrization, modes of variability, climatic phenomena, etc.—allows us tohighlight some elements of the epistemology of model<strong>in</strong>g.& 2010 Elsevier Ltd. All rights reserved.When cit<strong>in</strong>g this paper, please use the full journal title Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics1. IntroductionAnthropogenic <strong>climate</strong> change has been studied <strong>in</strong> <strong>climate</strong>science laboratories over the past thirty years. Over the pasttwenty years, it has become the object of global expertise with thepublication of IPCC reports to which thous<strong>and</strong>s of scientists havecontributed. More recently, the issue of <strong>climate</strong> change hasclimbed to the top of the <strong>in</strong>ternational political <strong>and</strong> diplomaticagenda, lead<strong>in</strong>g to major evolutions <strong>in</strong> considerations of economy,geopolitical equilibrium, North–South relations, consumption <strong>and</strong>lifestyles. Even if the problem has become <strong>in</strong>creas<strong>in</strong>gly political,scientific expertise reta<strong>in</strong>s its central role. From the beg<strong>in</strong>n<strong>in</strong>g,<strong>climate</strong> change was a largely ‘‘science-driven’’ issue, mostlyresult<strong>in</strong>g from <strong>climate</strong> model<strong>in</strong>g <strong>and</strong> <strong>simulations</strong> of future <strong>climate</strong>change (Heymann, 2009).Consider<strong>in</strong>g the importance of these political <strong>and</strong> economicstakes, <strong>climate</strong> model<strong>in</strong>g has not given rise to much research <strong>in</strong>the social sciences. In particular, there are few studies of thevalidation <strong>and</strong> evaluation of models through comparison with<strong>observation</strong>al data, even though this is an essential doma<strong>in</strong> thatE-mail address: guillemot@damesme.cnrs.frendows models with their scientific character as well as with thecredence we lend to <strong>simulations</strong>. 1 Indeed <strong>climate</strong> scientists spendmuch of their time test<strong>in</strong>g their models, compar<strong>in</strong>g them tomeasurements of the real <strong>climate</strong>, <strong>and</strong> these evaluations constitute,<strong>in</strong> their op<strong>in</strong>ion, the pr<strong>in</strong>cipal guarantees of the skill ofmodels, of their scientific validity <strong>and</strong> of the reliability of future<strong>climate</strong> projections.This work is <strong>in</strong> large part based on a study carried out <strong>between</strong>2003 <strong>and</strong> 2006 <strong>in</strong> the two most important <strong>in</strong>stitutions thatdevelop <strong>and</strong> use <strong>climate</strong> models <strong>in</strong> France, the Laboratoire de1 I should def<strong>in</strong>e the terms model, simulation <strong>and</strong> numerical experiment as theyare used <strong>in</strong> this article, because these def<strong>in</strong>itions vary depend<strong>in</strong>g on the discipl<strong>in</strong>e,language, uses <strong>and</strong> authors. Here, I adopt the term<strong>in</strong>ology currently used by<strong>climate</strong> modelers. The word model (<strong>climate</strong> model, Global Circulation Model,meso-scale model, etc.) designates a program that is meant to run on a computer<strong>and</strong> carry out algorithms step by step. Simulation designates the results producedby a model’s output, i.e. the product of the calculations performed by thecomputer by means of that model <strong>in</strong> simulat<strong>in</strong>g a particular climatic configurationthat is provided as <strong>in</strong>put (for example, the simulation of the <strong>climate</strong> <strong>in</strong> the 20thcentury with such <strong>in</strong>crease of CO 2 levels with the Météo-France’s model, orsimulation of the last glacial maximum. . .). A numerical experiment is a simulationwith the objective of virtually explor<strong>in</strong>g the <strong>climate</strong>’s behavior by vary<strong>in</strong>gparameters or representation of phenomena.1355-2198/$ - see front matter & 2010 Elsevier Ltd. All rights reserved.doi:10.1016/j.shpsb.2010.07.003


H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252 243Météorologie Dynamique (LMD) of the CNRS, <strong>in</strong> Paris, <strong>and</strong> theCentre de Recherche de Météo-France (the French organism forweather forecast) <strong>in</strong> Toulouse. This study primarily relied on twotypes of sources: <strong>in</strong>ternal laboratory records (activity reports,plann<strong>in</strong>g reports, <strong>in</strong>ternal journals, Web sites, colloquia, workshopreports, etc.) <strong>and</strong> extensive <strong>in</strong>terviews with scientists. InSection 2 of this article, I draw a brief review of studies oncomputer model<strong>in</strong>g <strong>and</strong> <strong>climate</strong> models, <strong>and</strong> try to frame the roleof <strong>observation</strong> <strong>in</strong> validation of <strong>climate</strong> models. In Section 3, after aquick survey of the <strong>observation</strong>al data used <strong>in</strong> <strong>climate</strong> science,<strong>and</strong> an <strong>in</strong>sight of the fundamental difficulties that faces validationof <strong>climate</strong> models, I seek to describe <strong>and</strong> analyze what sorts ofrelationships modelers establish <strong>between</strong> data <strong>and</strong> model <strong>simulations</strong>,based on observ<strong>in</strong>g actual scientific practices throughseveral examples: top-down validation, local evaluation ofparametrization aga<strong>in</strong>st field experiments, validation of climaticeffects of a small scale processes, evaluation of a model’s capacityto simulate particular phenomena. . . In Section 4, I attempt toderive a few epistemological lessons on <strong>climate</strong> model<strong>in</strong>g <strong>and</strong>what dist<strong>in</strong>guishes it from more traditional theoretico-experimentalsciences <strong>in</strong> regards to their relationship to data.2. Studies on numerical models, <strong>climate</strong> model<strong>in</strong>g <strong>and</strong><strong>observation</strong>, a brief review2.1. Models <strong>between</strong> theory application <strong>and</strong> the creation ofknowledgeComputer model<strong>in</strong>g, which emerged after World War II, hass<strong>in</strong>ce the 1970s <strong>and</strong> 1980s permeated nearly all sectors of science,technology, <strong>in</strong>dustry <strong>and</strong> economy. Yet, it was only recently that itstarted elicit<strong>in</strong>g any notable research activity <strong>in</strong> philosophy,history of science or science <strong>and</strong> technology studies (STS). For along time, discourse on models privileged a ‘‘semantic’’ approachthat focused on theories <strong>and</strong> accord<strong>in</strong>g to which a model is first<strong>and</strong> foremost a representation that gives mean<strong>in</strong>g to a mathematicalformalism. Over the past few years, however, there hasbeen a renewed reflection on models. The ‘‘cult of theory’’ hasbeen criticized by authors who assert models’ superiority overtheories as representations of the world (Cartwright, 1983, 1999;Sismondo, 1999). Accord<strong>in</strong>g to Morgan <strong>and</strong> Morrison (1999),models consist of elements other than just theories <strong>and</strong> data, <strong>and</strong>‘‘it is precisely because the models are partially <strong>in</strong>dependent ofboth theories <strong>and</strong> the world that they have this autonomouscomponent <strong>and</strong> so can be used as <strong>in</strong>struments of exploration <strong>in</strong>both doma<strong>in</strong>s’’. As autonomous agents, models can therebybecome active ‘‘mediators’’ <strong>between</strong> theories <strong>and</strong> the world, <strong>and</strong>may have more to teach us than theory does on its own. Ow<strong>in</strong>g tothis mediat<strong>in</strong>g function, the model<strong>in</strong>g of complex physicalsystems—systems that are poorly understood even when theoriesof underly<strong>in</strong>g processes exist—cannot be reduced to calculationsthat apply known laws: ‘‘The computer <strong>simulations</strong> (. . .) <strong>in</strong>volvesa complex cha<strong>in</strong> of <strong>in</strong>ferences that serve to transform theoreticalstructures <strong>in</strong>to specific concrete knowledge of physical system.(. . .) This process of transformation is also a process of knowledgecreation, <strong>and</strong> it has its own unique epistemology’’ (W<strong>in</strong>sberg,1999, p. 275).Nevertheless, the cognitive approach to models <strong>in</strong> undoubtedly<strong>in</strong>sufficient. The computer’s massive <strong>in</strong>fluence, the emergenceof new scientific objects, model<strong>in</strong>g practices that are more<strong>and</strong> more heterogeneous, as well as their <strong>in</strong>creas<strong>in</strong>g use <strong>in</strong>establish<strong>in</strong>g expertise, makes ‘‘study<strong>in</strong>g the activity of model<strong>in</strong>g<strong>in</strong> its <strong>in</strong>stitutional, technical <strong>and</strong> political environment, <strong>and</strong>without dissociat<strong>in</strong>g cognitive <strong>and</strong> social elements’’ (Armatte &Dahan, 2004, p. 245) all the more necessary. Accord<strong>in</strong>g toKnuuttila et al. (2006), a convergence is already discernible<strong>between</strong> philosophers (up to this po<strong>in</strong>t focused on theories) <strong>and</strong>researchers <strong>in</strong> science studies (traditionally oriented towards thelaboratory), who are shar<strong>in</strong>g <strong>in</strong>terest <strong>in</strong> the role of model<strong>in</strong>g <strong>and</strong>simulation <strong>in</strong> scientific practices.2.2. What is at stake <strong>in</strong> study<strong>in</strong>g <strong>climate</strong> modelsUntil very recently, <strong>climate</strong> model<strong>in</strong>g attracted few epistemologists,<strong>in</strong> part because it seems to fall under application, not underfundamental physics, br<strong>in</strong>g<strong>in</strong>g <strong>in</strong>to play established physicstheories <strong>and</strong> loosely formalized heterogeneous elements. Moreover,it is embedded <strong>in</strong> expertise <strong>and</strong> embroiled <strong>in</strong> major politicalstakes. One would th<strong>in</strong>k that the latter characteristics would elicitthe <strong>in</strong>terest of the social sciences. This has been the case, but to alimited extent: the sociopolitical stakes <strong>in</strong>herent <strong>in</strong> <strong>climate</strong>models seem to have a contradictory <strong>in</strong>fluence <strong>in</strong> this regard.In the context of <strong>climate</strong> change debates, models are oftenbrought center-stage <strong>and</strong> placed <strong>in</strong>to question—how can theypurport to predict the future of <strong>climate</strong>? Political controversiesare frequently transposed to the scientific, <strong>and</strong> even epistemological,field: <strong>climate</strong> change skeptics shed doubt not only onprojections but on the models themselves <strong>and</strong> seek to ‘‘stigmatizemodel<strong>in</strong>g as <strong>in</strong>ferior science on philosophical grounds’’ (Norton &Suppe, 2001, p. 67). Much of the time, such polemics focus on therelationship <strong>between</strong> models <strong>and</strong> <strong>observation</strong>al data (Edwards,1999). Computer models are contrasted with ‘‘sounds science’’,found on data <strong>and</strong> solid theories, <strong>and</strong> the possibility of verify<strong>in</strong>gmodels’ projections aga<strong>in</strong>st data is questioned (Oreskes et al.,1994). In response to these criticisms, Paul Edwards has shownthat if models <strong>and</strong> data are effectively <strong>in</strong> a relationship of<strong>in</strong>terdependence—models be<strong>in</strong>g ‘‘data-laden’’ <strong>and</strong> data ‘‘modelfiltered’’—thisrelationship is not circular, but symbiotic, eachga<strong>in</strong><strong>in</strong>g advantage from the other. In a detailed analysis, Norton &Suppe (2001) ma<strong>in</strong>ta<strong>in</strong> that <strong>in</strong>terdependence exists <strong>between</strong>theories <strong>and</strong> experiments as well, <strong>and</strong> that the absence ofcerta<strong>in</strong>ty, simplify<strong>in</strong>g hypotheses, etc. are not the prerogative ofmodels, nor do they constitute def<strong>in</strong>itive obstacles to knowledge.These authors conclude that models may be trusted for the samereasons <strong>and</strong> to the same extent that traditional experiments areendowed with credibility or trusted.If, despite these debates, <strong>climate</strong> model<strong>in</strong>g as a new mode ofproduction of knowledge has attracted a small number of studies(comparatively to the economic or political side of the problem), itcould be that the political role of these models makes their studymore delicate, possibly risky. The research conducted <strong>in</strong> thisdoma<strong>in</strong> has shown how the representation of uncerta<strong>in</strong>ty(Shackley & Wynne, 1996), the estimate of <strong>climate</strong> sensitivity(Van der Sluijs et al., 1998), <strong>and</strong> recourse to flux adjustments(Shackley et al., 1999) all result <strong>in</strong> negotiations or <strong>in</strong> scientiststak<strong>in</strong>g <strong>in</strong>to account the expectations of policy makers. This has attimes placed researchers <strong>in</strong> an uncomfortable position: emphasiz<strong>in</strong>gthe co-construction <strong>between</strong> science <strong>and</strong> politics risksbe<strong>in</strong>g co-opted by a critique of the objectivity of <strong>climate</strong> science<strong>and</strong> the validity of its results. Even when it comes to ‘‘defend<strong>in</strong>gthe <strong>in</strong>determ<strong>in</strong>ate character of the <strong>climate</strong> sciences’’ (Shackleyet al., 1999, p. 35), any reference to uncerta<strong>in</strong>ty or ambiguity canbe turned <strong>in</strong>to a weapon <strong>in</strong> the h<strong>and</strong>s of critics of the fight aga<strong>in</strong>stglobal warm<strong>in</strong>g (Edwards, 1996). Forsyth (2003, p. xiii) analyzedit well when he wrote: ‘‘these are controversial times for writ<strong>in</strong>gabout environmental science <strong>and</strong> politics’’. The political stakescan lead to clos<strong>in</strong>g black boxes more so than to analyz<strong>in</strong>g theircontent; to prematurely transform<strong>in</strong>g ‘‘matters of concern’’ <strong>in</strong>to‘‘matters of fact’’ (Latour, 2004).


H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252 245synergy <strong>between</strong> the various scientific tools used <strong>in</strong> the study ofthe atmosphere: theory, model<strong>in</strong>g, <strong>observation</strong>, <strong>and</strong> <strong>in</strong>strumentation.In other laboratories that participate <strong>in</strong> the development of aGCM together with LMD (<strong>and</strong> that studied other components ofthe <strong>climate</strong> such as the ocean, the biosphere, etc.), the experimentalor <strong>in</strong>strumental dimension is as important as model<strong>in</strong>g<strong>and</strong> precedes it. The same can be said for Météo-France. All theselaboratories have strong <strong>and</strong> autonomous identities, focused onan object of research tackled us<strong>in</strong>g several tools. Traditionally,their scientists were often more <strong>in</strong>terested <strong>in</strong> underst<strong>and</strong><strong>in</strong>g<strong>climate</strong> (or ocean. . .) mechanism <strong>and</strong> develop<strong>in</strong>g parametrizationclose to the physics of the process than <strong>in</strong> build<strong>in</strong>g coupled globalmodels (Dahan Dalmedico & Guillemot, 2008). Modelers attachimportance to l<strong>in</strong>ks <strong>between</strong> <strong>observation</strong> <strong>and</strong> modelisation, <strong>and</strong>try to develop these relationships—even if they constituted adist<strong>in</strong>ct community, separated from communities conduct<strong>in</strong>g<strong>observation</strong>, <strong>and</strong> if communication difficulties exist <strong>between</strong> thetwo. That culture of <strong>observation</strong> constitutes a shared value amongFrench laboratories <strong>in</strong> this doma<strong>in</strong>. 33.2. Corrected, homogenized, <strong>and</strong> reanalyzed <strong>observation</strong>al dataWhat are the <strong>observation</strong>al data with which <strong>simulations</strong> areconfronted? Three categories can be dist<strong>in</strong>guished: data from vastnetworks of meteorological stations, on l<strong>and</strong>, <strong>and</strong> across theoceans; data provided by <strong>in</strong>struments on satellites (meteorological,oceanographic, or scientific satellites), <strong>and</strong> f<strong>in</strong>ally, datacollected dur<strong>in</strong>g field experiments focused on a specific region,phenomenon, <strong>and</strong> time period. Dozens of field campaigns havebeen organized s<strong>in</strong>ce the 1970s, requir<strong>in</strong>g massive human <strong>and</strong>technical <strong>in</strong>vestments (airplanes, ships, balloons), <strong>and</strong> br<strong>in</strong>g<strong>in</strong>gtogether numerous organizations (from meteorology, but alsotransportation, defense, forestry, . . .).It is important to <strong>in</strong>sist on one essential characteristic of thesedata—where they come from: they have been heavily reconstructed(Edwards, 1999). In the case of the <strong>climate</strong> sciences, ‘‘rawdata’’ are not usable. What a satellite <strong>in</strong>strument is measur<strong>in</strong>g isvery much removed from the physical parameters which areneeded by meteorologists or <strong>climate</strong> scientists: for example, <strong>in</strong>order to obta<strong>in</strong> the surface temperature of a po<strong>in</strong>t on the Earth’ssurface from a signal captured by a meteorological satellite, nofewer than three <strong>in</strong>termediate models are necessary that comb<strong>in</strong>e<strong>in</strong>itial data with numerous other factors (K<strong>and</strong>el, 2002). Informationcom<strong>in</strong>g from surface stations are not as <strong>in</strong>direct, but they aremore heterogeneous <strong>and</strong> scattered, <strong>and</strong> therefore always have tobe completed <strong>and</strong> harmonized with the aid of computer models.On the other h<strong>and</strong>, obta<strong>in</strong><strong>in</strong>g broad <strong>and</strong> homogenous data seriesover many decades (which is <strong>in</strong>dispensable for detect<strong>in</strong>gsignatures of <strong>climate</strong> change), dem<strong>and</strong> important reconstructionefforts: data must be corrected <strong>and</strong> re-calibrated to take <strong>in</strong>toaccount changes <strong>in</strong> measur<strong>in</strong>g technique or detectors. Météo-France developed a program that could locate the ‘‘ruptures <strong>in</strong>homogeneity’’ <strong>in</strong> measurements it had collected over a century(these ruptures were largely due to modifications <strong>in</strong> the<strong>in</strong>strument’s surround<strong>in</strong>gs). This allowed Météo-France to reconstructa homogenous evolution of <strong>climate</strong> <strong>in</strong> France throughoutthe 20th century (Moissel<strong>in</strong> et al., 2002).F<strong>in</strong>ally, an <strong>in</strong>creas<strong>in</strong>gly common type of data is the ‘‘reanalysisdata sets’’, which takes the <strong>in</strong>terdependence <strong>between</strong> models <strong>and</strong>3 We do not f<strong>in</strong>d <strong>in</strong> our study the dist<strong>in</strong>ction observed by Sundberg (2007)<strong>between</strong> experimenters’ <strong>and</strong> modelers’ aims. On the one h<strong>and</strong>, we have notstudied the community of researchers work<strong>in</strong>g on <strong>observation</strong>s—only thecommunity of modelers. On the other h<strong>and</strong>, the French modeler’s objective is(at least) as much to improve the underst<strong>and</strong><strong>in</strong>g of climatic processes as tocreat<strong>in</strong>g representations of processes that can be implemented <strong>in</strong> models.data even further. These are series of meteorological data from thepast entirely reprocessed <strong>and</strong> completed with a <strong>climate</strong> modelthrough a procedure <strong>in</strong>spired by the ‘‘variational assimilation’’technique, which is rout<strong>in</strong>ely used <strong>in</strong> weather forecast <strong>in</strong> order to<strong>in</strong>troduce <strong>observation</strong>al data <strong>in</strong> near real-time <strong>in</strong>to projectionmodels—<strong>in</strong> other words, a k<strong>in</strong>d of dynamic <strong>in</strong>terpolation of past<strong>observation</strong>s <strong>in</strong> a model. Thus reanalyzed data fill <strong>in</strong> the gaps <strong>and</strong>correct the shortcom<strong>in</strong>gs of <strong>observation</strong>s: the data becomecomplete, homogenous, <strong>and</strong> coherent. Veritable hybrids of<strong>observation</strong> <strong>and</strong> model<strong>in</strong>g, these reanalyses add new uncerta<strong>in</strong>tiesthat are l<strong>in</strong>ked to the shortcom<strong>in</strong>gs of the <strong>in</strong>itial data, to theuncerta<strong>in</strong>ties of the model, <strong>and</strong> most of all, to the sparsity of<strong>observation</strong>s that are artificially filled <strong>in</strong> by model<strong>in</strong>g (Bengtssonet al., 2004). 4 When us<strong>in</strong>g them to validate models, modelers tryto take <strong>in</strong>to account these uncerta<strong>in</strong>ties by, for example, lend<strong>in</strong>gless credence to the reanalysis of past periods than they grant tothose of more recent periods (<strong>in</strong>terview with A, Météo-France,January 2004).3.3. Fundamental difficulties <strong>in</strong> the validation of modelsBefore turn<strong>in</strong>g to validation practices, let us quickly describe<strong>climate</strong> models. A numerical <strong>climate</strong> model (like a weatherforecast model) is a Global Circulation Model (GCM): it seeks tosimulate atmospheric circulation, represented by a three-dimensionalgrid, over the course of time. With<strong>in</strong> each grid cell <strong>and</strong> foreach time step, the computer calculates the parameters that arecharacteristic of the atmosphere’s state from their values <strong>in</strong> thepreced<strong>in</strong>g time step by runn<strong>in</strong>g the algorithms that constitute themodel. The model is composed of two large parts: a part thatdescribes the movement of air masses, whose algorithms arederived from fluid dynamics equations; modelers call this thedynamic part. The other part, the so-called physics part, calculatesthe forc<strong>in</strong>g of atmospheric circulation; it deals with verticalexchanges <strong>between</strong> atmosphere <strong>and</strong> outer space or with theEarth’s surface 5 (the ocean, cont<strong>in</strong>ental l<strong>and</strong> mass, or ice). Theseexchanges—of radiation, energy, water, etc.—occur at a muchsmaller scale than that of the model (which is on the order ofseveral hundred kilometers) <strong>and</strong> they are represented by ‘‘parameterizations’’that statistically reproduce, at the scale of a gridcell, the climatic effects of the phenomena under consideration.The parameterizations, veritable smaller models nested with<strong>in</strong>the ma<strong>in</strong> model, are extremely diverse; certa<strong>in</strong> more or lessdirectly arise from physical theories (when it comes to radiation,for <strong>in</strong>stance, the parameterizations synthesize quantum physicscalculations), others are more empirical or phenomenologicalrepresentations (vegetation ecosystems, for example) (Guillemot,2007; Sundberg, 2007).Meteorological models <strong>and</strong> <strong>climate</strong> models are thereforerather similar. However, they are used differently. In everydayforecasts, the atmosphere’s future state is calculated <strong>in</strong> a4 The reanalysis can be classified depend<strong>in</strong>g on the relative <strong>in</strong>fluence of the<strong>observation</strong>al data <strong>and</strong> the model :‘‘An A <strong>in</strong>dicates that the analysis variable isstrongly <strong>in</strong>fluenced by observed data, <strong>and</strong> hence it is <strong>in</strong> the most reliable class (e.g.,upper air temperature <strong>and</strong> w<strong>in</strong>d). The designation B <strong>in</strong>dicates that, although thereare <strong>observation</strong>al data that directly affect the value of the variable, the model alsohas a very strong <strong>in</strong>fluence on the analysis value (e.g., humidity, <strong>and</strong> surfacetemperature). The letter C <strong>in</strong>dicates that there are no <strong>observation</strong>s directlyaffect<strong>in</strong>g the variable, so that it is derived solely from the model fields forced bythe data assimilation to rema<strong>in</strong> close to the atmosphere (e.g., clouds, precipitation,<strong>and</strong> surface fluxes). ‘‘(Kalnay et al., 1996).5 Calculations of dynamic part are carried out on the three-dimensional grid,whereas physics part may be seen as a juxtaposition of air columns that do not<strong>in</strong>teract. Dynamic <strong>and</strong> physics parts deal with different k<strong>in</strong>ds of variables, <strong>and</strong>have different time steps (the time step of the physics part be<strong>in</strong>g larger). Cf. LMD(2005).


246H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252determ<strong>in</strong>istic fashion, start<strong>in</strong>g from its state as measured a fewdays or hours earlier. 6 For longer ranges of a few weeks, theatmosphere’s dynamic is chaotic, <strong>and</strong> only statistical propertiesare predicted. 7 Weather is not predicted for November 30, 2077;<strong>in</strong>stead, averages (or variabilities) are provided for temperature,precipitation, etc., for the period <strong>between</strong> 2070 <strong>and</strong> 2100. Thisbr<strong>in</strong>gs us to the first difficulty of evaluat<strong>in</strong>g <strong>climate</strong> models. Formeteorological models, validation seems rather simple, at least <strong>in</strong>pr<strong>in</strong>ciple: forecasts can be compared the very next day to thecharacteristics of actual weather. In <strong>climate</strong> model<strong>in</strong>g, however,the <strong>simulations</strong> only have a statistical value, <strong>and</strong> the comparisoncan only be based on data series for present or past <strong>climate</strong>.Validat<strong>in</strong>g projections of future <strong>climate</strong> is even more difficult <strong>and</strong><strong>in</strong>direct (I will return to this later).The evaluation of <strong>climate</strong> models faces another fundamentaldifficulty: the entanglement of <strong>climate</strong> processes <strong>in</strong> the modelmakes validat<strong>in</strong>g the representation of a particular phenomenonextremely delicate. When model<strong>in</strong>g first began, the manageabilityof models gave rise to certa<strong>in</strong> illusions about their capacity toexpla<strong>in</strong> the <strong>climate</strong>’s mechanisms. Joseph Smagor<strong>in</strong>sky, the‘‘father’’ of the first GCM, wrote that ‘‘The ma<strong>in</strong> advantage <strong>in</strong>diagnos<strong>in</strong>g model <strong>simulations</strong> is that we know a great deal aboutthe mathematical distortions we have <strong>in</strong>troduced, <strong>and</strong> right orwrong, we have all the variables def<strong>in</strong>ed everywhere <strong>and</strong> all of thetime’’ (cited <strong>in</strong> Nebecker, 1995, p. 178). Jule Charney, anotherimportant pioneer of <strong>climate</strong> model<strong>in</strong>g who founded <strong>and</strong> directedthe American Numerical Meteorology Project <strong>in</strong> 1948, noted withoptimism: ‘‘When a computer simulation successfully synthesizesa number of theoretically predicted phenomena <strong>and</strong> is <strong>in</strong> accordwith reality, it validates both itself <strong>and</strong> the theories’’ (cited <strong>in</strong>Nebecker, 1995, p. 180).However, as models became more complex, it was necessary toobserve that Charney’s statement could backfire: the apparentvalidation of a model through <strong>observation</strong> could result from thecomb<strong>in</strong>ation of a false hypothesis <strong>and</strong> a faulty representation <strong>in</strong>the model, which together give a good <strong>climate</strong> simulation due towhat modelers call ‘‘error compensation’’. A simulation couldthereby appear ‘‘correct but for the wrong reason’’. Modelvalidation proved to be more delicate than theory validation:theories are also under-determ<strong>in</strong>ed by experiments, <strong>in</strong> accordancewith Duhem’s thesis, but the difficulty is pushed to a higherdegree <strong>in</strong> models, which br<strong>in</strong>g <strong>in</strong>to <strong>in</strong>teraction numerous<strong>in</strong>tricated hypothesis <strong>and</strong> representations of processes.As models <strong>in</strong>corporated a grow<strong>in</strong>g number of elements <strong>and</strong>processes, scientists were confronted with the difficulty of<strong>in</strong>terpret<strong>in</strong>g their <strong>simulations</strong>, of attribut<strong>in</strong>g a cause to aphenomenon <strong>and</strong> underst<strong>and</strong><strong>in</strong>g multiple feedbacks. The largenumber of <strong>in</strong>teract<strong>in</strong>g mechanisms, which constitutes thespecificity of models <strong>and</strong> makes numerical <strong>simulations</strong> <strong>and</strong>experiments possible, is also what makes their validationparticularly arduous (Lenhard & W<strong>in</strong>sberg, this issue). 8 More<strong>and</strong> more, the researchers’ work came to consist of underst<strong>and</strong><strong>in</strong>gwhat happens <strong>in</strong> their model, which parameter <strong>in</strong>fluences such<strong>and</strong> such result <strong>and</strong> how. The model itself, ‘‘almost as difficult tounderst<strong>and</strong> as the real <strong>climate</strong>’’, became an object of study.‘‘Climate model<strong>in</strong>g means work<strong>in</strong>g on what comes <strong>in</strong>to the model6 Nowdays, meteorological agencies also predict the weather 4–10 days <strong>in</strong>advance based on probabilistic ‘‘ensemble’’ forecasts.7 These differences <strong>in</strong> scale can <strong>in</strong>troduce certa<strong>in</strong> differences <strong>between</strong> weatherforecast models <strong>and</strong> <strong>climate</strong> models. For example, ocean currents or polar icedynamics are represented <strong>in</strong> <strong>climate</strong> models, but not necessarily <strong>in</strong> meteorologicalmodels. Reciprocally, local details are important for weather forecast<strong>in</strong>g, but notfor <strong>climate</strong> model<strong>in</strong>g.8 Lenhard & W<strong>in</strong>sberg (this issue) develop a similar analysis of what they call‘‘confirmation hollism’’ caused by the ‘‘entranchment’’ of <strong>climate</strong> models, whichmakes them ‘‘analytically impenetrable’’.<strong>and</strong> what comes out of it, it means underst<strong>and</strong><strong>in</strong>g what there is <strong>in</strong>the model, how it reacts, what are its characteristics’’ expla<strong>in</strong>s aresearcher at the LMD (<strong>in</strong>terview with B, LMD, July 2003).3.4. Evaluation on all scalesModelers tend to distrust the term ‘‘validation’’ <strong>and</strong> prefer touse expressions like ‘‘evaluation’’—the norm <strong>in</strong> IPCC reports(R<strong>and</strong>all et al., 2007). The concept of validation was criticized <strong>in</strong> aScience article (Oreskes et al., 1994) that ma<strong>in</strong>ta<strong>in</strong>ed thatnumerical <strong>climate</strong> models could be neither verified nor validated<strong>in</strong> a rigorous fashion, but could only be confirmed under certa<strong>in</strong>conditions. The article gave rise to many debates, <strong>and</strong> modelers,prompted to a modesty of sorts, declared more humbly that it wasa question of ‘‘evaluat<strong>in</strong>g the model’s performance’’ or of show<strong>in</strong>gthat a model is ‘‘sufficiently good to be useful’’.Beyond these nuances, the first essential po<strong>in</strong>t is that a modelis not evaluated <strong>in</strong> general. What is evaluated is its capacity toaccount for a particular climatic characteristic or a def<strong>in</strong>edphenomenon. Evaluations are performed at all temporal <strong>and</strong>spatial scales <strong>and</strong> at all levels of the model: they might concerncharacteristics of average global <strong>climate</strong>, a geographically limitedphenomenon, the model’s capacity to represent a specific feedback,etc. The type of validation depends on how the model isused: a model might be appropriate for medium-term <strong>simulations</strong>(for the study of <strong>in</strong>terannual variability, for <strong>in</strong>stance), but not for<strong>simulations</strong> spann<strong>in</strong>g one hundred years. Consequently, there isno systematic protocol for evaluat<strong>in</strong>g models. An evaluationsupposes a prelim<strong>in</strong>ary question, the def<strong>in</strong>ition of a problem forwhich an appropriate procedure for confront<strong>in</strong>g models <strong>and</strong> datamust be imag<strong>in</strong>ed. ‘‘It requires astuteness <strong>and</strong> creativity more sothan respect for a method’’, summarizes a LMD researcher(<strong>in</strong>terview with C, LMD, July 2003). Modelers must know howto make use of everyth<strong>in</strong>g at their disposal <strong>in</strong> order to ‘‘constra<strong>in</strong>the system’’ (<strong>in</strong>terview with D, Météo-France, January 2004). Forexample, the eruption of Mount P<strong>in</strong>atubo <strong>in</strong> 1991, presentedresearchers with a unique opportunity to validate the representationof aerosols <strong>in</strong> models.Despite the plurality of evaluations, two greater types ofapproaches are dist<strong>in</strong>guishable, one ‘‘top-down’’ <strong>and</strong> one ‘‘bottomup.’’ Top-down validations consist of compar<strong>in</strong>g <strong>simulations</strong> toglobal data series. This is an older type of validation: models were<strong>in</strong>itially validated <strong>in</strong> relation to average <strong>climate</strong>, by compar<strong>in</strong>g amap of the simulated <strong>climate</strong> with a map of climatic averagesbased on <strong>observation</strong>al data, <strong>in</strong> order to see if the model correctlyreproduced large climatic characteristics (temperature, w<strong>in</strong>d,ma<strong>in</strong> phenomena). Subsequently, it was also necessary to validatethe <strong>climate</strong>’s variability: seasonal cycles, <strong>in</strong>terannual <strong>and</strong> decennialvariability, monsoons, extreme event frequency, El N<strong>in</strong>o. . .Model evaluation concerned itself with larger <strong>and</strong> larger variabilitydoma<strong>in</strong>s. In this way, Météo-France studies the capacity ofits model Arpege to reproduce the variability spectrum ofprecipitation, <strong>in</strong>clud<strong>in</strong>g extreme precipitation, by study<strong>in</strong>g thedistribution of ra<strong>in</strong> <strong>in</strong>tensity down to the daily scale.S<strong>in</strong>ce the 1990s, another k<strong>in</strong>d of validation (bottom-upvalidation) has been used for test<strong>in</strong>g parameters aga<strong>in</strong>st fieldexperiments. The procedure consists of study<strong>in</strong>g a <strong>climate</strong>phenomenon <strong>in</strong> those geographic locations where it is predom<strong>in</strong>ant(for example, the monsoon <strong>in</strong> India, or w<strong>in</strong>ter storms <strong>in</strong> theNorth Atlantic) <strong>and</strong> us<strong>in</strong>g this case study to test the manner <strong>in</strong>which this phenomenon is represented (or ‘‘parametrized’’) <strong>in</strong> themodel (Chaboureau & Bechtold, 2002). This methodology hasbeen used to test many parametrizations through numerous fieldexperiments—for example parametrizations of clouds <strong>in</strong> severalGCM <strong>in</strong> Europe have been tested with<strong>in</strong> the framework of


H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252 247program EUCREM <strong>and</strong> EUROCS. 9 The procedure can be decomposed<strong>in</strong>to three steps, with<strong>in</strong> which <strong>in</strong>tervene no less than threedifferent models. The first step consists of carry<strong>in</strong>g out ameasurement campaign with<strong>in</strong> a zone that is monitored by<strong>observation</strong> stations. Then—this is the second step—a meso-scalemodel, also called ‘‘cloud resolv<strong>in</strong>g model’’ (with grid cellsmeasur<strong>in</strong>g a few kilometers) is used to simulate weatherevolution <strong>in</strong> this zone dur<strong>in</strong>g the time period under consideration:meso-scale specialists enter <strong>in</strong>to their models parameters measuredat the beg<strong>in</strong>n<strong>in</strong>g of this period, <strong>and</strong> def<strong>in</strong>e limit conditions,so that the simulated <strong>climate</strong> resembles the <strong>climate</strong> observeddur<strong>in</strong>g the campaign. In this way, the meso-scale model isvalidated by <strong>observation</strong>s <strong>in</strong> a detailed fashion. F<strong>in</strong>ally, <strong>climate</strong>modelers test the studied parametrization <strong>in</strong> a simplified, onedimensionalversion of the model. This so-called ‘‘column’’ modelconsists of a s<strong>in</strong>gle horizontal grid cell with all of the verticallayers superimposed; it conta<strong>in</strong>s all of the ‘‘physics part’’ of a GCMbut no dynamics, so, it is far less difficult to use. This onedimensionalmodel is provided <strong>in</strong> <strong>in</strong>put with the external <strong>climate</strong>data from the meso-scale model, then it runs <strong>and</strong> its simulation iscompared to that produced by the meso-model, which permitsmodelers to validate its parametrization, <strong>and</strong> eventually, toameliorate it (<strong>in</strong>terview with B <strong>and</strong> E, LMD, July 2003 <strong>and</strong> July2005).To summarize: modelers compare the <strong>climate</strong> simulated by aone-dimensional model equipped with the parametrization to betested, to a <strong>climate</strong> simulated by the meso-model that is validatedby <strong>observation</strong>. In this sophisticated methodology, the meso-scalemodel plays the <strong>in</strong>termediary <strong>between</strong> the data <strong>and</strong> the largescalemodel, by provid<strong>in</strong>g this large-scale model with a completeset of ‘‘predigested’’ data reconstituted from <strong>observation</strong>s. Suchstudies of parametrization through field experiments have multipliedover the past fifteen years or so due to the availability ofoperational meso-scale models (such as the Méso-NH modeldeveloped by Météo-France).In follow<strong>in</strong>g these steps, what rema<strong>in</strong>s to be done is theimplantation of the new (or ameliorated) parameterization <strong>in</strong>the GCM, <strong>and</strong> it is here that the real difficulties beg<strong>in</strong> (joke themodelers), s<strong>in</strong>ce one <strong>in</strong>variably obta<strong>in</strong>s a simulated <strong>climate</strong> that iscatastrophic! This has to do with the error compensationmentioned above: even though the preced<strong>in</strong>g model wasequipped with a parameterization that is farther from thephysical mechanism, the model’s errors <strong>and</strong> approximationscompensated each other <strong>in</strong> order to engender an accurate <strong>climate</strong>.The parameterizations <strong>in</strong> a model constitute ‘‘a family’’ (<strong>in</strong>terviewwith A, Météo France, January 2004), <strong>and</strong> the implantation of anew parameterizations requires much research, test<strong>in</strong>g, <strong>and</strong>control.3.5. Evaluat<strong>in</strong>g long-term feedback <strong>between</strong> clouds <strong>and</strong> radiationNevertheless, validation cannot be reduced to global evaluationof a model by compar<strong>in</strong>g it to global databases on the oneh<strong>and</strong>, <strong>and</strong> validation of parameterizations by local case studies onthe other. In particular, one must evaluate the so-called ‘‘climaticeffects’’ of some parametrizations. Small-scale processes representedby parameterizations have consequences that cannot beperceived dur<strong>in</strong>g field study, but that become apparent <strong>in</strong> thelong-term <strong>and</strong> over longer distances. These climatic effects alsomust be reproduced through parameterization. One of the mostimportant be<strong>in</strong>g the feedback <strong>between</strong> clouds <strong>and</strong> radiation.Clouds are the most <strong>in</strong>fluential element of <strong>climate</strong>, <strong>and</strong> their9 See EUROCS website: http://www.cnrm.meteo.fr/gcss/EUROCS/EUROCS.html.effects are particularly complex <strong>and</strong> difficult to model, speciallytheir <strong>in</strong>teraction with radiations—which they can reflect orabsorb depend<strong>in</strong>g on the wavelength, type of clouds, <strong>and</strong> otherparameters. While cloud formation, convections or precipitationscan be studied through local campaigns, the <strong>in</strong>teraction <strong>between</strong>clouds <strong>and</strong> radiation are not proximately observable (<strong>in</strong>terviewwith A, Météo-France, January 2004).It was the global warm<strong>in</strong>g issue that made necessary the studyof the long-term impacts of these parameterizations. Indeed,climatic changes are noth<strong>in</strong>g other than distant <strong>and</strong> large-scaleconsequences of a small scale warm<strong>in</strong>g, provoked by an <strong>in</strong>crease<strong>in</strong> green-house gas concentration. This warm<strong>in</strong>g provokes adisequilibrium <strong>in</strong> the atmosphere’s lower layers that <strong>in</strong>teractswith numerous small-scale mechanisms, which are representedby parameterizations: turbulence, cloud microphysics, etc.(Le Treut, 1999). A number of studies have established thatdifferent cloud representations are primarily responsible for theuncerta<strong>in</strong>ty of models as well as for differences <strong>between</strong> differentmodel’s projections of <strong>climate</strong> change. It is therefore crucial tounderst<strong>and</strong> how cloud-radiation feedback evolves with <strong>climate</strong>change, <strong>and</strong> to evaluate if models correctly reproduce thisevolution. Because they cannot observe future <strong>climate</strong>, <strong>climate</strong>scientists have to settle with explor<strong>in</strong>g the correlations <strong>between</strong>climatic variables with <strong>in</strong>crease <strong>in</strong> temperature. However, theyface an additional difficulty: temperature <strong>in</strong>crease pr<strong>in</strong>cipallyaffects atmospheric dynamics, which favors certa<strong>in</strong> types ofclouds. This first-order effect masks the impact of temperature<strong>in</strong>creases on cloud microphysics <strong>and</strong> on convection heights—<strong>in</strong>short, on the physical evolutions of clouds which have important,long-term climatic impacts because they affect cloud–radiation<strong>in</strong>teraction (<strong>in</strong>terview with F, LMD, July 2003).A key po<strong>in</strong>t <strong>in</strong> model<strong>in</strong>g is to wisely choose the variablesthat characterize the phenomenon under study, called ‘‘diagnostics’’by the modelers. Dur<strong>in</strong>g a stay at the Godard Institute forSpace Studies (GISS) <strong>in</strong> New York, a young LMD researcher (F)developed an orig<strong>in</strong>al method for explor<strong>in</strong>g cloud–radiationfeedback <strong>and</strong> its sensitivity to warm<strong>in</strong>g (Bony et al., 2004).Draw<strong>in</strong>g on all sorts of <strong>observation</strong>al data on clouds (fromsatellite databases to reanalyzed data, etc.) <strong>and</strong> us<strong>in</strong>g statisticalanalysis, F sought to establish the diagnostics that showed theeffect of temperature on cloud physics, <strong>in</strong> given dynamicconditions. Her new diagnostic has been used later to test thecapacity of cloud parametrization of the LMD <strong>climate</strong> model torepresent this feedback. Let us expose briefly the pr<strong>in</strong>ciple of thisdiagnostic.Instead of represent<strong>in</strong>g clouds accord<strong>in</strong>g to longitude <strong>and</strong>latitude, F decided to represent them along a s<strong>in</strong>gle axis, as afunction of the vertical speed of the air. ‘‘In this way, we canrepresent on a s<strong>in</strong>gle axis, on one side where the air rises, on theother, where it goes down’’, she expla<strong>in</strong>s ‘‘Over there are all ofthe convective clouds, here the low clouds [. . .] In classify<strong>in</strong>g allof the zones as a function of vertical speed, we obta<strong>in</strong>cont<strong>in</strong>uous variation <strong>in</strong> properties of clouds <strong>and</strong> of the watervapor; everyth<strong>in</strong>g is organized <strong>in</strong> a simple manner. . . It’smuch easier to analyze what is happen<strong>in</strong>g [. . .] Instead of look<strong>in</strong>gat th<strong>in</strong>gs regionally, we try to classify them <strong>in</strong> a syntheticmanner’’.By com<strong>in</strong>g up with this diagnostic (widely used ever s<strong>in</strong>ce),which provides the specialist with a new synoptic panorama ofcloud organization, the scientist was able to extract new<strong>in</strong>formation from a flood of available data. The search for newways of see<strong>in</strong>g is described as creative <strong>and</strong> funny: ‘‘One canchoose to look at th<strong>in</strong>gs <strong>in</strong> more detail, by look<strong>in</strong>g at differentvariables, by carry<strong>in</strong>g out statistical analyses (. . .) What<strong>in</strong>terests me is look<strong>in</strong>g at th<strong>in</strong>gs otherwise; <strong>in</strong> a somewhat moretwisted way. . .’’.


248H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–2523.6. Mak<strong>in</strong>g <strong>simulations</strong> <strong>and</strong> data ‘‘speak the same language’’A diagnostic is a means of analyz<strong>in</strong>g <strong>observation</strong>al data, butalso the output of the model’s <strong>simulations</strong>. Diagnostics thereforeconstitute an evaluation method: apply<strong>in</strong>g the same diagnostic to<strong>simulations</strong> <strong>and</strong> <strong>observation</strong>s renders them commensurable <strong>and</strong>allows for the comparison of two schemes constructed <strong>in</strong>accordance with the same criteria. Some climatologists enforcethis rule when evaluat<strong>in</strong>g models: ‘‘use <strong>observation</strong>s <strong>and</strong> <strong>simulations</strong><strong>in</strong> the exact same way’’ (<strong>in</strong>terview with F, LMD, July 2003).For example, they may choose to study the radiation sent back<strong>in</strong>to outer space by the outer layer of the atmosphere becausesatellite <strong>in</strong>struments measure this flux. However, they wouldavoid work<strong>in</strong>g on the radiation’s vertical distribution, which themodel can calculate, but which cannot be measured. In this case,researchers voluntarily limit the field of numerical experiments sothat it only <strong>in</strong>cludes those that can be directly compared to<strong>observation</strong>.On this theme, one can give two additional examples of themodel–data relationship. LMD researchers who wished toevaluate their model’s reproduction of the monsoon <strong>in</strong> India,used a program for analyz<strong>in</strong>g meteorological data that wasdeveloped by a researcher at the European Centre for Medium-Range Weather Forecasts <strong>in</strong> Read<strong>in</strong>g (UK). This program selectsfrom data the parameters that characterize monsoon depressions,thereby construct<strong>in</strong>g trajectories; subsequently, it produces astatistical representation of the properties of these perturbations.With the help of this program, LMD researchers have analyzedmonsoon depressions simulated by their models <strong>in</strong> a region <strong>in</strong>India over n<strong>in</strong>e (simulated) years. Among those virtual depressions,they’ve identified those that have the characteristics of amonsoon, <strong>and</strong> have compared them to real <strong>observation</strong>s of Indianmonsoons that are analyzed by the same program. Theirconclusion is two-fold: ‘‘(1) LMD’s model is capable of simulat<strong>in</strong>gmonsoon depressions that exhibit realistic circulation characteristics,(2) the ‘‘track<strong>in</strong>g’’ method is powerful <strong>and</strong> offers a panoplyof robust quantitative statistical studies that make it possible toeffectuate a precise analysis of the simulated depressionsystems’’. 10 With this example, we can see that research doesnot limit itself to evaluat<strong>in</strong>g a model; it is also concerned with themethod of analysis used, <strong>and</strong> with monsoon displacement. Thiswork actually deals with three levels of analysis: the monsoon(whose statistical characteristics are under study); the model(which is to be evaluated <strong>in</strong> relation to its capacity to reproducethe monsoon), <strong>and</strong> f<strong>in</strong>ally, the common method of analysis(whose efficacy is under evaluation).Another example, which will also keep us <strong>in</strong> India: this time itis a matter of validat<strong>in</strong>g the model’s capacity to simulate atropical hurricane that hits the northeast of India on October 29,1999. First, researchers <strong>in</strong>troduce <strong>in</strong>to the model the atmosphericconditions of October 21, 1999, <strong>and</strong> then the model simulates the<strong>climate</strong> of the follow<strong>in</strong>g ten days with the zoom function po<strong>in</strong>tedat India. A program made it possible to transform calculated<strong>climate</strong> characteristics by simulat<strong>in</strong>g the signal that would bedetected by the Meteosat satellite if it observed the phenomenon.Thus, researchers could easily compare ‘‘real’’ images of cyclonestaken by Meteosat <strong>in</strong> October 1999 with simulated satelliteimages (this comparative method is named ‘‘from model tosatellite’’.). In all of these examples, it is a matter of ‘‘mak<strong>in</strong>gmodels <strong>and</strong> measurements speak the same language’’. 1110 Extracts from LMD’s <strong>in</strong>ternal journal LMDZ Info no. 0 (July 2000), p. 12:‘‘caractérisation des dépressions atmosphériques simulées par le modeles decirculation générale du LMD (MCG LMD6)’’.11 Extract of ‘‘Rencontre Modeles—Données’’, LMD’s <strong>in</strong>ternal journal LMDZInfo no. 0 (July 2000), p. 7.4. Bottom-up epistemology of <strong>climate</strong> model<strong>in</strong>g4.1. Some epistemological remarks on the relationships <strong>between</strong><strong>simulations</strong> <strong>and</strong> <strong>observation</strong>sIn order to be more through <strong>in</strong> this outl<strong>in</strong>e of the relationship<strong>between</strong> data <strong>and</strong> <strong>simulations</strong>, I would have to give moreexamples, notably examples of how <strong>simulations</strong> of past <strong>climate</strong>are compared to paleoclimatic data. Besides, <strong>in</strong>tercomparisonprojects organized by the Program for Model Diagnosis <strong>and</strong>Intercomparison (Atmosphere Model Intercomparison Project,Paleo<strong>climate</strong> Model Intercomparison Project, Coupled ModelIntercomparison Project, etc.) play an essential role <strong>in</strong> theseevaluations, <strong>and</strong> <strong>in</strong> structur<strong>in</strong>g the model<strong>in</strong>g community as well;they deserve to be discussed <strong>in</strong> details (see Lenhard & W<strong>in</strong>sberg,this issue). However, the cases described above, even if succ<strong>in</strong>ct<strong>and</strong> limited, do already po<strong>in</strong>t to a few reflections on a bottom-upepistemology of model<strong>in</strong>g that emerges from an analysis ofpractices.The first remark concerns the manipulation of data. Thecomputer does not merely engender virtual <strong>climate</strong>s, it alsoallows researchers to manipulate <strong>observation</strong>s or rather ‘‘to lookat th<strong>in</strong>gs otherwise, <strong>in</strong> a somewhat twisted way’’ (as F po<strong>in</strong>tedout) <strong>in</strong> order to uncover hidden correlations. Due to open accessto databases <strong>and</strong> reanalyses, play<strong>in</strong>g with <strong>observation</strong>s is an<strong>in</strong>tegral part of the modeler’s work. We are quite far here from theopposition <strong>between</strong> fixed <strong>and</strong> untouchable data <strong>and</strong> readilymalleable <strong>simulations</strong>. It is almost the <strong>in</strong>verse: hav<strong>in</strong>g alreadyundergone all sorts of transformations, the data can be sortedfurther <strong>and</strong> ‘‘twisted’’ <strong>in</strong> all directions s<strong>in</strong>ce they come from<strong>observation</strong> <strong>and</strong> rema<strong>in</strong> unswerv<strong>in</strong>gly l<strong>in</strong>ked to it. Simulations, onthe other h<strong>and</strong>, dem<strong>and</strong> a more cautions h<strong>and</strong>l<strong>in</strong>g: because theyhave no l<strong>in</strong>k to the real world, they are bound to always be<strong>in</strong>gmeasured aga<strong>in</strong>st data.Certa<strong>in</strong>ly, the fact that data are not given, that they arecalibrated, corrected, reduced, that they need theory <strong>and</strong>model<strong>in</strong>g—all of this is not new <strong>and</strong> has been studied bynumerous authors (Galison, 1987; Hack<strong>in</strong>g, 1989; among others).The general character of data manipulation was one of thearguments Norton <strong>and</strong> Suppe (2001) used to counter critics ofmodel validation. Knorr-Cet<strong>in</strong>a (1992) remarks that ‘‘the theoreticalrelevance of laboratories’’ rests ‘‘upon the malleability ofnatural objects’’. With<strong>in</strong> the doma<strong>in</strong> of the field sciences, Latour(2001) impressively analyzed the ‘‘circulat<strong>in</strong>g reference’’ (thesuccessive transformations of data) <strong>in</strong> pedology (science of soil).The work on <strong>climate</strong> <strong>observation</strong> that I have described recallsLatours description <strong>in</strong> this regard: Between science <strong>and</strong> its object,there is neither correspondence, nor gaps, Latour writes, but asuccession of small displacements, ‘‘cascade of transformations’’.Similarly, we have seen that cascades of transformations allowback <strong>and</strong> forth <strong>between</strong> data <strong>and</strong> <strong>climate</strong> <strong>simulations</strong>. ‘‘This cha<strong>in</strong>has to rema<strong>in</strong> reversible. The succession of stages must betraceable, allow<strong>in</strong>g for travel <strong>in</strong> both directions’’ (Latour (2001)p. 72). This claim applies of course to <strong>climate</strong> data. 12 In both cases,we f<strong>in</strong>d the same capacity of comb<strong>in</strong>ation <strong>and</strong> comparison of data,allow<strong>in</strong>g new transformations: ‘‘Hardly surpris<strong>in</strong>g, then, that <strong>in</strong>the calm <strong>and</strong> cool office the botanist who patiently arranges theleaves is able to discern emerg<strong>in</strong>g patterns that no predecessor12 Without go<strong>in</strong>g <strong>in</strong>to a fresh controversy that has opened up as this text issubmitted for publication, <strong>and</strong> which does not encroach on the problematic of thisarticle, the ‘‘ClimateGate’’ affair (the hack<strong>in</strong>g of more than 1000 emails from theClimate Research Unit (UK) <strong>and</strong> the polemics that followed few days before theClimate Change summit <strong>in</strong> Copenhagen <strong>in</strong> December 2009), highlights the crucialimportance of accessibility <strong>and</strong> traceability of scientific data <strong>in</strong> a highly politicalcontext.


H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252 249could see (. . .) Scattered through time <strong>and</strong> space, these leaveswould never have met without her redistribut<strong>in</strong>g their traits <strong>in</strong>tonew comb<strong>in</strong>ations’’ (Latour (2001), p. 38). If we st<strong>and</strong> <strong>in</strong> the leavesfor clouds, <strong>and</strong> the botanist for the climatologist, we would th<strong>in</strong>kwe are read<strong>in</strong>g a description of F explor<strong>in</strong>g cloud’s properties.Regard<strong>in</strong>g the manipulation of data, there is no difference <strong>in</strong>pr<strong>in</strong>ciple <strong>between</strong> <strong>climate</strong> model<strong>in</strong>g <strong>and</strong> other sciences. Nevertheless,this data malleability is of a much higher degree <strong>in</strong> the<strong>climate</strong> sciences, due to the extensive use of computers on alllevels.The second remark is that exchanges <strong>between</strong> models <strong>and</strong><strong>observation</strong>s are more symmetrical than we would believe. Thiscirculation cont<strong>in</strong>ually moves <strong>in</strong> both directions, <strong>in</strong> an iterativeback <strong>and</strong> forth, whereby both data <strong>and</strong> <strong>simulations</strong> are repeatedlycompared <strong>and</strong> discussed. Therefore, even if customarilymodels are evaluated based on <strong>observation</strong>s, the <strong>in</strong>versealso occurs <strong>and</strong> models serve to validate methods of <strong>in</strong>terpret<strong>in</strong>gthe data. This is especially the case <strong>in</strong> paleoclimatology.The <strong>in</strong>terpretation of data from the distant past is particularlydelicate because it relies on relationships that are themselvesdepend<strong>in</strong>g on the <strong>climate</strong>. For <strong>in</strong>stance, reconstruct<strong>in</strong>g <strong>climate</strong>from pollen makes use of relationships (<strong>between</strong> properties ofpollen <strong>and</strong> parameters such as temperature <strong>and</strong> precipitation),which might have been very different <strong>in</strong> the past from what theyare today. If divergences <strong>between</strong> the model <strong>and</strong> the data arefound, they can be expla<strong>in</strong>ed <strong>in</strong> many ways: model errors, aprocess poorly accounted for <strong>in</strong> model<strong>in</strong>g, but also errors <strong>in</strong> data,or moreover <strong>in</strong> data <strong>in</strong>terpretation—or any comb<strong>in</strong>ation of thesedifferent factors.Thus, contradictions <strong>between</strong> paleoclimatic <strong>simulations</strong> <strong>and</strong>data has sometimes raised doubts about the latter: for example,an estimate of ocean surface temperatures dur<strong>in</strong>g the last glacialmaximum was shown to be false after it happened to be<strong>in</strong>compatible with many models. The ‘‘reconciliation’’ <strong>between</strong>models <strong>and</strong> data is the result of dialogues <strong>and</strong> ‘‘iterative work’’<strong>between</strong> data specialists <strong>and</strong> modelers (<strong>in</strong>terview with G,Laboratoire des Sciences du Climat et de l’Environnement, June2006)—this cooperation play<strong>in</strong>g a notable part <strong>in</strong> paleoclimatology.The iterative dialogue <strong>between</strong> <strong>simulations</strong> <strong>and</strong> <strong>observation</strong>sis facilitated by the availability of powerful computers, whichmade it possible to make the two ‘‘speak the same language’’ to‘‘use them <strong>in</strong> the same manner’’ (accord<strong>in</strong>g to the rule followed bysome modelers); <strong>in</strong> the examples given <strong>in</strong> Section 3, the commonlanguage is that of the diagnostic, of a method of analysis or<strong>in</strong>strumental measurement. As <strong>in</strong> all sciences, here one obta<strong>in</strong>scharts, curves, <strong>and</strong> histograms—produced by the computer, <strong>and</strong>aris<strong>in</strong>g from <strong>simulations</strong> as from data—that constitute what iscompared, analyzed, <strong>and</strong> discussed, <strong>and</strong> what constitutes proof(Latour, 1989).The third characteristic noticed here proceeds from this back<strong>and</strong> forth: models are at once (or alternatively) validated by<strong>observation</strong>s <strong>and</strong> used to complete the data. They are the object toexplore <strong>and</strong> the tool of exploration; they <strong>in</strong>separably serve tounderst<strong>and</strong> the <strong>climate</strong> <strong>and</strong> make predictions about it. Because ofthis, it is impossible to strictly dist<strong>in</strong>guish a models constructionfrom its use. Scientists go back <strong>and</strong> forth <strong>between</strong> the developmentphase <strong>and</strong> the simulation phase, rely<strong>in</strong>g on the model tostudy <strong>and</strong> project the <strong>climate</strong> <strong>and</strong> on the <strong>climate</strong> to explore <strong>and</strong>ameliorate the model, follow<strong>in</strong>g a multitude of different modalities.(Heymann (2006) made a similar po<strong>in</strong>t for atmosphericchemistry model<strong>in</strong>g). If model development <strong>in</strong>volves its utilization(even if just for the sake of test<strong>in</strong>g), us<strong>in</strong>g the model generallyrequires participat<strong>in</strong>g <strong>in</strong> its construction, or at least sufficientlyknow<strong>in</strong>g its content to be able to carry out sensitivity experimentsor studies of variability. Stated differently: the model is not(yet) a black box, a tool easily accessible to all users, a mach<strong>in</strong>e forproduc<strong>in</strong>g color images, <strong>in</strong> the words of a LMD scientist (whodreads such use of today’s models). The model rema<strong>in</strong>s an objectof research.There is a fourth po<strong>in</strong>t to raise. What is evaluated is thecapacity to reproduce or account for a phenomenon (themonsoon, for <strong>in</strong>stance), or a climatic characteristic (for example,variability of precipitation). And this evaluation is never anisolated task: every comb<strong>in</strong>ation of phenomena, available data,<strong>and</strong> urgent questions suggests certa<strong>in</strong> methods of analysis tothe scientists’ imag<strong>in</strong>ation. A general protocol for validation doesnot exist—no more than a universal norm for experimentaltest<strong>in</strong>g (Atten & Pestre, 2002). Norms of validation are def<strong>in</strong>edat the same time as the facts to be validated, as well as theanalysis methods to which data <strong>and</strong> models will be subjected <strong>and</strong>that allows for their comparison. We could say that theresearchers must construct the phenomenon to be validated.Evidently, the researchers do not construct the phenomenoncalled Indian monsoon; however, it is not the simulation ofthe monsoon ‘‘itself’’ that is under evaluation, rather the setof parameters characteriz<strong>in</strong>g the monsoon—that is effectivelyconstructed.Fifth remark: these modes of analysis, which br<strong>in</strong>g outstructures, correlations, <strong>and</strong> retroactions <strong>in</strong> the models <strong>and</strong> thedata, are also what allows modelers to expla<strong>in</strong> <strong>and</strong> underst<strong>and</strong>phenomena by simplify<strong>in</strong>g them. Evaluations also have a heuristicfunction. The computer’s comb<strong>in</strong>atorial <strong>and</strong> sort<strong>in</strong>g capacity, <strong>in</strong>allow<strong>in</strong>g modelers to br<strong>in</strong>g order to <strong>observation</strong>s <strong>and</strong> to classifyclouds, helps triumph over tangle <strong>and</strong> multiplicity of data <strong>and</strong>overcomes (<strong>in</strong> part) the famous complexity of clouds <strong>and</strong> theirclimatic <strong>in</strong>teractions. Here we recall Latour’s remark about thebotanist sort<strong>in</strong>g leaves <strong>in</strong> her lab: ‘‘. . . a pattern emerges (. . .) <strong>and</strong>here aga<strong>in</strong>, it would be astonish<strong>in</strong>g if it were not the case.Invention almost always follows the new h<strong>and</strong>le offered by a newtranslation or transportation’’ (Latour, 1999, p. 53).4.2. The question of realism <strong>in</strong> <strong>climate</strong> model<strong>in</strong>gThe last remark deals with a particularly delicate po<strong>in</strong>t, therealism of models, which deserve a longer exposition. Models donot aim to ‘‘imitate’’ the real <strong>climate</strong> (which would hardly makesense). Every model is <strong>in</strong>complete, simplify<strong>in</strong>g, <strong>and</strong> it is the resultof choices, def<strong>in</strong>itions, <strong>and</strong> conceptions made by its authors.Modelers, as we have seen, seek to look at th<strong>in</strong>gs accord<strong>in</strong>g to newframes of references. Is there anyth<strong>in</strong>g less realistic than cloudsthat are l<strong>in</strong>ed up as if ready for battle, or monsoons reduced totheir statistical characteristics? It is a matter of underst<strong>and</strong><strong>in</strong>gclimatic mechanisms, <strong>in</strong>creas<strong>in</strong>g confidence <strong>in</strong> models <strong>and</strong>projections of <strong>climate</strong> change, which does not entail produc<strong>in</strong>grealistic representations. Simulations <strong>and</strong> <strong>observation</strong>s must‘‘speak the same language’’, but this is not the language of thereal <strong>climate</strong>. 13 Even data do not constitute a faithful representationof the <strong>climate</strong>. The referent to which <strong>simulations</strong> arecompared is not ‘‘the <strong>climate</strong>’’, it is a set of remodeled data thatare carefully selected from the hundreds of thous<strong>and</strong>s of data setsfurnished by <strong>in</strong>strument networks on l<strong>and</strong>, sea, <strong>and</strong> <strong>in</strong> outerspace. Only an <strong>in</strong>strumented world is capable of provid<strong>in</strong>g thedata that are used to test models.Yet, the question of realism is at the heart of the image ofmodels that scientists present to policy makers <strong>and</strong> the public.13 That still recalls Latour’s analysis about pedology <strong>in</strong> Amazonia: ‘‘But theseacts of reference are all the more assured s<strong>in</strong>ce they rely not so much onresemblance as on a regulated series of transformations, transmutations <strong>and</strong>translations’’ (Latour, 1999, p. 58) ‘‘It is not realistic; it does not resemble anyth<strong>in</strong>g.It does more than resemble. It takes the place of the orig<strong>in</strong>al situation, which we canretrace. . .’’ (Latour, 1999, p. 67)


250H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252Models are <strong>in</strong> part constituted from algorithms that reproducelaws of dynamics <strong>and</strong> thermodynamics <strong>and</strong> <strong>in</strong> part fromparametrizations that scientists cont<strong>in</strong>uously seeks to br<strong>in</strong>g‘‘closer to the physics of the process’’. An <strong>in</strong>creas<strong>in</strong>g number ofphenomena <strong>and</strong> cycles that <strong>in</strong>fluence the <strong>climate</strong> are taken <strong>in</strong>toaccount. Spatial <strong>and</strong> temporal resolutions are improv<strong>in</strong>g due tomore powerful computers <strong>and</strong> means of <strong>observation</strong>, giv<strong>in</strong>g abetter geographical representation of the globe. It is becausecomputers allow ‘‘pragmatic <strong>in</strong>teraction without theoreticalbackground’’ of model components (Küppers & Lenhard, 2007),because they allow all of these ‘‘formal heterogeneous systems’’(Varenne, 2007) to <strong>in</strong>teract <strong>and</strong> work together, simulat<strong>in</strong>g theirtemporal development, that <strong>simulations</strong> have come to betterreproduce some climatic phenomena (for <strong>in</strong>stantance, coupl<strong>in</strong>gwith vegetation helps expla<strong>in</strong> strong Asian monsoon <strong>in</strong> theHolocene epoch). Progress <strong>in</strong> this doma<strong>in</strong> seems to move towardsf<strong>in</strong>er resolution, detail, <strong>and</strong> proliferation of elements, for an<strong>in</strong>creas<strong>in</strong>gly faithful representation of the <strong>climate</strong>. When <strong>climate</strong>scientists address the non-specialist public, they normally beg<strong>in</strong>by present<strong>in</strong>g a sketch of this progress from primitive atmosphericmodels—bare globes with crude grids–from the 1970s totoday’s ‘‘earth systems’’ populated by all sorts of chemical <strong>and</strong>vegetal species, mounta<strong>in</strong>s, seas, cities, <strong>and</strong> rivers. This representationseem to be the exact opposite of that given by high-energyphysicists—the famous ‘‘quest for the ultimate particle’’: <strong>in</strong>steadof a reductionist race towards the elementary <strong>and</strong> towardsunification, <strong>climate</strong> model<strong>in</strong>g would advance towards a horizonof comprehensive representation of everyth<strong>in</strong>g.The image is nevertheless too simple. While this path towardscomplexity is a serious trend <strong>in</strong> <strong>climate</strong> model<strong>in</strong>g, to which thestriv<strong>in</strong>g for realism is often l<strong>in</strong>ked, it is but one driv<strong>in</strong>g force ofmodel<strong>in</strong>g, <strong>and</strong> it is not without problems. First, global EarthSystem models are not the only models used by researchers; theyare assisted by simpler models, ‘‘idealized’’ models, etc. Inaddition, there are scientific debates on the best means ofimprov<strong>in</strong>g models. Certa<strong>in</strong> scientists th<strong>in</strong>k that we will betterunderst<strong>and</strong> <strong>and</strong> project the <strong>climate</strong> by improv<strong>in</strong>g parametrizationsof essential atmospheric phenomena as opposed to describ<strong>in</strong>g<strong>in</strong> detail various types of vegetation, while others th<strong>in</strong>k thatmodel<strong>in</strong>g will benefit most from tak<strong>in</strong>g <strong>in</strong>to account new factors.Other <strong>in</strong>ternal debates exist on the limits of GCMs, for example,on the question of to what po<strong>in</strong>t can these models be used on theregional scale to respond to grow<strong>in</strong>g social dem<strong>and</strong>. Illustrat<strong>in</strong>gthe problematic character of the notion of realism, <strong>climate</strong>scientists use this term to designate a number of different th<strong>in</strong>gs:they speak of the realism of a description of a process—of aparametrization, for <strong>in</strong>stance—<strong>and</strong> of the realism of a simulation.Now, those two realisms are often <strong>in</strong>itially <strong>in</strong>compatible (I evokedthe difficulty of implement<strong>in</strong>g new parametrizations earlier)—thechoice to privilege one or the other depends on the objective ofmodel<strong>in</strong>g, as well as on the culture <strong>and</strong> <strong>in</strong>stitutional frameworkof the laboratory (Shackley, 2001). The researchers’ work consistsof def<strong>in</strong><strong>in</strong>g what counts, which cannot be reduced to an<strong>in</strong>eluctable advance towards complexity or maximum resolution.However, this scientific work, <strong>and</strong> the question of realism <strong>in</strong>particular, cannot be isolated from the political stakes <strong>in</strong>volved<strong>in</strong> <strong>climate</strong> model<strong>in</strong>g (Shackley et al., 1999). Climate projectionsrely on models that are expected to provide to policy makers<strong>in</strong>creas<strong>in</strong>gly better representations of all climatic elements <strong>in</strong>order to produce a higher quality <strong>and</strong> more precise projection,notably on the local scale. It is necessary to discuss the naivevision of models, to cast doubt on their realism, to underscoretheir limits <strong>and</strong> to challenge that conception of science–policyrelationship based on the ‘‘l<strong>in</strong>ear model’’ (Pielke, 2002; Sarewitz,2000), even if it can pose the risk be<strong>in</strong>g confused with (or used by)the opponents of <strong>climate</strong> change policy.4.3. Model<strong>in</strong>g <strong>and</strong> field science versus theory <strong>and</strong> experiment-basedsciences: similitudes <strong>and</strong> differencesTo what extent are the preced<strong>in</strong>g epistemological remarksspecific to the relation <strong>between</strong> numerical models <strong>and</strong> <strong>observation</strong>s?Could the same analysis be carried out <strong>in</strong> regards to therelationship <strong>between</strong> theory <strong>and</strong> experimental results? That dataare reconstructed, that validation norms are def<strong>in</strong>ed at the sametime as that which is to be validated, that sciences do not producemimetic images of reality, all of this results from very generalf<strong>in</strong>d<strong>in</strong>gs. On the level of field <strong>observation</strong>s, there do not seem tobe differences <strong>in</strong> pr<strong>in</strong>ciple <strong>between</strong> the older classical sciences<strong>and</strong> <strong>climate</strong> model<strong>in</strong>g. Of course, differences <strong>in</strong> size <strong>and</strong> scaleexist, s<strong>in</strong>ce the <strong>climate</strong> sciences depend on a veritable (technical,metrologic, adm<strong>in</strong>istrative. . .) ‘‘mobilization of the world’’(Latour, 1989, p. 539), which has allowed for the development<strong>and</strong> ma<strong>in</strong>tenance of a dense <strong>and</strong> complex measurement network.Numbers represent<strong>in</strong>g objects <strong>and</strong> properties <strong>in</strong>volved <strong>in</strong> <strong>climate</strong>(meteorological measurements on the ground, cloud measurementsfrom satellites, water measurements from ships, characteristicsof vegetation. . .) circulate, are concentrated <strong>and</strong>comb<strong>in</strong>ed, <strong>and</strong> this <strong>in</strong>formation com<strong>in</strong>g from all over the worldis made available to models. In order to master the avalanche ofdata <strong>in</strong>side this gigantic ‘‘center of calculations’’, it is stillnecessary to classify, superimpose, <strong>in</strong>vent new transformationsthat will reduce the number of these objects, summarize theirrelationships <strong>and</strong> transcribe them to our scale. Computationpermits these manipulations at a gr<strong>and</strong> scale, <strong>and</strong> allowsfor virtually transform<strong>in</strong>g the <strong>climate</strong> <strong>and</strong> experiment<strong>in</strong>g on<strong>observation</strong>s. The change is by degree: the computer prolongs anold history, offer<strong>in</strong>g <strong>in</strong>creased computational power <strong>and</strong> superimpositioncapacity (Latour, 1989). The power of computerscience endows models <strong>and</strong> data with unprecedented plasticity(Picker<strong>in</strong>g, 1995) <strong>and</strong> allows for new connection <strong>between</strong> them.As we have seen, numerical computation has made possiblethe model<strong>in</strong>g of a system conta<strong>in</strong><strong>in</strong>g many heterogeneouselements <strong>and</strong> processes that <strong>in</strong>teract nonl<strong>in</strong>early, but <strong>in</strong> do<strong>in</strong>gthis it has also made validation particularly arduous. A similarunderdeterm<strong>in</strong>ation is found <strong>in</strong> <strong>observation</strong>s: <strong>climate</strong> scientistshave at their disposal <strong>and</strong> abundance of data collected <strong>in</strong> massivequantities, which are at the same time more global, plural, <strong>and</strong><strong>in</strong>complete than experimental measurements. If experiments arecarefully tailored to test<strong>in</strong>g a theoretical hypothesis, <strong>observation</strong>s<strong>in</strong> the <strong>climate</strong> doma<strong>in</strong> are rather ‘‘ready to wear’’: it is necessaryto choose, select, <strong>and</strong> even adjust if needed. How is it possible tomove past this double underdeterm<strong>in</strong>ation of models <strong>and</strong><strong>observation</strong>al data? How can the <strong>in</strong>f<strong>in</strong>ite potentialities of themodel be confronted with the <strong>in</strong>f<strong>in</strong>ite realities of the field? Thefew examples we have seen have given an idea of it: by choos<strong>in</strong>g adoma<strong>in</strong>, a def<strong>in</strong>ition, a series of questions, <strong>and</strong> a mode of analysisthrough which the model’s <strong>and</strong> the real <strong>climate</strong>’s function<strong>in</strong>g canbe studied at once.More fundamentally, there is a difference <strong>between</strong> therelations that l<strong>in</strong>k theories <strong>and</strong> experiments on the one h<strong>and</strong>,<strong>and</strong> model<strong>in</strong>g <strong>and</strong> field <strong>observation</strong>s on the other. All scientificdiscipl<strong>in</strong>es share the requirement of test<strong>in</strong>g that permit to decide<strong>between</strong> statements. An experimental statement benefits from itscapacity to resist controversy by demonstrat<strong>in</strong>g that it is not asimple fiction, the <strong>in</strong>strument hav<strong>in</strong>g been constructed preciselyso that ‘‘the experimental fact would be expla<strong>in</strong>ed by the answerto the question posed’’ (Stengers, 1993, p. 154). This is not thecase for numerical model<strong>in</strong>g because models have to do preciselywith fiction. Like fictions, <strong>and</strong> unlike theories, models have thecapacity to ‘‘express content not immediately situated <strong>in</strong> thedimensions of true or false’’ (Barberousse <strong>and</strong> Ludwig, 2001, p. 23)they can ‘‘at once contradict accepted hypotheses <strong>and</strong> tell us


H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252 251someth<strong>in</strong>g about the world’’ (Barberousse <strong>and</strong> Ludwig, 2001, p.36). No model has exclusivity on represent<strong>in</strong>g a phenomenon,s<strong>in</strong>ce many representations coexist that meet different needs <strong>and</strong>that are sometimes l<strong>in</strong>ked to choices made by the author. 14 As faras field <strong>observation</strong>s are concerned, it is impossible to prove withcerta<strong>in</strong>ty the stability of established relationships to their subjects(this is one of the difficulties of validat<strong>in</strong>g <strong>simulations</strong> of future<strong>climate</strong> <strong>and</strong> <strong>in</strong>terpret<strong>in</strong>g data from the past). A valid explanationfor one terra<strong>in</strong> will not necessarily hold <strong>in</strong> another (it oftenhappens that a parametrization validated for one region of theglobe is not suitable for another because the dom<strong>in</strong>ant processeswere not identical). Situations cannot be purified, ‘‘no s<strong>in</strong>gle causehas the general power to cause, each one is part of a history <strong>and</strong> itis from this history that it gets its identity as a cause’’ (Stengers,1993, p. 159). Any validation of a model with data from the fieldhas to take <strong>in</strong>to account these multiple causes that vary <strong>in</strong> time<strong>and</strong> space.5. ConclusionThe central importance of <strong>observation</strong> for model<strong>in</strong>g cannot beoveremphasized. There has been a parallel evolution <strong>between</strong>progress made <strong>in</strong> model<strong>in</strong>g <strong>and</strong> the collection of larger <strong>and</strong> largerdata quantities, by satellites <strong>in</strong> particular. If <strong>climate</strong> model<strong>in</strong>g hasadvanced to a degree unparalleled <strong>in</strong> the environmental sciences,this is due to the exponential growth <strong>in</strong> computational power <strong>and</strong>to resolution of equations govern<strong>in</strong>g atmospheric circulation, butalso due to a unique <strong>and</strong> dense <strong>in</strong>strument network that is highlydeveloped <strong>and</strong> organized on an <strong>in</strong>ternational scale.Let us return to the questions posed by the philosophersevoked at the beg<strong>in</strong>n<strong>in</strong>g of this article. If models do not directlyrepresent the real world, if their numerical experiments are notabout the world, how can they br<strong>in</strong>g knowledge about reality?What gives models their credential? What guarantees knowledgeobta<strong>in</strong>ed from <strong>simulations</strong>? We have looked for the responses <strong>in</strong>researchers’ practices. What establishes scientists’ trust <strong>in</strong> theirown models, what guarantees the value of the knowledge theyproduce, is validation or evaluation by <strong>observation</strong>al data, muchmore so than their relation to theories or experiments.Relationships to theories undoubtedly constitute one of theorig<strong>in</strong>alities of <strong>climate</strong> model<strong>in</strong>g, <strong>and</strong> dist<strong>in</strong>guish it from othermodes of knowledge production. Its capacity to <strong>in</strong>tegrate heterogeneoustheories, milieus <strong>and</strong> elements, to span scales of time,space <strong>and</strong> complexity, to comb<strong>in</strong>e the s<strong>in</strong>gular <strong>and</strong> the cont<strong>in</strong>gent,along with its faculty for simulation, tak<strong>in</strong>g <strong>in</strong>to accounthistorical evolution <strong>and</strong> fictional scenarios—all of this constitutesnew ways of underst<strong>and</strong><strong>in</strong>g scientific knowledge peculiar tonumerical model<strong>in</strong>g. On the other h<strong>and</strong>, <strong>in</strong> its relations to the real(<strong>in</strong>strumented) world, <strong>climate</strong> model<strong>in</strong>g resembles other scientificdiscipl<strong>in</strong>es, thereby establish<strong>in</strong>g its credentials <strong>and</strong> reliability.It is these relationships <strong>between</strong> models <strong>and</strong> <strong>observation</strong>s, theselanguages <strong>in</strong>vented by scientists <strong>and</strong> common to <strong>simulations</strong> <strong>and</strong>data, these multiple orig<strong>in</strong>al <strong>and</strong> robust l<strong>in</strong>ks, that fasten <strong>climate</strong>model<strong>in</strong>g to the material world, <strong>and</strong> that contribute to theimprovement of models <strong>and</strong> scientists’ underst<strong>and</strong><strong>in</strong>g of climaticphenomena.ReferencesArmatte, M., & Dahan, A. (2004). Modeles et modélisations (1950–2000):Nouvelles pratiques, nouveaux enjeux. Rev Hist Sci, 57/2.14 In <strong>climate</strong> models, parametrizations are often identified by their author’sname—we hear of ‘‘convection pattern from X’’ or ‘‘boundary layer scheme of Y’’.Atten, M., & Pestre, D. (2002). He<strong>in</strong>rich Hertz. L’adm<strong>in</strong>istration de la preuve. Paris:PUF.Barberousse, A., & Ludwig, P. (2001). Les modeles comme fiction. Philosophie, 68,16–43.Bengtsson, L., et al. (2004). Can <strong>climate</strong> trends be calculated from re-analysis data?J Geophys Res, V109.Bony, S., et al. (2004). On dynamic <strong>and</strong> thermodynamic compônents of cloudchanges. Clim Dyn, 22, 71–86.Cartwright, N. (1983). How the laws of physics lie. Clarendon Press.Cartwright, N. (1999). Models <strong>and</strong> the limits of theory: quantum Hamiltonians <strong>and</strong>the BCS model of superconductivity. In M. S. Morgan, & M. Morrison (Eds.),Models as mediators: perspective on natural <strong>and</strong> social science. Cambridge:Cambridge University Press.Chaboureau, J.-P., & Bechtold, P. (2002). A simple cloud parameterization derivedfrom cloud resolv<strong>in</strong>g model data: Diagnostic <strong>and</strong> prognostic applications. JAtmos Sci, 59, 2362–2372.Dahan Dalmedico, A., & Guillemot, H. (2008). Climate change: scientific dynamics,expertise <strong>and</strong> political challenges. In C. Paradeise (Ed.), Science <strong>and</strong> Sovera<strong>in</strong>ty.New York: Routledge.Edwards, P. (1996). Global comprehensive models <strong>in</strong> politics <strong>and</strong> policy mak<strong>in</strong>g.Climatic Change, 32(2), 149–161.Edwards, P. (1999). Global <strong>climate</strong> science, uncerta<strong>in</strong>ty <strong>and</strong> politics : data-ladenmodels, models-filtered data. Sci Culture, 8(4).Edwards, P. (2006). Meteorology as <strong>in</strong>frastructure globalism. Osiris, 21, 229–250.Forsyth, T. (2003). Critical political ecology: the politics of environmental science. NewYork: Routledge.Galison, P. (1987). How experiments end. Chicago: University of Chicago Press.Galison, P. (1996). Computer <strong>simulations</strong> <strong>and</strong> the trad<strong>in</strong>g zone. In P. Galison, & D.Stump (Eds.), The disunity of science: boundaries, context <strong>and</strong> power. Stanford:Stanford University Press.Guillemot, H. (2007). Les modeles numériques de climat. In A. Dahan (Ed.), LesModeles du futur. Paris: La Découverte.Hack<strong>in</strong>g, I. (1989). Represent<strong>in</strong>g <strong>and</strong> <strong>in</strong>terven<strong>in</strong>g. New York: Free Press.Hack<strong>in</strong>g, I. (1992). The self-v<strong>in</strong>dication of the laboratory sciences. In A. Picker<strong>in</strong>g(Ed.), Science as practice <strong>and</strong> culture. Chicago: University of Chicago Press.Heymann, M. (2006). Model<strong>in</strong>g reality. Practice, knowledge, <strong>and</strong> uncerta<strong>in</strong>ty <strong>in</strong>atmospheric transport simulation. Hist Stud Phys Biol Sci, 37(1), 49–85.Heymann, M. (2009). Klimakonstruktionen: Von der klassischen Klimatologie zurKlimaforschung. NTM. Int J Hist. Ethics Nat Sci Technol Med, 17(2), 171–197.Kalnay, et al. (1996). The NCEP/NCAR 40-year reanalysis project. Bullet<strong>in</strong> of theAmerican Meteorological Society 448.K<strong>and</strong>el, R. (2002). Les modeles météorologiques et climatiques. In P. Nouvel (Ed.),Enquête sur le concept de modele. Paris: PUF.Knorr-Cet<strong>in</strong>a, K. (1992). The couch, the cathedral <strong>and</strong> the laboratory: on therelationship <strong>between</strong> experiment <strong>and</strong> laboratory <strong>in</strong> science. In A. Picker<strong>in</strong>g(Ed.), Science as practice <strong>and</strong> culture. Chicago: University of Chicago Press.Knuuttila, T., et al. (2006). Computer models <strong>and</strong> <strong>simulations</strong> <strong>in</strong> scientific practice(Editorial). Sci Stud, 19(1), 3–11.Küppers, G., & Lenhard, J. (2007). From hierarchical to network-like <strong>in</strong>tegration: arevolution of model<strong>in</strong>g style <strong>in</strong> computer simulation. In J. Lenhard, G. Küppers,& T. Sh<strong>in</strong>n (Eds.), Simulation: Pragmatic Construction of Reality, Sociology of theSciences, vol. 25). Dordrecht: Spr<strong>in</strong>ger.Kuhn, T. (1977). The essential tension: selected studies <strong>in</strong> scientific traditions <strong>and</strong>changes. University of Chicago Press.Latour B. (1989). La science en action (réédition Gallimard 1995).Latour, B. (2001). L’espoir de P<strong>and</strong>ore. Paris: La Découverte. English version (1999):P<strong>and</strong>ora’s hope. Essays on the reality of science studies. Harvard University Press.Latour, B. (2004). Why has critique run out of steam? From matters of fact tomatters of concern. Crit. Inquiry, 30(2), 25–248.Lenhard, J., & W<strong>in</strong>sberg, E. Holism, entrenchment <strong>and</strong> the future of <strong>climate</strong> modelpluralism, this issue, doi:10.1016/j.shpsb.2010.07.001.Le Treut, H. (1999). Le défi de la modélisation du climat. In: INSU, 30 ans derecherche en sciences de l’Univers 1967–1997, 1997–1999, Lettre du ProgrammeInternational Géosphere–Biosphere-Programme Mondial de Recherche sur leClimat (IGBP-WCRP) 9.Lewis, J.-M. (1998). Clarify<strong>in</strong>g the dynamics of the general circulation: Phillips’s1956 experiment. Bull Am Meteorol Soc, 79, 39–60.LMD (2005). Instruction manual for atmosphere global circulation model. /http://web.lmd.jussieu.fr/lmdz/manuelGCM/ma<strong>in</strong>/node3.htmlS.Miller, C. (2001). Scientific <strong>in</strong>ternationalism <strong>in</strong> American foreign policy: The case ofmeteorology, 1947–1958. In P. Clark Miller (Ed.), Chang<strong>in</strong>g the atmosphere:expert knowledge <strong>and</strong> environmental governance. Edwards: MIT Press.Moissel<strong>in</strong>, P., et al. (2002). Les changements climatiques en France au XXe siecle.Étude des longues séries homogénéisées de données de températures et deprécipitations. La Météorologie, 38, 45–46.Morgan, M. S., & Morrison, M. (Eds.). (1999). Models as mediators: perspective onnatural <strong>and</strong> social science. Cambridge: Cambridge University Press.Nebeker, F. (1995). Calculat<strong>in</strong>g the weather: meteorology <strong>in</strong> the 20th century.International geophysics series, 60. Academic Press.Norton, S., & Suppe, F. (2001). Why atmospheric model<strong>in</strong>g is good science. In C.Miller, & P. Edwards (Eds.), Chang<strong>in</strong>g the atmosphere: expert knowledge <strong>and</strong>environmental governance. Cambridge: MIT Press.Oreskes, N., et al. (1994). Verification, validation, <strong>and</strong> confirmation of numericalmodels <strong>in</strong> the earth sciences. Science, 263, 641–646.Picker<strong>in</strong>g, A. (1995). The Mangle of Practice. Time, Agency <strong>and</strong> Science. University ofChicago Press.


252H. Guillemot / Studies <strong>in</strong> History <strong>and</strong> Philosophy of Modern Physics 41 (2010) 242–252Pielke, R., Jr. (2002). Policy, politics <strong>and</strong> perspective. Nature, 416, 368.R<strong>and</strong>all, D. A., et al. (2007). Climate Models <strong>and</strong> Their Evaluation. In Solomon (Ed.),Climate change 2007: the physical science basis. contribution of work<strong>in</strong>g group i tothe fourth assessment report of the IPCC. Cambridge: Cambridge UniversityPress.Rochas, M., & Javelle, J.-P. (1993). La météorologie. Paris: éditions Syros.Sarewitz, D. (2000). Science <strong>and</strong> environmental policy: An excess of objectivity. InR. Frodeman (Ed.), Earth matters: the earth sciences, philosophy <strong>and</strong> the claims ofcommunity (pp. 79–98).Shackley, S., & Wynne, B. (1996). Represent<strong>in</strong>g uncerta<strong>in</strong>ty <strong>in</strong> globate <strong>climate</strong>change <strong>and</strong> policy : Boundary order<strong>in</strong>g devices <strong>and</strong> authority. Sci Technol HumValues, 21, 3.Shackley S. et al. (1999). Adjust<strong>in</strong>g to policy expectations <strong>in</strong> <strong>climate</strong> changemodel<strong>in</strong>g: an <strong>in</strong>terdiscipl<strong>in</strong>ary study of flux adjustments <strong>in</strong> coupled atmosphere–oceangeneral circulation models, MIT Jo<strong>in</strong>t Program Science <strong>and</strong> Policyof Climate Change, Report no. 48, mai 1999.Shackley, S. (2001). Epistemic lifestyles <strong>in</strong> <strong>climate</strong> change model<strong>in</strong>g. In P. ClarkMiller (Ed.), Chang<strong>in</strong>g the atmosphere: expert knowledge <strong>and</strong> environmentalgovernance. Edwards: MIT Press.Sismondo, S. (1999). Models, <strong>simulations</strong> <strong>and</strong> their objects. Sci Context, 12(2), 247–260.Stengers, I. (1993). L’<strong>in</strong>vention des sciences modernes. Paris: La Découverte.Sundberg, M. (2007). Parameterizations as boundary objects on the <strong>climate</strong> arena.Soc Stud Sci, 37, 473–488.Van der Sluijs, J., et al. (1998). Anchor<strong>in</strong>g devices <strong>in</strong> science for policy: the case ofconsensus around <strong>climate</strong> sensitivity. Soc Stud Sci, 28(2).Varenne, F. (2003). La simulation conc-ue comme expérience concrete. In J. P. Müller(Ed.), Le statut épistémologiquedelasimulation,éditions de l’ENST (pp. 299–313).Varenne, F. (2007). Du modele a la simulation <strong>in</strong>formatique. Paris: Vr<strong>in</strong>.W<strong>in</strong>sberg, E. (1999). Sanction<strong>in</strong>g models: the epistemology of simulation. SciContext, 12, 2.W<strong>in</strong>sberg, E. (2003). Simulated experiments: methodology for a virtual world.Philos Sci, 70, 105–125.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!