[tel-00726959, v1] CaractÃ©riser le milieu interstellaire ... - HAL - INRIA

More documents

Recommendations

Info

IRAM Memo 2005-1CLASS evolution: I. Improved OTF supportP. Hily-Blant 1 , J. Pety 1,2 , S. Guilloteau 31. IRAM (Grenoble)2. LERMA, Observatoire de Paris3. L3AB, Observatoire de BordeauxDec, 20th 2005Version 1.0tel-00726959, version 1 - 31 Aug 2012CLASS evolution: I. Improved OTF supportChange RecordRevision Date Section/ RemarksPage affected1 2005-12-20 All Initial versionCLASS evolution: I. Improved OTF supportContents1Contents1 CLASS internal data format 41.1 Pointed observation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.2 On–The–Fly observation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 Limitations, ease of use and efficiency 62.1 Philosophy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62.2 Implications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62.2.1 New OTF data format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62.2.2 Memory limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62.3 Warning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73 Large dataset processing 73.1 Basic idea . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73.2 Listing and Table of Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73.3 Index consistency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93.4 Visualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93.5 Sorting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103.6 Baseline fitting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103.7 Interactive data exploration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124 Miscellaneous changes 154.1 New defaults . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154.2 Command names . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154.3 Griding and spectra cube visualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154.4 PLAIT algorithm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165 CLASS90 for beta testers 1623
CLASS evolution: I. Improved OTF support1. class internal data formatCLASS evolution: I. Improved OTF support1. class internal data formattel-00726959, version 1 - 31 Aug 2012AbstractCLASS is a GILDAS 1 software for reduction and analysis of (sub)–millimeter spectroscopic data.It is daily used to reduce spectra acquired with the IRAM 30m telescope. CLASS is currently usedin many other facilities (e.g. CSO, HHT, Effelsberg) and it is considered for use by Herschel/HIFI.CLASS history started in 1983. As a consequence, it was written in FORTRAN 77 and tailored toreduce pointed observations. On–The–Fly support was added in the 90s but it showed limitation asthe quantity of OTF data increased quickly. One year ago, we decided to fully rewrite CLASS inFORTRAN 90 with the 3 following goals: 1) clarifying satisfying features with backward compatibilityin mind, 2) improving code readability to simplify maintenance and 3) easing reduction of large OTFdata sets. This memo is describing the current state of affair with a particular emphasis on changesin the program behavior. Future foreseen changes (linked to the increase of receiver instantaneousbandwidth like an improved conversion from frequency to velocity axis) will be described in a futurememo.1 CLASS internal data formatObservations with a single dish telescope may be divided in two categories:1. Pointed observation: The telescope beam is pointed toward a fixed position of the source duringthe signal integration. In its simplest form, the scan is composed of a spectrum whose intensity isaccumulated during the scan duration. Nothing prevents more complex scan definitions, e.g. a scancomposed of several shorter integrations, all at the same position on the sky.2. On-The-Fly (OTF) observation: The telescope beam continuously drifts on source during the integrationto make a map of the source. The scan is then composed of set of spectra regularly dumped(typically every 1 second) during a contiguous portion of time (typically 10 minutes). Each dumpedspectra corresponds to a different position on the sky.1.1 Pointed observationOnly two minor changes happened into the data format of a scan containing a single spectra. The data isstored as a header (divided in independent sections) and the data. We have added: 1) the three parametersassociated to the descriptive coordinate system (2 parameters for the system center + the system positionangle) to be able to go from this descriptive coordinate system to a standard (e.g. equatorial) coordinatesystem and 2) a subscan number. This subscan number is foreseen to always be greater than 1. Thereis one exception: when CLASS90 read data in old format, the subscan number is zero and a warning isissued.1.2 On–The–Fly observationIn CLASS77, an OTF scan is stored as a header and a 2 dimensional array containing the intensities ofdumped spectra as a function of time plus a given number of columns (named DAPS for Data AssociatedParameters) containing header parameters whose values vary during the scan (e.g. the position on the sky,date from beginning of scan). Therefore, all the dumped spectra share the same header in CLASS77.In CLASS90, each dumped spectra of an OTF scan is stored as a pointed observation with its ownheader and data. The concept of scan is kept, as all dumped spectra inside an OTF scan share the samescan number. They are tagged by a subscan number whose value is incremented for each new OTF line(both to enable easy selection of a single line inside one OTF scan, and to ensure consistency with the30m numbering). The dumped spectra are also tagged by a unique observation number. This new OTFdata format has several advantages:1 http://www.iram.fr/GILDASCLASS evolution: I. Improved OTF support2 Limitations, ease of use and efficiency2.1 Philosophy42. limitations, ease of use and efficiencySeveral qualities are desirable for a reduction software: portability, stability, ease of maintenance, easeof use, short learning curve, good documentation, time and storage efficiency, best functionalities, noarbitrary limitations and last but not least backward compatibility. As we are manpower limited, itis impossible to get the perfect software. We thus have to make some compromises to get the closestpossible to perfect. For instance, we rewrote CLASS in FORTRAN 90 although this may bring shortterminstability because this clarifies the program structure and it thus eases future maintenance (key tolong term stability). We also favor functionalities over efficiency with the idea that CLASS users will behappier to be able to do something a bit inefficiently than to be stuck. Obviously, we always keep storageand time efficiency in mind and we are willing to improve the situation when a widely used feature is tooinefficient. Finally, if we make all our effort to have a 100% backward compatibility in data format so thatusers will be able to do something useful even with even very old data, we can not ensure full backwardcompatibility on defaults and command names. The easiest way to implement new features (required byimproved instrumentation) is sometimes to change defaults and command names though we try to refrainfrom making those kind of changes without good reasons.2.2 Implications2.2.1 New OTF data formatOne of the major change in CLASS90 is the new way OTF data are stored. While advantages havealready been described, the main inconvenient is an increase of the size of the data on disk and RAMmemory by at most 20-30%, due to the new individual headers (Note that this increase becomes negligiblefor spectra with a large number of channels).Data access time is less problematic as the data has always been buffered by CLASS. In fact, wechoose this OTF data format to have a much more user-friendly approach to OTF processing. Indeed,it maybe (but still has to be proven...) that the CPU time will be a bit larger with CLASS90 thanwith CLASS77 for perfect data. However, our main goal is to decrease the human time spent on datareduction to deal with the unavailable problems.2.2.2 Memory limitationsAlmost all processing steps are available spectrum per spectrum because this is a very powerful way towork around the limitation of your computer RAM memory. There are two main exceptions:• When opening a file, CLASS is buffering information (source name, line name, telescope name, scannumber, offset, etc...) on each observations of the file to speed next find commands. This bufferhas a fixed sized to avoid code complexity. This limits the number of observations that CLASS90can read/write during one session. The default maximum number of observations is currently setto 100 000 which amounts to about 5 MB of RAM memory. This number can be set to a largervalue through the CLASS_IDX_SIZE logical variable in your $HOME/.gag.dico configuration file as itis probable that the default value is too small with the largest maps observed today.• In CLASS90, it is also possible to load a whole index as a single 2D array for further visualizationand processing (see below). There is no limitation on the number of dumped spectra loadable, apartfrom the previous limitation and the RAM memory of your computer.Except from the index buffer, all other CLASS90 buffers are now dynamically allocated, in particularthe buffer R & T containing the spectra data. This means that the number of channels of a spectrum isnow unlimited which is a useful feature for line surveys.Figure 1: File conversion tool to convert from CLASS77 to CLASS90 data format. The action of thiswidget is equivalent to “go class-convert infilename outfilename” command at prompt level.• It considerably simplifies the source code, as operations on OTF scan are not a special case anymore.While some operations need the information that a dumped spectra is part of an OTF scan, OTFscans may be seen as a collection of independent spectra for many basic operations.• The granularity of operations is much finer. For instance, access and work on any dumped spectrais now obvious. Moreover, it is obvious in this framework to store the windows used for baselinefitting for every dumped spectra.• The scan/subscan organization can be generalized to other kind of observation (rasters, cross scans,...)For backward compatibility, CLASS90 will be able to read the old OTF data format. Nevertheless,it will then stubbornly refuse to do anything else with it than to rewrite the data in the new OTF dataformat. This is easily done with the following commands:LAS90> file in 12co21-oldfmt.30mLAS90> file out 12co21-newfmt.30m newLAS90> set line 12co(2-1)LAS90> findLAS90> for ientry 1 to foundLAS90> get nLAS90> writeLAS90> nextFor the user’s convenience, CLASS90 proposes a widget that implements this conversion with severaladditional safeguards (as avoiding to convert again data already written in new format). Fig. 1 shows thiswidget available in the main CLASS90 menu. This widget is just a front-end to a procedure launched bythe “go class-convert infilename outfilename” command. This procedure can be used in scripts toautomate conversion.Since the advent of the New Control System (NCS) of the 30m in fall 2005, the reading of raw data andthe chopper calibration is done by MIRA (developed by H. Wiesemeyer) which directly writes data in theCLASS90 format. For data acquired previously (with the Old Control System), the conversion step ismandatory. Indeed, the reading of raw data format and the chopper calibration were done by OTFCAL(maintained by A. Sievers), which still writes OTF scans using the CLASS77 data format.CLASS evolution: I. Improved OTF support2.3 Warning53. large dataset processingWhen processing a small number of spectra, CLASS90 will be quick on whatever kind of computer.Now, if CLASS90 users needs to process 300 000 dumped spectra, they should then be prepared to usea powerful computer (with lot’s of RAM to avoid swapping) and to wait during processing, whicheversoftware (in particular whichever version of CLASS) they are using.Moreover, flexibility is favored in CLASS90. This means that the same things may be done in manydifferent, more or less efficient ways. It will take time to the CLASS90 community to learn what shouldbe or not be done to ensure efficiency. For instance, loading 300 000 with the LOAD command (see below) ona laptop is probably going to take a while (if possible at all due to limitation in RAM memory). However,this possibility does not even exist within CLASS77.3 Large dataset processingIt is today possible with the IRAM–30 m to map a square degree field in 12 CO (J=2–1). As an order ofmagnitude, this gives a final spectra cube of about 10 6 spectra with a slight oversampling of 4 ′′ .3.1 Basic ideaAn observer who has just spent a few hours doing OTF observation of the same source may want tovisualize all the dumped spectra at once even though they do not belong to the same scan. This wasimpossible in CLASS77. In CLASS90, it is now possible to load all the individual spectra currently inthe index as a 2D array for future work, in particular visualization.3.2 Listing and Table of ContentBefore visualizing, the user needs to know what kind of data is available. The LIST command is commonlyused to easily see the content of the current index. However, this command outputs one line perobservation in CLASS90 which is useless when dealing with thousands of observations. The LIST /SCANcommand reintroduces the CLASS77 way of listing an index, i.e. one line per scan and setup (i.e. uniquecombination of source, line and telescope names). LIST /SCAN /BRIEF lists the scan with the number ofassociated observations. These three possibilities respectively giveLAS90> listI-LISTE, Current index:197; 3 B0355+508 12CO(1-0) 30M-V01-A100 -109.1 -100.0 Eq 9608; 1198; 3 B0355+508 12CO(1-0) 30M-V01-A100 -106.1 -100.0 Eq 9608; 1199; 3 B0355+508 12CO(1-0) 30M-V01-A100 -103.0 -100.0 Eq 9608; 1200; 3 B0355+508 12CO(1-0) 30M-V01-A100 -100.5 -100.0 Eq 9608; 1201; 3 B0355+508 12CO(1-0) 30M-V01-A100 -97.5 -100.0 Eq 9608; 1...270; 3 B0355+508 12CO(1-0) 30M-V02-B100 -109.1 -100.0 Eq 9608; 1271; 3 B0355+508 12CO(1-0) 30M-V02-B100 -106.1 -100.0 Eq 9608; 1272; 3 B0355+508 12CO(1-0) 30M-V02-B100 -103.0 -100.0 Eq 9608; 1273; 3 B0355+508 12CO(1-0) 30M-V02-B100 -100.5 -100.0 Eq 9608; 1274; 3 B0355+508 12CO(1-0) 30M-V02-B100 -97.5 -100.0 Eq 9608; 1...343; 3 B0355+508 12CO(2-1) 30M-V03-A230 -109.1 -100.0 Eq 9608; 1344; 3 B0355+508 12CO(2-1) 30M-V03-A230 -106.1 -100.0 Eq 9608; 1345; 3 B0355+508 12CO(2-1) 30M-V03-A230 -103.0 -100.0 Eq 9608; 1346; 3 B0355+508 12CO(2-1) 30M-V03-A230 -100.5 -100.0 Eq 9608; 1347; 3 B0355+508 12CO(2-1) 30M-V03-A230 -97.5 -100.0 Eq 9608; 167
Page 1 and 2:
UNIVERSITÉ PIERRE ET MARIE CURIEHA
Page 3 and 4:
tel-00726959, version 1 - 31 Aug 20
Page 5 and 6:
Table des matières1 Rapport de sou
Page 7 and 8:
Rapport après soutenanceHabilitati
Page 9 and 10:
Chapitre 2Curriculum vitaetel-00726
Page 11 and 12:
2.7 ANIMATION ET DIFFUSION DE LA CU
Page 13 and 14:
2.8 PARCOURS 131992-1993 ÉCOLE NOR
Page 15 and 16:
Chapitre 3Copyright: IRAM/PdBIIntro
Page 17 and 18:
tel-00726959, version 1 - 31 Aug 20
Page 19 and 20:
4.2 ETUDES DIRECTES EN ÉMISSION 19
Page 21 and 22:
4.4 LA LUMINOSITY CO PAR MOLÉCULE
Page 23 and 24:
356 E. Falgarone et al.: Extreme ve
Page 25 and 26:
Page 27 and 28:
Page 29 and 30:
Page 31 and 32:
Page 33 and 34:
Page 35 and 36:
Page 37 and 38:
A&A 518, A45 (2010)1001010⌠⌡ τ
Page 39 and 40:
A&A 518, A45 (2010)If X HCO + is as
Page 41 and 42:
A&A 518, A45 (2010)tel-00726959, ve
Page 43 and 44:
A&A 518, A45 (2010)tel-00726959, ve
Page 45 and 46:
A&A 518, A45 (2010)Table E.2. Data
Page 47 and 48:
A&A 541, A58 (2012)tel-00726959, ve
Page 49 and 50:
A&A 541, A58 (2012)tel-00726959, ve
Page 51 and 52:
A&A 541, A58 (2012)0.08 0.10.20.12
Page 53 and 54:
A&A 541, A58 (2012)b=240.11 0.1 0.1
Page 55 and 56:
0.080.09 0.1A&A 541, A58 (2012)0.14
Page 57 and 58:
A&A 541, A58 (2012)43˚00'0.3 0.44
Page 59 and 60:
A&A 541, A58 (2012)68˚00'1.1 0.91.
Page 61 and 62:
A&A 541, A58 (2012)α(J2000)-19H57m
Page 63 and 64:
A&A 541, A58 (2012)tel-00726959, ve
Page 65 and 66:
A&A 541, A58 (2012)Jenkins, E. B.,
Page 67 and 68:
A&A 541, A58 (2012)Galactic Latitud
Page 69 and 70:
tel-00726959, version 1 - 31 Aug 20
Page 71 and 72:
5.2 UNE PHYSIQUE BIEN CONTRAINTE ET
Page 73 and 74:
5.3 PERSPECTIVES : DES RELEVÉS DE
Page 75 and 76:
A&A 435, 885-899 (2005)DOI: 10.1051
Page 77 and 78:
tel-00726959, version 1 - 31 Aug 20
Page 79 and 80:
J. Pety et al.: Are PAHs precursors
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
566 J. R. Goicoechea et al.: Low su
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
tel-00726959, version 1 - 31 Aug 20
Page 109 and 110:
J. R. Goicoechea et al.: Low sulfur
Page 111 and 112:
L42J. Pety et al.: Deuterium fracti
Page 113 and 114: L44J. Pety et al.: Deuterium fracti
Page 115 and 116: 772 J. R. Goicoechea et al.: The io
Page 127 and 128: A&A 494, 977-985 (2009)DOI: 10.1051
Page 129 and 130: M. Gerin et al.: HCO mapping of the
Page 137 and 138: Table 1. Observation parameters for
Page 139 and 140: A&A 534, A49 (2011)tel-00726959, ve
Page 145 and 146: tel-00726959, version 1 - 31 Aug 20
Page 157 and 158: ¡¢£¤¥¢¦¢ §¨ ©
Page 161 and 162: 7.2 MODE INTERFÉROMÉTRIQUE 161tel
Page 163: 7.3 LE FUTUR DE LA RADIO-ASTRONOMIE
Page 167 and 168: CLASS evolution: I. Improved OTF su
Page 169 and 170: A&A 526, A47 (2011)DOI: 10.1051/000
Page 171 and 172: S. Maret et al.: Weeds: a CLASS ext
Page 173 and 174: S. Maret et al.: Weeds: a CLASS ext
Page 175 and 176: IRAM-30m EMIR time/sensitivity esti
Page 177 and 178: IRAM-30m EMIR time/sensitivity esti
Page 179 and 180: IRAM-30m HERA time/sensitivity esti
Page 181 and 182: ¬þ«ðZñÛùþ˜ï³þ«ðWMõÑ
Page 183 and 184: ¨-A¨-, #f¡§¨\¤qŠ’‹¼€(
Page 185 and 186: ¤H F!";
Page 187 and 188: #O.u\J0$!&%©ÉQ©6¦©¨-.u& (HÌ>
Page 189 and 190: ¨*.G©6E¦cÇ¦©¨&ẗØn¨"!-‡
Page 191 and 192: ¢¡¤£¦¥¨§ P© ¡ £¦¥¨§
Page 193 and 194: '¥0vB"(-7£O.'¥!5#&(-7)7)(:9.*d#J
Page 195 and 196: ¥¤¡ b@‚¥_ƒO@02,.(-EFJbe O@#V
Page 197 and 198: 02J$#J+'10-ï 3 02EFJ+')EKJ5L5†R(
Page 215 and 216:
A&A 517, A12 (2010)tel-00726959, ve
Page 217 and 218:
Table C.1. Definition of the symbol
Page 219 and 220:
IRAM Memo 2011-2WIFISYN:The GILDAS
Page 221 and 222:
WIFISYN3. practiceWIFISYN3. practic
Page 223 and 224:
WIFISYNA. implementation planWIFISY
Page 225 and 226:
tel-00726959, version 1 - 31 Aug 20
Page 227 and 228:
8.3 PERSPECTIVES 227tel-00726959, v
Page 229 and 230:
3 REQUIREMENTS 44 CHANGES FOR END-U
Page 231 and 232:
5 CHANGES FOR PROGRAMMERS 125 CHANG
Page 233 and 234:
A EXHAUSTIVE DESCRIPTION OF THE CHA
Page 235 and 236:
Chapitre 9Copyright: Stéphane Guis
Page 237 and 238:
9.3 ACTIVITÉS 2008-2011 237tel-007
Page 239 and 240:
Contribution de l'Action Spécique
Page 241 and 242:
A. des multi-pixels à bure : une s
Page 243 and 244:
5. besoins en services annexes, bé
Page 245 and 246:
Articles publiés dans des revues
Page 247 and 248:
ARTICLES PUBLIÉS DANS DES REVUES
Page 249 and 250:
Mémos IRAM et ALMAtel-00726959, ve
Page 251 and 252:
Actes de colloques nationaux et int
Page 253 and 254:
ACTES DE COLLOQUES NATIONAUX ET INT
Page 255 and 256:
tel-00726959, version 1 - 31 Aug 20
show all

[tel-00726959, v1] CaractÃ©riser le milieu interstellaire ... - HAL - INRIA

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?