Please note that when delivered to the observer, this file also contains the XMM SSC data screening report for the observation, appended at the end. 1 PCMS Processing ----------------- Full release note for prod configuration 01_prod8.3_20100920.120500 =================================================================== PCMS Infrastructure Version: 8.3 Pipeline Version: 01_prod8.3_20100920.120500 Pipeline Name: prod8.3 Release Date: 2010-09-20 SAS Manifest: xmmsas_20100920_1801 SAS Version: 10.0.3 ppstrack Summary ======= This pipeline represents a significant change with respect to the previous prod8.1 pipeline (version:07000001_20090303.144400), embodying both a substantial number of (mostly minor) changes to the PCMS processing system itself and incorporation of version 10.0.3 of the SAS. The most significant changes to the pipeline include: i) Creation of per-band detector masks. In the previous pipeline, PN bad (dark) columns in the band 1 and 2 exposure maps were based on band 1 information while band 3-5 exposure maps were based on band 3. However, for the background maps, dark columns were mapped based on band 1 detector masks only. As a result, PN band 3-5 exposure maps differed in appearance from the background maps in terms of the dark columns imprinted on them. This caused no material difference in source detection as the (conservative) band-1 detector mask is applied but it led to visual differences in the band 3-5 exposure and background maps. In this new pipeline, this discrepancy in the exposure/background maps is removed by the creation and use of the multi-band detector masks. Note that the band-1 detector mask is, however, still applied, as before, in source detection. ii) Inclusion, for the first time, of the epreject task to better filter PN low energy MIP events Other upgrades involve: iii) A number of minor bugs and cosmetic improvements have been made to the PPS html output files. PN SW and MOS W6 modes are now (correctly) shown as not used for source-specific-product creation. The precision of some quantities (e.g. coordinates, detection likelihood) are made more consistent, and the coordinate error units are now (correctly) stated as arcseconds. Rounding errors on coordinates should no longer yield 60.0 for the seconds/arcseconds element. iv) EPIC flare background timeseries graphic plots are now plotted with the count rate (y axis) in log space to better highlight the low rate periods. v) In cases where the OPEN filter is used with the EPIC instruments, these data are now excluded from the source detection stage to reduce the potential impact of optically loaded sources. The OPEN filter is only used extremely rarely. vi) Where the variability test was not applied or failed during the processing of EPIC source specific time-series products, the AVRATE, CHISQUAR and CHI2PROB keywords are set to -1 and N_POINTS=0. vii) Systematic errors are now set to the values of 0.35 (where astrometric rectification was successful) and 1.0 otherwise, as explained in Watson et al., 2009, A&A, 493, 339-373. These values are propagated for use by the ACDS external catalogue cross-correlation stage. viii) The USNO B-1 extract used during the astrometric rectification of both EPIC and OM source lists is created as a formal product for the first time. This file includes USNO B-1 objects in the full EPIC field. ix) The nsigma parameter is raised from 2 to 3 for omdetect in OM fast mode processing. The changes of the SAS between SAS version 8.0 used in pipeline 07000001_20090303.144400 and SAS version 10.0.2 are described at http://xmm.esac.esa.int/sas/current/documentation/releasenotes. Minor further changes were included in to SAS 10.0.3 which is used in this pipeline. Documentation ============= Documentation for this pipeline and pipeline products can be found here: Pipeline Summary ================ i. Products Created. ii. SAS Tasks. iii. Calibration Files. iv. Response Matrices. v. Energy Bands. vi. Energy Conversion Factors. vii. Source Position Rectification. i. Products Created =================== The following table summarises all possible product files created by this pipeline. Withdrawn products are included and marked for completeness. Product file names are subdivided into components: Pooooooooooiiseeeccccccbnnn.ttt where: oooooooooo is the Observation Identifier. ii is the instrument. s is the scheduled flag. eee is the exposure number. cccccc is the file identifier given in the table below. b is the instrument specific field (ISF): Energy band for EPIC instruments. OM science window or OM filter code for OM products. Spectral order for RGS products. nnn is the hexidecimal source number or 000. ttt is the file type. |=============|========================================|===================|=========|==============|========|==============| | Status/notes| Product Index Description | File Identifier | Class | File Types | ISF | Per Source | |=============|========================================|===================|=========|==============|========|==============| | | MAIN CROSS CORRELATION PAGE | XCORRE | CATOBS | HTM | | | | | EPIC OBSERVATION BOX-LOCAL SOURCE LIST | OBLSLI | EPICOBS | FIT | | | | | EPIC OBSERVATION BOX-MAP SOURCE LIST | OBMSLI | EPICOBS | FIT | | | | | EPIC OBSERVATION SENSITIVITY MAP | OSNSMP | EPICOBS | FIT | BAND | | | | EPIC MOS IMAGING MODE EVENT LIST | MIEVLI | EPICEXP | FIT | | | | | EPIC PN IMAGING MODE EVENT LIST | PIEVLI | EPICEXP | FIT | | | | | EPIC TIMING MODE EVENT LIST | TIEVLI | EPICEXP | FIT | | | | | EPIC FLARE BACKGROUND TIMESERIES | FBKTSR | EPICEXP | FIT,PDF | | | | | EPIC EXPOSURE MAP | EXPMAP | EPICEXP | FIT,PNG | BAND | | | | EPIC IMAGE | IMAGE_ | EPICEXP | FIT,PNG | BAND | | | | EPIC SOURCE DS9 REGIONS | REGION | EPICOBS | ASC | | | | | EPIC OBSERVATION ML SOURCE LIST | OMSRLI | EPICOBS | FIT | | | | | EPIC SUMMARY SOURCE LIST | OBSMLI | EPICOBS | FIT,HTM | | | | (1) | EPIC DETECTION MASK | DETMSK | EPICOBS | FIT,PNG | BAND | | | | EPIC MERGED BACKGROUND MAP | BKGMAP | EPICOBS | FIT,PNG | BAND | | | | EPIC OBSERVATION BACKGROUND MAP | OBKGMP | EPICOBS | FIT,PNG | BAND | | | | EPIC OBSERVATION EXPOSURE MAP | OEXPMP | EPICOBS | FIT,PNG | BAND | | | | EPIC OBSERVATION IMAGE | OIMAGE | EPICOBS | FIT,PNG | BAND | | | | EPIC OBSERVATION SUMMARY | SUMMAR | EPICOBS | HTM | | | | | EPIC SOURCE DS9 REGION | SRCREG | EPICSRC | ASC | | Y | | | EPIC ANCILLARY RESPONSE FUNCTION | SRCARF | EPICSRC | FIT | | Y | | | EPIC SOURCE BACKGROUND SPECTRUM | BGSPEC | EPICSRC | FIT | | Y | | | EPIC SOURCE SPECTRUM | SRSPEC | EPICSRC | FIT | | Y | | | EPIC SOURCE TIMESERIES | SRCTSR | EPICSRC | FIT | BAND | Y | | | EPIC SOURCE FFT PLOT | SFFTPL | EPICSRC | PDF | BAND | Y | | | EPIC SOURCE SPECTRUM PLOT | SPCPLT | EPICSRC | PDF | | Y | | | EPIC SOURCE TIMESERIES PLOT | STSPLT | EPICSRC | PDF | BAND | Y | | | OM FULL-FRAME IMAGE | FIMAG_ | OMEXP | FIT | | | | | OM TRACKING STAR TIMESERIES | TSTRTS | OMEXP | FIT,PDF | | | | | OM FULL-FRAME SKY IMAGE | FSIMAG | OMEXP | FIT,PNG | | | | | OM TRACKING HISTORY PLOT | TSHPLT | OMEXP | PDF | | | | | OM OBSERVATION SOURCE LIST | OBSMLI | OMOBS | FIT | | | | | OM FULL-FRAME HIRES SKY IMAGE MOSAIC | HSIMAG | OMOBS | FIT,PNG | FILTER | | | | OM FULL-FRAME LORES SKY IMAGE MOSAIC | LSIMAG | OMOBS | FIT,PNG | FILTER | | | | OM RUDI-5 SKY IMAGE MOSAIC | RSIMAG | OMOBS | FIT,PNG | FILTER | | | | OM USER WINDOWS SKY IMAGE MOSAIC | USIMAG | OMOBS | FIT,PNG | FILTER | | | | OM OBSERVATION SUMMARY | SUMMAR | OMOBS | HTM | | | | | OM OSW SOURCE TIMESERIES | TIMESR | OMSRC | FIT,PDF | OSW | Y | | | OM GRISM DS9 REGIONS | SGSREG | OMSW | ASC | OSW | | | | OM GRISM DS9 SPECTRUM REGIONS | SPCREG | OMSW | ASC | OSW | | | | OM OSW FAST REGION FILE | SFSREG | OMSW | ASC | OSW | | | | OM OSW REGION FILE | SWSREG | OMSW | ASC | OSW | | | | OM FAST MODE OSW IMAGE | IMAGEF | OMSW | FIT | OSW | | | | OM FAST MODE OSW SKY IMAGE | SIMAGF | OMSW | FIT | OSW | | | | OM GRISM SPECTRA LIST | SPECLI | OMSW | FIT | OSW | | | | OM OSW FAST SOURCE LIST | SFSRLI | OMSW | FIT | OSW | | | | OM OSW GRISM SOURCE LIST | SGSRLI | OMSW | FIT | OSW | | | | OM OSW IMAGE | IMAGE_ | OMSW | FIT | | | | | OM OSW SOURCE LIST | SWSRLI | OMSW | FIT | | | | | OM GRISM SOURCE SPECTRUM | SPECTR | OMSW | FIT,PDF,PNG | OSW | Y | | | OM GRISM-ALIGNED IMAGE | GIMAGE | OMSW | FIT,PNG | OSW | | | | OM OSW SKY IMAGE | SIMAGE | OMSW | FIT,PNG | | | | | PPS RUN MESSAGE | PPSMSG | PPSOBS | ASC | | | | | PPS SCRIPT LOG | SCRLOG | PPSOBS | ASC | | | | | ATTITUDE TIME SERIES | ATTTSR | PPSOBS | FIT | | | | NEW (2) | REFERENCE CATALOGUE | REFCAT | PPSOBS | FIT | | | | | CALIBRATION INDEX FILE | CALIND | PPSOBS | FIT | | | | | PPS PRODUCT INDEX | PINDEX | PPSOBS | FIT | | | | | PPS OBSERVATION SUMMARY | SUMMAR | PPSOBS | HTM | | | | | PPS RUN SUMMARY | PPSSUM | PPSOBS | HTM | | | | | SSC LOGO 1 | SSCLG1 | PPSOBS | PNG | | | | | SSC LOGO 2 | SSCLG2 | PPSOBS | PNG | | | | | RGS BACKGROUND MODEL | BGMODL | RGSEXP | FIT | ORDER | | | | RGS EVENT LIST | EVENLI | RGSEXP | FIT | | | | | RGS EXPOSURE MAP | EXPMAP | RGSEXP | FIT | | | | | RGS SOURCE LIST | SRCLI_ | RGSEXP | FIT | | | | | RGS WHOLE FIELD RESPONSE MATRIX | WREMAT | RGSEXP | FIT | ORDER | Y | | | RGS ENERGY-DISPERSION IMAGE | ORDIMG | RGSEXP | FIT,PNG | | | | | RGS FLARE BACKGROUND TIMESERIES | FBKTSR | RGSEXP | FIT,PNG | | | | | RGS IMAGE | IMAGE_ | RGSEXP | FIT,PNG | | | | | RGS WHOLEFIELD SPECTRUM | WFSPEC | RGSEXP | FIT,PDF | ORDER | | | | RGS FLUXED SPECTRUM | FLUXED | RGSOBS | FIT,PDF | ORDER | Y | | | RGS OBSERVATION SUMMARY | SUMMAR | RGSOBS | HTM | | | | | RGS CROSS-DISPERSION HISTOGRAM | DSPHIS | RGSSRC | FIT | ORDER | Y | | | RGS RESPONSE MATRIX | RSPMAT | RGSSRC | FIT | ORDER | Y | | | RGS SOURCE BACKGROUND SPECTRUM | BGSPEC | RGSSRC | FIT | ORDER | Y | | | RGS SOURCE SPECTRUM | SRSPEC | RGSSRC | FIT,PDF | ORDER | Y | | | RGS BACKGROUND SPECTRUM | SBSPEC | RGSSRC | FIT | ORDER | Y | |=============|========================================|===================|=========|==============|========|==============| Notes (1) - In this pipeline, the EPIC detector mask files are now made on a per-band, per-camera basis. Previously a single mask, based on band-1, was made per camera. (2) - A new pipeline product is made which is an extract of the USNO B-1 catalogue covering the XMM-Newton field. This file, used in the astrometric rectification processes for EPIC and OM data, is being made available to make it easier for users to replicate this aspect of pipeline processing. ii. SAS Tasks ============= The current pipeline uses a pipeline-specific SAS manifest, xmmsas_xmmsas_20100920_1801. This manifest is built around the version 10.0.0 release of the SAS (manifest xmmsas_20100423_1801 - see http://xmm.esac.esa.int/sas/current/documentation/releasenotes/xmmsas_10.0.0.shtml for details of the SAS task versions and changes relative to the previous SAS releases) but includes a small number of specific task patches released in the subsequent public SAS 10.0.1 and 10.0.2 updates. It also includes one extra task (ppsslewsumm) needed for the slew pipeline and some minor patches to other tasks, all of which are contained in SAS 10.0.3. For all practical purposes, the pipeline SAS is consistent with the publicly available SAS (10.0.2). iii. Calibration Files ====================== Pipeline processing generally accesses an evolving set of CCFs (current calibration files). For each observation, a subset of the full set of CCFs is used in processing that pertains to the epoch of the observation; the CCF components/versions used are identified in the calibration index file (PooooooooooOBX000CALIND0000.FIT) that is included in the delivered observation data product set. iv. Response Matrices ===================== The pipeline uses a set of EPIC canned RMFs which are updated from time to time. At inception, this pipeline accesses version 10.0 of the PN RMFs and version 1.2 of the MOS RMFs. The latest available canned RMFs are described and available from https://www.cosmos.esa.int/web/xmm-newton/calibration Note that for the MOS instruments, the latest available RMFs are position dependent and supersede those used in the pipeline. Users analysing MOS spectra of sources on or near the MOS 'patch' may wish to obtain and use the newer RMF files. v. Energy Bands =============== |======|===================| | Band | Energy Range (eV) | |======|===================| | 1 | 200 - 500 | | 2 | 500 - 1000 | | 3 | 1000 - 2000 | | 4 | 2000 - 4500 | | 5 | 4500 - 12000 | | 6 | 200 - 2000 | | 7 | 2000 - 12000 | | 8 | 200 - 12000 | | 9 | 500 - 4500 | |======|===================| vi. Energy Conversion Factors ============================= EPIC energy conversion factors (ECFs) are computed using the instrument response files (PN version 7.0, MOS version 1.2) for an assumed absorbed power law model with Gamma=1.7 and an absorbing column density of 3x10^20/cm2. They are provided for each EPIC instrument and filter, for each energy band. In this pipeline, the following fixed energy conversion factors (ECFs) are used: |============|========|=========================================================================| | Instrument | Filter | Band | | | | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | |============|========|=========|=========|=========|==========|==========|===|===|===|=========| | epn | Open | 16.5304 | 10.2555 | 6.16611 | 1.98190 | 0.556273 | - | - | - | 5.13134 | | epn | Thin | 9.05601 | 8.25349 | 5.87836 | 1.95026 | 0.555226 | - | - | - | 4.58257 | | epn | Medium | 7.88027 | 7.99516 | 5.77852 | 1.92694 | 0.554529 | - | - | - | 4.48375 | | epn | Thick | 4.69897 | 6.13757 | 4.99916 | 1.82646 | 0.547553 | - | - | - | 3.78153 | | emos1 | Open | 3.09427 | 2.19119 | 2.12500 | 0.757786 | 0.143898 | - | - | - | 1.51194 | | emos1 | Thin | 1.72543 | 1.80741 | 2.02768 | 0.746683 | 0.143585 | - | - | - | 1.39049 | | emos1 | Medium | 1.51415 | 1.75577 | 1.99329 | 0.737800 | 0.143375 | - | - | - | 1.36449 | | emos1 | Thick | 0.98524 | 1.42597 | 1.77517 | 0.707822 | 0.141457 | - | - | - | 1.20820 | | emos2 | Open | 3.14224 | 2.19588 | 2.13171 | 0.762227 | 0.151536 | - | - | - | 1.51740 | | emos2 | Thin | 1.73763 | 1.80975 | 2.03440 | 0.750569 | 0.151222 | - | - | - | 1.39543 | | emos2 | Medium | 1.52095 | 1.75929 | 1.99916 | 0.742242 | 0.151013 | - | - | - | 1.36917 | | emos2 | Thick | 0.98324 | 1.42832 | 1.78104 | 0.711708 | 0.148990 | - | - | - | 1.21236 | |============|========|=========|=========|=========|==========|==========|===|===|===|=========| vii. Source Position Rectification ================================== Source position rectification continues to be performed against extracts from the USNO-B1 catalogue.