Full release note for ppsprod-18.01 =================================== Pipeline Version: 18.01_20200110_1700 Pipeline name: ppsprod Release Date: 2020-01-10 SAS Manifest: xmmsas_20191120_1210 Summary ======= This version of the pipeline is basically the one used to reprocess all archival data available up to 2019. The few changes in SAS routines versions only reflect the upgrade to public SAS18 version. Since the reprocessed observaions public before April 2019 have been used for a major version of the EPIC Serendipitous Source Catalogue (SSC), the changes outlined below refer to the pipeline used for previous major version of the SSC catalogue, some of them were already introduced in previous pipeline versions. Improvements in calibrations are not listed here as they can be found in SAS and/or CCFs release notes. i) Extraction of source-specific products (SSP) (time-series and spectra) for individual sources has undergone a major revision. The size of the source extraction region is still optimized according to the brightness of the source, but the region to estimate the associated background is now restricted to the same CCD where the center of the source is found, except for MOS SW modes, where an annulus over the peripheral CCDs is chosen. PNG files with source and background extraction regions overlaid on count images are also new SSP products. In the case of EPIC-pn Timing mode data the location of the source in RAWX coordinate is determined as the location of maximum of the RAWX histogram. The source extraction region extends 9 RAWX columns on side of the source location and the background region is fixed to RAWX in [2,6]. If the source and background extraction regions are found to overlap or there are less than 100 counts in the histogram, the source products are not created. In the case of very strong spectra this method may produce a background with significant contribution of the source at certain energies. ii) EPIC lightcurves are produced per energy band for all exposures. A new FITS file is available under the PPS products per EPIC instrument and observation which contains lightcurves for all the available exposures in the energy bands 1, 2, 3, 4, 5 and 8. For TIMING mode information is given in the energy bands 2, 3, 4 and 9. The time bin size for PN Light Curves has been fixed to 20 times the frametime of the corresponding exposure mode. For MOS1/2 the method to fix the time bin size according the mean count rate has not been modified. Given the low count number per bin in most EPIC-pn lightcurves the variability tests are computed on lightcurves rebinned to an average of 20 counts per bin and the results of the tests are saved in the header of the small time bin PPS product. iii) The method to estimate the background in EPIC images has been changed from splines interpolation to local smoothing of source free regions. The new method in combination of an extra call to embadpixfind task yield a reasonable compromise between detection number and spurious content. iv) Special flagging has been included for sources detected in OM low sensitivity patch. v) Quiescent particle background (estimated from Filter-Wheel-Closed repository) and EPIC-pn out of time events are subtracted from EPIC coloured images. Other minor changes related to general info about observations environment are a) new PPS file with spacecraft orbit information as Geocentric Equatorial J2000 and Geocentric Solar Ecliptic coordinates b) new PPS file with Radiation Monitor count rates The version of SAS being used is a pipeline-specific manifest xmmsas_20191120_1210. This is based on the public SAS release 18.0.0, described at http://www.cosmos.esa.int/web/xmm-newton/sas-release-notes-1800 Documentation ============= Documentation for this pipeline can be found at: http://www.cosmos.esa.int/web/xmm-newton/pipeline and links therein. Pipeline Summary ================ i. Products created. ii. SAS Tasks. iii. Calibration files. iv. Response matrices. v. Energy Bands. vi. Energy Conversion Factors. vii. Source Position Rectification. i. Products Created =================== The following table summarises all possible product files created by this pipeline. Withdrawn products are noted for completeness. Product file names are subdivided into components: Pooooooooooiiseeeccccccbnnn.ttt where: oooooooooo is the Observation Identifier. ii is the instrument. s is the scheduled flag. eee is the exposure number. cccccc is the file identifier given in the table below. b is the instrument specific field (ISF): Energy band for EPIC instruments. OM science window or OM filter code for OM products. Spectral order for RGS products. nnn is the hexidecimal source number or 000. ttt is the file type. |=============|==========================================|===================|=========|==============|========|==============| | Status/notes| Product Index Description | File Identifier | Class | File Types | ISF | Per Source | |=============|==========================================|===================|=========|==============|========|==============| | | EPIC OBSERVATION BOX-LOCAL SOURCE LIST | OBLSLI | EPICOBS | FIT | | | | | EPIC OBSERVATION BOX-MAP SOURCE LIST | OBMSLI | EPICOBS | FIT | | | | | EPIC OBSERVATION SENSITIVITY MAP | OSNSMP | EPICOBS | FIT | BAND | | | | EPIC SOURCE DS9 REGIONS | REGION | EPICOBS | ASC | | | | | EPIC OBSERVATION ML SOURCE LIST | OMSRLI | EPICOBS | FIT | | | | | EPIC SUMMARY SOURCE LIST | OBSMLI | EPICOBS | FIT,HTM | | | | | EPIC DETECTION MASK | DETMSK | EPICOBS | FIT | BAND | | | | EPIC MERGED BACKGROUND MAP | BKGMAP | EPICOBS | FIT | BAND | | | | EPIC MERGED EXPOSURE MAP | MEXPMP | EPICOBS | FIT | BAND | | | | EPIC OBSERVATION BACKGROUND MAP | OBKGMP | EPICOBS | FIT,PNG | BAND | | | | EPIC OBSERVATION EXPOSURE MAP | OEXPMP | EPICOBS | FIT,PNG | BAND | | | | EPIC OBSERVATION FOOTPRINT | OFTPRT | EPICOBS | ASC | BAND | | | | EPIC OBSERVATION IMAGE | OIMAGE | EPICOBS | FIT,PNG | BAND | | | | EPIC THREE-COLOUR IMAGE | 3COLIM | EPICOBS | FIT,PNG | BAND | | | | EPIC OBSERVATION SUMMARY | SUMMAR | EPICOBS | HTM | | | | | EPIC MOS IMAGING MODE EVENT LIST | MIEVLI | EPICEXP | FIT | | | | | EPIC PN IMAGING MODE EVENT LIST | PIEVLI | EPICEXP | FIT | | | | | EPIC TIMING MODE EVENT LIST | TIEVLI | EPICEXP | FIT | | | | | EPIC FLARE BACKGROUND TIMESERIES | FBKTSR | EPICEXP | FIT,PDF | | | | | EPIC EXPOSURE MAP | EXPMAP | EPICEXP | FIT,PNG | BAND | | | | EPIC IMAGE | IMAGE_ | EPICEXP | FIT,PNG | BAND | | | | EPIC SOURCE DS9 REGION | SRCREG | EPICSRC | ASC | | Y | | | EPIC ANCILLARY RESPONSE FUNCTION | SRCARF | EPICSRC | FIT | | Y | | | EPIC SOURCE BACKGROUND SPECTRUM | BGSPEC | EPICSRC | FIT | | Y | | | EPIC SOURCE SPECTRUM | SRSPEC | EPICSRC | FIT | | Y | | | EPIC SOURCE SPECTRUM | SRSPEC | EPICSRC | PNG | | Y | | | EPIC SOURCE TIMESERIES | SRCTSR | EPICSRC | FIT | BAND | Y | | | EPIC SOURCE SPECTRUM PLOT | SPCPLT | EPICSRC | PDF | | Y | | | EPIC SOURCE TIMESERIES PLOT | STSPLT | EPICSRC | PDF | BAND | Y | | | OM FULL-FRAME IMAGE | FIMAG_ | OMEXP | FIT | | | | | OM TRACKING STAR TIMESERIES | TSTRTS | OMEXP | FIT | | | | | OM FULL-FRAME SKY IMAGE | FSIMAG | OMEXP | FIT,PNG | | | | | OM TRACKING HISTORY PLOT | TSHPLT | OMEXP | PDF | | | | | OM OBSERVATION SOURCE LIST | OBSMLI | OMOBS | FIT | | | | | OM OBSERVATION SOURCE LIST MOSAIC | OBSMOS | OMOBS | FIT | | | | | OM RUDI-5 SOURCE LIST MOSAIC | RSISWS | OMOBS | FIT | | | | | OM FULL-FRAME HIRES SOURCE LIST MOSAIC | HSISWS | OMOBS | FIT | | | | | OM FULL-FRAME LORES SOURCE LIST MOSAIC | LSISWS | OMOBS | FIT | | | | | OM USER WINDOWS SOURCE LIST MOSAIC | USISWS | OMOBS | FIT | | | | | OM OBSERVATION SOURCE REGION | OBSMLI | OMOBS | ASC | | | | | OM RUDI-5 SOURCE REGION MOSAIC | RSISWS | OMOBS | ASC | | | | | OM FULL-FRAME HIRES SOURCE REGION MOSAIC | HSISWS | OMOBS | ASC | | | | | OM FULL-FRAME LORES SOURCE REGION MOSAIC | LSISWS | OMOBS | ASC | | | | | OM USER WINDOWS SOURCE REGION MOSAIC | USISWS | OMOBS | ASC | | | | | OM FULL-FRAME HIRES SKY IMAGE MOSAIC | HSIMAG | OMOBS | FIT,PNG | FILTER | | | | OM FULL-FRAME LORES SKY IMAGE MOSAIC | LSIMAG | OMOBS | FIT,PNG | FILTER | | | | OM RUDI-5 SKY IMAGE MOSAIC | RSIMAG | OMOBS | FIT,PNG | FILTER | | | | OM USER WINDOWS SKY IMAGE MOSAIC | USIMAG | OMOBS | FIT,PNG | FILTER | | | | OM OBSERVATION SUMMARY | SUMMAR | OMOBS | HTM | | | | | OM OSW SOURCE TIMESERIES | TIMESR | OMSRC | FIT,PDF | OSW | Y | | | OM GRISM DS9 REGIONS | SGSREG | OMSW | ASC | OSW | | | | OM GRISM DS9 SPECTRUM REGIONS | SPCREG | OMSW | ASC | OSW | | | | OM OSW FAST REGION FILE | SFSREG | OMSW | ASC | OSW | | | | OM OSW REGION FILE | SWSREG | OMSW | ASC | OSW | | | | OM FAST MODE OSW IMAGE | IMAGEF | OMSW | FIT | OSW | | | | OM FAST MODE OSW SKY IMAGE | SIMAGF | OMSW | FIT | OSW | | | | OM FAST MODE OSW SKY IMAGE | SIMAGF | OMSW | PNG | OSW | | | | OM GRISM SPECTRA LIST | SPECLI | OMSW | FIT | OSW | | | | OM OSW FAST SOURCE LIST | SFSRLI | OMSW | FIT | OSW | | | | OM OSW GRISM SOURCE LIST | SGSRLI | OMSW | FIT | OSW | | | | OM OSW IMAGE | IMAGE_ | OMSW | FIT | | | | | OM OSW SOURCE LIST | SWSRLI | OMSW | FIT | | | | | OM GRISM SOURCE SPECTRUM | SPECTR | OMSW | FIT,PDF | OSW | Y | | | OM GRISM-ALIGNED IMAGE | GIMAGE | OMSW | FIT | OSW | | | | OM OSW SKY IMAGE | SIMAGE | OMSW | FIT,PNG | | | | | RGS BACKGROUND MODEL | BGMODL | RGSEXP | FIT | ORDER | | | | RGS EVENT LIST | EVENLI | RGSEXP | FIT | | | | | RGS EXPOSURE MAP | EXPMAP | RGSEXP | FIT | | | | | RGS SOURCE LIST | SRCLI_ | RGSEXP | FIT | | | | | RGS WHOLE FIELD RESPONSE MATRIX | WREMAT | RGSEXP | FIT | ORDER | Y | | | RGS ENERGY-DISPERSION IMAGE | ORDIMG | RGSEXP | FIT,PNG | | | | | RGS FLARE BACKGROUND TIMESERIES | FBKTSR | RGSEXP | FIT | | | | | RGS IMAGE | IMAGE_ | RGSEXP | FIT,PNG | | | | | RGS WHOLEFIELD SPECTRUM | WFSPEC | RGSEXP | FIT,PDF | ORDER | | | | RGS FLUXED SPECTRUM | FLUXED | RGSOBS | FIT,PDF | ORDER | Y | | | RGS OBSERVATION SUMMARY | SUMMAR | RGSOBS | HTM | | | | | RGS CROSS-DISPERSION HISTOGRAM | DSPHIS | RGSSRC | FIT | ORDER | Y | | | RGS RESPONSE MATRIX | RSPMAT | RGSSRC | FIT | ORDER | Y | | | RGS SOURCE BACKGROUND SPECTRUM | BGSPEC | RGSSRC | FIT | ORDER | Y | | | RGS SOURCE SPECTRUM | SRSPEC | RGSSRC | FIT,PDF | ORDER | Y | | | RGS BACKGROUND SPECTRUM | SBSPEC | RGSSRC | FIT | ORDER | Y | | | RGS SOURCE BACKGROUND TIMESERIES | SRBTSR | RGSSRC | FIT | | Y | | | RGS SOURCE TIMESERIES | SRCTSR | RGSSRC | FIT | | Y | | | RGS SOURCE TIMESERIES PLOT | STSPLT | RGSSRC | PDF | | | | | MAIN CROSS CORRELATION PAGE | XCORRE | CATOBS | HTM | | | | | CATALOGUE DESCRIPTIONS | Dxxxxa | CATCAT | HTM | | | | | EPIC FOV CROSS-CORRELATION RESULTS | FOVRES | CATCAT | HTM | | | | | EPIC FOV CROSS-CORRELATION RESULTS | Fxxxxa | CATCAT | FIT | | | | | EPIC SOURCE CROSS-CORRELATION RESULTS | Sxxxxa | CATOBS | FIT | | | | | EPIC SOURCE CROSS-CORRELATION RESULTS | SRCRES | CATOBS | HTM | | | | | EPIC SOURCE CROSS-CORRELATION SUMMARY | SRCSUM | CATOBS | HTM | | | | | EPIC SOURCE CROSS-CORRELATION SUMMARY | SRCSUM | CATOBS | FIT | | | | | EPIC FOV CROSS-CORRELATION SUMMARY | FOVSUM | CATOBS | FIT | | | | | EPIC FOV CROSS-CORRELATION SUMMARY | FOVSUM | CATOBS | HTM | | | | | EPIC CATALOGUE PLOT | CATPLT | CATOBS | PDF | | | | | SEARCHED CATALOGUES | SRCHD_ | CATOBS | HTM | | | | | SEARCHED CATALOGUES | SRCHD_ | CATOBS | FIT | | | | | XMM-ROSAT IMAGE | ROSIMG | CATOBS | PDF | | | | | FINDING CHART | FCHART | CATSRC | PDF | | Y | | | PPS RUN MESSAGE | PPSMSG | PPSOBS | ASC | | | | | PPS SCRIPT LOG | SCRLOG | PPSOBS | ASC | | | | | SPACECRAFT ORBIT | ORBTSR | PPSOBS | FIT | | | | NEW | RADMON RATE | RADMON | PPSOBS | FIT | | | | | ATTITUDE TIME SERIES | ATTTSR | PPSOBS | FIT | | | | | REFERENCE CATALOGUE | REFCAT | PPSOBS | FIT | | | | | CALIBRATION INDEX FILE | CALIND | PPSOBS | FIT | | | | | PPS PRODUCT INDEX | PINDEX | PPSOBS | FIT | | | | | PPS OBSERVATION SUMMARY | SUMMAR | PPSOBS | HTM | | | | | PPS RUN SUMMARY | PPSSUM | PPSOBS | HTM | | | | | SSC LOGO 1 | SSCLG1 | PPSOBS | PNG | | | | | SSC LOGO 2 | SSCLG2 | PPSOBS | PNG | | | | | CDS LOGO 1 | CDSLG1 | PPSOBS | PNG | | | | | CDS LOGO 2 | CDSLG2 | PPSOBS | PNG | | | | | CDS LOGO 3 | CDSLG3 | PPSOBS | PNG | | | |=============|==========================================|===================|=========|==============|========|==============| The files from the CAT* classes, are products generated by the Archival Catalogue and Database Subsystem (ACDS) at the Observatoire Astronomique de Strasbourg (OAS) - they are the result of cross-correlations of XMM sources with archival catalogues by the ACDS. They have been made previously but are outlined here for the first time. Those files with xxxxa tags are generated for each external catalogue that the XMM sources are correlated with. ii. SAS Tasks ============= The current pipeline uses a pipeline-specific SAS manifest xmmsas_20191120_1210. This manifest is built upon the version 18.0.0 release of the SAS (manifest xmmsas_20190531_1155 - see http://www.cosmos.esa.int/web/xmm-newton/sas-release-notes-1800. for details of the SAS task versions and changes relative to the previous SAS releases) but includes a number of specific task patches. SAS tasks used in the current pipeline are shown in the table below, along with their respective versions in SAS 18.0.0. The second column indicates whether the task has a newer (>) or the same (=) version number in the pipeline version. |================|===|=================|============| | TASK | | SAS 18.0.0 | 18.01 | |================|===|=================|============| |addattribute | = | 2.3 | 2.3 | |arfgen | = | 1.98.3 | 1.98.3 | |attcalc | = | 4.39 | 4.39 | |attfilter | = | 4.39 | 4.39 | |attbin | = | 1.5 | 1.5 | |atthkgen | = | 1.22.1 | 1.22.1 | |attmove | = | 1.6 | 1.6 | |backscale | = | 1.6 | 1.6 | |badpix | = | 2.33 | 2.33 | |badpixfind | = | 1.41 | 1.41 | |bkgoptrate | = | 1.8 | 1.8 | |catcorr | = | 0.11.1 | 0.11.1 | |catprep | = | 0.5.4 | 0.5.4 | |cifbuild | = | 4.9 | 4.9 | |dpssflag | = | 11.6 | 11.6 | |dpsssrc | = | 1.2.1 | 1.2.1 | |dscopyblock | = | 1.11.1 | 1.11.1 | |dscp | = | 1.11.1 | 1.11.1 | |dsrm | = | 1.11.1 | 1.11.1 | |eboxdetect | = | 4.28.2 | 4.28.2 | |ebkgreg | = | 0.8 | 0.8 | |echeckregion | = | 1.54 | 1.54 | |ecoordconv | = | 1.54 | 1.54 | |eexpmap | = | 4.12 | 4.12 | |efftplot | = | 2.21 | 2.21 | |ekstest | = | 2.8 | 2.8 | |elcplot | = | 2.6 | 2.6 | |emask | = | 2.15 | 2.15 | |embadpixfind | = | 2.6.1 | 2.6.1 | |emenergy | = | 8.9 | 8.9 | |emevents | = | 8.8 | 8.8 | |emeventsproj | = | 1.6 | 1.6 | |emframes | = | 5.11 | 5.11 | |emldetect | = | 7.5.2 | 7.5.2 | |emosaic | = | 1.18 | 1.18 | |emtaglenoise | = | 1.2 | 1.2 | |eootepileupmask | = | 2.10 | 2.10 | |epatplot | = | 1.22 | 1.22 | |epevents | = | 6.55 | 6.55 | |epexposure | = | 0.16 | 0.16 | |epfast | = | 0.7 | 0.7 | |epframes | = | 8.116 | 8.116 | |epiclccorr | = | 1.22.2 | 1.22.2 | |epproc | = | 2.24.1 | 2.24.1 | |eposcorr | = | 3.13 | 3.13 | |epreject | = | 5.18.1 | 5.18.1 | |epnoise | = | 0.9 | 0.9 | |esensmap | = | 3.13 | 3.13 | |eslewchain | = | 1.17.1 | 1.17.1 | |eslewsearch | = | 1.17.1 | 1.17.1 | |esources | = | 1.5 | 1.5 | |especget | = | 1.54 | 1.54 | |esplinemap | = | 5.1.1 | 5.1.1 | |etimeget | = | 1.54 | 1.54 | |etruecolor | = | 1.30.1 | 1.30.1 | |evalcorr | = | 0.8 | 0.8 | |evlistcomb | = | 4.20 | 4.20 | |evqpb | = | 0.5 | 0.5 | |evselect | = | 3.68 | 3.68 | |gtialign | = | 2.11 | 2.11 | |gtimerge | = | 1.8 | 1.8 | |hkgtigen | = | 1.15 | 1.15 | |implot | = | 2.20 | 2.20 | |implotregions | = | 1.1 | 1.1 | |implotrgb | = | 2.20 | 2.20 | |imweightadd | = | 1.68 | 1.68 | |lccorr_pcms | = | 1.7 | 1.7 | |lcplot | = | 1.22.1 | 1.22.1 | |merge | = | 0.15 | 0.15 | |odfingest | = | 3.32.1 | 3.32.1 | |omatt | = | 2.57.1 | 2.57.1 | |omcomb | = | 2.5 | 2.5 | |omcosflag | = | 1.35 | 1.35 | |omdetect | = | 5.41 | 5.41 | |omdrifthist | = | 1.30.1 | 1.30.1 | |omfastflat | = | 1.22 | 1.22 | |omfastshift | = | 1.26 | 1.26 | |omflatfield | = | 2.7 | 2.7 | |omflatgen | = | 1.13 | 1.13 | |omlcbuild | = | 1.41 | 1.41 | |ommag | = | 3.12 | 3.12 | |ommodmap | = | 2.26 | 2.26 | |ommosaic | = | 2.10 | 2.10 | |omgprep | = | 1.11 | 1.11 | |omgrism | = | 1.29 | 1.29 | |omgrismplot | = | 1.7 | 1.7 | |omprep | = | 2.48 | 2.48 | |omqualitymap | = | 1.5 | 1.5 | |omregion | = | 2.15 | 2.15 | |omsrclistcomb | = | 2.23 | 2.23 | |ommergelists | = | 1.1 | 1.1 | |omthconv | = | 1.35 | 1.35 | |orbit | = | 2.12 | 2.12 | |ppsslewsumm | = | 1.3 | 1.3 | |ppssumm | = | 3.7 | 3.7 | |preqgti | = | 0.10.1 | 0.10.1 | |radmonfix | = | 0.5.2 | 0.5.2 | |region | = | 7.15 | 7.15 | |regionmask | = | 1.68 | 1.68 | |rgsangles | = | 4.9 | 4.9 | |rgsbadpix | = | 2.20 | 2.20 | |rgsbkgmodel | = | 1.5.1 | 1.5.1 | |rgsbkgmodelTest | = | 1.5.1 | 1.5.1 | |rgsenergy | = | 2.2 | 2.2 | |rgsevents | = | 3.13 | 3.13 | |rgsfilter | = | 1.19 | 1.19 | |rgsfluxer | = | 1.10 | 1.10 | |rgsframes | = | 3.19 | 3.19 | |rgsimplot | = | 1.18 | 1.18 | |rgslccorr | = | 0.57.1 | 0.57.1 | |rgsoffsetcalc | = | 1.19 | 1.19 | |rgsregions | = | 1.23 | 1.23 | |rgsrmfgen | = | 1.16 | 1.16 | |rgssources | = | 6.3 | 6.3 | |rgsspecplot | = | 2.23 | 2.23 | |rgsspectrum | = | 2.9 | 2.9 | |rmfgen | = | 2.8.1 | 2.8.1 | |slconv | = | 2.6 | 2.6 | |specgroup | = | 1.7 | 1.7 | |srcmatch | = | 3.22 | 3.22 | |tabcalc | = | 2.9 | 2.9 | |tabgtigen | = | 2.13 | 2.13 | |================|===|=================|============| iii. Calibration Files ====================== Pipeline processing generally accesses an evolving set of CCFs (current calibration files). For each observation, a subset of the full set of CCFs is used in processing that pertains to the epoch of the observation; the CCF components/versions used are identified in the calibration index file (PooooooooooOBX000CALIND0000.FIT) that is included in the delivered observation data product set. The complete list of CCFs used in the processing is given here: Table of valid CCFs at 2020-01-10T00:20:02 |================================|=============|=======| | Calibration File | Issue range | Count | |================================|=============|=======| | DEBUG:_mlovccf: | 0000 | 1 | | EMOS1_ADUCONV | 0087-0111 | 25 | | EMOS1_BACKGROUND | 0001 | 1 | | EMOS1_BADPIX | 0025-0039(*)| 13 | | EMOS1_CALSOURCEDATA | 0001 | 1 | | EMOS1_CONTAMINATION | 0001 | 1 | | EMOS1_CTI | 0075-0099 | 25 | | EMOS1_DARKFRAME | 0011-0037 | 27 | | EMOS1_EFFICIENCY | 0001 | 1 | | EMOS1_FILTERTRANSX | 0015 | 1 | | EMOS1_FWC | 0002 | 1 | | EMOS1_HKPARMINT | 0008-0011 | 4 | | EMOS1_LINCOORD | 0018 | 1 | | EMOS1_MODEPARAM | 0006 | 1 | | EMOS1_PATTERNLIB | 0005 | 1 | | EMOS1_QUANTUMEF | 0020-0021 | 2 | | EMOS1_REDIST | 0106-0120(*)| 14 | | EMOS1_SCREENTHRESH | 0001 | 1 | | EMOS1_TIMECORR | 0003 | 1 | | EMOS2_ADUCONV | 0088-0115 | 28 | | EMOS2_BACKGROUND | 0001 | 1 | | EMOS2_BADPIX | 0017-0026(*)| 9 | | EMOS2_CALSOURCEDATA | 0001 | 1 | | EMOS2_CONTAMINATION | 0001 | 1 | | EMOS2_CTI | 0076-0103 | 28 | | EMOS2_DARKFRAME | 0011-0033 | 23 | | EMOS2_EFFICIENCY | 0001 | 1 | | EMOS2_FILTERTRANSX | 0015 | 1 | | EMOS2_FWC | 0002 | 1 | | EMOS2_HKPARMINT | 0008-0010 | 3 | | EMOS2_LINCOORD | 0018 | 1 | | EMOS2_MODEPARAM | 0006 | 1 | | EMOS2_PATTERNLIB | 0005 | 1 | | EMOS2_QUANTUMEF | 0020-0021 | 2 | | EMOS2_REDIST | 0106-0120(*)| 14 | | EMOS2_SCREENTHRESH | 0001 | 1 | | EMOS2_TIMECORR | 0003 | 1 | | EPN_ADUCONV | 0077-0142(*)| 36 | | EPN_BACKGROUND | 0001 | 1 | | EPN_BADPIX | 0093-0145 | 53 | | EPN_BUCLOSEDODI | 0001-0005 | 5 | | EPN_CALSOURCEDATA | 0001 | 1 | | EPN_CTI | 0049-0050 | 2 | | EPN_DARKFRAME | 0001 | 1 | | EPN_EFFICIENCY | 0001 | 1 | | EPN_FILTERTRANSX | 0019 | 1 | | EPN_FWC | 0002 | 1 | | EPN_HKPARMINT | 0005 | 1 | | EPN_LINCOORD | 0009 | 1 | | EPN_MODEPARAM | 0003 | 1 | | EPN_PATTERNLIB | 0001 | 1 | | EPN_QUANTUMEF | 0018 | 1 | | EPN_REDIST | 0012 | 1 | | EPN_REJECT | 0006-0008(*)| 2 | | EPN_TICLOSEDODI | 0001-0013 | 13 | | EPN_TIMECORR | 0011-0015(*)| 4 | | EPN_TIMEJUMPTOL | 0001 | 1 | | OM_ASTROMET | 0012 | 1 | | OM_BADPIX | 0007-0008 | 2 | | OM_COLORTRANS | 0010 | 1 | | OM_DARKFRAME | 0003 | 1 | | OM_DIFFUSEGALA | 0001 | 1 | | OM_GRISMCAL | 0005 | 1 | | OM_HKPARMINT | 0004 | 1 | | OM_LARGESCALESENS | 0002 | 1 | | OM_LINCOORD | 0001 | 1 | | OM_PHOTTONAT | 0007 | 1 | | OM_PIXTOPIXSENS | 0003 | 1 | | OM_PSF1DRB | 0010 | 1 | | OM_QUICKMAG | 0002 | 1 | | OM_ZODIACAL | 0001 | 1 | | RGS1_ADUCONV | 0006-0029(*)| 17 | | RGS1_BACKGROUND | 0001 | 1 | | RGS1_BADPIX | 0012-0038(*)| 10 | | RGS1_CALSOURCEDATA | 0001 | 1 | | RGS1_CLOCKPATTERNS | 0001 | 1 | | RGS1_COOLPIX | 0001 | 1 | | RGS1_CROSSPSF | 0004 | 1 | | RGS1_CTI | 0001-0015(*)| 10 | | RGS1_DARKFRAME | 0005 | 1 | | RGS1_EFFAREACORR | 0014 | 1 | | RGS1_EXAFS | 0005 | 1 | | RGS1_HKPARMINT | 0009-0016(*)| 6 | | RGS1_LINCOORD | 0008 | 1 | | RGS1_LINESPREADFUNC | 0005 | 1 | | RGS1_MODEPARAM | 0004-0005 | 2 | | RGS1_QUANTUMEF | 0015 | 1 | | RGS1_REDIST | 0004 | 1 | | RGS1_SAACORR | 0001 | 1 | | RGS1_TEMPLATEBCKGND | 0006 | 1 | | RGS2_ADUCONV | 0006-0034(*)| 18 | | RGS2_BACKGROUND | 0001 | 1 | | RGS2_BADPIX | 0012-0033(*)| 8 | | RGS2_CALSOURCEDATA | 0001 | 1 | | RGS2_CLOCKPATTERNS | 0001 | 1 | | RGS2_COOLPIX | 0001 | 1 | | RGS2_CROSSPSF | 0004 | 1 | | RGS2_CTI | 0001-0016(*)| 11 | | RGS2_DARKFRAME | 0006 | 1 | | RGS2_EFFAREACORR | 0014 | 1 | | RGS2_EXAFS | 0005 | 1 | | RGS2_HKPARMINT | 0008-0015(*)| 6 | | RGS2_LINCOORD | 0008 | 1 | | RGS2_LINESPREADFUNC | 0005 | 1 | | RGS2_MODEPARAM | 0004-0005 | 2 | | RGS2_QUANTUMEF | 0016 | 1 | | RGS2_REDIST | 0004 | 1 | | RGS2_SAACORR | 0001 | 1 | | RGS2_TEMPLATEBCKGND | 0007-0008 | 2 | | XMM_ABSCOEFS | 0004 | 1 | | XMM_BORESIGHT | 0029 | 1 | | XMM_MISCDATA | 0022 | 1 | | XMM_SPECQUAL | 0002 | 1 | | XRT1_XAREAEF | 0009 | 1 | | XRT1_XENCIREN | 0003 | 1 | | XRT1_XPSF | 0016 | 1 | | XRT2_XAREAEF | 0010 | 1 | | XRT2_XENCIREN | 0003 | 1 | | XRT2_XPSF | 0016 | 1 | | XRT3_XAREAEF | 0012 | 1 | | XRT3_XENCIREN | 0003 | 1 | | XRT3_XPSF | 0018 | 1 | |================================|=============|=======| (*): Incomplete range. Total number of valid CCFs required : 515 iv. Response Matrices ===================== The pipeline accesses a set of canned response matrices (RMFs) which correspond to those issued with the SAS public release used as base for it, here 18.0.0. RMFs used in this pipeline were released November 20th, 2019. EPIC MOS RMFs are defined via a set of epoch-dependent files (14 epochs to date). They are further divided by instrument mode and by detector position - in particular, MOS RMFs are available to reflect the impacts of changes occurring in the core (c) and wings (w) of a small patch known to have suffered degradation, as well as off-patch (o) locations (i.e. everywhere else on the detector). PN RMFs are divided by instrument mode and position along the Y-direction of the CCDs. The canned EPIC response matrices used in the bulk reprocessing are shown below. |====================================| | Canned RMFs | |====================================| | m_e_im_p0_c.rmf | | m_e_im_p0_w.rmf | | m_e_im_p0_o.rmf | | m_e_im_pall_o.rmf | | m_e_im_pall_c.rmf | | m_e_im_pall_w.rmf | | m_e_tu_p0_c.rmf | | m_e_tu_p0_w.rmf | | m_e_tu_p0_o.rmf | | m_e_tu_pall_o.rmf | | m_e_tu_pall_c.rmf | | m_e_tu_pall_w.rmf | | | | epn_e_bu23_dY9_v18.0.rmf | | epn_e_bu23_sdY9_v18.0.rmf | | epn_e_bu23_sY9_v18.0.rmf | | epn_e_ef20_dY_v18.0.rmf | | epn_e_ef20_sdY_v18.0.rmf | | epn_e_ef20_sY_v18.0.rmf | | epn_e_ff20_dY_v18.0.rmf | | epn_e_ff20_sdY_v18.0.rmf | | epn_e_ff20_sY_v18.0.rmf | | epn_e_lw20_dY_v18.0.rmf | | epn_e_lw20_sdY_v18.0.rmf | | epn_e_lw20_sY_v18.0.rmf | | epn_e_sw20_dY_v18.0.rmf | | epn_e_sw20_sdY_v18.0.rmf | | epn_e_sw20_sY_v18.0.rmf | | epn_e_sw20_sdY6_v18.0.rmf | | epn_e_sw20_sY6_v18.0.rmf | | epn_e_ti40_sdY9_v18.0.rmf | |====================================| where = 1 (MOS1) or 2 (MOS2), , i=1-14 (MOS epochs), i=1-3 (PN epochs) and , j=0-9 (Y-positions); , m=5-9 (Y-positions); , n=7-9 (Y-positions); The latest available canned response files are described at, and available from, http://www.cosmos.esa.int/web/xmm-newton/epic-response-files. See also http://www.cosmos.esa.int/web/xmm-newton/epic-files-updates for further details on the latest update to EPIC RMFs. v. Energy Bands =============== |======|===================| | Band | Energy Range (eV) | |======|===================| | 1 | 200 - 500 | | 2 | 500 - 1000 | | 3 | 1000 - 2000 | | 4 | 2000 - 4500 | | 5 | 4500 - 12000 | | 8 | 200 - 12000 | | 9 | 500 - 4500 | |======|===================| vi. Energy Conversion Factors ============================= EPIC energy conversion factors (ECFs) are used to derive simple flux estimates from measured count rates. The ECFs are computed using the instrument response files for an assumed absorbed power law model with Gamma=1.7 and an absorbing column density of 3x10^20/cm2. ECFs used in pipeline processing are not computed as functions of position or epoch but are fixed values, computed for each EPIC instrument and filter, for each energy band. They are presented in the table below. For PN they are based on the full-frame, on-axis position from epoch 3. For MOS they are based on the Full-frame (imaging) mode, off-patch RMF from epoch 14. Rather than compute an average ECF over time, a single epoch was chosen so as to relate to a specific epoch RMF. The largest epoch-dependence is in band 1 and amounts to a range of about 15%. The off-patch position was chosen to reflect the majority of sources - RMFs for the core and wings of the MOS 'patch' are only relevant to a very small number of objects in the field. In this pipeline, the following fixed energy conversion factors (ECFs) are used: |============|========|============================================================================| | Instrument | Filter | Band | | | | 1 | 2 | 3 | 4 | 5 | 8 | 9 | |============|========|============================================================================| | epn | open | 16.9775 | 10.0693 | 6.1547 | 1.9846 | 0.5776 | 4.1236 | 5.0979 | | epn | thin | 9.5243 | 8.1203 | 5.8668 | 1.9525 | 0.5772 | 3.3243 | 4.5588 | | epn | medium | 8.3693 | 7.8678 | 5.7676 | 1.9295 | 0.5767 | 3.1926 | 4.4601 | | epn | thick | 5.1061 | 6.0477 | 4.9895 | 1.8284 | 0.5695 | 2.5928 | 3.7637 | | emos1 | open | 3.1882 | 2.1892 | 2.1509 | 0.7675 | 0.1493 | 1.0915 | 1.5195 | | emos1 | thin | 1.7813 | 1.8012 | 2.0522 | 0.7557 | 0.1487 | 0.9291 | 1.3963 | | emos1 | medium | 1.5634 | 1.7500 | 2.0175 | 0.7469 | 0.1488 | 0.9001 | 1.3699 | | emos1 | thick | 1.0183 | 1.4199 | 1.7962 | 0.7158 | 0.1466 | 0.7775 | 1.2127 | | emos2 | open | 3.2053 | 2.2020 | 2.1545 | 0.7754 | 0.1582 | 1.1004 | 1.5271 | | emos2 | thin | 1.7757 | 1.8089 | 2.0557 | 0.7639 | 0.1582 | 0.9361 | 1.4028 | | emos2 | medium | 1.5529 | 1.7570 | 2.0206 | 0.7548 | 0.1573 | 0.9061 | 1.3763 | | emos2 | thick | 1.0042 | 1.4234 | 1.7995 | 0.7240 | 0.1556 | 0.7832 | 1.2181 | |============|========|============================================================================| vii. Source Position Rectification ================================== In the bulk reprocessing, astrometric field rectification (where possible) is performed against extracts from the USNO-B1.0, SDSS-DR9 or 2MASS catalogues as the astrometric reference frame.