Detailed release note for pipeline 04000013/20030722.143236 The previous production pipeline (02000050/20021220.132037, prod) used SAS 5.4, that is xmmsas_20021218_1802 (except for ppssumm, see release note for pipeline 02000050/20021220.132037). The new pipeline started operations on 23/07/03. It uses SAS 5.4.2, that is xmmsas_20030717_1631. The pipeline is prod2 version 04000013/20030722.143236. Details: -------- Prev pipeline New pipeline 02000050/20021220.132037 04000013/20030722.143236 # # Modules # ------ # # ExpDetect 1.33 1.34 # Version 1.34 - 2003-06-13 (RDS) # + New ECFs for latest QE files # # Finalize 1.19 1.20 # Version 1.21 - 2003-07-17 (DJF) # + Adapted ppssumm command line to deal with absent # catalogue index file. # Version 1.20 - 2003-06-20 (DJF) # + Changed to take account of ppssumm 3.0+ which now # generates all summary pages in one go. # # MOSEvents 2.20 2.28 # Version 2.28 - 2003-07-01 (DJF) # + #XMMEA_EM selection had been applied to wrong evselect. This caused # removal of GATTI events before flare background construction. # Try again. #XMMEA_EM selection applied to final event list # Version 2.27 - 2003-07-01 (DJF) # + XMMEA_EM selection still not working, more testing. # Version 2.26 - 2003-07-01 (DJF) # + Fixed use of #XMMEA_EM flag selection in good event filtering. # From (FLAG & #XMMEA_EM)==0 to (#XMMEA_EM)==0 # Version 2.25 - 2003-07-01 (DJF) # + Corrected good event filtering. Had missed out the ==0 from the flag # filter. # Version 2.24 - 2003-06-30 (DJF) # + Added emosdatamodes => 'IMAGING' to first evlistcomb call. # Version 2.23 - 2003-04-11 (DJF) # + Fixed command line to evlistcomb (instrument= 'emos' rather than # thisInstrument) # Version 2.22 - 2003-04-08 (DJF) # + Added Jean Ballet's newer recipy for improved flare screening # Version 2.21 - 2002-07-01 (DJF) # + Changed image creation flags to XMMEA_EM # # MakeCIF 1.15 1.17 # Version 1.17 - 2003-06-26 (DJF) # + Call to get obs_start and procdate for cifbuild was using # upper case parameter names in a case-sensitive environment # where lower case were required. Fixed. # Version 1.16 - 2003-06-25 (DJF) # + Added information to help identify a problem with cfibuild parameters. # # MakeImage 1.58 1.62 # Version 1.62 - 2003-06-30 (DJF) # + Give fimgstat all of its parameters # Version 1.61 - 2003-06-30 (DJF) # + Add mode parameter to fimgstat. # Version 1.60 - 2003-06-27 (DJF) # + Use ftool fimgstat to determine if images are # empty or not before calling implot. # Version 1.59 - 2003-06-25 (DJF) # + Added PATTERN<=12 selection for MOS images across all bands # # OMSrcRect 1.09 1.12 # Version 1.12 - 22-Jul-2003 # + Change omatt call to use rotateimage=>F rahter than ppsoswset. # ppsoswset=F was generating a spurious file 'F'. # Version 1.11 - 18-Jul-2003 # + omatt failing, CBrindle suggests explicit setting of ppsoswset=F. # Version 1.10 - 18-Dec-2002 # + Removed creation of empty rectified sky image file. # # RGSEvents 3.14 3.15 # Version 3.15 - 11-Apr-2003 (DJF) # + Add EXPIDSTR to flare background via addattribute # # RGSProducts 1.26 1.30 # Version 1.30 - 17-July-2003 (DJF) # + Replace missing } else { in conditional selection of rgsimplot parameters # Version 1.29 - 25-June-2003 (DJF) # + Turned off production of fluxes spectra as intermediate products # Version 1.28 - 25-June-2003 (DJF) # + Turn rgs response matrix from intermediate to final product. # Version 1.27 - 08-April-2003 (DJF) # + Make rgs response matrices # # StampKeywords 1.10 1.11 # Version 1.11 - 2003-06-25 (DJF) # + Version number increased to ease configuration control. # No functional changes made. # # VerifyODF 1.13 1.15 # Version 1.15 - 2003-07-22 (DJF) # + Moved tcsfix call from ingest stage to here # Version 1.14 - 2003-06-20 (DJF) # + obssumm removed. This funtionality is now provided by ppssumm 3.0+ # Tasks # ----- # # dpsssrc 0.4.1 0.4.2 # Version 0.4.2 - 2003-01-09 (bol) # + adding column AENPGX for flag setting selection (bol) # + IND_SOL can be modified if it exists # # eexpmap 3.27.2 3.27.3 # Version 3.27.3 - 2002-06-13 (GL) # + release track version - Same as v3.31, but uses param v1.x # - Use column TIMEDEL in exposure extensions to # calculate exposures. # - For EPN, write keywords "OOTCORR" and "OOTFRAC". # - Changed parameter types of "attitudeset", "eventset", and "expimageset" # to "dataset". # - Adapted to dsslib v5.x # - Fixed error in flag mask interpretation. # - Closed SPRs: SSC-SPR-3105, -3102, -3066, -3065, -3032 # # emframes 4.11.3 4.11.4 # Version 4.11.4 - 2003-06-19 (DJF) # - Change fineunit from 4.D-5 to 3.999D-5 (fixes SPR 3133) # # emldetect 4.11.15 4.11.17 # Version 4.11.17 - 2002-06-13 GL # - Fixed distribution # Version 4.11.16 - 2002-06-13 GL # - Same as 4.29, but using param 1.x # Version 4.29 - 2003-05-26 GL (dev track) # - Enable extent fitting with beta function # New parameter "extentmodel" # - Corrected error in fixing positions when using fitposition=no and # nmaxfit>1. # - Closed SPR SSC-SPR-3098: Running emldetect with fixed source coordinates # - Closed SPR SSC-SPR-3108: OOTE correction not documented # Version 4.28 - 2003-04-25 GL (dev track) # - Read keyword OOTCORR from EPN exposure maps # If "true", do not apply OOT correction to output count rates. # Version 4.27 - 2003-02-28 GL (dev track) # - Fixed error in function gammln. # - Fixed error in subroutine LIKE. # ->Reduces values of DET_ML and EXT_ML by a factor >= 2. # Values of EXT_ML are now also corrected for the number # of free fit parameters (number of input images). # - Closed SSC-SPR-3090: wrong DET_ML values # # epframes 8.46.11 8.46.16 # Version 8.46.16 - 2003-05-06 (MJF) # - (src/epframes_mod.f90): fix a compiler problem on machine "ssc1" (linux) # Version 8.46.15 - 2003-05-05 (MJF) # - (src/epframes_mod.f90): corrected spatial DLIMAP inhomogeneities due to # incomplete "whole frame MIP rejection" accumulation # - (src/epframes_mod.f90): adjusted the internal "late-time-reset" parameter # to 4 for FF and eFF modes (due to problems with 0608_0145840201_PNU014) # - closed SSC-SPR-3104: Whole frame MIP rejection not fully accounted for # SSC-SPR-3121: Subscript 1 of ARRFRACEXP (value 8645) is out of # range [0608_0145840201_PNU014 Q2] # Version 8.46.14 - 2003-03-11 (MJF) # - (src/epframes_mod.f90): adjusted the internal "late-time-reset" parameter # from 11 to 100 for SW mode (due to problems with 0583_0137750201_PNU003) # - (src/epframes_mod.f90): check against rejection of all time entries, in # this case create empty output file # - (*): undid the changes related to parameters "withfinetime" and # "lowerthreshold" to comply with the RT (otherwise identical to 8.57) # - closed SSC-SPR-3095: too late time reset in 0583_0137750201_PNU003 # SSC-SPR-3091: Crash if all time entries are rejected # Version 8.46.13 - 2003-02-11 (MJF) # - (src/epframes_mod.f90): new parameter "withfinetime" to switch off the # fine time correction for TI+BU modes for easier identification of time # jumps, default "withfinetime=Y" preserves recommended (old) behaviour. # - (src/epframes_mod.f90): new parameter "lowerthreshold" to disregard # low-energy events (with amplitudes < lowerthreshold [adu]) already at # this stage, default "lowerthreshold=0" preserves recommended (old) # behaviour. This may be useful to compare early mission data with recent # observations as the setup was different (lowertreshold=23 instead of 20 # now) # - (src/epframes_mod.f90): updated list of "nom" values for offset columns # - (config/epframes.*): added new parameters "withfinetime" and # "lowerthreshold" # - (doc/epframes_description.tex): added new parameters "withfinetime", # "lowerthreshold" # - closed SSC-SPR-2981: Subscript 1 of ARREXPTIME is out of range # [0482_0111290601_PNS003 Q2] # SSC-SPR-3000: Subscript 1 of ARREXPTIME is out of range # [0103 0111020201_PNS003 Q1] # Version 8.46.12 - 2003-01-10 (MJF) # - (src/epframes_mod.f90): access F1828,1829,F1830 and F1628,1629,1630 # columns instead of F1528,1529,1530 to identify the uploaded BadPixelTable # code, this automatically enables the identification of masked mode # flavours # - closed SSC-SPR-2417: Inconsistent time related keywords # SSC-SPR-3064: BadPixelTable coding accesses wrong HK columns # # fimgstat [none] [no-version] # # obssumm 4.4.7 [none] # # omatt 2.30.1 2.30.2 # Version 2.30.2 - 2003-07-17 (CB) # - Length of string holding catalogue file name increased. # # omdetect 4.1.8 4.1.12 # Version 4.1.12 - 2003-02-04 (CB) # + (src/omdetect_mod.f90) Modified so that when processing a # fast-chain image no source rejection takes place (fixes SPR 3101). # Corrected documentation for SPR 3088. # Version 4.1.11 - 2003-14-02 (CB) # + Corrected 0.5 pixel error in positions & reduced size of centroiding # box to reduce contamination by nearby sources (fixes SPRs 3071 & # 3077). Made small improvements to source-detection routine (to fix # SPR 3078). Point-source detection algorithm now searches for # sources in order of decreasing pixel value. Faint sources now less # likely to be missed. # Version 4.1.10 - 2003-01-08 (CB) # + (src/omdetect_mod.f90) Modified to obtain ccdframe time # and deadfraction from wdx file if not present in image header, # so that omdetect is backwards compatible with old images. # added optional parameter wdxset to config file to get information. # Version 4.1.9 - 2002-12-20 (CB) # + Remove write statement in omdetectbackground_mod.f90 # # omthconv 1.27.7 1.27.14 # Version 1.27.14 - 2003-05-07 (CB) # - Another attemp at uploading into release-track.. # Version 1.27.13 - 2003-04-29 (CB) # - A reupload of yesterdays failed upload. # Version 1.27.12 - 2003-04-28 (CB) # + (src/omthconv_mod.f90) modified code to get exposure identifier string # to correct failure in Leicester pipeline. This is a temporary fix until # omprep is modified to add it to all fits file headers. # Version 1.27.11 - 2003-01-09 (CB) # - Fixed test-harness failure. # Version 1.27.10 - 2003-01-08 (CB) # + (src/omthconv_mod.f90) exposure id string checked to ensure # not X... to prevent oal call failure- fixes omfchain problem. # Version 1.27.9 - 2003-01-06 (CB) # - Updated files in test directory to fix test failure. # Version 1.27.8 - 2002-11-04 (CB) # + (src/omthconv_mod.f90) Replaced call to "getstartendexp" by oal call. # Fixes SPR 3056 # # ppssumm 2.3.7 3.0.6 # Version 3.0.6 - 2003-07-11 (DJF) # - New parameter fitsum to allow writing of odf summary file as FIT's file # (used in testing). # - Changed catfile parameter to optional to accomodate no ACDS products. # - Do not generate link to catalogue index if it is not present. # - Fixed Exposures count on observation page # - Fixed soritng of RGS exposure specific products. # Version 3.0.5 - 2003-07-11 # - Corrected href's between pages. Was using full path rather than just # filename. # Version 3.0.4 - 2003-07-10 # - Yet more fixes for build errors which don't occur here at LUX. # Version 3.0.3 - 2003-07-09 # - A few more bug fixes which only appear with gcc-3.2.x # Version 3.0.2 - 2003-07-07 # - Fixed some C++ errors in SOC build which don't occur locally. # Version 3.0.1 - 2003-07-03 # - Added taskname and version number to bottom of pages. # Version 3.0 - 2003-01-28 # - Complete rewrite in C++ # # Libraries # --------- # # cal 3.152.2 3.152.3 # Version 3.152.3 - 2003-01-30 (UL) # + be tolerant when encountering DATE-END=-1 in setState() [needed as of # 3.152.2 to determine exposure duration] # # dal 1.159.2 1.159.3 # Version 1.159.3 - 2002-01-02 (GV) # + (tests/sprtests/spr2390*cc) Show that the problem reported in # SOC-SPR-2390 is in the DAL and not in cfitsio. # # sas 1.315.17 1.315.26 # Version 1.315.26 - 2003-03-31 (GV) # + (uploadreport) Upload via intermediate tar file. Upload to # Vilspa server. # Version 1.315.25 - 2003-03-31 (GV) # + (uploadreport) Upload via intermediate tar file. Upload to # Vilspa server. # Version 1.315.24 - 2003-03-31 (GV) # + (uploadreport) Upload via intermediate tar file. Upload to # Vilspa server. # Version 1.315.23 - 2003-03-31 (GV) # + (uploadsas) Make use of Vilspa ftp server. # Version 1.315.22 - 2003-01-21 (GV) # + AKA to 5.4.x-rt, version numbers in shared libraries off. # Version 1.315.21 - 2003-01-10 (GV) # + (sas.bib) fix typo on CALHB entry ct:calhb, update URLs for # Chandra documents (region, data model etc.) # + (Make.include) shared libraries have a version number, AKA # adjusted for final round of builds. # Version 1.315.20 - 2003-01-06 (GV) # + (bin/uploadreport) force ftp to run in passive mode, so it works # from behind some firewalls. # Version 1.315.19 - 2002-12-20 (GV) # + (Make.include) change AKA, switch off version number in libraries. # Version 1.315.18 - 2002-12-19 (GV) # + (sas.bib) How many tries to get a reference right?? Fix typo in # URL for CALHB. # # slconv 1.1.1 1.1.2 # Version 1.1.2 - 2002-01-10 (IMS/LUX) # - Temporarily removed diff from test harness, which was failing on some # platforms. # # Parameters # ---------- # ModuleResources.TaskEnvironment. SAS_CCFPATH # /raid/ccf/willbepublic:/raid/ccf/public # changed to # /raid/ccf/public # # Pipeline infrastructure # ----------------------- # # pcms 5.2.5 5.2.8 # Version 5.2.8 - 2003-05-12 (DJF) # + Added ODF_VERSION as keyword ODFVER to the Product Index # Version 5.2.7 - 2003-05-02 (DJF) # + Added mechanism for running sas tasks in low memory mode. Adding a # flag $TASKNAME-lowmemory to the intermediate files directory will # activate this. This is relatively crude as it applies to all runs of a # sas task within the given sequence. It is should only be used for the # last ditch attempt. # Version 5.2.6 - 2003-01-20 (DJF) # + added SAS_RAND_SEED - This will be switched on at the next prod changeover # + added tests for undefined parameters passed to doCommand, findFile and # newFile functions. This should help track down a few unexpected pcms # failures.