From dph@opabinia Tue Apr 22 15:54:31 1997 Received: from opabinia.mit.edu by wiwaxia AA25398; Tue, 22 Apr 97 15:54:29 EDT Received: by opabinia AA24307; Tue, 22 Apr 97 15:50:48 EDT Date: Tue, 22 Apr 97 15:50:48 EDT From: David Huenemoerder To: asc@opabinia Subject: guide to xrcf pipe output Status: R I have copied some ASC pipeline output here for our "education" and planning purposes. The data are a couple days of HRC-I, HRC-S with HETG: 970322 G-HHI-EA-7.030-7.033 970401 G-HHI-EA-6.002-6.003 I put the data in /nfs/opabinia/d4/data/prod2/pipe. I hope the following serves as a quick orientation to the data. In particular, knowing what is in the output tables will help collection for analysis and fitting. The hardcopy is needed to verify debug wild results. Note there are still some problems with the grating pipes. Anastasia did a valiant job getting pipes running, but said there were many hands-on operations. For some reasons, masks are not always wide enough, and the counts get truncated. Another known problem is with synchronization of the HRC and BND exposure times - sometimes the BND time is longer. There is an HRC light-curve on the L1 hardcopy product worth checking. Wade through the following if motivated. Otherwise, file it for future reference. ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;; After the "/nfs/opabinia/d4" the path is the same as at SAO, with one exception: at SAO, symbolic links are used, and "cd .." doesn't always take you back where you came from --- so use explicit paths relative to /data/prod2/pipe! The directory structure in /data/prod2/pipe is shown in the following tree, which follows one path (others are similar): (one is a big directory - so skip along to get back to the narrative...) /nfs/opabinia/d4/data/prod2/pipe/970322: total 6 drwxr-xr-x 6 dph 512 Apr 19 14:55 . drwxr-xr-x 4 dph 512 Apr 19 16:26 .. drwxr-xr-x 3 dph 512 Apr 14 00:37 G-HHI-EA-7.030 drwxr-xr-x 3 dph 512 Apr 14 00:33 G-HHI-EA-7.031 drwxr-xr-x 3 dph 512 Apr 13 23:57 G-HHI-EA-7.032 drwxr-xr-x 3 dph 512 Apr 18 15:17 G-HHI-EA-7.033 /nfs/opabinia/d4/data/prod2/pipe/970322/G-HHI-EA-7.030: total 37 drwxr-xr-x 3 dph 512 Apr 14 00:37 . drwxr-xr-x 6 dph 512 Apr 19 14:55 .. -rw-r--r-- 1 dph 145 Apr 14 00:37 G-HHI-EA-7.030.info -rw-r--r-- 1 dph 32973 Apr 14 00:37 G-HHI-EA-7.030.newtests drwxr-xr-x 8 dph 512 Apr 14 00:37 i001 /nfs/opabinia/d4/data/prod2/pipe/970322/G-HHI-EA-7.030/i001: total 8 drwxr-xr-x 8 dph 512 Apr 14 00:37 . drwxr-xr-x 3 dph 512 Apr 14 00:37 .. drwxr-xr-x 3 dph 512 Apr 14 00:37 bndl1 drwxr-xr-x 3 dph 512 Apr 14 00:37 hrcl1 drwxr-xr-x 3 dph 512 Mar 29 18:11 hrcl1.5dt drwxr-xr-x 3 dph 512 Apr 14 00:37 hrcl1.5fp drwxr-xr-x 4 dph 512 Apr 14 00:39 hrcl2_gefa drwxr-xr-x 3 dph 512 Apr 14 00:37 hxdsl0 /nfs/opabinia/d4/data/prod2/pipe/970322/G-HHI-EA-7.030/i001/hrcl2_gefa: total 10 drwxr-xr-x 4 dph 512 Apr 14 00:39 . drwxr-xr-x 8 dph 512 Apr 14 00:37 .. -rw-r--r-- 1 dph 1610 Apr 14 00:39 do_hrcl2_gefa.G-HHI-EA-7.030i001.log drwxr-xr-x 2 dph 2560 Apr 14 00:39 out drwxr-xr-x 3 dph 2560 Apr 14 00:40 out_OLD /nfs/opabinia/d4/data/prod2/pipe/970322/G-HHI-EA-7.030/i001/hrcl2_gefa/out: total 41698 drwxr-xr-x 2 dph 2560 Apr 14 00:39 . drwxr-xr-x 4 dph 512 Apr 14 00:39 .. -rw-r--r-- 1 dph 4 Apr 14 00:37 G-HHI-EA-7.030.fpdet -rw-r--r-- 1 dph 14040 Apr 14 00:37 hrc_ghhiea7030i001n000.ped -rw-r--r-- 1 dph 73875 Apr 14 00:37 hrc_ghhiea7030i001n000.ped.log -rw-r--r-- 1 dph 17280 Apr 14 00:37 hrc_ghhiea7030i001n000_cnt.fits -rw-r--r-- 1 dph 6192 Apr 14 00:37 hrc_ghhiea7030i001n000_cnt.tab -rw-r--r-- 1 dph 23040 Apr 14 00:37 hrc_ghhiea7030i001n000_efa.fits -rw-r--r-- 1 dph 6944 Apr 14 00:37 hrc_ghhiea7030i001n000_efa.tab -rw-r--r-- 1 dph 11922789 Apr 14 00:38 hrc_ghhiea7030i001n000_hdc.ps -rw-r--r-- 1 dph 2119680 Apr 14 00:38 hrc_ghhiea7030i001n000_hmi1.fits -rw-r--r-- 1 dph 506880 Apr 14 00:38 hrc_ghhiea7030i001n000_hmi1_cnt.fits -rw-r--r-- 1 dph 38992 Apr 14 00:38 hrc_ghhiea7030i001n000_hmi1_cnt.imh -rw-r--r-- 1 dph 578560 Apr 14 00:38 hrc_ghhiea7030i001n000_hmi1_cnt.pix ... ... [stuff deleted] --- hmi1 = Heg arm, MInus 1 order, and soforth... ... -rw-r--r-- 1 dph 5885 Apr 14 00:38 hrc_ghhiea7030i001n000_obs.par -rw-r--r-- 1 dph 11520 Apr 14 00:38 hrc_ghhiea7030i001n000_reg.fits -rw-r--r-- 1 dph 2528 Apr 14 00:38 hrc_ghhiea7030i001n000_reg.tab -rw-r--r-- 1 dph 23040 Apr 14 00:38 hrc_ghhiea7030i001n000_src.fits -rw-r--r-- 1 dph 11804 Apr 14 00:39 hrc_ghhiea7030i001n000_src.tab -rw-r--r-- 1 dph 33 Apr 14 00:39 run_pipe.stat.hrc_ghhiea7030i001n000 -rw-r--r-- 1 dph 37 Apr 14 00:38 summary_main.aux -rw-r--r-- 1 dph 19720 Apr 14 00:39 summary_main.dvi -rw-r--r-- 1 dph 7581 Apr 14 00:39 summary_main.log What are all those files? Directory name structure: /data/prod2/pipe/970322/G-HHI-EA-7.030/i001/hrcl2_gefa/out: | | | | | | | | | | | | | | the bottom, | | | | where output goes | | | | | | | type of pipe | | | | | iteration number | TRW-ID | year,month,day There are some cases where there may be more than one iteration per TRW-ID, and there will be several i00* subdirectories. Note the filehame structure: hrc_ghhiea7070i001n000 |---|+++++++++|---|+++ | | | | | | | | | | | (beats me) | | | | | iteration | | | trw-id, lower-cased, delimiters removed | detector Type of pipes: bndl1 - bnd level 1. BND data and harcopy here. hrcl1 - HRC level 1. Basic event file here. hrcl1.5* - grating Level 1.5 (diffraction coords) (I don't know what the "dt" or "fp" are for. Augmented event file is here. hrcl2_gefa - level 2, grating, effective area ouput. hxdsl0 - the HXDS level 0 data. In each of these "i0nm/*/out" sub-directories, you can find: - a file with suffix "_hdc.ps". This is the postscript "hardcopy" output. - FITS event binary tables, named *_evt.fits (Level 1, primarily). - tables of results, named "*_res.fits" (Level 2, primarily). - various images (with .fits, .imh, .qp suffixes) (There are typically different versions of the same information, such as corresponding .tab files (ST-tables) and .fits (FITS bintables).) *** Of particular interest for HETG observations are, for examples: *** hrcl1/out/hrc_ghhiea7030i001n000_hdc.ps ---- printed tables describing test configuration, and images of the field. hrcl2_gefa/out/hrc_ghhiea7030i001n000_hdc.ps - level 2 grating effective area hardcopy; includes images of fields and regions, printed tables of bnd counts, region counts, resulting effective areas. Refer to the hardcopy to see printed versions of the tables stored in the following files: hrc_ghhiea7030i001n000_efa.fits ---- Effective Area Results Table, which has effective area as derived from each BND and from the mean BND rates. ___Column_Names_________Formats______Dims______Units___ Obs_id A11 Source_E E15.7 Source_lam E15.7 arm I12 grt_arm A7 order I12 net E15.7 neterr E15.7 exp_time E15.7 sec net_ctrt E15.7 cnt/sec net_ctrterr E15.7 cnt/sec Aeff_1_hb E15.7 cm*cm err_Aeff_1_hb E15.7 cm*cm Aeff_2_hn E15.7 cm*cm err_Aeff_2_hn E15.7 cm*cm Aeff_3_hs E15.7 cm*cm err_Aeff_3_hs E15.7 cm*cm Aeff_4_ht E15.7 cm*cm err_Aeff_4_ht E15.7 cm*cm Aeff_5_ave E15.7 cm*cm err_Aeff_5_ave E15.7 cm*cm hrc_ghhiea7030i001n000_cnt.fits --- Source Counts Table, ___Column_Names_________Formats______Dims______Units___ Obs_id A11 Source_E E15.7 Source_lam E15.7 arm I12 grt_arm A7 order I12 raw I12 pixels I12 bkgd E15.7 net E15.7 neterr E15.7 cnt/pix E15.7 err/pix E15.7 hrc_ghhiea7030i001n000_reg.fits --- Region Description Table, which defines where counts were taken for each order. ___Column_Names_________Formats______Dims______Units___ Obs_id A11 grt_arm A7 order I12 field_of_centroid A29 Pixels box_of_centroid A29 Pixels field_cnts_box A29 Pixels box_of_cnts_box A29 Pixels hrc_ghhiea7030i001n000_src.fits --- Source Positions Table ___Column_Names_________Formats______Dims______Units___ Obs_id A11 Source_E E15.7 Source_lam E15.7 arm I12 grt_arm A7 order I12 meanx D25.17 pix meany D25.17 pix fwhm_maj D25.17 pix fwhm_min D25.17 pix ellipt D25.17 angle D25.17 degrees amplitud D25.17 counts In: hrcl1.5fp/out hrc_ghhiea7030i001n000_hdc.ps Harcdopy summary, for Level 1.5 processing. hrc_ghhiea7030i001n000_grt.fits - Level 1.5 grating events file ___Column_Names_________Formats______Dims______Units___ START 1D seconds STOP 1D seconds ___Column_Names_________Formats______Dims______Units___ TIME 1D CRSV 1I CRSU 1I AMP_SF 1I AV1 1I AV2 1I AV3 1I AU1 1I AU2 1I AU3 1I RAWX 1I RAWY 1I CHIPX 1I CHIPY 1I TDETX 1I TDETY 1I DETX 1I DETY 1I X 1I Y 1I PHA 1I SUMAMPS 1I CHIP_ID 1I DET_ID 1I STATUS 1J STATUS 1I TG_PART 1I TG_R 1I TG_D 1I TG_MLAM 1E