Weblog fails with "list index out of range"
Closed this issue · 2 comments
I wanted to experiment with phase transfer for a dataset. I moved one of my two phase calibrators from the list of phase cals to a target, so that I have one phase cal and two targets. I also updated the pipeline to latest version. Not sure which of these (or both) is the cause, but now the first weblog step fails as:
CASA 5.1.0-74 -- Common Astronomy Software Applications
--> CrashReporter initialized.
2017-11-12 22:18:45 | INFO | Starting pipeline
2017-11-12 22:18:45 | INFO | Running pipeline from: pipeline/
2017-11-12 22:18:45 | INFO | Pipeline version: v0.6.6
2017-11-12 22:18:45 | INFO | Using github branch: master
2017-11-12 22:18:45 | INFO | github last commit: 7db6156
2017-11-12 22:18:45 | INFO | This log uses UTC times
2017-11-12 22:18:45 | INFO | Inputs from file: inputs.txt
2017-11-12 22:18:45 | INFO | Parameters in inputs file:
2017-11-12 22:18:45 | INFO | fits_path : ./fitsidi/
2017-11-12 22:18:45 | INFO | inbase : TSARP220_C_20171013
2017-11-12 22:18:45 | INFO | targets : 1534+2330,1516+1932
2017-11-12 22:18:45 | INFO | phscals : 1532+2344
2017-11-12 22:18:45 | INFO | fluxcal : 1331+305
2017-11-12 22:18:45 | INFO | bpcal : 1407+284
2017-11-12 22:18:45 | INFO | ptcal : 0319+415
2017-11-12 22:18:45 | INFO | refant : Mk2
2017-11-12 22:18:45 | INFO | Lo_dropout_scans:
2017-11-12 22:18:45 | INFO | manual_flags_a : ./inputfg_a.flags
2017-11-12 22:18:45 | INFO | manual_flags_b : ./inputfg_b_avg.flags
2017-11-12 22:18:45 | INFO | run_importfits : 0
2017-11-12 22:18:45 | INFO | summary_weblog : 1
2017-11-12 22:18:45 | INFO | hanning : 0
2017-11-12 22:18:45 | INFO | ms2mms : 0
2017-11-12 22:18:45 | INFO | flag_0_aoflagger: 0
2017-11-12 22:18:45 | INFO | flag_1_apriori : 1
2017-11-12 22:18:45 | INFO | flag_2a_manual : 1
2017-11-12 22:18:45 | INFO | average_1 : 1
2017-11-12 22:18:45 | INFO | plot_data : 1
2017-11-12 22:18:45 | INFO | save_flags : 1
2017-11-12 22:18:45 | INFO | restore_flags : 0
2017-11-12 22:18:45 | INFO | flag_2b_manual : 1
2017-11-12 22:18:45 | INFO | init_models : 1
2017-11-12 22:18:45 | INFO | bandpass_0 : 1
2017-11-12 22:18:45 | INFO | flag_3_tfcropBP : 0
2017-11-12 22:18:45 | INFO | delay : 1
2017-11-12 22:18:45 | INFO | gain_0_p_ap : 1
2017-11-12 22:18:45 | INFO | fluxscale : 1
2017-11-12 22:18:45 | INFO | bandpass_1_sp : 1
2017-11-12 22:18:45 | INFO | gain_1_amp_sp : 1
2017-11-12 22:18:45 | INFO | applycal_all : 1
2017-11-12 22:18:45 | INFO | flag_4_rflag : 0
2017-11-12 22:18:45 | INFO | plot_corrected : 1
2017-11-12 22:18:45 | INFO | first_images : 1
2017-11-12 22:18:45 | INFO | weblog : 1
2017-11-12 22:18:45 | INFO | Generating empty flags list
2017-11-12 22:18:45 | INFO | Using MS file: TSARP220_C_20171013.ms
2017-11-12 22:18:45 | INFO | Starting summary weblog
2017-11-12 22:18:45 | INFO | Reading ms file information for MS: TSARP220_C_20171013.ms
2017-11-12 22:18:45 | INFO | Targets: 1534+2330,1516+1932
2017-11-12 22:18:45 | INFO | Phasecals: 1532+2344
2017-11-12 22:18:45 | INFO | Fluxcal: 1331+305
2017-11-12 22:18:45 | INFO | Bandpass: 1407+284
2017-11-12 22:18:45 | INFO | Pointcal: 0319+415
2017-11-12 22:18:45 | INFO | Sources in MS TSARP220_C_20171013.ms: 1516+1932,1407+284,0319+415,1532+2344,1331+305,1534+2330
2017-11-12 22:18:46 | INFO | Antennas in MS TSARP220_C_20171013.ms: ['Mk2', 'Pi', 'Da', 'Kn', 'De', 'Cm']
2017-11-12 22:18:49 | INFO | Refant: Mk2
2017-11-12 22:18:49 | INFO | Plotting elevation to: ./plots/plots_observation/TSARP220_C_20171013_elevation.png
2017-11-12 22:19:17 | INFO | Plotting uv-coverage for all sources
2017-11-12 22:19:18 | INFO | Plotting uvcov for 1516+1932: ./plots/plots_observation/TSARP220_C_20171013_uvcov_1516+1932.png
2017-11-12 22:19:22 | INFO | Plotting uvcov for 1407+284: ./plots/plots_observation/TSARP220_C_20171013_uvcov_1407+284.png
2017-11-12 22:19:25 | INFO | Plotting uvcov for 0319+415: ./plots/plots_observation/TSARP220_C_20171013_uvcov_0319+415.png
2017-11-12 22:19:27 | INFO | Plotting uvcov for 1532+2344: ./plots/plots_observation/TSARP220_C_20171013_uvcov_1532+2344.png
2017-11-12 22:19:32 | INFO | Plotting uvcov for 1331+305: ./plots/plots_observation/TSARP220_C_20171013_uvcov_1331+305.png
2017-11-12 22:19:35 | INFO | Plotting uvcov for 1534+2330: ./plots/plots_observation/TSARP220_C_20171013_uvcov_1534+2330.png
2017-11-12 22:19:46 | INFO | Saving information of MS TSARP220_C_20171013.ms in: TSARP220_C_20171013.ms.pkl
2017-11-12 22:19:46 | INFO | Start weblog
Traceback (most recent call last):
File "/opt/packages/casainst/casa-release-5.1.0-74.el7/lib/python2.7/init_welcome.py", line 24, in
execfile(__candidates[0])
File "pipeline/eMERLIN_CASA_pipeline.py", line 407, in
run_pipeline(inputs=inputs)
File "pipeline/eMERLIN_CASA_pipeline.py", line 128, in run_pipeline
emwlog.start_weblog(msinfo)
File "pipeline/functions/weblog.py", line 280, in start_weblog
weblog_images(msinfo)
File "pipeline/functions/weblog.py", line 233, in weblog_images
show_image(msinfo, wlog, i)
File "pipeline/functions/weblog.py", line 241, in show_image
phscal = msinfo['sources']['phscals'].split(',')[i]
IndexError: list index out of range
The problem is how your sources are specified. When there are more than one target/phasecal pairs, you need to keep the 1:1 sequence, always 1 target and 1 calibrator. So you need to use:
targets = 'trg1,trg2'
phscals= 'phs1,phs2'
even if phs1==phs2 is the same source. Otherwise it would be difficult to keep track of which solutions need to be aplied to each source.
Aaaaaaaaha! Makes sense, thanks! The documentation says " If more than one target is selected, the corresponding phase calibrator has to keep the same order." but I did not understand this properly. Thanks for the clarification.