2018-09-09 02:20:56,112 DEBUG run_quick about to write control file parameters to --yearbase 2018 --cruisename oc1809a --configtype python --sonar os75bb --dbname a_oc --datatype uhdas --cfgpath /home/data/oc1809a/proc/os75bb/config --ens_len 300 #--update_gbin ## python gbins: run by "run_lastensq.py" at sea #offset between transducer and gps, applied in at-sea processing # NOTE : read special instructions to change offsets # diagnostics in cal/watertrk/guess_xducerxy.out # parameters used: --xducer_dx 1 --xducer_dy -30 ## see config/oc1809a_proc.py for other settings --skip_avg ## see above --max_search_depth 2000 --ping_headcorr --proc_engine python --refuv_smoothwin 3 --incremental --find_pflags --top_plotbin 1 --auto 2018-09-09 02:20:56,114 DEBUG quick_adcp sys.argv = /usr/local/currents/bin/run_quick.py -d os75bb 2018-09-09 02:20:56,115 DEBUG quick_setup found cruise_info.hcorr (adu5, adu, 3) 2018-09-09 02:20:56,115 DEBUG quick_setup no heading correction will be used within the ensembles but values are staged in cal/rotate/hcorr.asc 2018-09-09 02:20:56,116 INFO quick_setup fix file is a_oc.gps 2018-09-09 02:20:56,116 INFO quick_setup reflayer: ref_method = refsm 2018-09-09 02:20:56,116 INFO quick_setup reflayer: refuv_source = nav 2018-09-09 02:20:56,116 INFO quick_setup reflayer: refuv_smoothwin = 3 2018-09-09 02:20:56,116 INFO quick_adcp ===================================================== 2018-09-09 02:20:56,116 INFO quick_adcp ===================================================== 2018-09-09 02:20:56,116 INFO quick_adcp command line was: /usr/local/currents/bin/run_quick.py -d os75bb 2018-09-09 02:20:56,116 INFO quick_adcp cwd is /home/data/oc1809a/proc/os75bb about to run these steps: - write_clearflags - scandata - avg_and_load - codaseditsetup - setflags - getnav - lst_hdg - plot_headcorr - navsteps - find_pflags - apply_edit - navsteps - lst_temp - plot_temp - lst_npings - calib - matfiles - adcpsect - refabs - smoothnav - putnav - refplots - find_pflags - codaseditsetup 2018-09-09 02:20:56,116 DEBUG quick_asect extracting matlab files for os75bb 2018-09-09 02:20:56,118 DEBUG quick_setup data directory: /home/data/oc1809a/raw/os75 2018-09-09 02:20:56,118 INFO quick_setup found 86 files using wildcard expansion relative to scan directory wildcard string was: "/home/data/oc1809a/raw/os75/*.raw" 2018-09-09 02:20:56,118 INFO quick_setup presently in scan, writing filelist to /home/data/oc1809a/proc/os75bb/ping/datafile_list.txt 2018-09-09 02:20:56,119 INFO quick_setup found 86 raw data files 2018-09-09 02:20:56,119 DEBUG quick_adcp starting with data files (as seen from scan/ or load/ directory): /home/data/oc1809a/raw/os75/oc2018_244_27325.raw ... 2018-09-09 02:20:56,119 DEBUG quick_adcp Sun Sep 9 02:20:56 2018 running: /usr/local/currents/bin/run_quick.py -d os75bb ----- adcpsect variables ------ cbasename contour dbname a_oc dbpath ../adcpdb deeper_boundaries [50, 75, 100, 125, 150, 175, 200, 225, 250, 275, 300, 325, 350, 375, 400, 425, 450, 475, 500, 525, 550, 575, 600, 625, 650, 675, 700, 725, 750, 775] firstdepth 17 gridnum 80 increment 10 loaded_time_range all numbins 128 outdir . pgmin 50 prefix allbins_ proc_yearbase 2018 rl_endbin 20 rl_startbin 2 ss_string separate timegrid 60 vbasename vector ----- quick_adcp.py variables and current values ------ adjust_time 1 auto True badbeam None beamangle 30 bl_half_width 3 btrk_step 1.5 cfgpath /home/data/oc1809a/proc/os75bb/config cntfile /home/data/oc1809a/proc/os75bb/os75bb_qpy.cnt commands None configtype python cruisename oc1809a data_def vmadcp.def data_filelist /home/data/oc1809a/proc/os75bb/ping/datafile_list.txt datadir /home/data/oc1809a/raw/os75 datafile_glob *.raw datatype uhdas dbname a_oc dday_bailout None debug False ens_len 300 expert None filelist ['/home/data/oc1809a/raw/os75/oc2018_244_27325.raw', '/home/data/oc1809a/raw/os75/oc2018_244_28800.raw', '/home/data/oc1809a/raw/os75/oc2018_244_36000.raw', '/home/data/oc1809a/raw/os75/oc2018_244_43200.raw', '/home/data/oc1809a/raw/os75/oc2018_244_50400.raw', '/home/data/oc1809a/raw/os75/oc2018_244_57600.raw', '/home/data/oc1809a/raw/os75/oc2018_244_64800.raw', '/home/data/oc1809a/raw/os75/oc2018_244_72000.raw', '/home/data/oc1809a/raw/os75/oc2018_244_79200.raw', '/home/data/oc1809a/raw/os75/oc2018_244_81410.raw', '/home/data/oc1809a/raw/os75/oc2018_245_00000.raw', '/home/data/oc1809a/raw/os75/oc2018_245_07200.raw', '/home/data/oc1809a/raw/os75/oc2018_245_07341.raw', '/home/data/oc1809a/raw/os75/oc2018_245_14400.raw', '/home/data/oc1809a/raw/os75/oc2018_245_21600.raw', '/home/data/oc1809a/raw/os75/oc2018_245_28800.raw', '/home/data/oc1809a/raw/os75/oc2018_245_36000.raw', '/home/data/oc1809a/raw/os75/oc2018_245_43200.raw', '/home/data/oc1809a/raw/os75/oc2018_245_50400.raw', '/home/data/oc1809a/raw/os75/oc2018_245_57600.raw', '/home/data/oc1809a/raw/os75/oc2018_245_64800.raw', '/home/data/oc1809a/raw/os75/oc2018_245_72000.raw', '/home/data/oc1809a/raw/os75/oc2018_245_79200.raw', '/home/data/oc1809a/raw/os75/oc2018_246_00000.raw', '/home/data/oc1809a/raw/os75/oc2018_246_07200.raw', '/home/data/oc1809a/raw/os75/oc2018_246_14400.raw', '/home/data/oc1809a/raw/os75/oc2018_246_21600.raw', '/home/data/oc1809a/raw/os75/oc2018_246_28800.raw', '/home/data/oc1809a/raw/os75/oc2018_246_36000.raw', '/home/data/oc1809a/raw/os75/oc2018_246_43200.raw', '/home/data/oc1809a/raw/os75/oc2018_246_50400.raw', '/home/data/oc1809a/raw/os75/oc2018_246_57600.raw', '/home/data/oc1809a/raw/os75/oc2018_246_64800.raw', '/home/data/oc1809a/raw/os75/oc2018_246_72000.raw', '/home/data/oc1809a/raw/os75/oc2018_246_79200.raw', '/home/data/oc1809a/raw/os75/oc2018_247_00000.raw', '/home/data/oc1809a/raw/os75/oc2018_247_07200.raw', '/home/data/oc1809a/raw/os75/oc2018_247_14400.raw', '/home/data/oc1809a/raw/os75/oc2018_247_21600.raw', '/home/data/oc1809a/raw/os75/oc2018_247_28800.raw', '/home/data/oc1809a/raw/os75/oc2018_247_36000.raw', '/home/data/oc1809a/raw/os75/oc2018_247_43200.raw', '/home/data/oc1809a/raw/os75/oc2018_247_50400.raw', '/home/data/oc1809a/raw/os75/oc2018_247_57600.raw', '/home/data/oc1809a/raw/os75/oc2018_247_64800.raw', '/home/data/oc1809a/raw/os75/oc2018_247_72000.raw', '/home/data/oc1809a/raw/os75/oc2018_247_79200.raw', '/home/data/oc1809a/raw/os75/oc2018_248_00000.raw', '/home/data/oc1809a/raw/os75/oc2018_248_07200.raw', '/home/data/oc1809a/raw/os75/oc2018_248_14400.raw', '/home/data/oc1809a/raw/os75/oc2018_248_21600.raw', '/home/data/oc1809a/raw/os75/oc2018_248_28800.raw', '/home/data/oc1809a/raw/os75/oc2018_248_36000.raw', '/home/data/oc1809a/raw/os75/oc2018_248_43200.raw', '/home/data/oc1809a/raw/os75/oc2018_248_50400.raw', '/home/data/oc1809a/raw/os75/oc2018_248_57600.raw', '/home/data/oc1809a/raw/os75/oc2018_248_64800.raw', '/home/data/oc1809a/raw/os75/oc2018_248_72000.raw', '/home/data/oc1809a/raw/os75/oc2018_248_79200.raw', '/home/data/oc1809a/raw/os75/oc2018_248_81631.raw', '/home/data/oc1809a/raw/os75/oc2018_249_00000.raw', '/home/data/oc1809a/raw/os75/oc2018_249_07200.raw', '/home/data/oc1809a/raw/os75/oc2018_249_14400.raw', '/home/data/oc1809a/raw/os75/oc2018_249_21600.raw', '/home/data/oc1809a/raw/os75/oc2018_249_28800.raw', '/home/data/oc1809a/raw/os75/oc2018_249_36000.raw', '/home/data/oc1809a/raw/os75/oc2018_249_43200.raw', '/home/data/oc1809a/raw/os75/oc2018_249_50400.raw', '/home/data/oc1809a/raw/os75/oc2018_249_57600.raw', '/home/data/oc1809a/raw/os75/oc2018_249_64800.raw', '/home/data/oc1809a/raw/os75/oc2018_249_72000.raw', '/home/data/oc1809a/raw/os75/oc2018_249_79200.raw', '/home/data/oc1809a/raw/os75/oc2018_250_00000.raw', '/home/data/oc1809a/raw/os75/oc2018_250_07200.raw', '/home/data/oc1809a/raw/os75/oc2018_250_14400.raw', '/home/data/oc1809a/raw/os75/oc2018_250_21600.raw', '/home/data/oc1809a/raw/os75/oc2018_250_28800.raw', '/home/data/oc1809a/raw/os75/oc2018_250_36000.raw', '/home/data/oc1809a/raw/os75/oc2018_250_43200.raw', '/home/data/oc1809a/raw/os75/oc2018_250_50400.raw', '/home/data/oc1809a/raw/os75/oc2018_250_57600.raw', '/home/data/oc1809a/raw/os75/oc2018_250_64800.raw', '/home/data/oc1809a/raw/os75/oc2018_250_72000.raw', '/home/data/oc1809a/raw/os75/oc2018_250_79200.raw', '/home/data/oc1809a/raw/os75/oc2018_251_00000.raw', '/home/data/oc1809a/raw/os75/oc2018_251_07200.raw'] filter_hwidth 0.0208 find_pflags True firstdepth 17 fixfile a_oc.gps fixfilexy a_oc.agt frequency 75 hcorr_inst adu5 help False incremental True instname os75 jitter 15 max_BLKprofiles 300 max_search_depth 2000 maxrunsecs None min_filter_fraction 0.5 mixed_pings False model os nosave_editcfg 0 numbins 128 pgmin 50 ping_headcorr True pingpref None pingtype bb printformats png proc_engine python proc_yearbase 2018 procdir /home/data/oc1809a/proc/os75bb py_gbindirbase /home/data/oc1809a/gbin ref_method refsm refuv_inputfile a_oc.agt refuv_smoothwin 3 refuv_source nav rl_endbin 20 rl_startbin 2 rotate_amplitude 1 rotate_angle 0 save_lastens 0 skip_avg True sonar os75bb steps2rerun sum_xducer_dx 1 sum_xducer_dy -30 time_angle_base ens_hcorr time_angle_file ens_hcorr.ang timeout_secs 86400 top_plotbin 1 tuv_file refsm_tuv.asc txy_file a_oc.agt ub_type 1920 uhdas_config yearbase = 2018 uhdas_dir = /home/data/oc1809a sonar = os75bb gbin = /home/data/oc1809a/gbin gbinsonar = /home/data/oc1809a/gbin/os75 raw = /home/data/oc1809a/raw rawsonar = /home/data/oc1809a/raw/os75 rbin = /home/data/oc1809a/rbin proc = /home/data/oc1809a/proc procsonar = /home/data/oc1809a/proc/os75bb other attributes: gbin_params = hdg_inst : gyro hdg_inst_msgs : [('gyro', 'hdg'), ('adu5', 'adu'), ('adu800', 'adu')] hdg_msg : hdg pitch_inst : adu5 pitch_msg : adu pos_inst : gpsnav pos_msg : gps roll_inst : adu5 roll_msg : adu hcorr = ['adu5', 'adu', 3.0] acc_heading_cutoff = 0.02 update_gbin False uvwref_end None uvwref_start None vardoc False varvals False wtrk_step 7 xducer_dx 1 xducer_dy -30 yearbase 2018 configured to run the following steps: write_clearflags scandata avg_and_load codaseditsetup setflags getnav lst_hdg plot_headcorr navsteps find_pflags apply_edit navsteps lst_temp plot_temp lst_npings calib matfiles adcpsect refabs smoothnav putnav refplots find_pflags codaseditsetup 2018-09-09 02:20:56,119 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,119 INFO quick_adcp step 1: set up files in "edit" directory 2018-09-09 02:20:56,119 INFO quick_run file exists (edit/clearflags.tmp). not writing 2018-09-09 02:20:56,119 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,119 INFO quick_adcp step 2: scan files for time range 2018-09-09 02:20:56,119 DEBUG quick_npy Starting: scanping 2018-09-09 02:20:56,158 DEBUG quick_npy Ending: scanping 2018-09-09 02:20:56,161 DEBUG quick_subs start_end_time 2018/09/06 22:40:32 to 2018/09/06 22:45:46 2018-09-09 02:20:56,161 DEBUG quick_subs dd0: 248.944815 dd1: 248.948449 2018-09-09 02:20:56,161 DEBUG quick_subs running external command "lstblock adcpdb/a_oc adcpdb/a_oc.lst" 2018-09-09 02:20:56,165 DEBUG quick_subs lstblock ran successfully. 2018-09-09 02:20:56,165 DEBUG quick_subs start_end_time 2018/09/06 22:45:32 to 2018/09/09 02:15:31 2018-09-09 02:20:56,165 DEBUG quick_subs dd0: 248.948287 dd1: 251.094109 2018-09-09 02:20:56,166 DEBUG quick_adcp in quick_adcp.py before load, just looked for database times 2018-09-09 02:20:56,166 DEBUG quick_adcp origdb_time_range is 2018/09/06 22:45:32 to 2018/09/09 02:15:31 2018-09-09 02:20:56,166 DEBUG quick_adcp (248.948287 to 251.094109) 2018-09-09 02:20:56,166 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,166 INFO quick_adcp step 3: generate averaged data... 2018-09-09 02:20:56,166 INFO quick_run file load/ping_editparams.txt exists. not replacing 2018-09-09 02:20:56,166 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,166 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/load 2018-09-09 02:20:56,166 DEBUG quick_setup running python command "run_pingavg_npy" 2018-09-09 02:20:56,166 DEBUG quick_npy Starting: pingavg 2018-09-09 02:20:56,167 DEBUG quick_npy xducerxy is [1, -30] 2018-09-09 02:20:56,167 DEBUG quick_npy uvwref is None 2018-09-09 02:20:56,167 DEBUG quick_npy singleping editing parameters: 2018-09-09 02:20:56,167 DEBUG quick_npy bigtarget_mab_window : 11 2018-09-09 02:20:56,167 DEBUG quick_npy rl_endbin : 20 2018-09-09 02:20:56,167 DEBUG quick_npy max_search_depth : 2000 2018-09-09 02:20:56,168 DEBUG quick_npy cor_cutoff : 120 2018-09-09 02:20:56,168 DEBUG quick_npy ampfilt : 40 2018-09-09 02:20:56,168 DEBUG quick_npy bigtarget_lgb_margin : 0.500000 2018-09-09 02:20:56,168 DEBUG quick_npy rl_startbin : 2 2018-09-09 02:20:56,168 DEBUG quick_npy ecutoff : 0.800000 2018-09-09 02:20:56,168 DEBUG quick_npy refavg_valcutoff : 1 2018-09-09 02:20:56,168 DEBUG quick_npy weakprof_percent : 30 2018-09-09 02:20:56,168 DEBUG quick_npy bigtarget_ampthresh : 55 2018-09-09 02:20:56,170 INFO pingavg ---------------- 2018-09-09 02:20:56,170 INFO pingavg sonar is os75bb 2018-09-09 02:20:56,170 INFO pingavg Pingavg.run for time range 251.083337 to 251.097833 2018-09-09 02:20:56,170 INFO pingavg transducer offset: xducer_dx = 1.000, xducer_dy = -30.000 2018-09-09 02:20:56,170 INFO pingavg shifted positions applied to *.gpst2 and *.uvship' 2018-09-09 02:20:56,170 INFO pingavg ---------------- 2018-09-09 02:20:56,178 DEBUG pingavg Chunk 1 of 1, 251.083337 to 251.097833 2018-09-09 02:20:56,178 DEBUG pingavg Nothing written 2018-09-09 02:20:56,179 DEBUG quick_npy wrote 0 averages 2018-09-09 02:20:56,179 DEBUG quick_npy Ending: pingavg 2018-09-09 02:20:56,179 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,179 INFO quick_adcp step 4: load averaged data (to database) 2018-09-09 02:20:56,179 DEBUG quick_subs in del_overlapping: lastblock: 3 lastcmd: 3 delblks: [3] loadblks: [3] 2018-09-09 02:20:56,179 DEBUG quick_subs blockfiles remain; running mkblkdir 2018-09-09 02:20:56,180 DEBUG quick_subs running mkblkdir adcpdb/mkblkdir.tmp 2018-09-09 02:20:56,183 DEBUG quick_run [3] 2018-09-09 02:20:56,184 DEBUG quick_run cmdlist 2018-09-09 02:20:56,184 DEBUG quick_run ['./ens_blk003.cmd'] 2018-09-09 02:20:56,184 INFO quick_run loaded time range: 2018/09/09 00:45:31 to 2018/09/09 02:20:31 2018-09-09 02:20:56,184 DEBUG quick_setup load/ldcodas.tmp exists 2018-09-09 02:20:56,185 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,185 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/load 2018-09-09 02:20:56,185 DEBUG quick_setup running python command "ldcodas" 2018-09-09 02:20:56,185 DEBUG quick_subs filling "thisload" timerange 2018-09-09 02:20:56,185 DEBUG quick_subs in ldcodas 2018-09-09 02:20:56,185 DEBUG quick_subs cmdlist: 2018-09-09 02:20:56,185 DEBUG quick_subs ['./ens_blk003.cmd'] 2018-09-09 02:20:56,185 DEBUG quick_subs DATABASE_NAME: ../adcpdb/a_oc DEFINITION_FILE: vmadcp.def LOG_FILE: load.log YEAR_BASE: 2018 cmd_file_list /* use only if specifying cmd paths, not "@" */ END ./ens_blk003.cmd 2018-09-09 02:20:56,185 DEBUG quick_setup about to run ldcodas ldcodas.tmp 2018-09-09 02:20:56,191 INFO quick_run 4 block files present 2018-09-09 02:20:56,191 DEBUG quick_subs running external command "lstblock adcpdb/a_oc adcpdb/a_oc.lst" 2018-09-09 02:20:56,193 DEBUG quick_subs lstblock ran successfully. 2018-09-09 02:20:56,194 DEBUG quick_subs start_end_time 2018/09/06 22:45:32 to 2018/09/09 02:20:31 2018-09-09 02:20:56,194 DEBUG quick_subs dd0: 248.948287 dd1: 251.097581 2018-09-09 02:20:56,194 INFO quick_adcp database time range: 2018-09-09 02:20:56,194 INFO quick_adcp 2018/09/06 22:45:32 to 2018/09/09 02:20:31 2018-09-09 02:20:56,194 INFO quick_adcp (248.948287 to 251.097581) 2018-09-09 02:20:56,194 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,194 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/adcpdb 2018-09-09 02:20:56,194 DEBUG quick_setup running python command "lst_conf" 2018-09-09 02:20:56,194 DEBUG quick_subs dbname: a_oc output: a_oc.cnh time_ranges: all 2018-09-09 02:20:56,194 DEBUG quick_setup about to run lst_conf lst_conf.tmp 2018-09-09 02:20:56,199 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,199 INFO quick_adcp step 5: set up files for codas editing (gautoedit.py) 2018-09-09 02:20:56,199 DEBUG quick_run file edit/codas_editparams.txt exists. not replacing 2018-09-09 02:20:56,199 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,199 INFO quick_adcp step 6: run setflags? 2018-09-09 02:20:56,199 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,199 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/edit 2018-09-09 02:20:56,199 DEBUG quick_setup running python command "write_setflags" 2018-09-09 02:20:56,199 DEBUG quick_subs dbname: ../adcpdb/a_oc pg_min: 50 set_range_bit time_ranges: all 2018-09-09 02:20:56,199 DEBUG quick_setup about to run setflags setflags.tmp 2018-09-09 02:20:56,205 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,205 INFO quick_adcp step 7: get navigation 2018-09-09 02:20:56,205 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,205 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/nav 2018-09-09 02:20:56,206 DEBUG quick_setup running python command "catnav" 2018-09-09 02:20:56,206 INFO quick_subs navigation file nav/a_oc.gps created from load/*.gps2 2018-09-09 02:20:56,206 INFO quick_subs navigation file nav/a_oc.agt created from load/*.gpst2 2018-09-09 02:20:56,207 DEBUG quick_mpl Starting plot: uvship 2018-09-09 02:20:56,445 DEBUG quick_mpl Ending plot: uvship 2018-09-09 02:20:56,445 INFO quick_run plotted uvship 2018-09-09 02:20:56,445 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,445 INFO quick_adcp step 8: list heading 2018-09-09 02:20:56,445 DEBUG quick_setup cal/rotate/lst_hdg.tmp exists 2018-09-09 02:20:56,445 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,446 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/cal/rotate 2018-09-09 02:20:56,446 DEBUG quick_setup running python command "lst_hdg" 2018-09-09 02:20:56,446 DEBUG quick_subs dbname: ../../adcpdb/a_oc output: scn.hdg step_size= 1 year_base= 2018 time_ranges: all 2018-09-09 02:20:56,446 DEBUG quick_setup about to run lst_hdg lst_hdg.tmp 2018-09-09 02:20:56,452 INFO quick_run ... headings extracted 2018-09-09 02:20:56,452 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:56,452 INFO quick_adcp step 9: plot heading correction 2018-09-09 02:20:56,452 DEBUG quick_run hcorr_inst is adu5 2018-09-09 02:20:56,452 DEBUG quick_mpl Starting plot: hcorr 2018-09-09 02:20:56,457 DEBUG quick_mpl found 2.149297 days of data 2018-09-09 02:20:56,457 DEBUG quick_mpl figures with 4 panels per page, 1.000000 days per panel 2018-09-09 02:20:56,457 DEBUG quick_mpl printing 1 pages 2018-09-09 02:20:56,697 DEBUG quick_mpl Ending plot: hcorr 2018-09-09 02:20:56,697 INFO quick_run plots are in cal/rotate/*png 2018-09-09 02:20:56,697 INFO quick_adcp ------------------------- 2018-09-09 02:20:56,698 INFO quick_adcp ---- running navsteps --- 2018-09-09 02:20:56,698 INFO quick_adcp ------------------------- 2018-09-09 02:20:56,698 INFO quick_adcp step 10: nav steps: run adcpsect 2018-09-09 02:20:56,698 INFO quick_adcp navstep 1 2018-09-09 02:20:56,698 DEBUG quick_setup nav/as_nav.tmp exists 2018-09-09 02:20:56,698 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,698 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/nav 2018-09-09 02:20:56,698 DEBUG quick_setup running python command "as_nav" 2018-09-09 02:20:56,698 DEBUG quick_subs dbname: ../adcpdb/a_oc output: a_oc step_size: 1 ndepth: 20 time_ranges: separate year_base= 2018 option_list: pg_min= 50 navigation: reference_bins 2 to 20 end statistics: mean units= 0.01 /* cm/s instead of default m/s */ end flag_mask: ALL_BITS end end 2018/09/06 22:45:32 to 2018/09/09 02:20:31 /* the whole time range */ 2018-09-09 02:20:56,698 DEBUG quick_setup about to run adcpsect as_nav.tmp 2018-09-09 02:20:56,706 INFO quick_run ... ran adcpsect for navsteps 2018-09-09 02:20:56,707 INFO quick_adcp ------------------------- 2018-09-09 02:20:56,707 INFO quick_adcp step 11: nav steps: run refabs 2018-09-09 02:20:56,707 INFO quick_adcp navstep 2 2018-09-09 02:20:56,707 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,707 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/nav 2018-09-09 02:20:56,707 DEBUG quick_setup running python command "refabs" 2018-09-09 02:20:56,707 DEBUG quick_subs fix_file_type: simple reference_file: a_oc.nav fix_file: a_oc.agt output: a_oc.ref year_base= 2018 ensemble_length= 300 gap_tolerance= 10 2018-09-09 02:20:56,707 DEBUG quick_setup about to run refabs refabs.tmp 2018-09-09 02:20:56,714 INFO quick_run ... ran refabs for navsteps 2018-09-09 02:20:56,714 INFO quick_adcp ------------------------- 2018-09-09 02:20:56,714 INFO quick_adcp step 12: nav steps: run smoothr for plots 2018-09-09 02:20:56,714 INFO quick_adcp navstep 3 2018-09-09 02:20:56,714 DEBUG quick_setup nav/smoothr.tmp exists 2018-09-09 02:20:56,714 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,714 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/nav 2018-09-09 02:20:56,714 DEBUG quick_setup running python command "smoothr" 2018-09-09 02:20:56,715 DEBUG quick_subs reference_file: a_oc.nav refabs_output: a_oc.ref output: a_oc.sm filter_hwidth= 0.0208 min_filter_fraction= 0.5 max_gap_ratio= 0.05 max_gap_distance= 50 max_gap_time= 30 /* 0.5 minutes */ ensemble_time= 300 max_speed= 5.0 min_speed= 1.0 iterations= 5 fix_to_dr_limit= 0.00050 2018-09-09 02:20:56,715 DEBUG quick_setup about to run smoothr smoothr.tmp 2018-09-09 02:20:56,733 INFO quick_run ... ran smoothr 2018-09-09 02:20:56,733 INFO quick_adcp ------------------------- 2018-09-09 02:20:56,734 INFO quick_adcp step 13: nav steps: smooth navigation for velocities 2018-09-09 02:20:56,734 INFO quick_adcp navstep 4 2018-09-09 02:20:56,734 INFO quick_run smoothing method for ship speed: refsm 2018-09-09 02:20:56,734 INFO quick_run smoothing window: 3 2018-09-09 02:20:56,734 INFO quick_run ship speed source: nav 2018-09-09 02:20:56,734 DEBUG quick_npy Starting: refsm 2018-09-09 02:20:56,763 DEBUG quick_npy Ending: refsm 2018-09-09 02:20:56,763 INFO quick_run ... shipspeed smoothing step done 2018-09-09 02:20:56,763 INFO quick_adcp ------------------------- 2018-09-09 02:20:56,763 INFO quick_adcp step 14: nav steps: put positions and uvship from refsm into codasdb 2018-09-09 02:20:56,763 INFO quick_adcp navstep 5 2018-09-09 02:20:56,763 DEBUG quick_setup nav/put_txy.tmp exists 2018-09-09 02:20:56,763 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,763 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/nav 2018-09-09 02:20:56,763 DEBUG quick_setup running python command "put_txy" 2018-09-09 02:20:56,763 DEBUG quick_subs dbname: ../adcpdb/a_oc position_file: a_oc.agt year_base= 2018 tolerance= 5 2018-09-09 02:20:56,763 DEBUG quick_setup about to run put_txy put_txy.tmp 2018-09-09 02:20:56,769 INFO quick_run ... ran put_txy 2018-09-09 02:20:56,770 DEBUG quick_setup nav/put_tuv.tmp exists 2018-09-09 02:20:56,770 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:56,770 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/nav 2018-09-09 02:20:56,770 DEBUG quick_setup running python command "put_tuv" 2018-09-09 02:20:56,770 DEBUG quick_subs dbname: ../adcpdb/a_oc shipspeed_file: refsm_tuv.asc year_base= 2018 tolerance= 5 2018-09-09 02:20:56,770 DEBUG quick_setup about to run put_tuv put_tuv.tmp 2018-09-09 02:20:56,776 INFO quick_run ... ran put_tuv 2018-09-09 02:20:56,776 DEBUG quick_mpl Starting plot: nav 2018-09-09 02:20:57,001 DEBUG quick_mpl Ending plot: nav 2018-09-09 02:20:57,001 INFO quick_run ... made navigation plot 2018-09-09 02:20:57,001 INFO quick_adcp ------------------------- 2018-09-09 02:20:57,002 INFO quick_adcp step 15: nav steps: make reflayer plots 2018-09-09 02:20:57,002 INFO quick_adcp navstep 6 2018-09-09 02:20:57,002 DEBUG quick_mpl Starting plot: refl 2018-09-09 02:20:57,012 DEBUG quick_mpl found 2.142341 days of data 2018-09-09 02:20:57,012 DEBUG quick_mpl start day is 248.000000 2018-09-09 02:20:57,012 DEBUG quick_mpl figures with 2.000000 days per page 2018-09-09 02:20:57,012 DEBUG quick_mpl printing 2 pages 2018-09-09 02:20:57,012 DEBUG quick_mpl yrange will be [1.000000, 1.000000] 2018-09-09 02:20:57,463 DEBUG quick_mpl Ending plot: refl 2018-09-09 02:20:57,463 INFO quick_run ... made reflayer plots 2018-09-09 02:20:57,463 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:57,463 INFO quick_adcp step 10: find profile flags 2018-09-09 02:20:57,463 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:57,463 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/edit 2018-09-09 02:20:57,463 DEBUG quick_setup running python command "run_autoedit_npy" 2018-09-09 02:20:57,463 DEBUG quick_npy Starting: autoedit 2018-09-09 02:20:57,492 DEBUG pingedit wrote 33 bad bins to abadbin_tmp.asc 2018-09-09 02:20:57,494 DEBUG pingedit wrote 1 bad profiles to abadprf_tmp.asc 2018-09-09 02:20:57,494 DEBUG quick_npy Ending: autoedit 2018-09-09 02:20:57,494 INFO quick_run ... extracted files using automatic editing 2018-09-09 02:20:57,494 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:57,494 INFO quick_adcp step 11: apply editing 2018-09-09 02:20:57,494 DEBUG quick_run starting in: /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:57,494 DEBUG quick_run executing commands from: edit 2018-09-09 02:20:57,495 DEBUG quick_run about to run dbupdate ../adcpdb/a_oc abadprf_tmp.asc 2018-09-09 02:20:57,499 DEBUG quick_run about to run badbin ../adcpdb/a_oc abadbin_tmp.asc 2018-09-09 02:20:57,504 DEBUG quick_subs dbname: ../adcpdb/a_oc pg_min: 50 set_range_bit time_ranges: all 2018-09-09 02:20:57,504 DEBUG quick_run about to run setflags setflags.tmp 2018-09-09 02:20:57,511 DEBUG quick_run changing directories back to /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:57,511 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:57,511 INFO quick_adcp step 12: run calibration steps 2018-09-09 02:20:57,511 DEBUG quick_setup cal/botmtrk/lst_btrk.tmp exists 2018-09-09 02:20:57,511 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:57,511 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/cal/botmtrk 2018-09-09 02:20:57,511 DEBUG quick_setup running python command "lst_btrk" 2018-09-09 02:20:57,511 DEBUG quick_subs dbname: ../../adcpdb/a_oc output: a_oc.btm step_size= 1 year_base= 2018 time_ranges: 2018/09/06 22:45:32 to 2018/09/09 02:20:31 /* whole time range */ 2018-09-09 02:20:57,511 DEBUG quick_setup about to run lst_btrk lst_btrk.tmp 2018-09-09 02:20:57,516 DEBUG quick_setup cal/botmtrk/refabsbt.tmp exists 2018-09-09 02:20:57,516 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:57,517 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/cal/botmtrk 2018-09-09 02:20:57,517 DEBUG quick_setup running python command "refabsbt" 2018-09-09 02:20:57,517 DEBUG quick_subs fix_file_type: simple reference_file: a_oc.btm fix_file: ../../nav/a_oc.agt output: a_oc.ref year_base= 2018 ensemble_length= 300 gap_tolerance= 60 2018-09-09 02:20:57,517 DEBUG quick_setup about to run refabsbt refabsbt.tmp 2018-09-09 02:20:57,521 INFO quick_run ...bottom track info in check cal/botmtrk 2018-09-09 02:20:57,521 DEBUG quick_mpl Starting plot: btcal 2018-09-09 02:20:57,522 DEBUG quick_mpl No data in a_oc.btm 2018-09-09 02:20:57,522 DEBUG quick_mpl Returning from Btplot with no output 2018-09-09 02:20:57,522 DEBUG quick_mpl Ending plot: btcal 2018-09-09 02:20:57,522 DEBUG quick_setup nav/as_nav.tmp exists 2018-09-09 02:20:57,522 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:57,522 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/nav 2018-09-09 02:20:57,522 DEBUG quick_setup running python command "as_nav" 2018-09-09 02:20:57,522 DEBUG quick_subs dbname: ../adcpdb/a_oc output: a_oc step_size: 1 ndepth: 20 time_ranges: separate year_base= 2018 option_list: pg_min= 50 navigation: reference_bins 2 to 20 end statistics: mean units= 0.01 /* cm/s instead of default m/s */ end flag_mask: ALL_BITS end end 2018/09/06 22:45:32 to 2018/09/09 02:20:31 /* the whole time range */ 2018-09-09 02:20:57,522 DEBUG quick_setup about to run adcpsect as_nav.tmp 2018-09-09 02:20:57,530 DEBUG quick_setup cal/watertrk/timslip.tmp exists 2018-09-09 02:20:57,530 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:57,530 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/cal/watertrk 2018-09-09 02:20:57,530 DEBUG quick_setup running python command "timslip" 2018-09-09 02:20:57,530 DEBUG quick_subs fix_file_type: simple fix_file: ../../nav/a_oc.agt reference_file: ../../nav/a_oc.nav output_file: a_oc_7.cal year_base= 2018 min_n_fixes= 7 /* 5 7 9 */ n_refs= 7 /* 5 7 9 */ i_ref_l0= 1 i_ref_l1= 2 /* 1 2 3 */ i_ref_r0= 5 /* 4 5 6 */ i_ref_r1= 6 /* 4 6 8 */ up_thresh= 3.0 /* m/s */ down_thresh= 3.0 /* m/s */ turn_speed= 2.0 /* m/s */ turn_thresh= 60 /* degrees */ dtmax= 360 /* seconds, for 300-second ensembles */ tolerance= 5.e-5 /* days, about 5 seconds */ grid: ensemble use_shifted_times? no 2018-09-09 02:20:57,530 DEBUG quick_setup about to run timslip timslip.tmp 2018-09-09 02:20:57,536 INFO quick_run ... watertrack info in cal/watertrk 2018-09-09 02:20:57,536 DEBUG quick_mpl Starting plot: wtcal 2018-09-09 02:20:57,537 DEBUG quick_mpl Found 19 calibration points 2018-09-09 02:20:58,084 DEBUG quick_mpl Ending plot: wtcal 2018-09-09 02:20:58,084 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,084 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/cal/watertrk 2018-09-09 02:20:58,085 DEBUG quick_setup running python command "run_guess_xducerxy_npy" 2018-09-09 02:20:58,085 DEBUG quick_npy Starting: guess_xducerxy 2018-09-09 02:20:58,104 DEBUG quick_npy Ending: guess_xducerxy 2018-09-09 02:20:58,105 INFO quick_run ... check cal/watertrk for estimate 2018-09-09 02:20:58,105 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:58,105 INFO quick_adcp step 13: extract and plot temperature 2018-09-09 02:20:58,105 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,105 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/edit 2018-09-09 02:20:58,105 DEBUG quick_setup running python command "lst_temp" 2018-09-09 02:20:58,105 DEBUG quick_subs dbname: ../adcpdb/a_oc output: a_oc.tem step_size= 1 year_base= 2018 time_ranges: all 2018-09-09 02:20:58,105 DEBUG quick_setup about to run lst_temp lst_temp.tmp 2018-09-09 02:20:58,112 DEBUG quick_mpl Starting plot: temp 2018-09-09 02:20:58,116 DEBUG quick_mpl plotting 620 points 2018-09-09 02:20:58,252 DEBUG quick_mpl Ending plot: temp 2018-09-09 02:20:58,252 INFO quick_run plotted temperature 2018-09-09 02:20:58,253 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:58,253 INFO quick_adcp step 14: extract and plot number of pings per ensemble 2018-09-09 02:20:58,253 DEBUG quick_setup edit/lst_npings.tmp exists 2018-09-09 02:20:58,253 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,253 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/edit 2018-09-09 02:20:58,253 DEBUG quick_setup running python command "lst_npings" 2018-09-09 02:20:58,253 DEBUG quick_subs dbname: ../adcpdb/a_oc output: a_oc_npings.txt step_size= 1 year_base= 2018 time_ranges: all 2018-09-09 02:20:58,253 DEBUG quick_setup about to run lst_npings lst_npings.tmp 2018-09-09 02:20:58,259 DEBUG quick_mpl Starting plot: npings 2018-09-09 02:20:58,263 DEBUG quick_mpl plotting 620 points 2018-09-09 02:20:58,352 DEBUG quick_mpl Ending plot: npings 2018-09-09 02:20:58,352 INFO quick_run ... plotted number of pings per ensemble 2018-09-09 02:20:58,352 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:58,352 INFO quick_adcp step 15: extract matlab "allbins" 2018-09-09 02:20:58,352 DEBUG quick_asect step 18: make matlab files for plotting 2018-09-09 02:20:58,352 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,352 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/vector 2018-09-09 02:20:58,352 DEBUG quick_setup running python command "timegrid" 2018-09-09 02:20:58,353 DEBUG quick_setup about to run timegrid a_oc.tmp 2018-09-09 02:20:58,358 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,358 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/vector 2018-09-09 02:20:58,358 DEBUG quick_setup running python command "as_vect" 2018-09-09 02:20:58,358 DEBUG quick_setup about to run adcpsect as_vect.tmp 2018-09-09 02:20:58,367 DEBUG quick_asect done making vector matfiles 2018-09-09 02:20:58,367 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,367 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/contour 2018-09-09 02:20:58,367 DEBUG quick_setup running python command "timegrid" 2018-09-09 02:20:58,367 DEBUG quick_setup about to run timegrid a_oc.tmp 2018-09-09 02:20:58,371 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,372 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/contour 2018-09-09 02:20:58,372 DEBUG quick_setup running python command "as_cont" 2018-09-09 02:20:58,372 DEBUG quick_setup about to run adcpsect as_cont.tmp 2018-09-09 02:20:58,384 DEBUG quick_setup starting in /home/data/oc1809a/proc/os75bb 2018-09-09 02:20:58,384 DEBUG quick_setup executing commands from /home/data/oc1809a/proc/os75bb/contour 2018-09-09 02:20:58,384 DEBUG quick_setup about to run getmat -qrs -f allbins_ ../adcpdb/a_oc 2018-09-09 02:20:58,407 DEBUG quick_asect done running getmat with "allbins" 2018-09-09 02:20:58,407 INFO quick_adcp --------------------------------------------- 2018-09-09 02:20:58,407 INFO quick_adcp writing "cruise_info.txt" 2018-09-09 02:20:58,409 INFO run_quick copying NOFIG to /home/adcp/www/figures/os75bb_hcorr_plot.png 2018-09-09 02:20:58,409 INFO run_quick copying NOFIG to /home/adcp/www/figures/thumbnails/os75bb_hcorr_plot_thumb.png 2018-09-09 02:20:58,409 DEBUG run_quick matfile is contour/contour_uv.mat 2018-09-09 02:20:58,409 INFO run_quick copying contour/contour_uv.mat to /home/adcp/www/data/os75bb_cont_uv.mat 2018-09-09 02:20:58,409 DEBUG run_quick matfile is vector/vector_uv.mat 2018-09-09 02:20:58,410 INFO run_quick copying vector/vector_uv.mat to /home/adcp/www/data/os75bb_vect_uv.mat 2018-09-09 02:20:58,410 DEBUG run_quick matfile is contour/contour_xy.mat 2018-09-09 02:20:58,410 INFO run_quick copying contour/contour_xy.mat to /home/adcp/www/data/os75bb_cont_xy.mat 2018-09-09 02:20:58,410 DEBUG run_quick matfile is vector/vector_xy.mat 2018-09-09 02:20:58,410 INFO run_quick copying vector/vector_xy.mat to /home/adcp/www/data/os75bb_vect_xy.mat 2018-09-09 02:20:58,410 DEBUG run_quick about to copy file edit/a_oc.tem to /home/adcp/www/data/os75bb_temp.asc 2018-09-09 02:20:58,410 INFO run_quick copying edit/a_oc.tem to /home/adcp/www/data/os75bb_temp.asc 2018-09-09 02:20:58,467 DEBUG run_quick about to copy netcdf file /home/data/oc1809a/proc/os75bb/contour/os75bb.nc to /home/adcp/www/data/os75bb.nc 2018-09-09 02:20:58,468 INFO run_quick copying /home/data/oc1809a/proc/os75bb/contour/os75bb.nc to /home/adcp/www/data/os75bb.nc 2018-09-09 02:20:58,468 INFO run_quick nc_compressed: ddstep is 1 2018-09-09 02:20:58,502 INFO run_quick success: made compressed nc file /home/adcp/uhdas_tmp/os75bb_compr.nc 2018-09-09 02:20:58,510 INFO run_quick generating pingstats for os75bb 2018-09-09 02:20:58,510 INFO run_quick Ending quick_adcp.py