2020-02-26 13:46:03,511 INFO DAS_while_logging Starting DAS_while_logging.py 2020-02-26 13:46:03,568 INFO DAS_while_logging Cruiseid: NF2020_ORT 2020-02-26 13:46:03,582 INFO DAS_while_logging starting run method 2020-02-26 13:46:03,582 INFO DAS_while_logging speedlog_stopflagfile: /home/adcp/flags/DAS_speedlog.stop 2020-02-26 13:46:03,582 INFO DAS_while_logging speedlog_runflagfile: /home/adcp/flags/DAS_speedlog.running 2020-02-26 13:46:03,583 INFO DAS_while_logging speedlog command is /usr/local/currents/bin/DAS_speedlog.py & 2020-02-26 13:46:03,784 INFO incr_class posmv gps 1 2020-02-26 13:46:03,784 INFO incr_class 2020-02-26 13:46:03,784 INFO incr_class posmv pmv 0 2020-02-26 13:46:03,784 INFO incr_class 2020-02-26 13:46:03,785 INFO incr_class gpsnav gps 1 2020-02-26 13:46:03,785 INFO incr_class 2020-02-26 13:46:03,785 INFO incr_class gyro hdg 1 2020-02-26 13:46:03,785 INFO incr_class 2020-02-26 13:46:03,788 INFO DAS_while_logging active_procdirnames: ['os150bb'] 2020-02-26 13:46:03,788 INFO repeater task os150bb_lastensq initial time_to_run is 2020/02/26 13:51:08 2020-02-26 13:46:03,788 INFO repeater PeriodicSystem: os150bb_lastensq interval is 305 seconds cd /home/adcp/uhdas_tmp; run_lastensq.py -d os150bb --update_pygbin --averages --plotens_mpl --kt_vecprof --pingwarnN 30 --ktsdir 2020-02-26 13:46:03,788 INFO repeater task os150bb_quick initial time_to_run is 2020/02/26 13:51:08 2020-02-26 13:46:03,789 INFO repeater PeriodicSystem: os150bb_quick interval is 305 seconds cd /home/adcp/uhdas_tmp; run_quick.py -d os150bb 2020-02-26 13:46:03,789 INFO repeater task os150bb_lastvec initial time_to_run is 2020/02/26 13:51:08 2020-02-26 13:46:03,789 INFO repeater PeriodicSystem: os150bb_lastvec interval is 305 seconds cd /home/adcp/uhdas_tmp; run_lastfew_vec.py -d os150bb 2020-02-26 13:46:03,789 INFO repeater task os150bb_3dayplots initial time_to_run is 2020/02/26 13:51:08 2020-02-26 13:46:03,789 INFO repeater PeriodicSystem: os150bb_3dayplots interval is 300 seconds cd /home/adcp/uhdas_tmp; run_3dayplots_mpl.py -d os150bb --plot_amp 2020-02-26 13:46:03,790 INFO repeater task os150bb_tsstats initial time_to_run is 2020/02/26 14:01:03 2020-02-26 13:46:03,790 INFO repeater PeriodicSystem: os150bb_tsstats interval is 900 seconds cd /home/adcp/uhdas_tmp; run_plot_tsstats.py os150bb 2020-02-26 13:46:03,790 INFO repeater task os150bb_10pings initial time_to_run is 2020/02/26 14:01:03 2020-02-26 13:46:03,790 INFO repeater PeriodicSystem: os150bb_10pings interval is 900 seconds cd /home/adcp/uhdas_tmp; run_grab_lastpings.py -d os150bb 2020-02-26 13:46:03,790 INFO repeater task os150bb_beamplots initial time_to_run is 2020/02/26 14:01:03 2020-02-26 13:46:03,791 INFO repeater PeriodicSystem: os150bb_beamplots interval is 900 seconds cd /home/adcp/uhdas_tmp; plot_beamdiagnostics.py -m 20 -d os150bb --savefigs --webcopy -p scattering 2020-02-26 13:46:03,791 INFO repeater task os150bb_beamplots initial time_to_run is 2020/02/26 14:01:03 2020-02-26 13:46:03,791 INFO repeater PeriodicSystem: os150bb_beamplots interval is 900 seconds cd /home/adcp/uhdas_tmp; plot_beamdiagnostics.py -m 20 -d os150bb --savefigs --webcopy -p velocity 2020-02-26 13:46:03,795 INFO procsetup Network interface for speedlog websocket is eno2 2020-02-26 13:46:03,798 INFO procsetup Web_speedlog IP is 10.48.2.65 2020-02-26 13:46:03,798 INFO uhdas_webgen copying /home/adcp/config/proc_cfg.py to /home/adcp/www/configs/proc_cfg.py.txt 2020-02-26 13:46:03,798 INFO uhdas_webgen copying /home/adcp/config/sensor_cfg.py to /home/adcp/www/configs/sensor_cfg.py.txt 2020-02-26 13:46:03,798 INFO uhdas_webgen copying /home/adcp/config/cmdfiles/os150_default.cmd to /home/adcp/www/configs/os150_default.cmd.txt 2020-02-26 13:46:03,882 INFO repeater task posmv_hcorrstats initial time_to_run is 2020/02/26 14:01:03 2020-02-26 13:46:03,883 INFO repeater PeriodicSystem: posmv_hcorrstats interval is 900 seconds cd /home/adcp/uhdas_tmp; run_update_hbins.py; run_hbinhcorrstats.py --hcorr_inst posmv --plotdh --printstats 2020-02-26 13:46:03,883 INFO repeater task posmv_plotqc initial time_to_run is 2020/02/26 14:01:03 2020-02-26 13:46:03,883 INFO repeater PeriodicSystem: posmv_plotqc interval is 900 seconds cd /home/adcp/uhdas_tmp; run_plotposmv.py -n25 -d posmv 2020-02-26 13:46:03,883 INFO DAS_while_logging staging cruise report cd /home/adcp/uhdas_tmp; uhdas_report_generator.py --hacc_cutoff 0.028 -u /home/data/NF2020_ORT 2020-02-26 13:46:03,883 INFO repeater task report_generator initial time_to_run is 2020/02/26 14:46:03 2020-02-26 13:46:03,883 INFO repeater PeriodicSystem: report_generator interval is 3600 seconds cd /home/adcp/uhdas_tmp; uhdas_report_generator.py --hacc_cutoff 0.028 -u /home/data/NF2020_ORT 2020-02-26 13:46:03,883 INFO DAS_while_logging cleanup_figs no_figure 2020-02-26 13:46:03,885 INFO repeater writing repeaterlist to /home/adcp/uhdas_tmp/repeaters.txt 2020-02-26 13:51:09,497 INFO repeater task os150bb_lastensq starting 0.7 seconds late 2020-02-26 13:51:11,387 INFO repeater task os150bb_lastensq ended after 1.9 seconds 2020-02-26 13:51:11,390 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 13:51:04 2020-02-26 13:51:11,390 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 13:56:09 2020-02-26 13:51:11,390 INFO repeater task os150bb_quick starting 2.6 seconds late 2020-02-26 13:51:11,872 INFO repeater task os150bb_quick ended after 0.5 seconds 2020-02-26 13:51:11,873 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 13:51:04 2020-02-26 13:51:11,873 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 13:56:09 2020-02-26 13:51:11,873 INFO repeater task os150bb_lastvec starting 3.1 seconds late 2020-02-26 13:51:12,148 INFO repeater task os150bb_lastvec ended after 0.3 seconds 2020-02-26 13:51:12,149 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 13:51:04 2020-02-26 13:51:12,149 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 13:56:09 2020-02-26 13:51:12,149 INFO repeater task os150bb_3dayplots starting 3.4 seconds late 2020-02-26 13:51:12,711 INFO repeater task os150bb_3dayplots ended after 0.6 seconds 2020-02-26 13:51:12,711 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 13:56:08 2020-02-26 13:56:13,298 INFO repeater task os150bb_lastensq starting 4.3 seconds late 2020-02-26 13:56:14,891 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 13:56:14,891 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 13:56:04 2020-02-26 13:56:14,891 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:01:09 2020-02-26 13:56:14,892 INFO repeater task os150bb_quick starting 5.9 seconds late 2020-02-26 13:56:16,543 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 13:56:16,543 INFO repeater task os150bb_quick ended after 1.7 seconds 2020-02-26 13:56:16,544 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 13:56:04 2020-02-26 13:56:16,544 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:01:09 2020-02-26 13:56:16,544 INFO repeater task os150bb_lastvec starting 7.5 seconds late 2020-02-26 13:56:16,935 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 13:56:16,935 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 13:56:04 2020-02-26 13:56:16,935 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:01:09 2020-02-26 13:56:16,935 INFO repeater task os150bb_3dayplots starting 8.1 seconds late 2020-02-26 13:56:18,489 INFO repeater task os150bb_3dayplots output: could not parse 056_os150bb_panelN.png could not parse 056_os150bb_panelN.png 2020-02-26 13:56:18,490 INFO repeater task os150bb_3dayplots ended after 1.6 seconds 2020-02-26 13:56:18,490 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:01:08 2020-02-26 14:01:04,062 INFO repeater task os150bb_tsstats starting 0.3 seconds late 2020-02-26 14:01:04,638 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 14:01:04,638 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 14:16:03 2020-02-26 14:01:04,638 INFO repeater task os150bb_10pings starting 0.8 seconds late 2020-02-26 14:01:04,763 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 14:01:04,764 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 14:16:03 2020-02-26 14:01:04,764 INFO repeater task os150bb_beamplots starting 1.0 seconds late 2020-02-26 14:01:05,643 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 14:01:05,643 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 14:16:03 2020-02-26 14:01:05,643 INFO repeater task os150bb_beamplots starting 1.9 seconds late 2020-02-26 14:01:06,491 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2020-02-26 14:01:06,491 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 14:16:03 2020-02-26 14:01:06,491 INFO repeater task posmv_hcorrstats starting 2.6 seconds late 2020-02-26 14:01:07,150 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 14:01:07,150 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 14:16:03 2020-02-26 14:01:07,151 INFO repeater task posmv_plotqc starting 3.3 seconds late 2020-02-26 14:01:07,806 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 14:01:07,806 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 14:16:03 2020-02-26 14:01:12,812 INFO repeater task os150bb_lastensq starting 3.8 seconds late 2020-02-26 14:01:14,443 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:01:14,443 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:01:04 2020-02-26 14:01:14,443 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:06:09 2020-02-26 14:01:14,444 INFO repeater task os150bb_quick starting 5.4 seconds late 2020-02-26 14:01:15,879 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:01:15,879 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:01:15,879 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:01:04 2020-02-26 14:01:15,880 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:06:09 2020-02-26 14:01:15,880 INFO repeater task os150bb_lastvec starting 6.9 seconds late 2020-02-26 14:01:16,289 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:01:16,290 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:01:04 2020-02-26 14:01:16,290 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:06:09 2020-02-26 14:01:16,290 INFO repeater task os150bb_3dayplots starting 7.5 seconds late 2020-02-26 14:01:18,610 INFO repeater task os150bb_3dayplots ended after 2.3 seconds 2020-02-26 14:01:18,610 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:06:08 2020-02-26 14:06:09,177 INFO repeater task os150bb_lastensq starting 0.2 seconds late 2020-02-26 14:06:10,980 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2020-02-26 14:06:10,980 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:06:04 2020-02-26 14:06:10,980 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:11:09 2020-02-26 14:06:10,981 INFO repeater task os150bb_quick starting 2.0 seconds late 2020-02-26 14:06:12,368 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:06:12,368 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:06:12,369 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:06:04 2020-02-26 14:06:12,369 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:11:09 2020-02-26 14:06:12,369 INFO repeater task os150bb_lastvec starting 3.4 seconds late 2020-02-26 14:06:12,774 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:06:12,774 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:06:04 2020-02-26 14:06:12,774 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:11:09 2020-02-26 14:06:12,775 INFO repeater task os150bb_3dayplots starting 4.0 seconds late 2020-02-26 14:06:15,019 INFO repeater task os150bb_3dayplots ended after 2.2 seconds 2020-02-26 14:06:15,020 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:11:08 2020-02-26 14:11:10,588 INFO repeater task os150bb_lastensq starting 1.6 seconds late 2020-02-26 14:11:12,251 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2020-02-26 14:11:12,252 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:11:04 2020-02-26 14:11:12,252 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:16:09 2020-02-26 14:11:12,252 INFO repeater task os150bb_quick starting 3.3 seconds late 2020-02-26 14:11:13,664 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:11:13,664 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:11:13,664 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:11:04 2020-02-26 14:11:13,664 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:16:09 2020-02-26 14:11:13,665 INFO repeater task os150bb_lastvec starting 4.7 seconds late 2020-02-26 14:11:13,962 INFO repeater task os150bb_lastvec output: cannot make last_few_vec plot Traceback (most recent call last): File "/usr/local/currents/bin/run_lastfew_vec.py", line 106, in data = LFV.get_data() File "/usr/local/lib/python3.6/dist-packages/pycurrents/adcp/plot_lastfew_vec.py", line 114, in get_data platstr = navcalc.pretty_llstr(self.data.lat[-1],'lat') File "/usr/local/lib/python3.6/dist-packages/pycurrents/data/navcalc.py", line 366, in pretty_llstr 'lon': {-1:'W', 1:'E'}}[ptype][np.sign(wrapped)] TypeError: unhashable type: 'MaskedConstant' 2020-02-26 14:11:13,962 INFO repeater task os150bb_lastvec ended after 0.3 seconds 2020-02-26 14:11:13,962 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:11:04 2020-02-26 14:11:13,962 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:16:09 2020-02-26 14:11:13,962 INFO repeater task os150bb_3dayplots starting 5.2 seconds late 2020-02-26 14:11:16,765 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 14:11:16,765 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:16:08 2020-02-26 14:16:07,315 INFO repeater task os150bb_tsstats starting 3.5 seconds late 2020-02-26 14:16:07,905 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 14:16:07,905 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 14:31:03 2020-02-26 14:16:07,906 INFO repeater task os150bb_10pings starting 4.1 seconds late 2020-02-26 14:16:08,023 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 14:16:08,024 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 14:31:03 2020-02-26 14:16:08,024 INFO repeater task os150bb_beamplots starting 4.2 seconds late 2020-02-26 14:16:08,882 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 14:16:08,882 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 14:31:03 2020-02-26 14:16:08,882 INFO repeater task os150bb_beamplots starting 5.1 seconds late 2020-02-26 14:16:09,759 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 14:16:09,759 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 14:31:03 2020-02-26 14:16:09,759 INFO repeater task posmv_hcorrstats starting 5.9 seconds late 2020-02-26 14:16:10,434 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 14:16:10,434 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 14:31:03 2020-02-26 14:16:10,434 INFO repeater task posmv_plotqc starting 6.6 seconds late 2020-02-26 14:16:11,088 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 14:16:11,088 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 14:31:03 2020-02-26 14:16:16,095 INFO repeater task os150bb_lastensq starting 7.1 seconds late 2020-02-26 14:16:17,699 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:16:17,699 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:16:04 2020-02-26 14:16:17,699 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:21:09 2020-02-26 14:16:17,699 INFO repeater task os150bb_quick starting 8.7 seconds late 2020-02-26 14:16:19,185 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:16:19,186 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 14:16:19,186 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:16:04 2020-02-26 14:16:19,186 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:21:09 2020-02-26 14:16:19,186 INFO repeater task os150bb_lastvec starting 10.2 seconds late 2020-02-26 14:16:19,565 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:16:19,566 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:16:04 2020-02-26 14:16:19,566 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:21:09 2020-02-26 14:16:19,566 INFO repeater task os150bb_3dayplots starting 10.8 seconds late 2020-02-26 14:16:22,327 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 14:16:22,327 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:21:08 2020-02-26 14:21:12,857 INFO repeater task os150bb_lastensq starting 3.9 seconds late 2020-02-26 14:21:14,485 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:21:14,486 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:21:04 2020-02-26 14:21:14,486 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:26:09 2020-02-26 14:21:14,486 INFO repeater task os150bb_quick starting 5.5 seconds late 2020-02-26 14:21:15,972 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:21:15,972 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 14:21:15,972 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:21:04 2020-02-26 14:21:15,972 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:26:09 2020-02-26 14:21:15,973 INFO repeater task os150bb_lastvec starting 7.0 seconds late 2020-02-26 14:21:16,351 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:21:16,351 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:21:04 2020-02-26 14:21:16,351 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:26:09 2020-02-26 14:21:16,351 INFO repeater task os150bb_3dayplots starting 7.6 seconds late 2020-02-26 14:21:19,106 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 14:21:19,106 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:26:08 2020-02-26 14:26:09,667 INFO repeater task os150bb_lastensq starting 0.7 seconds late 2020-02-26 14:26:11,301 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:26:11,302 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:26:04 2020-02-26 14:26:11,302 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:31:09 2020-02-26 14:26:11,302 INFO repeater task os150bb_quick starting 2.3 seconds late 2020-02-26 14:26:12,725 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:26:12,725 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:26:12,725 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:26:04 2020-02-26 14:26:12,725 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:31:09 2020-02-26 14:26:12,726 INFO repeater task os150bb_lastvec starting 3.7 seconds late 2020-02-26 14:26:13,111 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:26:13,111 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:26:04 2020-02-26 14:26:13,111 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:31:09 2020-02-26 14:26:13,111 INFO repeater task os150bb_3dayplots starting 4.3 seconds late 2020-02-26 14:26:15,807 INFO repeater task os150bb_3dayplots ended after 2.7 seconds 2020-02-26 14:26:15,808 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:31:08 2020-02-26 14:31:06,354 INFO repeater task os150bb_tsstats starting 2.6 seconds late 2020-02-26 14:31:06,909 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 14:31:06,909 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 14:46:03 2020-02-26 14:31:06,910 INFO repeater task os150bb_10pings starting 3.1 seconds late 2020-02-26 14:31:07,028 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 14:31:07,028 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 14:46:03 2020-02-26 14:31:07,029 INFO repeater task os150bb_beamplots starting 3.2 seconds late 2020-02-26 14:31:07,884 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 14:31:07,884 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 14:46:03 2020-02-26 14:31:07,885 INFO repeater task os150bb_beamplots starting 4.1 seconds late 2020-02-26 14:31:08,785 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 14:31:08,785 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 14:46:03 2020-02-26 14:31:08,785 INFO repeater task posmv_hcorrstats starting 4.9 seconds late 2020-02-26 14:31:09,454 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 14:31:09,454 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 14:46:03 2020-02-26 14:31:09,455 INFO repeater task posmv_plotqc starting 5.6 seconds late 2020-02-26 14:31:10,115 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 14:31:10,115 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 14:46:03 2020-02-26 14:31:15,121 INFO repeater task os150bb_lastensq starting 6.1 seconds late 2020-02-26 14:31:16,789 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2020-02-26 14:31:16,789 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:31:04 2020-02-26 14:31:16,789 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:36:09 2020-02-26 14:31:16,789 INFO repeater task os150bb_quick starting 7.8 seconds late 2020-02-26 14:31:18,260 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:31:18,260 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 14:31:18,260 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:31:04 2020-02-26 14:31:18,260 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:36:09 2020-02-26 14:31:18,260 INFO repeater task os150bb_lastvec starting 9.3 seconds late 2020-02-26 14:31:18,640 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:31:18,641 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:31:04 2020-02-26 14:31:18,641 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:36:09 2020-02-26 14:31:18,641 INFO repeater task os150bb_3dayplots starting 9.9 seconds late 2020-02-26 14:31:21,397 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 14:31:21,397 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:36:08 2020-02-26 14:36:11,887 INFO repeater task os150bb_lastensq starting 2.9 seconds late 2020-02-26 14:36:13,545 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2020-02-26 14:36:13,545 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:36:04 2020-02-26 14:36:13,545 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:41:09 2020-02-26 14:36:13,546 INFO repeater task os150bb_quick starting 4.5 seconds late 2020-02-26 14:36:14,985 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:36:14,986 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:36:14,986 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:36:04 2020-02-26 14:36:14,986 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:41:09 2020-02-26 14:36:14,986 INFO repeater task os150bb_lastvec starting 6.0 seconds late 2020-02-26 14:36:15,369 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:36:15,369 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:36:04 2020-02-26 14:36:15,369 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:41:09 2020-02-26 14:36:15,369 INFO repeater task os150bb_3dayplots starting 6.6 seconds late 2020-02-26 14:36:18,106 INFO repeater task os150bb_3dayplots ended after 2.7 seconds 2020-02-26 14:36:18,106 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:41:08 2020-02-26 14:41:13,714 INFO repeater task os150bb_lastensq starting 4.7 seconds late 2020-02-26 14:41:15,290 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:41:15,291 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:41:04 2020-02-26 14:41:15,291 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:46:09 2020-02-26 14:41:15,291 INFO repeater task os150bb_quick starting 6.3 seconds late 2020-02-26 14:41:16,771 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:41:16,771 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 14:41:16,771 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:41:04 2020-02-26 14:41:16,771 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:46:09 2020-02-26 14:41:16,771 INFO repeater task os150bb_lastvec starting 7.8 seconds late 2020-02-26 14:41:17,153 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:41:17,153 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:41:04 2020-02-26 14:41:17,153 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:46:09 2020-02-26 14:41:17,154 INFO repeater task os150bb_3dayplots starting 8.4 seconds late 2020-02-26 14:41:19,891 INFO repeater task os150bb_3dayplots ended after 2.7 seconds 2020-02-26 14:41:19,892 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:46:08 2020-02-26 14:46:05,450 INFO repeater task os150bb_tsstats starting 1.7 seconds late 2020-02-26 14:46:06,005 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 14:46:06,005 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 15:01:03 2020-02-26 14:46:06,005 INFO repeater task os150bb_10pings starting 2.2 seconds late 2020-02-26 14:46:06,132 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 14:46:06,132 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 15:01:03 2020-02-26 14:46:06,133 INFO repeater task os150bb_beamplots starting 2.3 seconds late 2020-02-26 14:46:07,022 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 14:46:07,023 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:01:03 2020-02-26 14:46:07,023 INFO repeater task os150bb_beamplots starting 3.2 seconds late 2020-02-26 14:46:07,883 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 14:46:07,883 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:01:03 2020-02-26 14:46:07,884 INFO repeater task posmv_hcorrstats starting 4.0 seconds late 2020-02-26 14:46:08,620 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 14:46:08,620 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 15:01:03 2020-02-26 14:46:08,620 INFO repeater task posmv_plotqc starting 4.7 seconds late 2020-02-26 14:46:09,303 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 14:46:09,303 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 15:01:03 2020-02-26 14:46:09,304 INFO repeater task report_generator starting 5.4 seconds late 2020-02-26 14:46:12,845 INFO repeater task report_generator output: cruisename is report_dir is uhdas_dir is 0.0 sec : initial png rsync 1.0 sec : navplot: plot_rnav.py -s300 --noshow --title NF2020_ORT --outfile /home/data/NF2020_ORT/reports/nav_plot_all /home/data/NF2020_ORT/rbin/gpsnav/*.gps.rbin 0.0 sec : sonar_usage: plot_db_timeranges.py --outfile /home/data/NF2020_ORT/reports/sonar_usage --noshow /home/data/NF2020_ORT 0.0 sec : sonar_usage: convert -resize 200 /home/data/NF2020_ORT/reports/nav_plot_all_topo.png /home/data/NF2020_ORT/reports/nav_plot_all_topoT.png 0.0 sec : sonar_usage: convert -resize 200 /home/data/NF2020_ORT/reports/nav_plot_all_txy.png /home/data/NF2020_ORT/reports/nav_plot_all_txyT.png 0.0 sec : sonar_usage: convert -resize 200 /home/data/NF2020_ORT/reports/sonar_usage.png /home/data/NF2020_ORT/reports/sonar_usageT.png 0.0 sec : png_archive: rsync -a /home/data/NF2020_ORT/proc/os150bb/png_archive/ /home/data/NF2020_ORT/reports/os150bb_pngarchive 0.0 sec : uhdas_overview: uhdas_info.py --overview --logfile /home/data/NF2020_ORT/reports/uhdas_overview.txt /home/data/NF2020_ORT 0.0 sec : sonar_summary: sonar_summary.py --outfile /home/data/NF2020_ORT/reports/sonar_summary.txt --uhdas_dir /home/data/NF2020_ORT 0.0 sec : adcp_settings: uhdas_info.py --settings --logfile /home/data/NF2020_ORT/reports/ADCP_settings.txt /home/data/NF2020_ORT 0.0 sec : adcp_cals: uhdas_info.py --cals --logfile /home/data/NF2020_ORT/reports/ADCP_cals.txt /home/data/NF2020_ORT 1.0 sec : ens_hcorr: plot_enshcorr.py --infile /home/data/NF2020_ORT/proc/os150bb/cal/rotate/ens_hcorr.asc --outfile /home/data/NF2020_ORT/reports/os150bb_hcorr --yearbase 2020 --titlestring ens_hcorr_pmv 0.0 sec : ens_hcorr: convert -resize 200 /home/data/NF2020_ORT/reports/os150bb_hcorr.png /home/data/NF2020_ORT/reports/os150bb_hcorrT.png 1.0 sec : hcorr_serial_plot: plot_posmv.py --cutoff 0.028 -s 60 -o /home/data/NF2020_ORT/reports/posmv_quality --noshow /home/data/NF2020_ORT 0.0 sec : pycfg: cp -p /home/data/NF2020_ORT/raw/config/NF2020_ORT_proc.py /home/data/NF2020_ORT/reports/NF2020_ORT_proc.py.txt 0.0 sec : pycfg: cp -p /home/data/NF2020_ORT/raw/config/NF2020_ORT_sensor.py /home/data/NF2020_ORT/reports/NF2020_ORT_sensor.py.txt 3.0 seconds elapsed html page starts here: /home/data/NF2020_ORT/reports/index.html 2020-02-26 14:46:12,845 INFO repeater task report_generator ended after 3.5 seconds 2020-02-26 14:46:12,845 INFO repeater task report_generator next time_to_run is 2020/02/26 15:46:03 2020-02-26 14:46:17,851 INFO repeater task os150bb_lastensq starting 8.9 seconds late 2020-02-26 14:46:19,448 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:46:19,449 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:46:04 2020-02-26 14:46:19,449 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:51:09 2020-02-26 14:46:19,449 INFO repeater task os150bb_quick starting 10.4 seconds late 2020-02-26 14:46:20,890 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:46:20,890 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:46:20,890 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:46:04 2020-02-26 14:46:20,891 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:51:09 2020-02-26 14:46:20,891 INFO repeater task os150bb_lastvec starting 11.9 seconds late 2020-02-26 14:46:21,278 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:46:21,278 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:46:04 2020-02-26 14:46:21,279 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:51:09 2020-02-26 14:46:21,279 INFO repeater task os150bb_3dayplots starting 12.5 seconds late 2020-02-26 14:46:24,131 INFO repeater task os150bb_3dayplots ended after 2.9 seconds 2020-02-26 14:46:24,131 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:51:08 2020-02-26 14:51:09,716 INFO repeater task os150bb_lastensq starting 0.7 seconds late 2020-02-26 14:51:11,344 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:51:11,345 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:51:04 2020-02-26 14:51:11,345 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 14:56:09 2020-02-26 14:51:11,345 INFO repeater task os150bb_quick starting 2.3 seconds late 2020-02-26 14:51:12,781 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:51:12,781 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:51:12,781 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:51:04 2020-02-26 14:51:12,781 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 14:56:09 2020-02-26 14:51:12,782 INFO repeater task os150bb_lastvec starting 3.8 seconds late 2020-02-26 14:51:13,227 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:51:13,227 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:51:04 2020-02-26 14:51:13,227 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 14:56:09 2020-02-26 14:51:13,227 INFO repeater task os150bb_3dayplots starting 4.4 seconds late 2020-02-26 14:51:16,041 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 14:51:16,041 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 14:56:08 2020-02-26 14:56:11,646 INFO repeater task os150bb_lastensq starting 2.6 seconds late 2020-02-26 14:56:13,275 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 14:56:13,276 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:56:04 2020-02-26 14:56:13,276 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:01:09 2020-02-26 14:56:13,276 INFO repeater task os150bb_quick starting 4.3 seconds late 2020-02-26 14:56:14,709 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 14:56:14,709 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 14:56:14,709 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:56:04 2020-02-26 14:56:14,709 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:01:09 2020-02-26 14:56:14,710 INFO repeater task os150bb_lastvec starting 5.7 seconds late 2020-02-26 14:56:15,094 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 14:56:15,095 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 14:56:04 2020-02-26 14:56:15,095 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:01:09 2020-02-26 14:56:15,095 INFO repeater task os150bb_3dayplots starting 6.3 seconds late 2020-02-26 14:56:17,924 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 14:56:17,924 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:01:08 2020-02-26 15:01:08,519 INFO repeater task os150bb_tsstats starting 4.7 seconds late 2020-02-26 15:01:09,077 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 15:01:09,077 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 15:16:03 2020-02-26 15:01:09,078 INFO repeater task os150bb_10pings starting 5.3 seconds late 2020-02-26 15:01:09,205 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 15:01:09,206 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 15:16:03 2020-02-26 15:01:09,206 INFO repeater task os150bb_beamplots starting 5.4 seconds late 2020-02-26 15:01:10,092 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 15:01:10,093 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:16:03 2020-02-26 15:01:10,093 INFO repeater task os150bb_beamplots starting 6.3 seconds late 2020-02-26 15:01:10,955 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 15:01:10,955 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:16:03 2020-02-26 15:01:10,956 INFO repeater task posmv_hcorrstats starting 7.1 seconds late 2020-02-26 15:01:11,668 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 15:01:11,668 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 15:16:03 2020-02-26 15:01:11,668 INFO repeater task posmv_plotqc starting 7.8 seconds late 2020-02-26 15:01:12,337 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 15:01:12,337 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 15:16:03 2020-02-26 15:01:17,344 INFO repeater task os150bb_lastensq starting 8.3 seconds late 2020-02-26 15:01:18,944 INFO repeater task os150bb_lastensq output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/pingavg.py:217: UserWarning: Warning: converting a masked element to nan. Su.N)) /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/pingavg.py:221: UserWarning: Warning: converting a masked element to nan. self._tuv.write(fmt % (dday, usma_mean, vsma_mean)) 2020-02-26 15:01:18,944 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:01:18,944 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:01:04 2020-02-26 15:01:18,945 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:06:09 2020-02-26 15:01:18,945 INFO repeater task os150bb_quick starting 9.9 seconds late 2020-02-26 15:01:20,382 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:01:20,382 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 15:01:20,382 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:01:04 2020-02-26 15:01:20,382 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:06:09 2020-02-26 15:01:20,383 INFO repeater task os150bb_lastvec starting 11.4 seconds late 2020-02-26 15:01:20,672 INFO repeater task os150bb_lastvec output: cannot make last_few_vec plot Traceback (most recent call last): File "/usr/local/currents/bin/run_lastfew_vec.py", line 106, in data = LFV.get_data() File "/usr/local/lib/python3.6/dist-packages/pycurrents/adcp/plot_lastfew_vec.py", line 114, in get_data platstr = navcalc.pretty_llstr(self.data.lat[-1],'lat') File "/usr/local/lib/python3.6/dist-packages/pycurrents/data/navcalc.py", line 366, in pretty_llstr 'lon': {-1:'W', 1:'E'}}[ptype][np.sign(wrapped)] TypeError: unhashable type: 'MaskedConstant' 2020-02-26 15:01:20,672 INFO repeater task os150bb_lastvec ended after 0.3 seconds 2020-02-26 15:01:20,672 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:01:04 2020-02-26 15:01:20,672 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:06:09 2020-02-26 15:01:20,673 INFO repeater task os150bb_3dayplots starting 11.9 seconds late 2020-02-26 15:01:23,478 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:01:23,478 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:06:08 2020-02-26 15:06:09,037 INFO repeater task os150bb_lastensq starting 0.0 seconds late 2020-02-26 15:06:10,645 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:06:10,645 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:06:04 2020-02-26 15:06:10,645 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:11:09 2020-02-26 15:06:10,646 INFO repeater task os150bb_quick starting 1.6 seconds late 2020-02-26 15:06:12,063 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:06:12,064 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 15:06:12,064 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:06:04 2020-02-26 15:06:12,064 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:11:09 2020-02-26 15:06:12,064 INFO repeater task os150bb_lastvec starting 3.1 seconds late 2020-02-26 15:06:12,452 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:06:12,453 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:06:04 2020-02-26 15:06:12,453 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:11:09 2020-02-26 15:06:12,453 INFO repeater task os150bb_3dayplots starting 3.7 seconds late 2020-02-26 15:06:15,253 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:06:15,254 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:11:08 2020-02-26 15:11:10,839 INFO repeater task os150bb_lastensq starting 1.8 seconds late 2020-02-26 15:11:12,469 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:11:12,469 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:11:04 2020-02-26 15:11:12,469 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:16:09 2020-02-26 15:11:12,469 INFO repeater task os150bb_quick starting 3.5 seconds late 2020-02-26 15:11:13,891 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:11:13,892 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 15:11:13,892 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:11:04 2020-02-26 15:11:13,892 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:16:09 2020-02-26 15:11:13,892 INFO repeater task os150bb_lastvec starting 4.9 seconds late 2020-02-26 15:11:14,329 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:11:14,329 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:11:04 2020-02-26 15:11:14,329 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:16:09 2020-02-26 15:11:14,329 INFO repeater task os150bb_3dayplots starting 5.5 seconds late 2020-02-26 15:11:17,144 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:11:17,145 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:16:08 2020-02-26 15:16:07,715 INFO repeater task os150bb_tsstats starting 3.9 seconds late 2020-02-26 15:16:08,266 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 15:16:08,267 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 15:31:03 2020-02-26 15:16:08,267 INFO repeater task os150bb_10pings starting 4.5 seconds late 2020-02-26 15:16:08,387 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 15:16:08,387 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 15:31:03 2020-02-26 15:16:08,387 INFO repeater task os150bb_beamplots starting 4.6 seconds late 2020-02-26 15:16:09,351 INFO repeater task os150bb_beamplots ended after 1.0 seconds 2020-02-26 15:16:09,351 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:31:03 2020-02-26 15:16:09,351 INFO repeater task os150bb_beamplots starting 5.6 seconds late 2020-02-26 15:16:10,239 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 15:16:10,239 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:31:03 2020-02-26 15:16:10,240 INFO repeater task posmv_hcorrstats starting 6.4 seconds late 2020-02-26 15:16:10,934 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 15:16:10,934 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 15:31:03 2020-02-26 15:16:10,934 INFO repeater task posmv_plotqc starting 7.1 seconds late 2020-02-26 15:16:11,674 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 15:16:11,674 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 15:31:03 2020-02-26 15:16:16,680 INFO repeater task os150bb_lastensq starting 7.7 seconds late 2020-02-26 15:16:18,310 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:16:18,310 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:16:04 2020-02-26 15:16:18,310 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:21:09 2020-02-26 15:16:18,311 INFO repeater task os150bb_quick starting 9.3 seconds late 2020-02-26 15:16:19,742 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:16:19,742 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 15:16:19,742 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:16:04 2020-02-26 15:16:19,742 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:21:09 2020-02-26 15:16:19,743 INFO repeater task os150bb_lastvec starting 10.7 seconds late 2020-02-26 15:16:20,154 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:16:20,154 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:16:04 2020-02-26 15:16:20,154 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:21:09 2020-02-26 15:16:20,155 INFO repeater task os150bb_3dayplots starting 11.4 seconds late 2020-02-26 15:16:22,956 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:16:22,957 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:21:08 2020-02-26 15:21:13,597 INFO repeater task os150bb_lastensq starting 4.6 seconds late 2020-02-26 15:21:15,199 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:21:15,199 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:21:04 2020-02-26 15:21:15,199 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:26:09 2020-02-26 15:21:15,200 INFO repeater task os150bb_quick starting 6.2 seconds late 2020-02-26 15:21:16,628 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:21:16,628 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 15:21:16,629 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:21:04 2020-02-26 15:21:16,629 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:26:09 2020-02-26 15:21:16,629 INFO repeater task os150bb_lastvec starting 7.6 seconds late 2020-02-26 15:21:17,039 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:21:17,040 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:21:04 2020-02-26 15:21:17,040 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:26:09 2020-02-26 15:21:17,040 INFO repeater task os150bb_3dayplots starting 8.3 seconds late 2020-02-26 15:21:19,867 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:21:19,867 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:26:08 2020-02-26 15:26:10,433 INFO repeater task os150bb_lastensq starting 1.4 seconds late 2020-02-26 15:26:12,070 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:26:12,071 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:26:04 2020-02-26 15:26:12,071 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:31:09 2020-02-26 15:26:12,071 INFO repeater task os150bb_quick starting 3.1 seconds late 2020-02-26 15:26:13,559 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:26:13,559 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 15:26:13,559 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:26:04 2020-02-26 15:26:13,559 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:31:09 2020-02-26 15:26:13,559 INFO repeater task os150bb_lastvec starting 4.6 seconds late 2020-02-26 15:26:13,946 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:26:13,947 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:26:04 2020-02-26 15:26:13,947 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:31:09 2020-02-26 15:26:13,947 INFO repeater task os150bb_3dayplots starting 5.2 seconds late 2020-02-26 15:26:16,736 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:26:16,736 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:31:08 2020-02-26 15:31:07,332 INFO repeater task os150bb_tsstats starting 3.5 seconds late 2020-02-26 15:31:07,941 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 15:31:07,942 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 15:46:03 2020-02-26 15:31:07,942 INFO repeater task os150bb_10pings starting 4.2 seconds late 2020-02-26 15:31:08,064 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 15:31:08,064 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 15:46:03 2020-02-26 15:31:08,065 INFO repeater task os150bb_beamplots starting 4.3 seconds late 2020-02-26 15:31:08,937 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 15:31:08,937 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:46:03 2020-02-26 15:31:08,937 INFO repeater task os150bb_beamplots starting 5.1 seconds late 2020-02-26 15:31:09,834 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 15:31:09,834 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 15:46:03 2020-02-26 15:31:09,835 INFO repeater task posmv_hcorrstats starting 6.0 seconds late 2020-02-26 15:31:10,546 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 15:31:10,546 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 15:46:03 2020-02-26 15:31:10,546 INFO repeater task posmv_plotqc starting 6.7 seconds late 2020-02-26 15:31:11,261 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 15:31:11,264 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 15:46:03 2020-02-26 15:31:16,270 INFO repeater task os150bb_lastensq starting 7.3 seconds late 2020-02-26 15:31:17,846 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:31:17,847 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:31:04 2020-02-26 15:31:17,847 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:36:09 2020-02-26 15:31:17,847 INFO repeater task os150bb_quick starting 8.8 seconds late 2020-02-26 15:31:19,305 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:31:19,306 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 15:31:19,306 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:31:04 2020-02-26 15:31:19,306 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:36:09 2020-02-26 15:31:19,306 INFO repeater task os150bb_lastvec starting 10.3 seconds late 2020-02-26 15:31:19,695 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:31:19,695 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:31:04 2020-02-26 15:31:19,695 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:36:09 2020-02-26 15:31:19,696 INFO repeater task os150bb_3dayplots starting 10.9 seconds late 2020-02-26 15:31:22,562 INFO repeater task os150bb_3dayplots ended after 2.9 seconds 2020-02-26 15:31:22,562 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:36:08 2020-02-26 15:36:13,154 INFO repeater task os150bb_lastensq starting 4.2 seconds late 2020-02-26 15:36:14,743 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:36:14,743 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:36:04 2020-02-26 15:36:14,743 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:41:09 2020-02-26 15:36:14,744 INFO repeater task os150bb_quick starting 5.7 seconds late 2020-02-26 15:36:16,207 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:36:16,207 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 15:36:16,208 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:36:04 2020-02-26 15:36:16,208 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:41:09 2020-02-26 15:36:16,208 INFO repeater task os150bb_lastvec starting 7.2 seconds late 2020-02-26 15:36:16,593 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:36:16,593 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:36:04 2020-02-26 15:36:16,593 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:41:09 2020-02-26 15:36:16,593 INFO repeater task os150bb_3dayplots starting 7.8 seconds late 2020-02-26 15:36:19,427 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:36:19,427 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:41:08 2020-02-26 15:41:10,013 INFO repeater task os150bb_lastensq starting 1.0 seconds late 2020-02-26 15:41:11,581 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:41:11,582 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:41:04 2020-02-26 15:41:11,582 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:46:09 2020-02-26 15:41:11,582 INFO repeater task os150bb_quick starting 2.6 seconds late 2020-02-26 15:41:13,064 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:41:13,064 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 15:41:13,065 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:41:04 2020-02-26 15:41:13,065 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:46:09 2020-02-26 15:41:13,065 INFO repeater task os150bb_lastvec starting 4.1 seconds late 2020-02-26 15:41:13,465 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:41:13,465 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:41:04 2020-02-26 15:41:13,465 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:46:09 2020-02-26 15:41:13,466 INFO repeater task os150bb_3dayplots starting 4.7 seconds late 2020-02-26 15:41:16,318 INFO repeater task os150bb_3dayplots ended after 2.9 seconds 2020-02-26 15:41:16,318 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:46:08 2020-02-26 15:46:06,846 INFO repeater task os150bb_tsstats starting 3.1 seconds late 2020-02-26 15:46:07,405 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 15:46:07,406 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 16:01:03 2020-02-26 15:46:07,406 INFO repeater task os150bb_10pings starting 3.6 seconds late 2020-02-26 15:46:07,525 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 15:46:07,525 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 16:01:03 2020-02-26 15:46:07,525 INFO repeater task os150bb_beamplots starting 3.7 seconds late 2020-02-26 15:46:08,403 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 15:46:08,403 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:01:03 2020-02-26 15:46:08,403 INFO repeater task os150bb_beamplots starting 4.6 seconds late 2020-02-26 15:46:09,275 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 15:46:09,275 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:01:03 2020-02-26 15:46:09,275 INFO repeater task posmv_hcorrstats starting 5.4 seconds late 2020-02-26 15:46:09,983 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 15:46:09,983 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 16:01:03 2020-02-26 15:46:09,983 INFO repeater task posmv_plotqc starting 6.1 seconds late 2020-02-26 15:46:10,706 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 15:46:10,706 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 16:01:03 2020-02-26 15:46:10,706 INFO repeater task report_generator starting 6.8 seconds late 2020-02-26 15:46:14,176 INFO repeater task report_generator output: cruisename is report_dir is uhdas_dir is 0.0 sec : initial png rsync 1.0 sec : navplot: plot_rnav.py -s300 --noshow --title NF2020_ORT --outfile /home/data/NF2020_ORT/reports/nav_plot_all /home/data/NF2020_ORT/rbin/gpsnav/*.gps.rbin 0.0 sec : sonar_usage: plot_db_timeranges.py --outfile /home/data/NF2020_ORT/reports/sonar_usage --noshow /home/data/NF2020_ORT 0.0 sec : sonar_usage: convert -resize 200 /home/data/NF2020_ORT/reports/nav_plot_all_topo.png /home/data/NF2020_ORT/reports/nav_plot_all_topoT.png 0.0 sec : sonar_usage: convert -resize 200 /home/data/NF2020_ORT/reports/nav_plot_all_txy.png /home/data/NF2020_ORT/reports/nav_plot_all_txyT.png 0.0 sec : sonar_usage: convert -resize 200 /home/data/NF2020_ORT/reports/sonar_usage.png /home/data/NF2020_ORT/reports/sonar_usageT.png 0.0 sec : png_archive: rsync -a /home/data/NF2020_ORT/proc/os150bb/png_archive/ /home/data/NF2020_ORT/reports/os150bb_pngarchive 0.0 sec : uhdas_overview: uhdas_info.py --overview --logfile /home/data/NF2020_ORT/reports/uhdas_overview.txt /home/data/NF2020_ORT 0.0 sec : sonar_summary: sonar_summary.py --outfile /home/data/NF2020_ORT/reports/sonar_summary.txt --uhdas_dir /home/data/NF2020_ORT 0.0 sec : adcp_settings: uhdas_info.py --settings --logfile /home/data/NF2020_ORT/reports/ADCP_settings.txt /home/data/NF2020_ORT 0.0 sec : adcp_cals: uhdas_info.py --cals --logfile /home/data/NF2020_ORT/reports/ADCP_cals.txt /home/data/NF2020_ORT 1.0 sec : ens_hcorr: plot_enshcorr.py --infile /home/data/NF2020_ORT/proc/os150bb/cal/rotate/ens_hcorr.asc --outfile /home/data/NF2020_ORT/reports/os150bb_hcorr --yearbase 2020 --titlestring ens_hcorr_pmv 0.0 sec : ens_hcorr: convert -resize 200 /home/data/NF2020_ORT/reports/os150bb_hcorr.png /home/data/NF2020_ORT/reports/os150bb_hcorrT.png 1.0 sec : hcorr_serial_plot: plot_posmv.py --cutoff 0.028 -s 60 -o /home/data/NF2020_ORT/reports/posmv_quality --noshow /home/data/NF2020_ORT 0.0 sec : pycfg: cp -p /home/data/NF2020_ORT/raw/config/NF2020_ORT_proc.py /home/data/NF2020_ORT/reports/NF2020_ORT_proc.py.txt 0.0 sec : pycfg: cp -p /home/data/NF2020_ORT/raw/config/NF2020_ORT_sensor.py /home/data/NF2020_ORT/reports/NF2020_ORT_sensor.py.txt 3.0 seconds elapsed html page starts here: /home/data/NF2020_ORT/reports/index.html 2020-02-26 15:46:14,176 INFO repeater task report_generator ended after 3.5 seconds 2020-02-26 15:46:14,176 INFO repeater task report_generator next time_to_run is 2020/02/26 16:46:03 2020-02-26 15:46:19,205 INFO repeater task os150bb_lastensq starting 10.2 seconds late 2020-02-26 15:46:20,769 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:46:20,769 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:46:04 2020-02-26 15:46:20,769 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:51:09 2020-02-26 15:46:20,769 INFO repeater task os150bb_quick starting 11.8 seconds late 2020-02-26 15:46:22,237 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:46:22,238 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 15:46:22,238 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:46:04 2020-02-26 15:46:22,238 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:51:09 2020-02-26 15:46:22,238 INFO repeater task os150bb_lastvec starting 13.2 seconds late 2020-02-26 15:46:22,636 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:46:22,636 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:46:04 2020-02-26 15:46:22,636 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:51:09 2020-02-26 15:46:22,637 INFO repeater task os150bb_3dayplots starting 13.8 seconds late 2020-02-26 15:46:25,420 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:46:25,420 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:51:08 2020-02-26 15:51:11,005 INFO repeater task os150bb_lastensq starting 2.0 seconds late 2020-02-26 15:51:12,588 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:51:12,588 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:51:04 2020-02-26 15:51:12,588 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 15:56:09 2020-02-26 15:51:12,589 INFO repeater task os150bb_quick starting 3.6 seconds late 2020-02-26 15:51:14,062 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:51:14,063 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 15:51:14,063 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:51:04 2020-02-26 15:51:14,063 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 15:56:09 2020-02-26 15:51:14,063 INFO repeater task os150bb_lastvec starting 5.1 seconds late 2020-02-26 15:51:14,449 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:51:14,449 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:51:04 2020-02-26 15:51:14,449 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 15:56:09 2020-02-26 15:51:14,450 INFO repeater task os150bb_3dayplots starting 5.7 seconds late 2020-02-26 15:51:17,243 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 15:51:17,248 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 15:56:08 2020-02-26 15:56:12,844 INFO repeater task os150bb_lastensq starting 3.8 seconds late 2020-02-26 15:56:14,429 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 15:56:14,429 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:56:04 2020-02-26 15:56:14,429 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:01:09 2020-02-26 15:56:14,430 INFO repeater task os150bb_quick starting 5.4 seconds late 2020-02-26 15:56:15,875 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 15:56:15,875 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 15:56:15,875 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:56:04 2020-02-26 15:56:15,875 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:01:09 2020-02-26 15:56:15,876 INFO repeater task os150bb_lastvec starting 6.9 seconds late 2020-02-26 15:56:16,263 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 15:56:16,263 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 15:56:04 2020-02-26 15:56:16,263 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:01:09 2020-02-26 15:56:16,264 INFO repeater task os150bb_3dayplots starting 7.5 seconds late 2020-02-26 15:56:19,144 INFO repeater task os150bb_3dayplots ended after 2.9 seconds 2020-02-26 15:56:19,144 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:01:08 2020-02-26 16:01:04,692 INFO repeater task os150bb_tsstats starting 0.9 seconds late 2020-02-26 16:01:05,254 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 16:01:05,254 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 16:16:03 2020-02-26 16:01:05,254 INFO repeater task os150bb_10pings starting 1.5 seconds late 2020-02-26 16:01:05,375 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 16:01:05,375 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 16:16:03 2020-02-26 16:01:05,376 INFO repeater task os150bb_beamplots starting 1.6 seconds late 2020-02-26 16:01:06,261 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 16:01:06,261 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:16:03 2020-02-26 16:01:06,261 INFO repeater task os150bb_beamplots starting 2.5 seconds late 2020-02-26 16:01:07,127 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 16:01:07,127 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:16:03 2020-02-26 16:01:07,127 INFO repeater task posmv_hcorrstats starting 3.2 seconds late 2020-02-26 16:01:07,850 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 16:01:07,850 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 16:16:03 2020-02-26 16:01:07,850 INFO repeater task posmv_plotqc starting 4.0 seconds late 2020-02-26 16:01:08,618 INFO repeater task posmv_plotqc ended after 0.8 seconds 2020-02-26 16:01:08,618 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 16:16:03 2020-02-26 16:01:13,624 INFO repeater task os150bb_lastensq starting 4.6 seconds late 2020-02-26 16:01:15,217 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:01:15,217 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:01:04 2020-02-26 16:01:15,217 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:06:09 2020-02-26 16:01:15,218 INFO repeater task os150bb_quick starting 6.2 seconds late 2020-02-26 16:01:16,635 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:01:16,635 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 16:01:16,635 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:01:04 2020-02-26 16:01:16,635 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:06:09 2020-02-26 16:01:16,636 INFO repeater task os150bb_lastvec starting 7.6 seconds late 2020-02-26 16:01:17,043 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 16:01:17,044 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:01:04 2020-02-26 16:01:17,044 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:06:09 2020-02-26 16:01:17,044 INFO repeater task os150bb_3dayplots starting 8.3 seconds late 2020-02-26 16:01:19,862 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 16:01:19,862 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:06:08 2020-02-26 16:06:10,426 INFO repeater task os150bb_lastensq starting 1.4 seconds late 2020-02-26 16:06:12,013 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:06:12,014 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:06:04 2020-02-26 16:06:12,014 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:11:09 2020-02-26 16:06:12,014 INFO repeater task os150bb_quick starting 3.0 seconds late 2020-02-26 16:06:13,448 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:06:13,448 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 16:06:13,448 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:06:04 2020-02-26 16:06:13,448 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:11:09 2020-02-26 16:06:13,448 INFO repeater task os150bb_lastvec starting 4.4 seconds late 2020-02-26 16:06:13,837 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 16:06:13,837 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:06:04 2020-02-26 16:06:13,838 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:11:09 2020-02-26 16:06:13,838 INFO repeater task os150bb_3dayplots starting 5.0 seconds late 2020-02-26 16:06:16,707 INFO repeater task os150bb_3dayplots ended after 2.9 seconds 2020-02-26 16:06:16,708 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:11:08 2020-02-26 16:11:12,312 INFO repeater task os150bb_lastensq starting 3.3 seconds late 2020-02-26 16:11:13,946 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:11:13,946 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:11:04 2020-02-26 16:11:13,946 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:16:09 2020-02-26 16:11:13,947 INFO repeater task os150bb_quick starting 4.9 seconds late 2020-02-26 16:11:15,394 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:11:15,394 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 16:11:15,394 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:11:04 2020-02-26 16:11:15,395 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:16:09 2020-02-26 16:11:15,395 INFO repeater task os150bb_lastvec starting 6.4 seconds late 2020-02-26 16:11:15,776 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 16:11:15,776 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:11:04 2020-02-26 16:11:15,776 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:16:09 2020-02-26 16:11:15,777 INFO repeater task os150bb_3dayplots starting 7.0 seconds late 2020-02-26 16:11:18,571 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 16:11:18,571 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:16:08 2020-02-26 16:16:04,136 INFO repeater task os150bb_tsstats starting 0.3 seconds late 2020-02-26 16:16:04,690 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 16:16:04,691 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 16:31:03 2020-02-26 16:16:04,691 INFO repeater task os150bb_10pings starting 0.9 seconds late 2020-02-26 16:16:04,825 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 16:16:04,825 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 16:31:03 2020-02-26 16:16:04,825 INFO repeater task os150bb_beamplots starting 1.0 seconds late 2020-02-26 16:16:05,716 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 16:16:05,716 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:31:03 2020-02-26 16:16:05,716 INFO repeater task os150bb_beamplots starting 1.9 seconds late 2020-02-26 16:16:06,584 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 16:16:06,584 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:31:03 2020-02-26 16:16:06,584 INFO repeater task posmv_hcorrstats starting 2.7 seconds late 2020-02-26 16:16:07,327 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 16:16:07,327 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 16:31:03 2020-02-26 16:16:07,327 INFO repeater task posmv_plotqc starting 3.4 seconds late 2020-02-26 16:16:08,051 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 16:16:08,051 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 16:31:03 2020-02-26 16:16:13,057 INFO repeater task os150bb_lastensq starting 4.1 seconds late 2020-02-26 16:16:14,625 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:16:14,625 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:16:04 2020-02-26 16:16:14,625 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:21:09 2020-02-26 16:16:14,626 INFO repeater task os150bb_quick starting 5.6 seconds late 2020-02-26 16:16:16,049 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:16:16,049 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 16:16:16,050 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:16:04 2020-02-26 16:16:16,050 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:21:09 2020-02-26 16:16:16,050 INFO repeater task os150bb_lastvec starting 7.1 seconds late 2020-02-26 16:16:16,337 INFO repeater task os150bb_lastvec output: cannot make last_few_vec plot Traceback (most recent call last): File "/usr/local/currents/bin/run_lastfew_vec.py", line 106, in data = LFV.get_data() File "/usr/local/lib/python3.6/dist-packages/pycurrents/adcp/plot_lastfew_vec.py", line 114, in get_data platstr = navcalc.pretty_llstr(self.data.lat[-1],'lat') File "/usr/local/lib/python3.6/dist-packages/pycurrents/data/navcalc.py", line 366, in pretty_llstr 'lon': {-1:'W', 1:'E'}}[ptype][np.sign(wrapped)] TypeError: unhashable type: 'MaskedConstant' 2020-02-26 16:16:16,337 INFO repeater task os150bb_lastvec ended after 0.3 seconds 2020-02-26 16:16:16,337 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:16:04 2020-02-26 16:16:16,337 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:21:09 2020-02-26 16:16:16,338 INFO repeater task os150bb_3dayplots starting 7.5 seconds late 2020-02-26 16:16:19,118 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 16:16:19,118 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:21:08 2020-02-26 16:21:09,702 INFO repeater task os150bb_lastensq starting 0.7 seconds late 2020-02-26 16:21:11,359 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2020-02-26 16:21:11,360 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:21:04 2020-02-26 16:21:11,360 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:26:09 2020-02-26 16:21:11,360 INFO repeater task os150bb_quick starting 2.4 seconds late 2020-02-26 16:21:12,843 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:21:12,843 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 16:21:12,844 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:21:04 2020-02-26 16:21:12,844 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:26:09 2020-02-26 16:21:12,844 INFO repeater task os150bb_lastvec starting 3.8 seconds late 2020-02-26 16:21:13,247 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 16:21:13,247 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:21:04 2020-02-26 16:21:13,247 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:26:09 2020-02-26 16:21:13,248 INFO repeater task os150bb_3dayplots starting 4.5 seconds late 2020-02-26 16:21:16,074 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 16:21:16,074 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:26:08 2020-02-26 16:26:11,659 INFO repeater task os150bb_lastensq starting 2.7 seconds late 2020-02-26 16:26:13,217 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:26:13,218 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:26:04 2020-02-26 16:26:13,218 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:31:09 2020-02-26 16:26:13,218 INFO repeater task os150bb_quick starting 4.2 seconds late 2020-02-26 16:26:14,698 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:26:14,698 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 16:26:14,698 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:26:04 2020-02-26 16:26:14,698 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:31:09 2020-02-26 16:26:14,699 INFO repeater task os150bb_lastvec starting 5.7 seconds late 2020-02-26 16:26:15,095 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 16:26:15,096 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:26:04 2020-02-26 16:26:15,096 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:31:09 2020-02-26 16:26:15,096 INFO repeater task os150bb_3dayplots starting 6.3 seconds late 2020-02-26 16:26:17,896 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 16:26:17,896 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:31:08 2020-02-26 16:31:08,441 INFO repeater task os150bb_tsstats starting 4.7 seconds late 2020-02-26 16:31:09,003 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2020-02-26 16:31:09,004 INFO repeater task os150bb_tsstats next time_to_run is 2020/02/26 16:46:03 2020-02-26 16:31:09,004 INFO repeater task os150bb_10pings starting 5.2 seconds late 2020-02-26 16:31:09,124 INFO repeater task os150bb_10pings ended after 0.1 seconds 2020-02-26 16:31:09,124 INFO repeater task os150bb_10pings next time_to_run is 2020/02/26 16:46:03 2020-02-26 16:31:09,125 INFO repeater task os150bb_beamplots starting 5.3 seconds late 2020-02-26 16:31:09,984 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 16:31:09,984 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:46:03 2020-02-26 16:31:09,985 INFO repeater task os150bb_beamplots starting 6.2 seconds late 2020-02-26 16:31:10,868 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2020-02-26 16:31:10,868 INFO repeater task os150bb_beamplots next time_to_run is 2020/02/26 16:46:03 2020-02-26 16:31:10,868 INFO repeater task posmv_hcorrstats starting 7.0 seconds late 2020-02-26 16:31:11,586 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2020-02-26 16:31:11,586 INFO repeater task posmv_hcorrstats next time_to_run is 2020/02/26 16:46:03 2020-02-26 16:31:11,586 INFO repeater task posmv_plotqc starting 7.7 seconds late 2020-02-26 16:31:12,311 INFO repeater task posmv_plotqc ended after 0.7 seconds 2020-02-26 16:31:12,312 INFO repeater task posmv_plotqc next time_to_run is 2020/02/26 16:46:03 2020-02-26 16:31:17,316 INFO repeater task os150bb_lastensq starting 8.3 seconds late 2020-02-26 16:31:18,872 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:31:18,872 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:31:04 2020-02-26 16:31:18,873 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:36:09 2020-02-26 16:31:18,873 INFO repeater task os150bb_quick starting 9.9 seconds late 2020-02-26 16:31:20,335 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:31:20,335 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 16:31:20,335 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:31:04 2020-02-26 16:31:20,335 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:36:09 2020-02-26 16:31:20,335 INFO repeater task os150bb_lastvec starting 11.3 seconds late 2020-02-26 16:31:20,721 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 16:31:20,721 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:31:04 2020-02-26 16:31:20,721 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:36:09 2020-02-26 16:31:20,722 INFO repeater task os150bb_3dayplots starting 11.9 seconds late 2020-02-26 16:31:23,536 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 16:31:23,536 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:36:08 2020-02-26 16:36:09,125 INFO repeater task os150bb_lastensq starting 0.1 seconds late 2020-02-26 16:36:10,737 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:36:10,737 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:36:04 2020-02-26 16:36:10,737 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:41:09 2020-02-26 16:36:10,738 INFO repeater task os150bb_quick starting 1.7 seconds late 2020-02-26 16:36:12,218 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:36:12,218 INFO repeater task os150bb_quick ended after 1.5 seconds 2020-02-26 16:36:12,218 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:36:04 2020-02-26 16:36:12,218 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:41:09 2020-02-26 16:36:12,218 INFO repeater task os150bb_lastvec starting 3.2 seconds late 2020-02-26 16:36:12,605 INFO repeater task os150bb_lastvec ended after 0.4 seconds 2020-02-26 16:36:12,606 INFO repeater task os150bb_lastvec: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:36:04 2020-02-26 16:36:12,606 INFO repeater task os150bb_lastvec next time_to_run is 2020/02/26 16:41:09 2020-02-26 16:36:12,606 INFO repeater task os150bb_3dayplots starting 3.8 seconds late 2020-02-26 16:36:15,427 INFO repeater task os150bb_3dayplots ended after 2.8 seconds 2020-02-26 16:36:15,427 INFO repeater task os150bb_3dayplots next time_to_run is 2020/02/26 16:41:08 2020-02-26 16:41:10,983 INFO repeater task os150bb_lastensq starting 2.0 seconds late 2020-02-26 16:41:12,566 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2020-02-26 16:41:12,566 INFO repeater task os150bb_lastensq: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:41:04 2020-02-26 16:41:12,566 INFO repeater task os150bb_lastensq next time_to_run is 2020/02/26 16:46:09 2020-02-26 16:41:12,566 INFO repeater task os150bb_quick starting 3.6 seconds late 2020-02-26 16:41:14,013 INFO repeater task os150bb_quick output: /usr/local/lib/python3.6/dist-packages/pycurrents/adcp/adcp_nc.py:208: UserWarning: WARNING: missing_value cannot be safely cast to variable dtype x.missing_value = var.dtype.type(var.fill_value) 2020-02-26 16:41:14,013 INFO repeater task os150bb_quick ended after 1.4 seconds 2020-02-26 16:41:14,013 INFO repeater task os150bb_quick: Time from /home/data/NF2020_ORT/proc/os150bb/load/wrote_ens_time: 2020/02/26 16:41:04 2020-02-26 16:41:14,013 INFO repeater task os150bb_quick next time_to_run is 2020/02/26 16:46:09