2018-06-17 18:33:49,730 INFO repeater task nb300_10pings starting 2.5 seconds late 2018-06-17 18:33:49,908 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:34:09,939 INFO repeater task nb300_quick starting 2.7 seconds late 2018-06-17 18:34:13,043 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 18:34:13,043 INFO repeater task nb300_quick ended after 3.1 seconds 2018-06-17 18:34:13,043 INFO repeater task nb300_3dayplots starting 5.8 seconds late 2018-06-17 18:34:16,957 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 18:34:16,957 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 18:34:16,958 INFO repeater task nb300_tsstats starting 9.7 seconds late 2018-06-17 18:34:17,872 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 18:34:17,873 INFO repeater task nb300_beamplots starting 10.6 seconds late 2018-06-17 18:34:19,789 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 18:34:19,789 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 18:34:19,789 INFO repeater task nb300_beamplots starting 12.5 seconds late 2018-06-17 18:34:21,752 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 18:34:21,752 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 18:34:21,753 INFO repeater task ashtech_hcorrstats starting 14.5 seconds late 2018-06-17 18:34:22,840 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 18:35:17,921 INFO repeater task nb300_lastensq starting 0.9 seconds late 2018-06-17 18:35:20,543 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:35:20,544 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:35:20,544 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:35:07 2018-06-17 18:36:10,615 INFO repeater task nb300_10pings starting 3.3 seconds late 2018-06-17 18:36:10,799 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:37:20,883 INFO repeater task nb300_lastensq starting 3.9 seconds late 2018-06-17 18:37:23,486 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:37:23,486 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:37:23,486 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:37:07 2018-06-17 18:38:28,578 INFO repeater task nb300_10pings starting 1.3 seconds late 2018-06-17 18:38:28,762 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:39:08,817 INFO repeater task ashtech_hcorrstats starting 1.5 seconds late 2018-06-17 18:39:09,924 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 18:39:19,931 INFO repeater task nb300_lastensq starting 2.9 seconds late 2018-06-17 18:39:22,551 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:39:22,552 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:39:22,552 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:39:07 2018-06-17 18:40:47,670 INFO repeater task nb300_10pings starting 0.4 seconds late 2018-06-17 18:40:47,854 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:41:17,897 INFO repeater task nb300_lastensq starting 0.9 seconds late 2018-06-17 18:41:20,504 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:41:20,504 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:41:20,505 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:41:07 2018-06-17 18:43:10,632 INFO repeater task nb300_10pings starting 3.4 seconds late 2018-06-17 18:43:10,814 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:43:20,828 INFO repeater task nb300_lastensq starting 3.8 seconds late 2018-06-17 18:43:23,465 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:43:23,465 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:43:23,465 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:43:07 2018-06-17 18:44:08,536 INFO repeater task ashtech_hcorrstats starting 1.3 seconds late 2018-06-17 18:44:09,629 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 18:45:19,735 INFO repeater task nb300_lastensq starting 2.7 seconds late 2018-06-17 18:45:22,384 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:45:22,384 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:45:22,384 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:45:07 2018-06-17 18:45:27,387 INFO repeater task nb300_10pings starting 0.1 seconds late 2018-06-17 18:45:27,575 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:47:17,711 INFO repeater task nb300_lastensq starting 0.7 seconds late 2018-06-17 18:47:20,316 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:47:20,316 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:47:20,317 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:47:07 2018-06-17 18:47:50,349 INFO repeater task nb300_10pings starting 3.1 seconds late 2018-06-17 18:47:50,534 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:49:10,640 INFO repeater task nb300_quick starting 3.4 seconds late 2018-06-17 18:49:13,784 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 18:49:13,786 INFO repeater task nb300_quick ended after 3.1 seconds 2018-06-17 18:49:13,786 INFO repeater task nb300_3dayplots starting 6.5 seconds late 2018-06-17 18:49:17,710 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 18:49:17,710 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 18:49:17,711 INFO repeater task nb300_tsstats starting 10.4 seconds late 2018-06-17 18:49:18,629 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 18:49:18,629 INFO repeater task nb300_beamplots starting 11.4 seconds late 2018-06-17 18:49:20,498 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 18:49:20,498 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 18:49:20,499 INFO repeater task nb300_beamplots starting 13.2 seconds late 2018-06-17 18:49:22,471 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 18:49:22,471 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 18:49:22,471 INFO repeater task ashtech_hcorrstats starting 15.2 seconds late 2018-06-17 18:49:23,577 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 18:49:28,582 INFO repeater task nb300_lastensq starting 11.6 seconds late 2018-06-17 18:49:31,185 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:49:31,185 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:49:31,185 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:49:07 2018-06-17 18:50:11,247 INFO repeater task nb300_10pings starting 4.0 seconds late 2018-06-17 18:50:11,430 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:51:21,534 INFO repeater task nb300_lastensq starting 4.5 seconds late 2018-06-17 18:51:24,150 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:51:24,150 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:51:24,150 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:51:07 2018-06-17 18:52:29,238 INFO repeater task nb300_10pings starting 2.0 seconds late 2018-06-17 18:52:29,422 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:53:19,493 INFO repeater task nb300_lastensq starting 2.5 seconds late 2018-06-17 18:53:22,114 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:53:22,114 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:53:22,114 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:53:07 2018-06-17 18:54:12,184 INFO repeater task ashtech_hcorrstats starting 4.9 seconds late 2018-06-17 18:54:13,281 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 18:54:48,323 INFO repeater task nb300_10pings starting 1.1 seconds late 2018-06-17 18:54:48,507 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:55:18,547 INFO repeater task nb300_lastensq starting 1.5 seconds late 2018-06-17 18:55:21,183 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:55:21,183 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:55:21,183 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:55:07 2018-06-17 18:57:11,351 INFO repeater task nb300_10pings starting 4.1 seconds late 2018-06-17 18:57:11,532 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 18:57:21,547 INFO repeater task nb300_lastensq starting 4.5 seconds late 2018-06-17 18:57:24,160 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:57:24,160 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:57:24,160 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:57:07 2018-06-17 18:59:09,313 INFO repeater task ashtech_hcorrstats starting 2.0 seconds late 2018-06-17 18:59:10,402 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 18:59:20,415 INFO repeater task nb300_lastensq starting 3.4 seconds late 2018-06-17 18:59:23,019 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 18:59:23,019 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 18:59:23,019 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 18:59:07 2018-06-17 18:59:28,026 INFO repeater task nb300_10pings starting 0.8 seconds late 2018-06-17 18:59:28,210 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:01:18,363 INFO repeater task nb300_lastensq starting 1.4 seconds late 2018-06-17 19:01:20,991 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:01:20,991 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:01:20,991 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:01:07 2018-06-17 19:01:51,031 INFO repeater task nb300_10pings starting 3.8 seconds late 2018-06-17 19:01:51,213 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:03:21,327 INFO repeater task nb300_lastensq starting 4.3 seconds late 2018-06-17 19:03:23,941 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:03:23,942 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:03:23,942 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:03:07 2018-06-17 19:04:09,010 INFO repeater task nb300_10pings starting 1.7 seconds late 2018-06-17 19:04:09,192 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:04:09,192 INFO repeater task nb300_quick starting 1.9 seconds late 2018-06-17 19:04:12,336 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 19:04:12,337 INFO repeater task nb300_quick ended after 3.1 seconds 2018-06-17 19:04:12,337 INFO repeater task nb300_3dayplots starting 5.1 seconds late 2018-06-17 19:04:16,210 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 19:04:16,210 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 19:04:16,211 INFO repeater task nb300_tsstats starting 8.9 seconds late 2018-06-17 19:04:17,144 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 19:04:17,145 INFO repeater task nb300_beamplots starting 9.9 seconds late 2018-06-17 19:04:19,047 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:04:19,047 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 19:04:19,047 INFO repeater task nb300_beamplots starting 11.8 seconds late 2018-06-17 19:04:21,002 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:04:21,003 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 19:04:21,003 INFO repeater task ashtech_hcorrstats starting 13.7 seconds late 2018-06-17 19:04:22,101 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:05:17,182 INFO repeater task nb300_lastensq starting 0.2 seconds late 2018-06-17 19:05:19,798 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:05:19,798 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:05:19,798 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:05:07 2018-06-17 19:06:29,899 INFO repeater task nb300_10pings starting 2.6 seconds late 2018-06-17 19:06:30,084 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:07:20,151 INFO repeater task nb300_lastensq starting 3.2 seconds late 2018-06-17 19:07:22,775 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:07:22,775 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:07:22,776 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:07:07 2018-06-17 19:08:47,882 INFO repeater task nb300_10pings starting 0.6 seconds late 2018-06-17 19:08:48,070 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:09:08,098 INFO repeater task ashtech_hcorrstats starting 0.8 seconds late 2018-06-17 19:09:09,180 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:09:19,192 INFO repeater task nb300_lastensq starting 2.2 seconds late 2018-06-17 19:09:21,804 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:09:21,804 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:09:21,804 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:09:07 2018-06-17 19:11:11,936 INFO repeater task nb300_10pings starting 4.7 seconds late 2018-06-17 19:11:12,119 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:11:17,126 INFO repeater task nb300_lastensq starting 0.1 seconds late 2018-06-17 19:11:19,783 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:11:19,783 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:11:19,784 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:11:07 2018-06-17 19:13:19,960 INFO repeater task nb300_lastensq starting 3.0 seconds late 2018-06-17 19:13:22,565 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:13:22,565 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:13:22,565 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:13:07 2018-06-17 19:13:27,573 INFO repeater task nb300_10pings starting 0.3 seconds late 2018-06-17 19:13:27,757 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:14:07,819 INFO repeater task ashtech_hcorrstats starting 0.5 seconds late 2018-06-17 19:14:08,911 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:15:19,013 INFO repeater task nb300_lastensq starting 2.0 seconds late 2018-06-17 19:15:21,672 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:15:21,672 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:15:21,673 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:15:07 2018-06-17 19:15:51,715 INFO repeater task nb300_10pings starting 4.4 seconds late 2018-06-17 19:15:51,896 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:17:17,020 INFO repeater task nb300_lastensq starting 0.0 seconds late 2018-06-17 19:17:19,643 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:17:19,643 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:17:19,643 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:17:07 2018-06-17 19:18:09,708 INFO repeater task nb300_10pings starting 2.4 seconds late 2018-06-17 19:18:09,892 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:19:09,976 INFO repeater task nb300_quick starting 2.7 seconds late 2018-06-17 19:19:13,118 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 19:19:13,118 INFO repeater task nb300_quick ended after 3.1 seconds 2018-06-17 19:19:13,118 INFO repeater task nb300_3dayplots starting 5.9 seconds late 2018-06-17 19:19:17,016 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 19:19:17,016 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 19:19:17,016 INFO repeater task nb300_tsstats starting 9.7 seconds late 2018-06-17 19:19:17,943 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 19:19:17,944 INFO repeater task nb300_beamplots starting 10.7 seconds late 2018-06-17 19:19:19,800 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:19:19,800 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 19:19:19,800 INFO repeater task nb300_beamplots starting 12.5 seconds late 2018-06-17 19:19:21,772 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:19:21,772 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 19:19:21,773 INFO repeater task ashtech_hcorrstats starting 14.5 seconds late 2018-06-17 19:19:22,882 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:19:27,887 INFO repeater task nb300_lastensq starting 10.9 seconds late 2018-06-17 19:19:30,523 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:19:30,523 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:19:30,523 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:19:07 2018-06-17 19:20:30,615 INFO repeater task nb300_10pings starting 3.3 seconds late 2018-06-17 19:20:30,800 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:21:20,874 INFO repeater task nb300_lastensq starting 3.9 seconds late 2018-06-17 19:21:23,490 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:21:23,490 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:21:23,491 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:21:07 2018-06-17 19:22:48,605 INFO repeater task nb300_10pings starting 1.3 seconds late 2018-06-17 19:22:48,785 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:23:18,830 INFO repeater task nb300_lastensq starting 1.8 seconds late 2018-06-17 19:23:21,424 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:23:21,424 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:23:21,425 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:23:07 2018-06-17 19:24:11,504 INFO repeater task ashtech_hcorrstats starting 4.2 seconds late 2018-06-17 19:24:12,613 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:25:07,682 INFO repeater task nb300_10pings starting 0.4 seconds late 2018-06-17 19:25:07,867 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:25:17,880 INFO repeater task nb300_lastensq starting 0.9 seconds late 2018-06-17 19:25:20,514 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:25:20,514 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:25:20,514 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:25:07 2018-06-17 19:27:20,693 INFO repeater task nb300_lastensq starting 3.7 seconds late 2018-06-17 19:27:23,322 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:27:23,323 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:27:23,323 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:27:07 2018-06-17 19:27:28,330 INFO repeater task nb300_10pings starting 1.1 seconds late 2018-06-17 19:27:28,512 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:29:08,656 INFO repeater task ashtech_hcorrstats starting 1.4 seconds late 2018-06-17 19:29:09,746 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:29:19,752 INFO repeater task nb300_lastensq starting 2.8 seconds late 2018-06-17 19:29:22,359 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:29:22,359 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:29:22,359 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:29:07 2018-06-17 19:29:47,397 INFO repeater task nb300_10pings starting 0.1 seconds late 2018-06-17 19:29:47,579 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:31:17,700 INFO repeater task nb300_lastensq starting 0.7 seconds late 2018-06-17 19:31:20,332 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:31:20,332 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:31:20,332 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:31:07 2018-06-17 19:32:10,403 INFO repeater task nb300_10pings starting 3.1 seconds late 2018-06-17 19:32:10,584 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:33:20,690 INFO repeater task nb300_lastensq starting 3.7 seconds late 2018-06-17 19:33:23,319 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:33:23,319 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:33:07 2018-06-17 19:34:08,388 INFO repeater task nb300_quick starting 1.1 seconds late 2018-06-17 19:34:11,565 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 19:34:11,565 INFO repeater task nb300_quick ended after 3.2 seconds 2018-06-17 19:34:11,565 INFO repeater task nb300_3dayplots starting 4.3 seconds late 2018-06-17 19:34:15,450 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 19:34:15,451 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 19:34:15,451 INFO repeater task nb300_tsstats starting 8.2 seconds late 2018-06-17 19:34:16,355 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 19:34:16,356 INFO repeater task nb300_beamplots starting 9.1 seconds late 2018-06-17 19:34:18,278 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:34:18,278 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 19:34:18,279 INFO repeater task nb300_beamplots starting 11.0 seconds late 2018-06-17 19:34:20,298 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:34:20,298 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 19:34:20,298 INFO repeater task ashtech_hcorrstats starting 13.0 seconds late 2018-06-17 19:34:21,385 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:34:31,396 INFO repeater task nb300_10pings starting 4.1 seconds late 2018-06-17 19:34:31,581 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:35:21,651 INFO repeater task nb300_lastensq starting 4.7 seconds late 2018-06-17 19:35:24,272 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:35:24,273 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:35:24,273 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:35:07 2018-06-17 19:36:49,378 INFO repeater task nb300_10pings starting 2.1 seconds late 2018-06-17 19:36:49,562 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:37:19,606 INFO repeater task nb300_lastensq starting 2.6 seconds late 2018-06-17 19:37:22,275 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:37:22,275 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:37:22,276 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:37:07 2018-06-17 19:39:07,422 INFO repeater task nb300_10pings starting 0.2 seconds late 2018-06-17 19:39:07,607 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:39:07,608 INFO repeater task ashtech_hcorrstats starting 0.3 seconds late 2018-06-17 19:39:08,667 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:39:18,680 INFO repeater task nb300_lastensq starting 1.7 seconds late 2018-06-17 19:39:21,332 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:39:21,333 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:39:21,333 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:39:07 2018-06-17 19:41:21,481 INFO repeater task nb300_lastensq starting 4.5 seconds late 2018-06-17 19:41:24,130 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:41:24,130 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:41:24,130 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:41:07 2018-06-17 19:41:29,137 INFO repeater task nb300_10pings starting 1.9 seconds late 2018-06-17 19:41:29,319 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:43:19,476 INFO repeater task nb300_lastensq starting 2.5 seconds late 2018-06-17 19:43:22,114 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:43:22,114 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:43:22,114 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:43:07 2018-06-17 19:43:52,152 INFO repeater task nb300_10pings starting 4.9 seconds late 2018-06-17 19:43:52,345 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:44:07,368 INFO repeater task ashtech_hcorrstats starting 0.1 seconds late 2018-06-17 19:44:08,431 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:45:18,535 INFO repeater task nb300_lastensq starting 1.5 seconds late 2018-06-17 19:45:21,166 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:45:21,166 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:45:21,167 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:45:07 2018-06-17 19:46:11,242 INFO repeater task nb300_10pings starting 4.0 seconds late 2018-06-17 19:46:11,425 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:47:21,527 INFO repeater task nb300_lastensq starting 4.5 seconds late 2018-06-17 19:47:24,189 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:47:24,189 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:47:24,189 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:47:07 2018-06-17 19:48:29,268 INFO repeater task nb300_10pings starting 2.0 seconds late 2018-06-17 19:48:29,449 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:49:09,509 INFO repeater task nb300_quick starting 2.2 seconds late 2018-06-17 19:49:12,653 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 19:49:12,654 INFO repeater task nb300_quick ended after 3.1 seconds 2018-06-17 19:49:12,654 INFO repeater task nb300_3dayplots starting 5.4 seconds late 2018-06-17 19:49:16,545 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 19:49:16,546 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 19:49:16,546 INFO repeater task nb300_tsstats starting 9.3 seconds late 2018-06-17 19:49:17,463 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 19:49:17,463 INFO repeater task nb300_beamplots starting 10.2 seconds late 2018-06-17 19:49:19,369 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:49:19,369 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 19:49:19,369 INFO repeater task nb300_beamplots starting 12.1 seconds late 2018-06-17 19:49:21,346 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 19:49:21,347 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 19:49:21,347 INFO repeater task ashtech_hcorrstats starting 14.1 seconds late 2018-06-17 19:49:22,411 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:49:27,417 INFO repeater task nb300_lastensq starting 10.4 seconds late 2018-06-17 19:49:30,082 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:49:30,082 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:49:30,082 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:49:07 2018-06-17 19:50:50,205 INFO repeater task nb300_10pings starting 2.9 seconds late 2018-06-17 19:50:50,390 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:51:20,435 INFO repeater task nb300_lastensq starting 3.4 seconds late 2018-06-17 19:51:23,073 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:51:23,073 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:51:23,073 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:51:07 2018-06-17 19:53:08,226 INFO repeater task nb300_10pings starting 1.0 seconds late 2018-06-17 19:53:08,409 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:53:18,423 INFO repeater task nb300_lastensq starting 1.4 seconds late 2018-06-17 19:53:21,074 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:53:21,075 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:53:21,075 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:53:07 2018-06-17 19:54:11,153 INFO repeater task ashtech_hcorrstats starting 3.9 seconds late 2018-06-17 19:54:12,212 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:55:17,307 INFO repeater task nb300_lastensq starting 0.3 seconds late 2018-06-17 19:55:19,938 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:55:19,939 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:55:19,939 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:55:07 2018-06-17 19:55:29,950 INFO repeater task nb300_10pings starting 2.7 seconds late 2018-06-17 19:55:30,134 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:57:20,268 INFO repeater task nb300_lastensq starting 3.3 seconds late 2018-06-17 19:57:22,933 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:57:22,933 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 19:57:22,933 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:57:07 2018-06-17 19:57:47,971 INFO repeater task nb300_10pings starting 0.7 seconds late 2018-06-17 19:57:48,156 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 19:59:08,273 INFO repeater task ashtech_hcorrstats starting 1.0 seconds late 2018-06-17 19:59:09,331 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 19:59:19,344 INFO repeater task nb300_lastensq starting 2.3 seconds late 2018-06-17 19:59:21,990 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 19:59:21,990 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 19:59:21,990 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 19:59:07 2018-06-17 20:00:12,063 INFO repeater task nb300_10pings starting 4.8 seconds late 2018-06-17 20:00:12,247 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:01:17,336 INFO repeater task nb300_lastensq starting 0.3 seconds late 2018-06-17 20:01:19,989 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:01:19,989 INFO repeater task nb300_lastensq ended after 2.7 seconds 2018-06-17 20:01:19,989 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:01:07 2018-06-17 20:02:30,089 INFO repeater task nb300_10pings starting 2.8 seconds late 2018-06-17 20:02:30,273 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:03:20,335 INFO repeater task nb300_lastensq starting 3.3 seconds late 2018-06-17 20:03:22,949 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:03:22,949 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:03:22,950 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:03:06 2018-06-17 20:04:08,014 INFO repeater task nb300_quick starting 0.7 seconds late 2018-06-17 20:04:11,184 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 20:04:11,184 INFO repeater task nb300_quick ended after 3.2 seconds 2018-06-17 20:04:11,184 INFO repeater task nb300_3dayplots starting 3.9 seconds late 2018-06-17 20:04:15,089 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 20:04:15,089 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 20:04:15,090 INFO repeater task nb300_tsstats starting 7.8 seconds late 2018-06-17 20:04:16,008 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 20:04:16,009 INFO repeater task nb300_beamplots starting 8.7 seconds late 2018-06-17 20:04:17,960 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 20:04:17,961 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 20:04:17,961 INFO repeater task nb300_beamplots starting 10.7 seconds late 2018-06-17 20:04:19,890 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 20:04:19,891 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 20:04:19,891 INFO repeater task ashtech_hcorrstats starting 12.6 seconds late 2018-06-17 20:04:20,945 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 20:04:50,979 INFO repeater task nb300_10pings starting 3.7 seconds late 2018-06-17 20:04:51,166 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:05:16,206 INFO repeater task nb300_lastensq starting 0.2 seconds late 2018-06-17 20:05:18,819 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:05:18,820 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:05:06 2018-06-17 20:07:08,985 INFO repeater task nb300_10pings starting 1.7 seconds late 2018-06-17 20:07:09,165 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:07:19,182 INFO repeater task nb300_lastensq starting 3.2 seconds late 2018-06-17 20:07:21,752 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:07:21,753 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:07:06 2018-06-17 20:09:11,876 INFO repeater task ashtech_hcorrstats starting 4.6 seconds late 2018-06-17 20:09:12,941 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 20:09:17,942 INFO repeater task nb300_lastensq starting 1.9 seconds late 2018-06-17 20:09:20,555 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:09:20,555 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:09:20,556 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:09:06 2018-06-17 20:09:30,567 INFO repeater task nb300_10pings starting 3.3 seconds late 2018-06-17 20:09:30,754 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:11:20,906 INFO repeater task nb300_lastensq starting 4.9 seconds late 2018-06-17 20:11:23,520 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:11:23,520 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:11:23,520 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:11:06 2018-06-17 20:11:48,551 INFO repeater task nb300_10pings starting 1.3 seconds late 2018-06-17 20:11:48,731 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:13:18,853 INFO repeater task nb300_lastensq starting 2.9 seconds late 2018-06-17 20:13:21,470 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:13:21,470 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:13:21,471 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:13:06 2018-06-17 20:14:11,545 INFO repeater task nb300_10pings starting 4.3 seconds late 2018-06-17 20:14:11,724 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:14:11,726 INFO repeater task ashtech_hcorrstats starting 4.5 seconds late 2018-06-17 20:14:12,779 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 20:15:17,873 INFO repeater task nb300_lastensq starting 1.9 seconds late 2018-06-17 20:15:20,471 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:15:20,472 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:15:20,472 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:15:06 2018-06-17 20:16:30,569 INFO repeater task nb300_10pings starting 3.3 seconds late 2018-06-17 20:16:30,753 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:17:20,826 INFO repeater task nb300_lastensq starting 4.8 seconds late 2018-06-17 20:17:23,431 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:17:23,431 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:17:06 2018-06-17 20:18:48,525 INFO repeater task nb300_10pings starting 1.3 seconds late 2018-06-17 20:18:48,707 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:19:08,733 INFO repeater task nb300_quick starting 1.5 seconds late 2018-06-17 20:19:11,900 INFO repeater task nb300_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2018-06-17 20:19:11,900 INFO repeater task nb300_quick ended after 3.2 seconds 2018-06-17 20:19:11,900 INFO repeater task nb300_3dayplots starting 4.6 seconds late 2018-06-17 20:19:15,778 INFO repeater task nb300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2018-06-17 20:19:15,778 INFO repeater task nb300_3dayplots ended after 3.9 seconds 2018-06-17 20:19:15,779 INFO repeater task nb300_tsstats starting 8.5 seconds late 2018-06-17 20:19:16,711 INFO repeater task nb300_tsstats ended after 0.9 seconds 2018-06-17 20:19:16,712 INFO repeater task nb300_beamplots starting 9.4 seconds late 2018-06-17 20:19:18,603 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 20:19:18,604 INFO repeater task nb300_beamplots ended after 1.9 seconds 2018-06-17 20:19:18,604 INFO repeater task nb300_beamplots starting 11.3 seconds late 2018-06-17 20:19:20,556 INFO repeater task nb300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2018-06-17 20:19:20,556 INFO repeater task nb300_beamplots ended after 2.0 seconds 2018-06-17 20:19:20,557 INFO repeater task ashtech_hcorrstats starting 13.3 seconds late 2018-06-17 20:19:21,629 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 20:19:26,635 INFO repeater task nb300_lastensq starting 10.6 seconds late 2018-06-17 20:19:29,259 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:19:29,259 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:19:29,259 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:19:06 2018-06-17 20:21:09,386 INFO repeater task nb300_10pings starting 2.1 seconds late 2018-06-17 20:21:09,569 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:21:19,584 INFO repeater task nb300_lastensq starting 3.6 seconds late 2018-06-17 20:21:22,223 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:21:22,223 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:21:22,223 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:21:06 2018-06-17 20:23:17,376 INFO repeater task nb300_lastensq starting 1.4 seconds late 2018-06-17 20:23:19,989 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:23:19,990 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:23:19,990 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:23:06 2018-06-17 20:23:30,004 INFO repeater task nb300_10pings starting 2.7 seconds late 2018-06-17 20:23:30,187 INFO repeater task nb300_10pings ended after 0.2 seconds 2018-06-17 20:24:10,247 INFO repeater task ashtech_hcorrstats starting 3.0 seconds late 2018-06-17 20:24:11,299 INFO repeater task ashtech_hcorrstats ended after 1.1 seconds 2018-06-17 20:25:16,395 INFO repeater task nb300_lastensq starting 0.4 seconds late 2018-06-17 20:25:19,008 INFO repeater task nb300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:3847: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") 2018-06-17 20:25:19,009 INFO repeater task nb300_lastensq ended after 2.6 seconds 2018-06-17 20:25:19,009 INFO repeater task nb300_lastensq: Time from /home/data/SR1815/proc/nb300/load/wrote_ens_time: 2018/06/17 20:25:06 2018-06-17 20:25:28,158 INFO Translate translate exiting, hdg /home/data/SR1815/rbin/gpshead 2018-06-17 20:25:28,169 INFO Translate translate exiting, adu /home/data/SR1815/rbin/ashtech 2018-06-17 20:25:28,171 INFO Translate translate exiting, gps /home/data/SR1815/rbin/ashtech 2018-06-17 20:25:28,172 INFO Translate translate exiting, gps /home/data/SR1815/rbin/gp170 2018-06-17 20:25:28,173 INFO Translate translate exiting, gps /home/data/SR1815/rbin/gp150 2018-06-17 20:25:28,176 INFO Translate translate exiting, gps /home/data/SR1815/rbin/gpsnav 2018-06-17 20:25:29,024 INFO root cleanup_figs not_logging 2018-06-17 20:25:29,033 INFO root Exiting DAS_while_logging.py