2017-05-12 13:27:35,415 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:27:35,415 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:27:35,415 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:27:21 2017-05-12 13:29:25,723 INFO repeater task os75bb_10pings starting 3.6 seconds late 2017-05-12 13:29:25,812 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 13:29:25,813 INFO repeater task os75nb_10pings starting 3.7 seconds late 2017-05-12 13:29:25,899 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 13:29:35,919 INFO repeater task wh300_lastensq starting 4.9 seconds late 2017-05-12 13:29:37,328 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:29:37,328 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:29:37,328 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:29:21 2017-05-12 13:29:42,336 INFO repeater task wh300_10pings starting 0.2 seconds late 2017-05-12 13:29:42,427 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:31:22,677 INFO repeater task phins_hcorrstats starting 0.5 seconds late 2017-05-12 13:31:23,421 INFO repeater task phins_hcorrstats ended after 0.7 seconds 2017-05-12 13:31:23,422 INFO repeater task phins2_hcorrstats starting 1.3 seconds late 2017-05-12 13:31:24,168 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 13:31:34,186 INFO repeater task wh300_lastensq starting 3.2 seconds late 2017-05-12 13:31:35,639 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:31:35,639 INFO repeater task wh300_lastensq ended after 1.5 seconds 2017-05-12 13:31:35,639 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:31:21 2017-05-12 13:31:35,639 INFO repeater task os75bb_lastensq starting 0.6 seconds late 2017-05-12 13:31:36,632 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:31:36,632 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 13:31:36,632 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 13:31:25 2017-05-12 13:31:36,633 INFO repeater task os75nb_lastensq starting 1.6 seconds late 2017-05-12 13:31:37,609 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:31:37,609 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 13:31:37,609 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 13:31:25 2017-05-12 13:32:02,663 INFO repeater task wh300_10pings starting 0.5 seconds late 2017-05-12 13:32:02,756 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:33:33,005 INFO repeater task wh300_lastensq starting 2.0 seconds late 2017-05-12 13:33:34,438 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:33:34,438 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:33:34,438 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:33:21 2017-05-12 13:34:24,569 INFO repeater task wh300_10pings starting 2.4 seconds late 2017-05-12 13:34:24,659 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:34:44,708 INFO repeater task os75bb_10pings starting 2.6 seconds late 2017-05-12 13:34:44,791 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 13:34:44,792 INFO repeater task os75nb_10pings starting 2.6 seconds late 2017-05-12 13:34:44,867 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 13:35:35,001 INFO repeater task wh300_lastensq starting 4.0 seconds late 2017-05-12 13:35:36,406 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:35:36,406 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:35:36,406 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:35:21 2017-05-12 13:36:26,540 INFO repeater task wh300_quick starting 4.4 seconds late 2017-05-12 13:36:30,017 INFO repeater task wh300_quick ended after 3.5 seconds 2017-05-12 13:36:30,018 INFO repeater task wh300_3dayplots starting 7.9 seconds late 2017-05-12 13:36:35,727 INFO repeater task wh300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 13:36:35,727 INFO repeater task wh300_3dayplots ended after 5.7 seconds 2017-05-12 13:36:35,727 INFO repeater task wh300_tsstats starting 13.6 seconds late 2017-05-12 13:36:36,273 INFO repeater task wh300_tsstats ended after 0.5 seconds 2017-05-12 13:36:36,273 INFO repeater task os75bb_lastensq starting 1.3 seconds late 2017-05-12 13:36:37,230 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:36:37,230 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 13:36:37,230 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 13:36:25 2017-05-12 13:36:37,230 INFO repeater task os75bb_quick starting 15.1 seconds late 2017-05-12 13:36:39,932 INFO repeater task os75bb_quick ended after 2.7 seconds 2017-05-12 13:36:39,932 INFO repeater task os75bb_3dayplots starting 17.8 seconds late 2017-05-12 13:36:45,604 INFO repeater task os75bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 13:36:45,605 INFO repeater task os75bb_3dayplots ended after 5.7 seconds 2017-05-12 13:36:45,605 INFO repeater task os75bb_tsstats starting 23.4 seconds late 2017-05-12 13:36:46,127 INFO repeater task os75bb_tsstats ended after 0.5 seconds 2017-05-12 13:36:46,127 INFO repeater task os75nb_lastensq starting 11.1 seconds late 2017-05-12 13:36:47,115 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:36:47,115 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 13:36:47,115 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 13:36:25 2017-05-12 13:36:47,115 INFO repeater task os75nb_quick starting 25.0 seconds late 2017-05-12 13:36:49,836 INFO repeater task os75nb_quick ended after 2.7 seconds 2017-05-12 13:36:49,836 INFO repeater task os75nb_3dayplots starting 27.7 seconds late 2017-05-12 13:36:55,473 INFO repeater task os75nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 13:36:55,473 INFO repeater task os75nb_3dayplots ended after 5.6 seconds 2017-05-12 13:36:55,473 INFO repeater task os75nb_tsstats starting 33.3 seconds late 2017-05-12 13:36:56,028 INFO repeater task os75nb_tsstats ended after 0.6 seconds 2017-05-12 13:36:56,028 INFO repeater task wh300_beamplots starting 33.9 seconds late 2017-05-12 13:36:56,895 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:36:56,895 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 13:36:56,895 INFO repeater task wh300_beamplots starting 34.7 seconds late 2017-05-12 13:36:57,780 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:36:57,780 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 13:36:57,780 INFO repeater task os75bb_beamplots starting 35.6 seconds late 2017-05-12 13:36:58,591 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:36:58,591 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 13:36:58,591 INFO repeater task os75bb_beamplots starting 36.4 seconds late 2017-05-12 13:36:59,376 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:36:59,376 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 13:36:59,376 INFO repeater task os75nb_beamplots starting 37.2 seconds late 2017-05-12 13:37:00,152 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:37:00,152 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 13:37:00,152 INFO repeater task os75nb_beamplots starting 38.0 seconds late 2017-05-12 13:37:00,943 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:37:00,943 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 13:37:00,943 INFO repeater task phins_hcorrstats starting 38.8 seconds late 2017-05-12 13:37:01,684 INFO repeater task phins_hcorrstats ended after 0.7 seconds 2017-05-12 13:37:01,684 INFO repeater task phins2_hcorrstats starting 39.5 seconds late 2017-05-12 13:37:02,426 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 13:37:07,430 INFO repeater task wh300_10pings starting 25.3 seconds late 2017-05-12 13:37:07,522 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:37:32,588 INFO repeater task wh300_lastensq starting 1.6 seconds late 2017-05-12 13:37:34,038 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:37:34,038 INFO repeater task wh300_lastensq ended after 1.5 seconds 2017-05-12 13:37:34,039 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:37:21 2017-05-12 13:39:04,277 INFO repeater task wh300_10pings starting 2.1 seconds late 2017-05-12 13:39:04,368 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:39:34,437 INFO repeater task wh300_lastensq starting 3.4 seconds late 2017-05-12 13:39:35,830 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:39:35,831 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:39:35,831 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:39:21 2017-05-12 13:40:05,911 INFO repeater task os75bb_10pings starting 3.8 seconds late 2017-05-12 13:40:05,996 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 13:40:05,997 INFO repeater task os75nb_10pings starting 3.8 seconds late 2017-05-12 13:40:06,077 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 13:41:26,279 INFO repeater task wh300_10pings starting 4.1 seconds late 2017-05-12 13:41:26,373 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:41:26,375 INFO repeater task phins_hcorrstats starting 4.2 seconds late 2017-05-12 13:41:27,175 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 13:41:27,175 INFO repeater task phins2_hcorrstats starting 5.0 seconds late 2017-05-12 13:41:27,898 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 13:41:32,904 INFO repeater task wh300_lastensq starting 1.9 seconds late 2017-05-12 13:41:34,326 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:41:34,326 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:41:34,326 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:41:21 2017-05-12 13:41:39,336 INFO repeater task os75bb_lastensq starting 4.3 seconds late 2017-05-12 13:41:40,347 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:41:40,347 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 13:41:40,347 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 13:41:25 2017-05-12 13:41:40,348 INFO repeater task os75nb_lastensq starting 5.3 seconds late 2017-05-12 13:41:41,343 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:41:41,343 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 13:41:41,344 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 13:41:25 2017-05-12 13:43:31,649 INFO repeater task wh300_lastensq starting 0.6 seconds late 2017-05-12 13:43:33,051 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:43:33,052 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:43:33,052 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:43:21 2017-05-12 13:43:43,071 INFO repeater task wh300_10pings starting 0.9 seconds late 2017-05-12 13:43:43,159 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:45:23,420 INFO repeater task os75bb_10pings starting 1.3 seconds late 2017-05-12 13:45:23,516 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 13:45:23,517 INFO repeater task os75nb_10pings starting 1.4 seconds late 2017-05-12 13:45:23,603 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 13:45:33,622 INFO repeater task wh300_lastensq starting 2.6 seconds late 2017-05-12 13:45:35,070 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:45:35,070 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:45:35,070 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:45:21 2017-05-12 13:46:05,145 INFO repeater task wh300_10pings starting 3.0 seconds late 2017-05-12 13:46:05,244 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:46:25,304 INFO repeater task phins_hcorrstats starting 3.1 seconds late 2017-05-12 13:46:26,033 INFO repeater task phins_hcorrstats ended after 0.7 seconds 2017-05-12 13:46:26,034 INFO repeater task phins2_hcorrstats starting 3.9 seconds late 2017-05-12 13:46:26,779 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 13:46:36,803 INFO repeater task os75bb_lastensq starting 1.8 seconds late 2017-05-12 13:46:37,810 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:46:37,810 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 13:46:37,811 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 13:46:25 2017-05-12 13:46:37,811 INFO repeater task os75nb_lastensq starting 2.8 seconds late 2017-05-12 13:46:38,833 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:46:38,833 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 13:46:38,833 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 13:46:25 2017-05-12 13:47:33,983 INFO repeater task wh300_lastensq starting 3.0 seconds late 2017-05-12 13:47:35,435 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:47:35,435 INFO repeater task wh300_lastensq ended after 1.5 seconds 2017-05-12 13:47:35,435 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:47:21 2017-05-12 13:48:25,565 INFO repeater task wh300_10pings starting 3.4 seconds late 2017-05-12 13:48:25,657 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:49:35,841 INFO repeater task wh300_lastensq starting 4.8 seconds late 2017-05-12 13:49:37,274 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:49:37,274 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:49:37,274 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:49:21 2017-05-12 13:50:42,442 INFO repeater task wh300_10pings starting 0.3 seconds late 2017-05-12 13:50:42,533 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:50:42,534 INFO repeater task os75bb_10pings starting 0.4 seconds late 2017-05-12 13:50:42,617 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 13:50:42,618 INFO repeater task os75nb_10pings starting 0.5 seconds late 2017-05-12 13:50:42,698 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 13:51:22,798 INFO repeater task wh300_quick starting 0.6 seconds late 2017-05-12 13:51:26,912 INFO repeater task wh300_quick ended after 4.1 seconds 2017-05-12 13:51:26,913 INFO repeater task wh300_3dayplots starting 4.8 seconds late 2017-05-12 13:51:32,551 INFO repeater task wh300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 13:51:32,551 INFO repeater task wh300_3dayplots ended after 5.6 seconds 2017-05-12 13:51:32,552 INFO repeater task wh300_tsstats starting 10.4 seconds late 2017-05-12 13:51:33,087 INFO repeater task wh300_tsstats ended after 0.5 seconds 2017-05-12 13:51:33,088 INFO repeater task os75bb_quick starting 10.9 seconds late 2017-05-12 13:51:35,836 INFO repeater task os75bb_quick ended after 2.7 seconds 2017-05-12 13:51:35,836 INFO repeater task os75bb_3dayplots starting 13.7 seconds late 2017-05-12 13:51:41,668 INFO repeater task os75bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 13:51:41,668 INFO repeater task os75bb_3dayplots ended after 5.8 seconds 2017-05-12 13:51:41,668 INFO repeater task os75bb_tsstats starting 19.5 seconds late 2017-05-12 13:51:42,157 INFO repeater task os75bb_tsstats ended after 0.5 seconds 2017-05-12 13:51:42,157 INFO repeater task os75nb_lastensq starting 7.2 seconds late 2017-05-12 13:51:43,135 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:51:43,135 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 13:51:43,135 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 13:51:25 2017-05-12 13:51:43,136 INFO repeater task os75nb_quick starting 21.0 seconds late 2017-05-12 13:51:45,939 INFO repeater task os75nb_quick ended after 2.8 seconds 2017-05-12 13:51:45,939 INFO repeater task os75nb_3dayplots starting 23.8 seconds late 2017-05-12 13:51:51,707 INFO repeater task os75nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 13:51:51,707 INFO repeater task os75nb_3dayplots ended after 5.8 seconds 2017-05-12 13:51:51,708 INFO repeater task os75nb_tsstats starting 29.6 seconds late 2017-05-12 13:51:52,176 INFO repeater task os75nb_tsstats ended after 0.5 seconds 2017-05-12 13:51:52,176 INFO repeater task wh300_beamplots starting 30.0 seconds late 2017-05-12 13:51:53,055 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:51:53,055 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 13:51:53,055 INFO repeater task wh300_beamplots starting 30.9 seconds late 2017-05-12 13:51:53,971 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:51:53,971 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 13:51:53,971 INFO repeater task os75bb_beamplots starting 31.8 seconds late 2017-05-12 13:51:54,771 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:51:54,771 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 13:51:54,771 INFO repeater task os75bb_beamplots starting 32.6 seconds late 2017-05-12 13:51:55,591 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:51:55,592 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 13:51:55,592 INFO repeater task os75nb_beamplots starting 33.4 seconds late 2017-05-12 13:51:56,360 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:51:56,360 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 13:51:56,360 INFO repeater task os75nb_beamplots starting 34.2 seconds late 2017-05-12 13:51:57,162 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 13:51:57,162 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 13:51:57,162 INFO repeater task phins_hcorrstats starting 35.0 seconds late 2017-05-12 13:51:57,912 INFO repeater task phins_hcorrstats ended after 0.7 seconds 2017-05-12 13:51:57,912 INFO repeater task phins2_hcorrstats starting 35.8 seconds late 2017-05-12 13:51:58,654 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 13:52:03,655 INFO repeater task wh300_lastensq starting 32.7 seconds late 2017-05-12 13:52:05,081 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:52:05,082 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:52:05,082 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:51:21 2017-05-12 13:52:05,082 INFO repeater task os75bb_lastensq starting 30.1 seconds late 2017-05-12 13:52:06,074 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:52:06,074 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 13:52:06,074 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 13:51:25 2017-05-12 13:53:06,223 INFO repeater task wh300_10pings starting 4.1 seconds late 2017-05-12 13:53:06,299 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:53:31,362 INFO repeater task wh300_lastensq starting 0.4 seconds late 2017-05-12 13:53:32,774 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:53:32,774 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:53:32,774 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:53:21 2017-05-12 13:55:23,076 INFO repeater task wh300_10pings starting 0.9 seconds late 2017-05-12 13:55:23,170 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:55:33,193 INFO repeater task wh300_lastensq starting 2.2 seconds late 2017-05-12 13:55:34,618 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:55:34,618 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:55:34,619 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:55:21 2017-05-12 13:56:04,699 INFO repeater task os75bb_10pings starting 2.5 seconds late 2017-05-12 13:56:04,792 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 13:56:04,793 INFO repeater task os75nb_10pings starting 2.6 seconds late 2017-05-12 13:56:04,871 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 13:56:24,928 INFO repeater task phins_hcorrstats starting 2.8 seconds late 2017-05-12 13:56:25,666 INFO repeater task phins_hcorrstats ended after 0.7 seconds 2017-05-12 13:56:25,666 INFO repeater task phins2_hcorrstats starting 3.5 seconds late 2017-05-12 13:56:26,417 INFO repeater task phins2_hcorrstats ended after 0.8 seconds 2017-05-12 13:56:36,440 INFO repeater task os75bb_lastensq starting 1.4 seconds late 2017-05-12 13:56:37,441 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:56:37,441 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 13:56:37,441 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 13:56:25 2017-05-12 13:56:37,442 INFO repeater task os75nb_lastensq starting 2.4 seconds late 2017-05-12 13:56:38,419 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:56:38,419 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 13:56:38,419 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 13:56:25 2017-05-12 13:57:33,559 INFO repeater task wh300_lastensq starting 2.6 seconds late 2017-05-12 13:57:34,999 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:57:34,999 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:57:34,999 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:57:21 2017-05-12 13:57:45,023 INFO repeater task wh300_10pings starting 2.9 seconds late 2017-05-12 13:57:45,119 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 13:59:35,407 INFO repeater task wh300_lastensq starting 4.4 seconds late 2017-05-12 13:59:36,855 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 13:59:36,855 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 13:59:36,855 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 13:59:21 2017-05-12 14:00:06,929 INFO repeater task wh300_10pings starting 4.8 seconds late 2017-05-12 14:00:07,027 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:01:22,232 INFO repeater task os75bb_10pings starting 0.1 seconds late 2017-05-12 14:01:22,322 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:01:22,323 INFO repeater task os75nb_10pings starting 0.2 seconds late 2017-05-12 14:01:22,401 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:01:22,402 INFO repeater task phins_hcorrstats starting 0.2 seconds late 2017-05-12 14:01:23,152 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:01:23,153 INFO repeater task phins2_hcorrstats starting 1.0 seconds late 2017-05-12 14:01:23,869 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 14:01:33,890 INFO repeater task wh300_lastensq starting 2.9 seconds late 2017-05-12 14:01:35,326 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:01:35,327 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:01:35,327 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:01:21 2017-05-12 14:01:35,327 INFO repeater task os75bb_lastensq starting 0.3 seconds late 2017-05-12 14:01:36,317 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:01:36,317 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:01:36,317 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:01:25 2017-05-12 14:01:36,318 INFO repeater task os75nb_lastensq starting 1.3 seconds late 2017-05-12 14:01:37,293 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:01:37,293 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:01:37,293 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:01:25 2017-05-12 14:02:22,411 INFO repeater task wh300_10pings starting 0.3 seconds late 2017-05-12 14:02:22,501 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:03:32,686 INFO repeater task wh300_lastensq starting 1.7 seconds late 2017-05-12 14:03:34,105 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:03:34,105 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:03:34,105 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:03:21 2017-05-12 14:04:44,277 INFO repeater task wh300_10pings starting 2.1 seconds late 2017-05-12 14:04:44,364 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:05:34,485 INFO repeater task wh300_lastensq starting 3.5 seconds late 2017-05-12 14:05:35,842 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:05:35,842 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:05:35,842 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:05:21 2017-05-12 14:06:25,976 INFO repeater task wh300_quick starting 3.8 seconds late 2017-05-12 14:06:29,408 INFO repeater task wh300_quick ended after 3.4 seconds 2017-05-12 14:06:29,408 INFO repeater task wh300_3dayplots starting 7.3 seconds late 2017-05-12 14:06:35,187 INFO repeater task wh300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:06:35,188 INFO repeater task wh300_3dayplots ended after 5.8 seconds 2017-05-12 14:06:35,188 INFO repeater task wh300_tsstats starting 13.0 seconds late 2017-05-12 14:06:35,725 INFO repeater task wh300_tsstats ended after 0.5 seconds 2017-05-12 14:06:35,725 INFO repeater task os75bb_lastensq starting 0.7 seconds late 2017-05-12 14:06:36,733 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:06:36,733 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:06:36,733 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:06:25 2017-05-12 14:06:36,733 INFO repeater task os75bb_quick starting 14.6 seconds late 2017-05-12 14:06:39,482 INFO repeater task os75bb_quick ended after 2.7 seconds 2017-05-12 14:06:39,483 INFO repeater task os75bb_3dayplots starting 17.3 seconds late 2017-05-12 14:06:45,265 INFO repeater task os75bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:06:45,265 INFO repeater task os75bb_3dayplots ended after 5.8 seconds 2017-05-12 14:06:45,265 INFO repeater task os75bb_tsstats starting 23.1 seconds late 2017-05-12 14:06:45,747 INFO repeater task os75bb_tsstats ended after 0.5 seconds 2017-05-12 14:06:45,748 INFO repeater task os75nb_lastensq starting 10.7 seconds late 2017-05-12 14:06:46,736 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:06:46,736 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:06:46,736 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:06:25 2017-05-12 14:06:46,736 INFO repeater task os75nb_10pings starting 4.6 seconds late 2017-05-12 14:06:46,811 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:06:46,811 INFO repeater task os75nb_quick starting 24.7 seconds late 2017-05-12 14:06:49,597 INFO repeater task os75nb_quick ended after 2.8 seconds 2017-05-12 14:06:49,597 INFO repeater task os75nb_3dayplots starting 27.4 seconds late 2017-05-12 14:06:55,381 INFO repeater task os75nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:06:55,381 INFO repeater task os75nb_3dayplots ended after 5.8 seconds 2017-05-12 14:06:55,381 INFO repeater task os75nb_tsstats starting 33.2 seconds late 2017-05-12 14:06:55,857 INFO repeater task os75nb_tsstats ended after 0.5 seconds 2017-05-12 14:06:55,857 INFO repeater task wh300_beamplots starting 33.7 seconds late 2017-05-12 14:06:56,764 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:06:56,764 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 14:06:56,764 INFO repeater task wh300_beamplots starting 34.6 seconds late 2017-05-12 14:06:57,664 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:06:57,665 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 14:06:57,665 INFO repeater task os75bb_beamplots starting 35.5 seconds late 2017-05-12 14:06:58,448 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:06:58,448 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 14:06:58,448 INFO repeater task os75bb_beamplots starting 36.3 seconds late 2017-05-12 14:06:59,230 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:06:59,230 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 14:06:59,230 INFO repeater task os75nb_beamplots starting 37.1 seconds late 2017-05-12 14:07:00,006 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:07:00,006 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 14:07:00,006 INFO repeater task os75nb_beamplots starting 37.8 seconds late 2017-05-12 14:07:00,810 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:07:00,810 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 14:07:00,810 INFO repeater task phins_hcorrstats starting 38.7 seconds late 2017-05-12 14:07:01,563 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:07:01,563 INFO repeater task phins2_hcorrstats starting 39.4 seconds late 2017-05-12 14:07:02,285 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 14:07:07,291 INFO repeater task wh300_10pings starting 5.1 seconds late 2017-05-12 14:07:07,380 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:07:07,380 INFO repeater task os75bb_10pings starting 25.2 seconds late 2017-05-12 14:07:07,460 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:07:32,527 INFO repeater task wh300_lastensq starting 1.5 seconds late 2017-05-12 14:07:33,935 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:07:33,936 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:07:33,936 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:07:21 2017-05-12 14:09:24,222 INFO repeater task wh300_10pings starting 2.1 seconds late 2017-05-12 14:09:24,314 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:09:34,332 INFO repeater task wh300_lastensq starting 3.3 seconds late 2017-05-12 14:09:35,739 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:09:35,739 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:09:35,740 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:09:21 2017-05-12 14:11:26,048 INFO repeater task phins_hcorrstats starting 3.9 seconds late 2017-05-12 14:11:26,796 INFO repeater task phins_hcorrstats ended after 0.7 seconds 2017-05-12 14:11:26,796 INFO repeater task phins2_hcorrstats starting 4.6 seconds late 2017-05-12 14:11:27,561 INFO repeater task phins2_hcorrstats ended after 0.8 seconds 2017-05-12 14:11:32,567 INFO repeater task wh300_lastensq starting 1.6 seconds late 2017-05-12 14:11:33,971 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:11:33,972 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:11:33,972 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:11:21 2017-05-12 14:11:38,982 INFO repeater task os75bb_lastensq starting 4.0 seconds late 2017-05-12 14:11:39,989 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:11:39,989 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:11:39,989 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:11:25 2017-05-12 14:11:39,990 INFO repeater task os75nb_lastensq starting 5.0 seconds late 2017-05-12 14:11:40,960 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:11:40,960 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:11:40,960 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:11:25 2017-05-12 14:11:45,967 INFO repeater task wh300_10pings starting 3.8 seconds late 2017-05-12 14:11:46,055 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:12:06,103 INFO repeater task os75bb_10pings starting 3.9 seconds late 2017-05-12 14:12:06,195 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:12:06,196 INFO repeater task os75nb_10pings starting 4.0 seconds late 2017-05-12 14:12:06,274 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:13:31,495 INFO repeater task wh300_lastensq starting 0.5 seconds late 2017-05-12 14:13:32,904 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:13:32,904 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:13:32,904 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:13:21 2017-05-12 14:14:02,985 INFO repeater task wh300_10pings starting 0.8 seconds late 2017-05-12 14:14:03,081 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:15:33,308 INFO repeater task wh300_lastensq starting 2.3 seconds late 2017-05-12 14:15:34,756 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:15:34,756 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:15:34,756 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:15:21 2017-05-12 14:16:24,886 INFO repeater task wh300_10pings starting 2.7 seconds late 2017-05-12 14:16:24,963 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:16:24,965 INFO repeater task phins_hcorrstats starting 2.8 seconds late 2017-05-12 14:16:25,729 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:16:25,730 INFO repeater task phins2_hcorrstats starting 3.6 seconds late 2017-05-12 14:16:26,486 INFO repeater task phins2_hcorrstats ended after 0.8 seconds 2017-05-12 14:16:36,508 INFO repeater task os75bb_lastensq starting 1.5 seconds late 2017-05-12 14:16:37,518 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:16:37,518 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:16:37,518 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:16:25 2017-05-12 14:16:37,519 INFO repeater task os75nb_lastensq starting 2.5 seconds late 2017-05-12 14:16:38,523 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:16:38,523 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:16:38,524 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:16:25 2017-05-12 14:17:23,642 INFO repeater task os75bb_10pings starting 1.5 seconds late 2017-05-12 14:17:23,734 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:17:23,734 INFO repeater task os75nb_10pings starting 1.6 seconds late 2017-05-12 14:17:23,814 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:17:33,836 INFO repeater task wh300_lastensq starting 2.8 seconds late 2017-05-12 14:17:35,254 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:17:35,254 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:17:35,254 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:17:21 2017-05-12 14:18:45,441 INFO repeater task wh300_10pings starting 3.3 seconds late 2017-05-12 14:18:45,536 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:19:35,661 INFO repeater task wh300_lastensq starting 4.7 seconds late 2017-05-12 14:19:37,084 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:19:37,084 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:19:37,084 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:19:21 2017-05-12 14:21:02,307 INFO repeater task wh300_10pings starting 0.2 seconds late 2017-05-12 14:21:02,398 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:21:22,447 INFO repeater task wh300_quick starting 0.3 seconds late 2017-05-12 14:21:25,852 INFO repeater task wh300_quick ended after 3.4 seconds 2017-05-12 14:21:25,853 INFO repeater task wh300_3dayplots starting 3.7 seconds late 2017-05-12 14:21:31,620 INFO repeater task wh300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:21:31,620 INFO repeater task wh300_3dayplots ended after 5.8 seconds 2017-05-12 14:21:31,620 INFO repeater task wh300_tsstats starting 9.5 seconds late 2017-05-12 14:21:32,157 INFO repeater task wh300_tsstats ended after 0.5 seconds 2017-05-12 14:21:32,158 INFO repeater task os75bb_quick starting 10.0 seconds late 2017-05-12 14:21:34,892 INFO repeater task os75bb_quick ended after 2.7 seconds 2017-05-12 14:21:34,893 INFO repeater task os75bb_3dayplots starting 12.7 seconds late 2017-05-12 14:21:40,692 INFO repeater task os75bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:21:40,692 INFO repeater task os75bb_3dayplots ended after 5.8 seconds 2017-05-12 14:21:40,693 INFO repeater task os75bb_tsstats starting 18.5 seconds late 2017-05-12 14:21:41,174 INFO repeater task os75bb_tsstats ended after 0.5 seconds 2017-05-12 14:21:41,174 INFO repeater task os75nb_lastensq starting 6.2 seconds late 2017-05-12 14:21:42,128 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:21:42,128 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:21:42,128 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:21:25 2017-05-12 14:21:42,128 INFO repeater task os75nb_quick starting 20.0 seconds late 2017-05-12 14:21:44,813 INFO repeater task os75nb_quick ended after 2.7 seconds 2017-05-12 14:21:44,813 INFO repeater task os75nb_3dayplots starting 22.7 seconds late 2017-05-12 14:21:50,513 INFO repeater task os75nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:21:50,513 INFO repeater task os75nb_3dayplots ended after 5.7 seconds 2017-05-12 14:21:50,514 INFO repeater task os75nb_tsstats starting 28.4 seconds late 2017-05-12 14:21:50,980 INFO repeater task os75nb_tsstats ended after 0.5 seconds 2017-05-12 14:21:50,980 INFO repeater task wh300_beamplots starting 28.8 seconds late 2017-05-12 14:21:51,871 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:21:51,871 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 14:21:51,872 INFO repeater task wh300_beamplots starting 29.7 seconds late 2017-05-12 14:21:52,785 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:21:52,785 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 14:21:52,785 INFO repeater task os75bb_beamplots starting 30.6 seconds late 2017-05-12 14:21:53,579 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:21:53,579 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 14:21:53,579 INFO repeater task os75bb_beamplots starting 31.4 seconds late 2017-05-12 14:21:54,369 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:21:54,369 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 14:21:54,370 INFO repeater task os75nb_beamplots starting 32.2 seconds late 2017-05-12 14:21:55,144 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:21:55,144 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 14:21:55,144 INFO repeater task os75nb_beamplots starting 33.0 seconds late 2017-05-12 14:21:55,932 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:21:55,932 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 14:21:55,933 INFO repeater task phins_hcorrstats starting 33.8 seconds late 2017-05-12 14:21:56,690 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:21:56,690 INFO repeater task phins2_hcorrstats starting 34.5 seconds late 2017-05-12 14:21:57,425 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 14:22:02,431 INFO repeater task wh300_lastensq starting 31.4 seconds late 2017-05-12 14:22:03,870 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:22:03,870 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:22:03,870 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:21:21 2017-05-12 14:22:03,871 INFO repeater task os75bb_lastensq starting 28.9 seconds late 2017-05-12 14:22:04,896 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:22:04,896 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:22:04,896 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:21:25 2017-05-12 14:22:44,998 INFO repeater task os75bb_10pings starting 2.8 seconds late 2017-05-12 14:22:45,083 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:22:45,083 INFO repeater task os75nb_10pings starting 2.9 seconds late 2017-05-12 14:22:45,160 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:23:25,245 INFO repeater task wh300_10pings starting 3.1 seconds late 2017-05-12 14:23:25,332 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:23:35,350 INFO repeater task wh300_lastensq starting 4.4 seconds late 2017-05-12 14:23:36,757 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:23:36,757 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:23:36,757 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:23:21 2017-05-12 14:25:32,063 INFO repeater task wh300_lastensq starting 1.1 seconds late 2017-05-12 14:25:33,463 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:25:33,464 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:25:33,464 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:25:21 2017-05-12 14:25:43,486 INFO repeater task wh300_10pings starting 1.3 seconds late 2017-05-12 14:25:43,576 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:26:23,690 INFO repeater task phins_hcorrstats starting 1.5 seconds late 2017-05-12 14:26:24,436 INFO repeater task phins_hcorrstats ended after 0.7 seconds 2017-05-12 14:26:24,437 INFO repeater task phins2_hcorrstats starting 2.3 seconds late 2017-05-12 14:26:25,173 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 14:26:35,186 INFO repeater task os75bb_lastensq starting 0.2 seconds late 2017-05-12 14:26:36,133 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:26:36,133 INFO repeater task os75bb_lastensq ended after 0.9 seconds 2017-05-12 14:26:36,133 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:26:25 2017-05-12 14:26:36,133 INFO repeater task os75nb_lastensq starting 1.1 seconds late 2017-05-12 14:26:37,079 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:26:37,079 INFO repeater task os75nb_lastensq ended after 0.9 seconds 2017-05-12 14:26:37,079 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:26:25 2017-05-12 14:27:32,226 INFO repeater task wh300_lastensq starting 1.2 seconds late 2017-05-12 14:27:33,617 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:27:33,617 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:27:33,617 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:27:21 2017-05-12 14:28:03,692 INFO repeater task wh300_10pings starting 1.5 seconds late 2017-05-12 14:28:03,780 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:28:03,781 INFO repeater task os75bb_10pings starting 1.6 seconds late 2017-05-12 14:28:03,857 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:28:03,858 INFO repeater task os75nb_10pings starting 1.7 seconds late 2017-05-12 14:28:03,940 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:29:34,180 INFO repeater task wh300_lastensq starting 3.2 seconds late 2017-05-12 14:29:35,573 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:29:35,573 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:29:35,573 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:29:21 2017-05-12 14:30:25,696 INFO repeater task wh300_10pings starting 3.5 seconds late 2017-05-12 14:30:25,786 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:31:25,950 INFO repeater task phins_hcorrstats starting 3.8 seconds late 2017-05-12 14:31:26,709 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:31:26,710 INFO repeater task phins2_hcorrstats starting 4.5 seconds late 2017-05-12 14:31:27,457 INFO repeater task phins2_hcorrstats ended after 0.7 seconds 2017-05-12 14:31:32,463 INFO repeater task wh300_lastensq starting 1.5 seconds late 2017-05-12 14:31:33,887 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:31:33,888 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:31:33,888 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:31:21 2017-05-12 14:31:38,898 INFO repeater task os75bb_lastensq starting 3.9 seconds late 2017-05-12 14:31:39,851 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:31:39,852 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:31:39,852 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:31:25 2017-05-12 14:31:39,852 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2017-05-12 14:31:40,825 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:31:40,825 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:31:40,825 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:31:25 2017-05-12 14:32:46,002 INFO repeater task wh300_10pings starting 3.8 seconds late 2017-05-12 14:32:46,088 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:33:26,194 INFO repeater task os75bb_10pings starting 4.0 seconds late 2017-05-12 14:33:26,294 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:33:26,294 INFO repeater task os75nb_10pings starting 4.1 seconds late 2017-05-12 14:33:26,377 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:33:31,383 INFO repeater task wh300_lastensq starting 0.4 seconds late 2017-05-12 14:33:32,800 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:33:32,800 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:33:32,800 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:33:21 2017-05-12 14:35:03,032 INFO repeater task wh300_10pings starting 0.9 seconds late 2017-05-12 14:35:03,117 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:35:33,196 INFO repeater task wh300_lastensq starting 2.2 seconds late 2017-05-12 14:35:34,605 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:35:34,605 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:35:34,605 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:35:21 2017-05-12 14:36:24,729 INFO repeater task wh300_quick starting 2.6 seconds late 2017-05-12 14:36:28,189 INFO repeater task wh300_quick ended after 3.5 seconds 2017-05-12 14:36:28,189 INFO repeater task wh300_3dayplots starting 6.0 seconds late 2017-05-12 14:36:33,954 INFO repeater task wh300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:36:33,954 INFO repeater task wh300_3dayplots ended after 5.8 seconds 2017-05-12 14:36:33,954 INFO repeater task wh300_tsstats starting 11.8 seconds late 2017-05-12 14:36:34,492 INFO repeater task wh300_tsstats ended after 0.5 seconds 2017-05-12 14:36:34,492 INFO repeater task os75bb_quick starting 12.3 seconds late 2017-05-12 14:36:37,230 INFO repeater task os75bb_quick ended after 2.7 seconds 2017-05-12 14:36:37,230 INFO repeater task os75bb_3dayplots starting 15.1 seconds late 2017-05-12 14:36:43,005 INFO repeater task os75bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:36:43,005 INFO repeater task os75bb_3dayplots ended after 5.8 seconds 2017-05-12 14:36:43,006 INFO repeater task os75bb_tsstats starting 20.8 seconds late 2017-05-12 14:36:43,502 INFO repeater task os75bb_tsstats ended after 0.5 seconds 2017-05-12 14:36:43,502 INFO repeater task os75nb_lastensq starting 8.5 seconds late 2017-05-12 14:36:44,477 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:36:44,477 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:36:44,477 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:36:25 2017-05-12 14:36:44,477 INFO repeater task os75nb_quick starting 22.3 seconds late 2017-05-12 14:36:47,200 INFO repeater task os75nb_quick ended after 2.7 seconds 2017-05-12 14:36:47,201 INFO repeater task os75nb_3dayplots starting 25.0 seconds late 2017-05-12 14:36:53,019 INFO repeater task os75nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:36:53,019 INFO repeater task os75nb_3dayplots ended after 5.8 seconds 2017-05-12 14:36:53,019 INFO repeater task os75nb_tsstats starting 30.9 seconds late 2017-05-12 14:36:53,497 INFO repeater task os75nb_tsstats ended after 0.5 seconds 2017-05-12 14:36:53,497 INFO repeater task wh300_beamplots starting 31.3 seconds late 2017-05-12 14:36:54,359 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:36:54,359 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 14:36:54,360 INFO repeater task wh300_beamplots starting 32.2 seconds late 2017-05-12 14:36:55,257 INFO repeater task wh300_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:36:55,257 INFO repeater task wh300_beamplots ended after 0.9 seconds 2017-05-12 14:36:55,257 INFO repeater task os75bb_beamplots starting 33.1 seconds late 2017-05-12 14:36:56,063 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:36:56,063 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 14:36:56,063 INFO repeater task os75bb_beamplots starting 33.9 seconds late 2017-05-12 14:36:56,854 INFO repeater task os75bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:36:56,854 INFO repeater task os75bb_beamplots ended after 0.8 seconds 2017-05-12 14:36:56,854 INFO repeater task os75nb_beamplots starting 34.7 seconds late 2017-05-12 14:36:57,627 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:36:57,627 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 14:36:57,628 INFO repeater task os75nb_beamplots starting 35.5 seconds late 2017-05-12 14:36:58,407 INFO repeater task os75nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-05-12 14:36:58,407 INFO repeater task os75nb_beamplots ended after 0.8 seconds 2017-05-12 14:36:58,408 INFO repeater task phins_hcorrstats starting 36.2 seconds late 2017-05-12 14:36:59,159 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:36:59,160 INFO repeater task phins2_hcorrstats starting 37.0 seconds late 2017-05-12 14:36:59,926 INFO repeater task phins2_hcorrstats ended after 0.8 seconds 2017-05-12 14:37:04,932 INFO repeater task os75bb_lastensq starting 29.9 seconds late 2017-05-12 14:37:05,917 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:37:05,917 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:37:05,917 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:36:25 2017-05-12 14:37:25,965 INFO repeater task wh300_10pings starting 3.8 seconds late 2017-05-12 14:37:26,059 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:37:31,066 INFO repeater task wh300_lastensq starting 0.1 seconds late 2017-05-12 14:37:32,491 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:37:32,491 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:37:32,492 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:37:21 2017-05-12 14:38:42,679 INFO repeater task os75bb_10pings starting 0.5 seconds late 2017-05-12 14:38:42,758 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:38:42,759 INFO repeater task os75nb_10pings starting 0.6 seconds late 2017-05-12 14:38:42,841 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:39:32,960 INFO repeater task wh300_lastensq starting 2.0 seconds late 2017-05-12 14:39:34,370 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:39:34,370 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:39:34,370 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:39:21 2017-05-12 14:39:44,393 INFO repeater task wh300_10pings starting 2.2 seconds late 2017-05-12 14:39:44,484 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:41:24,764 INFO repeater task phins_hcorrstats starting 2.6 seconds late 2017-05-12 14:41:25,515 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:41:25,516 INFO repeater task phins2_hcorrstats starting 3.4 seconds late 2017-05-12 14:41:26,290 INFO repeater task phins2_hcorrstats ended after 0.8 seconds 2017-05-12 14:41:31,296 INFO repeater task wh300_lastensq starting 0.3 seconds late 2017-05-12 14:41:32,705 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:41:32,706 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:41:32,706 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:41:21 2017-05-12 14:41:37,716 INFO repeater task os75bb_lastensq starting 2.7 seconds late 2017-05-12 14:41:38,732 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:41:38,732 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:41:38,732 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:41:25 2017-05-12 14:41:38,733 INFO repeater task os75nb_lastensq starting 3.7 seconds late 2017-05-12 14:41:39,700 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:41:39,701 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:41:39,701 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:41:25 2017-05-12 14:42:04,752 INFO repeater task wh300_10pings starting 2.6 seconds late 2017-05-12 14:42:04,827 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:43:35,070 INFO repeater task wh300_lastensq starting 4.1 seconds late 2017-05-12 14:43:36,505 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:43:36,505 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:43:36,505 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:43:21 2017-05-12 14:44:06,582 INFO repeater task os75bb_10pings starting 4.4 seconds late 2017-05-12 14:44:06,668 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:44:06,669 INFO repeater task os75nb_10pings starting 4.5 seconds late 2017-05-12 14:44:06,744 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:44:26,794 INFO repeater task wh300_10pings starting 4.6 seconds late 2017-05-12 14:44:26,888 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:45:32,061 INFO repeater task wh300_lastensq starting 1.1 seconds late 2017-05-12 14:45:33,487 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:45:33,487 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:45:33,488 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:45:21 2017-05-12 14:46:23,625 INFO repeater task phins_hcorrstats starting 1.5 seconds late 2017-05-12 14:46:24,409 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2017-05-12 14:46:24,409 INFO repeater task phins2_hcorrstats starting 2.2 seconds late 2017-05-12 14:46:25,165 INFO repeater task phins2_hcorrstats ended after 0.8 seconds 2017-05-12 14:46:35,187 INFO repeater task os75bb_lastensq starting 0.2 seconds late 2017-05-12 14:46:36,164 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:46:36,164 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:46:36,164 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:46:25 2017-05-12 14:46:36,165 INFO repeater task os75nb_lastensq starting 1.2 seconds late 2017-05-12 14:46:37,152 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:46:37,152 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2017-05-12 14:46:37,152 INFO repeater task os75nb_lastensq: Time from /home/data/AT37_12/proc/os75nb/load/wrote_ens_time: 2017/05/12 14:46:25 2017-05-12 14:46:42,160 INFO repeater task wh300_10pings starting 0.0 seconds late 2017-05-12 14:46:42,251 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:47:32,381 INFO repeater task wh300_lastensq starting 1.4 seconds late 2017-05-12 14:47:33,790 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:47:33,790 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:47:33,790 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:47:21 2017-05-12 14:49:04,029 INFO repeater task wh300_10pings starting 1.9 seconds late 2017-05-12 14:49:04,127 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:49:24,171 INFO repeater task os75bb_10pings starting 2.0 seconds late 2017-05-12 14:49:24,262 INFO repeater task os75bb_10pings ended after 0.1 seconds 2017-05-12 14:49:24,263 INFO repeater task os75nb_10pings starting 2.1 seconds late 2017-05-12 14:49:24,349 INFO repeater task os75nb_10pings ended after 0.1 seconds 2017-05-12 14:49:34,363 INFO repeater task wh300_lastensq starting 3.4 seconds late 2017-05-12 14:49:35,777 INFO repeater task wh300_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:49:35,777 INFO repeater task wh300_lastensq ended after 1.4 seconds 2017-05-12 14:49:35,777 INFO repeater task wh300_lastensq: Time from /home/data/AT37_12/proc/wh300/load/wrote_ens_time: 2017/05/12 14:49:21 2017-05-12 14:51:26,085 INFO repeater task wh300_10pings starting 3.9 seconds late 2017-05-12 14:51:26,178 INFO repeater task wh300_10pings ended after 0.1 seconds 2017-05-12 14:51:26,178 INFO repeater task wh300_quick starting 4.0 seconds late 2017-05-12 14:51:29,625 INFO repeater task wh300_quick ended after 3.4 seconds 2017-05-12 14:51:29,626 INFO repeater task wh300_3dayplots starting 7.5 seconds late 2017-05-12 14:51:36,052 INFO repeater task wh300_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:51:36,052 INFO repeater task wh300_3dayplots ended after 6.4 seconds 2017-05-12 14:51:36,052 INFO repeater task wh300_tsstats starting 13.9 seconds late 2017-05-12 14:51:36,589 INFO repeater task wh300_tsstats ended after 0.5 seconds 2017-05-12 14:51:36,590 INFO repeater task os75bb_lastensq starting 1.6 seconds late 2017-05-12 14:51:37,574 INFO repeater task os75bb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning) 2017-05-12 14:51:37,574 INFO repeater task os75bb_lastensq ended after 1.0 seconds 2017-05-12 14:51:37,574 INFO repeater task os75bb_lastensq: Time from /home/data/AT37_12/proc/os75bb/load/wrote_ens_time: 2017/05/12 14:51:25 2017-05-12 14:51:37,575 INFO repeater task os75bb_quick starting 15.4 seconds late 2017-05-12 14:51:40,341 INFO repeater task os75bb_quick ended after 2.8 seconds 2017-05-12 14:51:40,342 INFO repeater task os75bb_3dayplots starting 18.2 seconds late 2017-05-12 14:51:46,111 INFO repeater task os75bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-05-12 14:51:46,112 INFO repeater task os75bb_3dayplots ended after 5.8 seconds 2017-05-12 14:51:46,112 INFO repeater task os75bb_tsstats starting 24.0 seconds late 2017-05-12 14:51:46,612 INFO repeater task os75bb_tsstats ended after 0.5 seconds 2017-05-12 14:51:46,612 INFO repeater task os75nb_lastensq starting 11.6 seconds late 2017-05-12 14:51:47,618 INFO repeater task os75nb_lastensq output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:79: RuntimeWarning: Degrees of freedom <= 0 for slice warnings.warn("Degrees of freedom <= 0 for slice", RuntimeWarning)