2015-03-23 16:29:12,026 INFO repeater task os150nb_tsstats starting 12.4 seconds late 2015-03-23 16:29:12,509 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 16:29:12,509 INFO repeater task os150bb_beamplots starting 12.9 seconds late 2015-03-23 16:29:13,393 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:29:13,393 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 16:29:13,393 INFO repeater task os150bb_beamplots starting 13.8 seconds late 2015-03-23 16:29:14,270 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:29:14,270 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 16:29:14,270 INFO repeater task os150nb_beamplots starting 14.6 seconds late 2015-03-23 16:29:15,158 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:29:15,158 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 16:29:15,158 INFO repeater task os150nb_beamplots starting 15.5 seconds late 2015-03-23 16:29:16,043 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:29:16,043 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 16:29:16,043 INFO repeater task posmv_hcorrstats starting 16.4 seconds late 2015-03-23 16:29:16,640 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 16:29:16,640 INFO repeater task posmv_plotposmv starting 17.0 seconds late 2015-03-23 16:29:17,232 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 16:30:52,455 INFO repeater task os150bb_lastensq starting 0.5 seconds late 2015-03-23 16:30:53,885 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 16:30:53,886 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 16:30:42 2015-03-23 16:30:53,886 INFO repeater task os150nb_lastensq starting 1.9 seconds late 2015-03-23 16:30:54,988 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 16:30:54,988 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 16:30:42 2015-03-23 16:32:00,108 INFO repeater task os150bb_10pings starting 0.5 seconds late 2015-03-23 16:32:00,212 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 16:32:00,213 INFO repeater task os150nb_10pings starting 0.6 seconds late 2015-03-23 16:32:00,307 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 16:34:00,554 INFO repeater task posmv_hcorrstats starting 0.9 seconds late 2015-03-23 16:34:01,175 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 16:34:01,175 INFO repeater task posmv_plotposmv starting 1.5 seconds late 2015-03-23 16:34:01,780 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 16:35:52,033 INFO repeater task os150bb_lastensq starting 0.0 seconds late 2015-03-23 16:35:53,430 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 16:35:53,431 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 16:35:42 2015-03-23 16:35:53,431 INFO repeater task os150nb_lastensq starting 1.4 seconds late 2015-03-23 16:35:54,514 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 16:35:54,514 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 16:35:42 2015-03-23 16:37:19,692 INFO repeater task os150bb_10pings starting 0.1 seconds late 2015-03-23 16:37:19,810 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 16:37:19,811 INFO repeater task os150nb_10pings starting 0.2 seconds late 2015-03-23 16:37:19,904 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 16:39:00,140 INFO repeater task posmv_hcorrstats starting 0.5 seconds late 2015-03-23 16:39:00,750 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 16:39:00,751 INFO repeater task posmv_plotposmv starting 1.1 seconds late 2015-03-23 16:39:01,372 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 16:40:56,547 INFO repeater task os150bb_lastensq starting 4.5 seconds late 2015-03-23 16:40:57,926 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 16:40:57,927 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 16:40:42 2015-03-23 16:40:57,927 INFO repeater task os150nb_lastensq starting 5.9 seconds late 2015-03-23 16:40:59,018 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 16:40:59,018 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 16:40:42 2015-03-23 16:42:44,262 INFO repeater task os150bb_10pings starting 4.6 seconds late 2015-03-23 16:42:44,364 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 16:42:44,365 INFO repeater task os150nb_10pings starting 4.7 seconds late 2015-03-23 16:42:44,453 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 16:43:59,626 INFO repeater task os150bb_quick starting 0.0 seconds late 2015-03-23 16:44:01,228 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 16:44:01,228 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 16:44:01,228 INFO repeater task os150bb_3dayplots starting 1.6 seconds late 2015-03-23 16:44:03,675 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 16:44:03,676 INFO repeater task os150bb_3dayplots ended after 2.4 seconds 2015-03-23 16:44:03,676 INFO repeater task os150bb_tsstats starting 4.1 seconds late 2015-03-23 16:44:04,153 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 16:44:04,154 INFO repeater task os150nb_quick starting 4.5 seconds late 2015-03-23 16:44:05,740 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 16:44:05,740 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 16:44:05,740 INFO repeater task os150nb_3dayplots starting 6.1 seconds late 2015-03-23 16:44:08,212 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 16:44:08,213 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 16:44:08,213 INFO repeater task os150nb_tsstats starting 8.6 seconds late 2015-03-23 16:44:08,694 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 16:44:08,694 INFO repeater task os150bb_beamplots starting 9.1 seconds late 2015-03-23 16:44:09,565 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:44:09,565 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 16:44:09,565 INFO repeater task os150bb_beamplots starting 9.9 seconds late 2015-03-23 16:44:10,429 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:44:10,429 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 16:44:10,429 INFO repeater task os150nb_beamplots starting 10.8 seconds late 2015-03-23 16:44:11,288 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:44:11,288 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 16:44:11,288 INFO repeater task os150nb_beamplots starting 11.7 seconds late 2015-03-23 16:44:12,215 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:44:12,215 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 16:44:12,215 INFO repeater task posmv_hcorrstats starting 12.6 seconds late 2015-03-23 16:44:12,807 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 16:44:12,807 INFO repeater task posmv_plotposmv starting 13.2 seconds late 2015-03-23 16:44:13,407 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 16:45:53,639 INFO repeater task os150bb_lastensq starting 1.6 seconds late 2015-03-23 16:45:55,082 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 16:45:55,082 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 16:45:42 2015-03-23 16:45:55,083 INFO repeater task os150nb_lastensq starting 3.1 seconds late 2015-03-23 16:45:56,189 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 16:45:56,189 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 16:45:42 2015-03-23 16:48:01,476 INFO repeater task os150bb_10pings starting 1.9 seconds late 2015-03-23 16:48:01,578 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 16:48:01,579 INFO repeater task os150nb_10pings starting 2.0 seconds late 2015-03-23 16:48:01,676 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 16:49:01,824 INFO repeater task posmv_hcorrstats starting 2.2 seconds late 2015-03-23 16:49:02,431 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 16:49:02,431 INFO repeater task posmv_plotposmv starting 2.8 seconds late 2015-03-23 16:49:03,033 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 16:50:53,282 INFO repeater task os150bb_lastensq starting 1.3 seconds late 2015-03-23 16:50:54,728 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 16:50:54,728 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 16:50:42 2015-03-23 16:50:54,729 INFO repeater task os150nb_lastensq starting 2.7 seconds late 2015-03-23 16:50:55,840 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 16:50:55,840 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 16:50:42 2015-03-23 16:53:21,188 INFO repeater task os150bb_10pings starting 1.6 seconds late 2015-03-23 16:53:21,286 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 16:53:21,287 INFO repeater task os150nb_10pings starting 1.7 seconds late 2015-03-23 16:53:21,380 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 16:54:01,468 INFO repeater task posmv_hcorrstats starting 1.8 seconds late 2015-03-23 16:54:02,053 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 16:54:02,053 INFO repeater task posmv_plotposmv starting 2.4 seconds late 2015-03-23 16:54:02,635 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 16:55:52,897 INFO repeater task os150bb_lastensq starting 0.9 seconds late 2015-03-23 16:55:54,308 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 16:55:54,308 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 16:55:42 2015-03-23 16:55:54,309 INFO repeater task os150nb_lastensq starting 2.3 seconds late 2015-03-23 16:55:55,400 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 16:55:55,401 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 16:55:42 2015-03-23 16:58:40,755 INFO repeater task os150bb_10pings starting 1.1 seconds late 2015-03-23 16:58:40,861 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 16:58:40,862 INFO repeater task os150nb_10pings starting 1.2 seconds late 2015-03-23 16:58:40,955 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 16:59:00,997 INFO repeater task os150bb_quick starting 1.4 seconds late 2015-03-23 16:59:02,542 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 16:59:02,542 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-23 16:59:02,543 INFO repeater task os150bb_3dayplots starting 2.9 seconds late 2015-03-23 16:59:04,961 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 16:59:04,961 INFO repeater task os150bb_3dayplots ended after 2.4 seconds 2015-03-23 16:59:04,961 INFO repeater task os150bb_tsstats starting 5.3 seconds late 2015-03-23 16:59:05,432 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 16:59:05,432 INFO repeater task os150nb_quick starting 5.8 seconds late 2015-03-23 16:59:07,007 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 16:59:07,007 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 16:59:07,008 INFO repeater task os150nb_3dayplots starting 7.4 seconds late 2015-03-23 16:59:09,547 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 16:59:09,547 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 16:59:09,548 INFO repeater task os150nb_tsstats starting 9.9 seconds late 2015-03-23 16:59:10,022 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 16:59:10,022 INFO repeater task os150bb_beamplots starting 10.4 seconds late 2015-03-23 16:59:10,915 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:59:10,916 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 16:59:10,916 INFO repeater task os150bb_beamplots starting 11.3 seconds late 2015-03-23 16:59:11,810 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:59:11,810 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 16:59:11,810 INFO repeater task os150nb_beamplots starting 12.2 seconds late 2015-03-23 16:59:12,691 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:59:12,691 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 16:59:12,691 INFO repeater task os150nb_beamplots starting 13.1 seconds late 2015-03-23 16:59:13,580 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 16:59:13,580 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 16:59:13,580 INFO repeater task posmv_hcorrstats starting 14.0 seconds late 2015-03-23 16:59:14,183 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 16:59:14,183 INFO repeater task posmv_plotposmv starting 14.6 seconds late 2015-03-23 16:59:14,792 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:00:55,030 INFO repeater task os150bb_lastensq starting 3.0 seconds late 2015-03-23 17:00:56,424 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:00:56,424 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:00:42 2015-03-23 17:00:56,425 INFO repeater task os150nb_lastensq starting 4.4 seconds late 2015-03-23 17:00:57,509 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:00:57,509 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:00:42 2015-03-23 17:04:02,944 INFO repeater task os150bb_10pings starting 3.3 seconds late 2015-03-23 17:04:03,041 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:04:03,042 INFO repeater task os150nb_10pings starting 3.4 seconds late 2015-03-23 17:04:03,138 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:04:03,140 INFO repeater task posmv_hcorrstats starting 3.5 seconds late 2015-03-23 17:04:03,753 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:04:03,753 INFO repeater task posmv_plotposmv starting 4.1 seconds late 2015-03-23 17:04:04,362 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:05:54,617 INFO repeater task os150bb_lastensq starting 2.6 seconds late 2015-03-23 17:05:56,044 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:05:56,045 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:05:42 2015-03-23 17:05:56,045 INFO repeater task os150nb_lastensq starting 4.0 seconds late 2015-03-23 17:05:57,146 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:05:57,146 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:05:42 2015-03-23 17:09:02,550 INFO repeater task posmv_hcorrstats starting 2.9 seconds late 2015-03-23 17:09:03,143 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:09:03,144 INFO repeater task posmv_plotposmv starting 3.5 seconds late 2015-03-23 17:09:03,723 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:09:23,765 INFO repeater task os150bb_10pings starting 4.1 seconds late 2015-03-23 17:09:23,868 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:09:23,869 INFO repeater task os150nb_10pings starting 4.2 seconds late 2015-03-23 17:09:23,962 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:10:54,172 INFO repeater task os150bb_lastensq starting 2.2 seconds late 2015-03-23 17:10:55,588 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:10:55,588 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:10:42 2015-03-23 17:10:55,589 INFO repeater task os150nb_lastensq starting 3.6 seconds late 2015-03-23 17:10:56,696 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:10:56,697 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:10:42 2015-03-23 17:14:02,127 INFO repeater task os150bb_quick starting 2.5 seconds late 2015-03-23 17:14:03,698 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:14:03,698 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 17:14:03,698 INFO repeater task os150bb_3dayplots starting 4.1 seconds late 2015-03-23 17:14:06,211 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:14:06,211 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 17:14:06,212 INFO repeater task os150bb_tsstats starting 6.6 seconds late 2015-03-23 17:14:06,690 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 17:14:06,690 INFO repeater task os150nb_quick starting 7.1 seconds late 2015-03-23 17:14:08,219 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:14:08,219 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-23 17:14:08,219 INFO repeater task os150nb_3dayplots starting 8.6 seconds late 2015-03-23 17:14:10,638 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:14:10,639 INFO repeater task os150nb_3dayplots ended after 2.4 seconds 2015-03-23 17:14:10,639 INFO repeater task os150nb_tsstats starting 11.0 seconds late 2015-03-23 17:14:11,108 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 17:14:11,108 INFO repeater task os150bb_beamplots starting 11.5 seconds late 2015-03-23 17:14:12,018 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:14:12,018 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 17:14:12,019 INFO repeater task os150bb_beamplots starting 12.4 seconds late 2015-03-23 17:14:12,875 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:14:12,875 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 17:14:12,875 INFO repeater task os150nb_beamplots starting 13.2 seconds late 2015-03-23 17:14:13,731 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:14:13,732 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 17:14:13,732 INFO repeater task os150nb_beamplots starting 14.1 seconds late 2015-03-23 17:14:14,589 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:14:14,589 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 17:14:14,589 INFO repeater task posmv_hcorrstats starting 15.0 seconds late 2015-03-23 17:14:15,201 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:14:15,201 INFO repeater task posmv_plotposmv starting 15.6 seconds late 2015-03-23 17:14:15,803 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:14:40,858 INFO repeater task os150bb_10pings starting 1.2 seconds late 2015-03-23 17:14:40,959 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:14:40,959 INFO repeater task os150nb_10pings starting 1.3 seconds late 2015-03-23 17:14:41,048 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:15:56,218 INFO repeater task os150bb_lastensq starting 4.2 seconds late 2015-03-23 17:15:57,669 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-23 17:15:57,669 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:15:42 2015-03-23 17:15:57,670 INFO repeater task os150nb_lastensq starting 5.7 seconds late 2015-03-23 17:15:58,814 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:15:58,814 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:15:42 2015-03-23 17:19:04,227 INFO repeater task posmv_hcorrstats starting 4.6 seconds late 2015-03-23 17:19:04,837 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:19:04,837 INFO repeater task posmv_plotposmv starting 5.2 seconds late 2015-03-23 17:19:05,451 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:20:00,578 INFO repeater task os150bb_10pings starting 1.0 seconds late 2015-03-23 17:20:00,689 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:20:00,690 INFO repeater task os150nb_10pings starting 1.1 seconds late 2015-03-23 17:20:00,785 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:20:55,910 INFO repeater task os150bb_lastensq starting 3.9 seconds late 2015-03-23 17:20:57,294 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:20:57,294 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:20:42 2015-03-23 17:20:57,295 INFO repeater task os150nb_lastensq starting 5.3 seconds late 2015-03-23 17:20:58,372 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:20:58,372 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:20:42 2015-03-23 17:24:03,834 INFO repeater task posmv_hcorrstats starting 4.2 seconds late 2015-03-23 17:24:04,448 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:24:04,448 INFO repeater task posmv_plotposmv starting 4.8 seconds late 2015-03-23 17:24:05,058 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:25:20,230 INFO repeater task os150bb_10pings starting 0.6 seconds late 2015-03-23 17:25:20,329 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:25:20,330 INFO repeater task os150nb_10pings starting 0.7 seconds late 2015-03-23 17:25:20,428 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:25:55,510 INFO repeater task os150bb_lastensq starting 3.5 seconds late 2015-03-23 17:25:56,990 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-23 17:25:56,990 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:25:42 2015-03-23 17:25:56,991 INFO repeater task os150nb_lastensq starting 5.0 seconds late 2015-03-23 17:25:58,100 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:25:58,100 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:25:42 2015-03-23 17:29:03,546 INFO repeater task os150bb_quick starting 3.9 seconds late 2015-03-23 17:29:05,124 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:29:05,124 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 17:29:05,125 INFO repeater task os150bb_3dayplots starting 5.5 seconds late 2015-03-23 17:29:07,627 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:29:07,627 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 17:29:07,627 INFO repeater task os150bb_tsstats starting 8.0 seconds late 2015-03-23 17:29:08,099 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 17:29:08,099 INFO repeater task os150nb_quick starting 8.5 seconds late 2015-03-23 17:29:09,680 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:29:09,680 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 17:29:09,680 INFO repeater task os150nb_3dayplots starting 10.1 seconds late 2015-03-23 17:29:12,211 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:29:12,212 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 17:29:12,212 INFO repeater task os150nb_tsstats starting 12.6 seconds late 2015-03-23 17:29:12,687 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 17:29:12,687 INFO repeater task os150bb_beamplots starting 13.1 seconds late 2015-03-23 17:29:13,574 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:29:13,574 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 17:29:13,575 INFO repeater task os150bb_beamplots starting 13.9 seconds late 2015-03-23 17:29:14,483 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:29:14,483 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 17:29:14,483 INFO repeater task os150nb_beamplots starting 14.9 seconds late 2015-03-23 17:29:15,350 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:29:15,351 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 17:29:15,351 INFO repeater task os150nb_beamplots starting 15.7 seconds late 2015-03-23 17:29:16,235 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:29:16,235 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 17:29:16,235 INFO repeater task posmv_hcorrstats starting 16.6 seconds late 2015-03-23 17:29:16,832 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:29:16,832 INFO repeater task posmv_plotposmv starting 17.2 seconds late 2015-03-23 17:29:17,420 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:30:42,630 INFO repeater task os150bb_10pings starting 3.0 seconds late 2015-03-23 17:30:42,736 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:30:42,737 INFO repeater task os150nb_10pings starting 3.1 seconds late 2015-03-23 17:30:42,828 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:30:52,848 INFO repeater task os150bb_lastensq starting 0.8 seconds late 2015-03-23 17:30:54,247 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:30:54,248 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:30:42 2015-03-23 17:30:54,248 INFO repeater task os150nb_lastensq starting 2.2 seconds late 2015-03-23 17:30:55,359 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:30:55,360 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:30:42 2015-03-23 17:34:00,795 INFO repeater task posmv_hcorrstats starting 1.2 seconds late 2015-03-23 17:34:01,382 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:34:01,382 INFO repeater task posmv_plotposmv starting 1.8 seconds late 2015-03-23 17:34:02,013 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:35:52,276 INFO repeater task os150bb_lastensq starting 0.3 seconds late 2015-03-23 17:35:53,688 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:35:53,688 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:35:42 2015-03-23 17:35:53,689 INFO repeater task os150nb_lastensq starting 1.7 seconds late 2015-03-23 17:35:54,768 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:35:54,769 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:35:42 2015-03-23 17:35:59,776 INFO repeater task os150bb_10pings starting 0.2 seconds late 2015-03-23 17:35:59,882 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:35:59,883 INFO repeater task os150nb_10pings starting 0.3 seconds late 2015-03-23 17:35:59,977 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:39:00,408 INFO repeater task posmv_hcorrstats starting 0.8 seconds late 2015-03-23 17:39:00,994 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:39:00,994 INFO repeater task posmv_plotposmv starting 1.4 seconds late 2015-03-23 17:39:01,597 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:40:56,846 INFO repeater task os150bb_lastensq starting 4.8 seconds late 2015-03-23 17:40:58,239 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:40:58,240 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:40:42 2015-03-23 17:40:58,240 INFO repeater task os150nb_lastensq starting 6.2 seconds late 2015-03-23 17:40:59,335 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:40:59,335 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:40:42 2015-03-23 17:41:24,387 INFO repeater task os150bb_10pings starting 4.8 seconds late 2015-03-23 17:41:24,485 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:41:24,486 INFO repeater task os150nb_10pings starting 4.9 seconds late 2015-03-23 17:41:24,579 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:43:59,904 INFO repeater task os150bb_quick starting 0.3 seconds late 2015-03-23 17:44:01,478 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:44:01,478 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 17:44:01,478 INFO repeater task os150bb_3dayplots starting 1.9 seconds late 2015-03-23 17:44:03,987 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:44:03,988 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 17:44:03,988 INFO repeater task os150bb_tsstats starting 4.4 seconds late 2015-03-23 17:44:04,465 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 17:44:04,466 INFO repeater task os150nb_quick starting 4.8 seconds late 2015-03-23 17:44:06,057 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:44:06,057 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 17:44:06,057 INFO repeater task os150nb_3dayplots starting 6.4 seconds late 2015-03-23 17:44:08,539 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:44:08,540 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 17:44:08,540 INFO repeater task os150nb_tsstats starting 8.9 seconds late 2015-03-23 17:44:09,017 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 17:44:09,017 INFO repeater task os150bb_beamplots starting 9.4 seconds late 2015-03-23 17:44:09,878 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:44:09,878 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 17:44:09,878 INFO repeater task os150bb_beamplots starting 10.3 seconds late 2015-03-23 17:44:10,822 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:44:10,822 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 17:44:10,822 INFO repeater task os150nb_beamplots starting 11.2 seconds late 2015-03-23 17:44:11,664 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:44:11,664 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-23 17:44:11,665 INFO repeater task os150nb_beamplots starting 12.0 seconds late 2015-03-23 17:44:12,536 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:44:12,537 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 17:44:12,537 INFO repeater task posmv_hcorrstats starting 12.9 seconds late 2015-03-23 17:44:13,140 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:44:13,140 INFO repeater task posmv_plotposmv starting 13.5 seconds late 2015-03-23 17:44:13,733 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:45:53,974 INFO repeater task os150bb_lastensq starting 2.0 seconds late 2015-03-23 17:45:55,379 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:45:55,379 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:45:42 2015-03-23 17:45:55,380 INFO repeater task os150nb_lastensq starting 3.4 seconds late 2015-03-23 17:45:56,475 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:45:56,475 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:45:42 2015-03-23 17:46:41,575 INFO repeater task os150bb_10pings starting 2.0 seconds late 2015-03-23 17:46:41,676 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:46:41,677 INFO repeater task os150nb_10pings starting 2.1 seconds late 2015-03-23 17:46:41,771 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:49:02,103 INFO repeater task posmv_hcorrstats starting 2.5 seconds late 2015-03-23 17:49:02,713 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:49:02,714 INFO repeater task posmv_plotposmv starting 3.1 seconds late 2015-03-23 17:49:03,330 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:50:53,587 INFO repeater task os150bb_lastensq starting 1.6 seconds late 2015-03-23 17:50:55,032 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 17:50:55,033 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:50:42 2015-03-23 17:50:55,033 INFO repeater task os150nb_lastensq starting 3.0 seconds late 2015-03-23 17:50:56,156 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:50:56,156 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:50:42 2015-03-23 17:52:01,251 INFO repeater task os150bb_10pings starting 1.6 seconds late 2015-03-23 17:52:01,347 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:52:01,348 INFO repeater task os150nb_10pings starting 1.7 seconds late 2015-03-23 17:52:01,447 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:54:01,659 INFO repeater task posmv_hcorrstats starting 2.0 seconds late 2015-03-23 17:54:02,246 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:54:02,247 INFO repeater task posmv_plotposmv starting 2.6 seconds late 2015-03-23 17:54:02,860 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 17:55:53,094 INFO repeater task os150bb_lastensq starting 1.1 seconds late 2015-03-23 17:55:54,586 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-23 17:55:54,587 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 17:55:42 2015-03-23 17:55:54,587 INFO repeater task os150nb_lastensq starting 2.6 seconds late 2015-03-23 17:55:55,695 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 17:55:55,695 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 17:55:42 2015-03-23 17:57:20,894 INFO repeater task os150bb_10pings starting 1.3 seconds late 2015-03-23 17:57:20,997 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 17:57:20,998 INFO repeater task os150nb_10pings starting 1.4 seconds late 2015-03-23 17:57:21,096 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 17:59:01,321 INFO repeater task os150bb_quick starting 1.7 seconds late 2015-03-23 17:59:02,890 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:59:02,890 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 17:59:02,891 INFO repeater task os150bb_3dayplots starting 3.3 seconds late 2015-03-23 17:59:05,395 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:59:05,395 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 17:59:05,396 INFO repeater task os150bb_tsstats starting 5.8 seconds late 2015-03-23 17:59:05,883 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 17:59:05,884 INFO repeater task os150nb_quick starting 6.3 seconds late 2015-03-23 17:59:07,402 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 17:59:07,402 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-23 17:59:07,402 INFO repeater task os150nb_3dayplots starting 7.8 seconds late 2015-03-23 17:59:09,844 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 17:59:09,844 INFO repeater task os150nb_3dayplots ended after 2.4 seconds 2015-03-23 17:59:09,845 INFO repeater task os150nb_tsstats starting 10.2 seconds late 2015-03-23 17:59:10,312 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 17:59:10,312 INFO repeater task os150bb_beamplots starting 10.7 seconds late 2015-03-23 17:59:11,159 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:59:11,159 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-23 17:59:11,160 INFO repeater task os150bb_beamplots starting 11.5 seconds late 2015-03-23 17:59:12,024 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:59:12,024 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 17:59:12,024 INFO repeater task os150nb_beamplots starting 12.4 seconds late 2015-03-23 17:59:12,948 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:59:12,948 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 17:59:12,948 INFO repeater task os150nb_beamplots starting 13.3 seconds late 2015-03-23 17:59:13,804 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 17:59:13,804 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 17:59:13,804 INFO repeater task posmv_hcorrstats starting 14.2 seconds late 2015-03-23 17:59:14,408 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 17:59:14,409 INFO repeater task posmv_plotposmv starting 14.8 seconds late 2015-03-23 17:59:15,001 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:00:55,229 INFO repeater task os150bb_lastensq starting 3.2 seconds late 2015-03-23 18:00:56,652 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:00:56,653 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:00:42 2015-03-23 18:00:56,653 INFO repeater task os150nb_lastensq starting 4.7 seconds late 2015-03-23 18:00:57,754 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:00:57,754 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:00:42 2015-03-23 18:02:43,007 INFO repeater task os150bb_10pings starting 3.4 seconds late 2015-03-23 18:02:43,115 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:02:43,116 INFO repeater task os150nb_10pings starting 3.5 seconds late 2015-03-23 18:02:43,217 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:04:03,439 INFO repeater task posmv_hcorrstats starting 3.8 seconds late 2015-03-23 18:04:04,070 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:04:04,070 INFO repeater task posmv_plotposmv starting 4.4 seconds late 2015-03-23 18:04:04,664 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:05:54,917 INFO repeater task os150bb_lastensq starting 2.9 seconds late 2015-03-23 18:05:56,298 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:05:56,298 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:05:42 2015-03-23 18:05:56,299 INFO repeater task os150nb_lastensq starting 4.3 seconds late 2015-03-23 18:05:57,395 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:05:57,396 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:05:42 2015-03-23 18:08:02,689 INFO repeater task os150bb_10pings starting 3.1 seconds late 2015-03-23 18:08:02,792 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:08:02,793 INFO repeater task os150nb_10pings starting 3.2 seconds late 2015-03-23 18:08:02,889 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:09:03,028 INFO repeater task posmv_hcorrstats starting 3.4 seconds late 2015-03-23 18:09:03,645 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:09:03,645 INFO repeater task posmv_plotposmv starting 4.0 seconds late 2015-03-23 18:09:04,263 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:10:54,512 INFO repeater task os150bb_lastensq starting 2.5 seconds late 2015-03-23 18:10:55,922 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:10:55,922 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:10:42 2015-03-23 18:10:55,923 INFO repeater task os150nb_lastensq starting 3.9 seconds late 2015-03-23 18:10:57,000 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:10:57,000 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:10:42 2015-03-23 18:13:22,337 INFO repeater task os150bb_10pings starting 2.7 seconds late 2015-03-23 18:13:22,444 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:13:22,445 INFO repeater task os150nb_10pings starting 2.8 seconds late 2015-03-23 18:13:22,536 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:14:02,622 INFO repeater task os150bb_quick starting 3.0 seconds late 2015-03-23 18:14:04,186 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:14:04,187 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 18:14:04,187 INFO repeater task os150bb_3dayplots starting 4.6 seconds late 2015-03-23 18:14:06,597 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:14:06,597 INFO repeater task os150bb_3dayplots ended after 2.4 seconds 2015-03-23 18:14:06,597 INFO repeater task os150bb_tsstats starting 7.0 seconds late 2015-03-23 18:14:07,061 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 18:14:07,062 INFO repeater task os150nb_quick starting 7.4 seconds late 2015-03-23 18:14:08,616 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:14:08,616 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 18:14:08,616 INFO repeater task os150nb_3dayplots starting 9.0 seconds late 2015-03-23 18:14:11,076 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:14:11,077 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 18:14:11,077 INFO repeater task os150nb_tsstats starting 11.5 seconds late 2015-03-23 18:14:11,539 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 18:14:11,539 INFO repeater task os150bb_beamplots starting 11.9 seconds late 2015-03-23 18:14:12,392 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:14:12,392 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 18:14:12,392 INFO repeater task os150bb_beamplots starting 12.8 seconds late 2015-03-23 18:14:13,249 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:14:13,249 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 18:14:13,250 INFO repeater task os150nb_beamplots starting 13.6 seconds late 2015-03-23 18:14:14,095 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:14:14,095 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-23 18:14:14,096 INFO repeater task os150nb_beamplots starting 14.5 seconds late 2015-03-23 18:14:14,994 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:14:14,994 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 18:14:14,995 INFO repeater task posmv_hcorrstats starting 15.4 seconds late 2015-03-23 18:14:15,594 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:14:15,595 INFO repeater task posmv_plotposmv starting 16.0 seconds late 2015-03-23 18:14:16,180 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:15:56,381 INFO repeater task os150bb_lastensq starting 4.4 seconds late 2015-03-23 18:15:57,761 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:15:57,762 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:15:42 2015-03-23 18:15:57,763 INFO repeater task os150nb_lastensq starting 5.8 seconds late 2015-03-23 18:15:58,871 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:15:58,872 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:15:42 2015-03-23 18:18:44,261 INFO repeater task os150bb_10pings starting 4.6 seconds late 2015-03-23 18:18:44,366 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:18:44,367 INFO repeater task os150nb_10pings starting 4.7 seconds late 2015-03-23 18:18:44,462 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:19:04,508 INFO repeater task posmv_hcorrstats starting 4.9 seconds late 2015-03-23 18:19:05,120 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:19:05,120 INFO repeater task posmv_plotposmv starting 5.5 seconds late 2015-03-23 18:19:05,732 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:20:55,985 INFO repeater task os150bb_lastensq starting 4.0 seconds late 2015-03-23 18:20:57,437 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-23 18:20:57,437 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:20:42 2015-03-23 18:20:57,438 INFO repeater task os150nb_lastensq starting 5.4 seconds late 2015-03-23 18:20:58,548 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:20:58,548 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:20:42 2015-03-23 18:24:03,971 INFO repeater task os150bb_10pings starting 4.3 seconds late 2015-03-23 18:24:04,077 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:24:04,077 INFO repeater task os150nb_10pings starting 4.5 seconds late 2015-03-23 18:24:04,171 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:24:04,172 INFO repeater task posmv_hcorrstats starting 4.5 seconds late 2015-03-23 18:24:04,789 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:24:04,789 INFO repeater task posmv_plotposmv starting 5.2 seconds late 2015-03-23 18:24:05,384 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:25:55,628 INFO repeater task os150bb_lastensq starting 3.6 seconds late 2015-03-23 18:25:57,018 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:25:57,018 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:25:42 2015-03-23 18:25:57,019 INFO repeater task os150nb_lastensq starting 5.0 seconds late 2015-03-23 18:25:58,097 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:25:58,097 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:25:42 2015-03-23 18:29:03,579 INFO repeater task os150bb_quick starting 4.0 seconds late 2015-03-23 18:29:05,163 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:29:05,163 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 18:29:05,164 INFO repeater task os150bb_3dayplots starting 5.5 seconds late 2015-03-23 18:29:07,680 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:29:07,680 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 18:29:07,680 INFO repeater task os150bb_tsstats starting 8.1 seconds late 2015-03-23 18:29:08,144 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 18:29:08,145 INFO repeater task os150nb_quick starting 8.5 seconds late 2015-03-23 18:29:09,720 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:29:09,720 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 18:29:09,720 INFO repeater task os150nb_3dayplots starting 10.1 seconds late 2015-03-23 18:29:12,190 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:29:12,190 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 18:29:12,190 INFO repeater task os150nb_tsstats starting 12.6 seconds late 2015-03-23 18:29:12,661 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 18:29:12,661 INFO repeater task os150bb_beamplots starting 13.0 seconds late 2015-03-23 18:29:13,538 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:29:13,538 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 18:29:13,539 INFO repeater task os150bb_beamplots starting 13.9 seconds late 2015-03-23 18:29:14,419 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:29:14,419 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 18:29:14,419 INFO repeater task os150nb_beamplots starting 14.8 seconds late 2015-03-23 18:29:15,283 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:29:15,283 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 18:29:15,283 INFO repeater task os150nb_beamplots starting 15.7 seconds late 2015-03-23 18:29:16,141 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:29:16,142 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 18:29:16,142 INFO repeater task posmv_hcorrstats starting 16.5 seconds late 2015-03-23 18:29:16,748 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:29:16,748 INFO repeater task posmv_plotposmv starting 17.1 seconds late 2015-03-23 18:29:17,338 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:29:22,345 INFO repeater task os150bb_10pings starting 2.7 seconds late 2015-03-23 18:29:22,450 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:29:22,450 INFO repeater task os150nb_10pings starting 2.8 seconds late 2015-03-23 18:29:22,541 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:30:52,747 INFO repeater task os150bb_lastensq starting 0.7 seconds late 2015-03-23 18:30:54,187 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:30:54,188 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:30:42 2015-03-23 18:30:54,189 INFO repeater task os150nb_lastensq starting 2.2 seconds late 2015-03-23 18:30:55,272 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:30:55,272 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:30:42 2015-03-23 18:34:00,708 INFO repeater task posmv_hcorrstats starting 1.1 seconds late 2015-03-23 18:34:01,307 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:34:01,308 INFO repeater task posmv_plotposmv starting 1.7 seconds late 2015-03-23 18:34:01,894 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:34:41,986 INFO repeater task os150bb_10pings starting 2.4 seconds late 2015-03-23 18:34:42,088 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:34:42,089 INFO repeater task os150nb_10pings starting 2.5 seconds late 2015-03-23 18:34:42,179 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:35:52,335 INFO repeater task os150bb_lastensq starting 0.3 seconds late 2015-03-23 18:35:53,710 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:35:53,710 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:35:42 2015-03-23 18:35:53,711 INFO repeater task os150nb_lastensq starting 1.7 seconds late 2015-03-23 18:35:54,783 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:35:54,784 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:35:42 2015-03-23 18:39:00,208 INFO repeater task posmv_hcorrstats starting 0.6 seconds late 2015-03-23 18:39:00,856 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:39:00,857 INFO repeater task posmv_plotposmv starting 1.2 seconds late 2015-03-23 18:39:01,453 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:40:01,586 INFO repeater task os150bb_10pings starting 2.0 seconds late 2015-03-23 18:40:01,688 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:40:01,689 INFO repeater task os150nb_10pings starting 2.1 seconds late 2015-03-23 18:40:01,789 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:40:56,910 INFO repeater task os150bb_lastensq starting 4.9 seconds late 2015-03-23 18:40:58,330 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:40:58,330 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:40:42 2015-03-23 18:40:58,331 INFO repeater task os150nb_lastensq starting 6.3 seconds late 2015-03-23 18:40:59,427 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:40:59,427 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:40:42 2015-03-23 18:43:59,837 INFO repeater task os150bb_quick starting 0.2 seconds late 2015-03-23 18:44:01,440 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:44:01,440 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 18:44:01,440 INFO repeater task os150bb_3dayplots starting 1.8 seconds late 2015-03-23 18:44:03,923 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:44:03,923 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 18:44:03,924 INFO repeater task os150bb_tsstats starting 4.3 seconds late 2015-03-23 18:44:04,409 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 18:44:04,409 INFO repeater task os150nb_quick starting 4.8 seconds late 2015-03-23 18:44:05,978 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:44:05,978 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 18:44:05,978 INFO repeater task os150nb_3dayplots starting 6.4 seconds late 2015-03-23 18:44:08,447 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:44:08,447 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 18:44:08,448 INFO repeater task os150nb_tsstats starting 8.8 seconds late 2015-03-23 18:44:08,942 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 18:44:08,943 INFO repeater task os150bb_beamplots starting 9.3 seconds late 2015-03-23 18:44:09,832 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:44:09,833 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 18:44:09,833 INFO repeater task os150bb_beamplots starting 10.2 seconds late 2015-03-23 18:44:10,713 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:44:10,713 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 18:44:10,713 INFO repeater task os150nb_beamplots starting 11.1 seconds late 2015-03-23 18:44:11,593 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:44:11,594 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 18:44:11,594 INFO repeater task os150nb_beamplots starting 12.0 seconds late 2015-03-23 18:44:12,471 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:44:12,471 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 18:44:12,471 INFO repeater task posmv_hcorrstats starting 12.8 seconds late 2015-03-23 18:44:13,085 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:44:13,085 INFO repeater task posmv_plotposmv starting 13.5 seconds late 2015-03-23 18:44:13,675 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:45:23,840 INFO repeater task os150bb_10pings starting 4.2 seconds late 2015-03-23 18:45:23,937 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:45:23,938 INFO repeater task os150nb_10pings starting 4.3 seconds late 2015-03-23 18:45:24,030 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:45:54,097 INFO repeater task os150bb_lastensq starting 2.1 seconds late 2015-03-23 18:45:55,497 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:45:55,497 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:45:42 2015-03-23 18:45:55,498 INFO repeater task os150nb_lastensq starting 3.5 seconds late 2015-03-23 18:45:56,610 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:45:56,610 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:45:42 2015-03-23 18:49:02,052 INFO repeater task posmv_hcorrstats starting 2.4 seconds late 2015-03-23 18:49:02,671 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:49:02,672 INFO repeater task posmv_plotposmv starting 3.0 seconds late 2015-03-23 18:49:03,273 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:50:43,517 INFO repeater task os150bb_10pings starting 3.9 seconds late 2015-03-23 18:50:43,620 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:50:43,621 INFO repeater task os150nb_10pings starting 4.0 seconds late 2015-03-23 18:50:43,723 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:50:53,742 INFO repeater task os150bb_lastensq starting 1.7 seconds late 2015-03-23 18:50:55,134 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:50:55,134 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:50:42 2015-03-23 18:50:55,135 INFO repeater task os150nb_lastensq starting 3.1 seconds late 2015-03-23 18:50:56,190 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:50:56,190 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:50:42 2015-03-23 18:54:01,623 INFO repeater task posmv_hcorrstats starting 2.0 seconds late 2015-03-23 18:54:02,262 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:54:02,263 INFO repeater task posmv_plotposmv starting 2.6 seconds late 2015-03-23 18:54:02,853 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 18:55:53,103 INFO repeater task os150bb_lastensq starting 1.1 seconds late 2015-03-23 18:55:54,513 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 18:55:54,514 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 18:55:42 2015-03-23 18:55:54,514 INFO repeater task os150nb_lastensq starting 2.5 seconds late 2015-03-23 18:55:55,582 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 18:55:55,582 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 18:55:42 2015-03-23 18:56:00,589 INFO repeater task os150bb_10pings starting 1.0 seconds late 2015-03-23 18:56:00,693 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 18:56:00,694 INFO repeater task os150nb_10pings starting 1.1 seconds late 2015-03-23 18:56:00,788 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 18:59:01,209 INFO repeater task os150bb_quick starting 1.6 seconds late 2015-03-23 18:59:02,800 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:59:02,800 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 18:59:02,800 INFO repeater task os150bb_3dayplots starting 3.2 seconds late 2015-03-23 18:59:05,246 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:59:05,246 INFO repeater task os150bb_3dayplots ended after 2.4 seconds 2015-03-23 18:59:05,246 INFO repeater task os150bb_tsstats starting 5.6 seconds late 2015-03-23 18:59:05,722 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 18:59:05,722 INFO repeater task os150nb_quick starting 6.1 seconds late 2015-03-23 18:59:07,293 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 18:59:07,293 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 18:59:07,293 INFO repeater task os150nb_3dayplots starting 7.7 seconds late 2015-03-23 18:59:09,761 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 18:59:09,761 INFO repeater task os150nb_3dayplots ended after 2.5 seconds 2015-03-23 18:59:09,762 INFO repeater task os150nb_tsstats starting 10.1 seconds late 2015-03-23 18:59:10,240 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 18:59:10,241 INFO repeater task os150bb_beamplots starting 10.6 seconds late 2015-03-23 18:59:11,088 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:59:11,088 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-23 18:59:11,088 INFO repeater task os150bb_beamplots starting 11.5 seconds late 2015-03-23 18:59:11,965 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:59:11,965 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 18:59:11,965 INFO repeater task os150nb_beamplots starting 12.3 seconds late 2015-03-23 18:59:12,823 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:59:12,823 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 18:59:12,823 INFO repeater task os150nb_beamplots starting 13.2 seconds late 2015-03-23 18:59:13,680 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 18:59:13,680 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 18:59:13,680 INFO repeater task posmv_hcorrstats starting 14.1 seconds late 2015-03-23 18:59:14,322 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 18:59:14,323 INFO repeater task posmv_plotposmv starting 14.7 seconds late 2015-03-23 18:59:14,956 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:00:55,151 INFO repeater task os150bb_lastensq starting 3.2 seconds late 2015-03-23 19:00:56,574 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 19:00:56,575 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:00:42 2015-03-23 19:00:56,575 INFO repeater task os150nb_lastensq starting 4.6 seconds late 2015-03-23 19:00:57,716 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:00:57,717 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:00:42 2015-03-23 19:01:22,774 INFO repeater task os150bb_10pings starting 3.2 seconds late 2015-03-23 19:01:22,882 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:01:22,883 INFO repeater task os150nb_10pings starting 3.3 seconds late 2015-03-23 19:01:22,979 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:04:03,372 INFO repeater task posmv_hcorrstats starting 3.7 seconds late 2015-03-23 19:04:03,982 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 19:04:03,983 INFO repeater task posmv_plotposmv starting 4.4 seconds late 2015-03-23 19:04:04,587 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:05:54,833 INFO repeater task os150bb_lastensq starting 2.8 seconds late 2015-03-23 19:05:56,256 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 19:05:56,256 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:05:42 2015-03-23 19:05:56,257 INFO repeater task os150nb_lastensq starting 4.3 seconds late 2015-03-23 19:05:57,362 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:05:57,362 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:05:42 2015-03-23 19:06:42,470 INFO repeater task os150bb_10pings starting 2.8 seconds late 2015-03-23 19:06:42,576 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:06:42,577 INFO repeater task os150nb_10pings starting 3.0 seconds late 2015-03-23 19:06:42,675 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:09:03,022 INFO repeater task posmv_hcorrstats starting 3.4 seconds late 2015-03-23 19:09:03,630 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 19:09:03,630 INFO repeater task posmv_plotposmv starting 4.0 seconds late 2015-03-23 19:09:04,214 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:10:54,471 INFO repeater task os150bb_lastensq starting 2.5 seconds late 2015-03-23 19:10:55,884 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 19:10:55,884 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:10:42 2015-03-23 19:10:55,885 INFO repeater task os150nb_lastensq starting 3.9 seconds late 2015-03-23 19:10:56,947 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:10:56,947 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:10:42 2015-03-23 19:12:02,090 INFO repeater task os150bb_10pings starting 2.5 seconds late 2015-03-23 19:12:02,197 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:12:02,198 INFO repeater task os150nb_10pings starting 2.6 seconds late 2015-03-23 19:12:02,291 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:14:02,574 INFO repeater task os150bb_quick starting 3.0 seconds late 2015-03-23 19:14:04,175 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 19:14:04,175 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 19:14:04,175 INFO repeater task os150bb_3dayplots starting 4.6 seconds late 2015-03-23 19:14:06,688 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 19:14:06,688 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 19:14:06,688 INFO repeater task os150bb_tsstats starting 7.1 seconds late 2015-03-23 19:14:07,173 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 19:14:07,174 INFO repeater task os150nb_quick starting 7.5 seconds late 2015-03-23 19:14:08,720 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 19:14:08,720 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-23 19:14:08,720 INFO repeater task os150nb_3dayplots starting 9.1 seconds late 2015-03-23 19:14:11,299 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 19:14:11,299 INFO repeater task os150nb_3dayplots ended after 2.6 seconds 2015-03-23 19:14:11,299 INFO repeater task os150nb_tsstats starting 11.7 seconds late 2015-03-23 19:14:11,772 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 19:14:11,773 INFO repeater task os150bb_beamplots starting 12.1 seconds late 2015-03-23 19:14:12,622 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:14:12,622 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-23 19:14:12,623 INFO repeater task os150bb_beamplots starting 13.0 seconds late 2015-03-23 19:14:13,516 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:14:13,516 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 19:14:13,516 INFO repeater task os150nb_beamplots starting 13.9 seconds late 2015-03-23 19:14:14,429 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:14:14,429 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 19:14:14,429 INFO repeater task os150nb_beamplots starting 14.8 seconds late 2015-03-23 19:14:15,283 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:14:15,283 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 19:14:15,283 INFO repeater task posmv_hcorrstats starting 15.7 seconds late 2015-03-23 19:14:15,938 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2015-03-23 19:14:15,939 INFO repeater task posmv_plotposmv starting 16.3 seconds late 2015-03-23 19:14:16,541 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:15:56,770 INFO repeater task os150bb_lastensq starting 4.8 seconds late 2015-03-23 19:15:58,174 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 19:15:58,174 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:15:42 2015-03-23 19:15:58,175 INFO repeater task os150nb_lastensq starting 6.2 seconds late 2015-03-23 19:15:59,260 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:15:59,261 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:15:42 2015-03-23 19:17:24,449 INFO repeater task os150bb_10pings starting 4.8 seconds late 2015-03-23 19:17:24,566 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:17:24,567 INFO repeater task os150nb_10pings starting 4.9 seconds late 2015-03-23 19:17:24,660 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:18:59,887 INFO repeater task posmv_hcorrstats starting 0.3 seconds late 2015-03-23 19:19:00,535 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 19:19:00,535 INFO repeater task posmv_plotposmv starting 0.9 seconds late 2015-03-23 19:19:01,131 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:20:56,393 INFO repeater task os150bb_lastensq starting 4.4 seconds late 2015-03-23 19:20:57,797 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 19:20:57,797 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:20:42 2015-03-23 19:20:57,798 INFO repeater task os150nb_lastensq starting 5.8 seconds late 2015-03-23 19:20:58,908 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:20:58,908 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:20:42 2015-03-23 19:22:44,153 INFO repeater task os150bb_10pings starting 4.5 seconds late 2015-03-23 19:22:44,261 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:22:44,262 INFO repeater task os150nb_10pings starting 4.6 seconds late 2015-03-23 19:22:44,361 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:24:04,555 INFO repeater task posmv_hcorrstats starting 4.9 seconds late 2015-03-23 19:24:05,224 INFO repeater task posmv_hcorrstats ended after 0.7 seconds 2015-03-23 19:24:05,225 INFO repeater task posmv_plotposmv starting 5.6 seconds late 2015-03-23 19:24:05,813 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:25:56,096 INFO repeater task os150bb_lastensq starting 4.1 seconds late 2015-03-23 19:25:57,569 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-23 19:25:57,569 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:25:42 2015-03-23 19:25:57,570 INFO repeater task os150nb_lastensq starting 5.6 seconds late 2015-03-23 19:25:58,631 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:25:58,631 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:25:42 2015-03-23 19:28:03,926 INFO repeater task os150bb_10pings starting 4.3 seconds late 2015-03-23 19:28:04,031 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:28:04,032 INFO repeater task os150nb_10pings starting 4.4 seconds late 2015-03-23 19:28:04,128 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:29:04,264 INFO repeater task os150bb_quick starting 4.6 seconds late 2015-03-23 19:29:05,820 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 19:29:05,821 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-23 19:29:05,821 INFO repeater task os150bb_3dayplots starting 6.2 seconds late 2015-03-23 19:29:08,274 INFO repeater task os150bb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 19:29:08,274 INFO repeater task os150bb_3dayplots ended after 2.5 seconds 2015-03-23 19:29:08,274 INFO repeater task os150bb_tsstats starting 8.7 seconds late 2015-03-23 19:29:08,752 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-23 19:29:08,752 INFO repeater task os150nb_quick starting 9.1 seconds late 2015-03-23 19:29:10,312 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-23 19:29:10,312 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-23 19:29:10,312 INFO repeater task os150nb_3dayplots starting 10.7 seconds late 2015-03-23 19:29:12,754 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-23 19:29:12,754 INFO repeater task os150nb_3dayplots ended after 2.4 seconds 2015-03-23 19:29:12,755 INFO repeater task os150nb_tsstats starting 13.1 seconds late 2015-03-23 19:29:13,225 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-23 19:29:13,225 INFO repeater task os150bb_beamplots starting 13.6 seconds late 2015-03-23 19:29:14,080 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:29:14,080 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 19:29:14,081 INFO repeater task os150bb_beamplots starting 14.5 seconds late 2015-03-23 19:29:14,949 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:29:14,949 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-23 19:29:14,949 INFO repeater task os150nb_beamplots starting 15.3 seconds late 2015-03-23 19:29:15,859 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:29:15,859 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 19:29:15,859 INFO repeater task os150nb_beamplots starting 16.2 seconds late 2015-03-23 19:29:16,736 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-23 19:29:16,736 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-23 19:29:16,736 INFO repeater task posmv_hcorrstats starting 17.1 seconds late 2015-03-23 19:29:17,338 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 19:29:17,338 INFO repeater task posmv_plotposmv starting 17.7 seconds late 2015-03-23 19:29:17,930 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:30:53,154 INFO repeater task os150bb_lastensq starting 1.2 seconds late 2015-03-23 19:30:54,577 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 19:30:54,577 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:30:42 2015-03-23 19:30:54,578 INFO repeater task os150nb_lastensq starting 2.6 seconds late 2015-03-23 19:30:55,725 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:30:55,725 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:30:42 2015-03-23 19:33:21,060 INFO repeater task os150bb_10pings starting 1.4 seconds late 2015-03-23 19:33:21,168 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:33:21,169 INFO repeater task os150nb_10pings starting 1.5 seconds late 2015-03-23 19:33:21,265 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:34:01,361 INFO repeater task posmv_hcorrstats starting 1.7 seconds late 2015-03-23 19:34:01,983 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 19:34:01,983 INFO repeater task posmv_plotposmv starting 2.4 seconds late 2015-03-23 19:34:02,574 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:35:52,811 INFO repeater task os150bb_lastensq starting 0.8 seconds late 2015-03-23 19:35:54,268 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-23 19:35:54,269 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:35:42 2015-03-23 19:35:54,269 INFO repeater task os150nb_lastensq starting 2.3 seconds late 2015-03-23 19:35:55,376 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:35:55,376 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:35:42 2015-03-23 19:38:40,765 INFO repeater task os150bb_10pings starting 1.1 seconds late 2015-03-23 19:38:40,870 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-23 19:38:40,871 INFO repeater task os150nb_10pings starting 1.2 seconds late 2015-03-23 19:38:40,959 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-23 19:39:01,007 INFO repeater task posmv_hcorrstats starting 1.4 seconds late 2015-03-23 19:39:01,650 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-23 19:39:01,650 INFO repeater task posmv_plotposmv starting 2.0 seconds late 2015-03-23 19:39:02,275 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2015-03-23 19:40:52,535 INFO repeater task os150bb_lastensq starting 0.5 seconds late 2015-03-23 19:40:53,927 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-23 19:40:53,927 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tf/proc/os150bb/load/wrote_ens_time: 2015/03/23 19:40:42 2015-03-23 19:40:53,928 INFO repeater task os150nb_lastensq starting 1.9 seconds late 2015-03-23 19:40:55,011 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-23 19:40:55,011 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tf/proc/os150nb/load/wrote_ens_time: 2015/03/23 19:40:42 2015-03-23 19:44:00,447 INFO repeater task os150bb_10pings starting 0.8 seconds late 2015-03-23 19:44:00,556 INFO repeater task os150bb_10pings ended after 0.1 seconds