2015-03-19 15:23:55,957 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:23:37 2015-03-19 15:23:55,958 INFO repeater task os150nb_lastensq starting 9.0 seconds late 2015-03-19 15:23:57,027 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 15:23:57,028 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:23:37 2015-03-19 15:25:37,258 INFO repeater task os150bb_10pings starting 1.8 seconds late 2015-03-19 15:25:37,366 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 15:25:37,367 INFO repeater task os150nb_10pings starting 1.9 seconds late 2015-03-19 15:25:37,458 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 15:28:37,878 INFO repeater task posmv_hcorrstats starting 2.4 seconds late 2015-03-19 15:28:38,365 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 15:28:38,365 INFO repeater task posmv_plotposmv starting 2.9 seconds late 2015-03-19 15:28:38,770 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 15:28:48,783 INFO repeater task os150bb_lastensq starting 1.8 seconds late 2015-03-19 15:28:50,155 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 15:28:50,155 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:28:37 2015-03-19 15:28:50,156 INFO repeater task os150nb_lastensq starting 3.2 seconds late 2015-03-19 15:28:51,238 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 15:28:51,238 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:28:37 2015-03-19 15:30:56,444 INFO repeater task os150bb_10pings starting 1.0 seconds late 2015-03-19 15:30:56,541 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 15:30:56,542 INFO repeater task os150nb_10pings starting 1.1 seconds late 2015-03-19 15:30:56,641 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 15:33:36,932 INFO repeater task posmv_hcorrstats starting 1.5 seconds late 2015-03-19 15:33:37,415 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 15:33:37,416 INFO repeater task posmv_plotposmv starting 1.9 seconds late 2015-03-19 15:33:37,818 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 15:33:47,837 INFO repeater task os150bb_lastensq starting 0.8 seconds late 2015-03-19 15:33:49,218 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 15:33:49,218 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:33:37 2015-03-19 15:33:49,219 INFO repeater task os150nb_lastensq starting 2.2 seconds late 2015-03-19 15:33:50,255 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 15:33:50,255 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:33:37 2015-03-19 15:36:15,589 INFO repeater task os150bb_10pings starting 0.1 seconds late 2015-03-19 15:36:15,689 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 15:36:15,690 INFO repeater task os150nb_10pings starting 0.2 seconds late 2015-03-19 15:36:15,784 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 15:38:36,133 INFO repeater task os150bb_quick starting 0.7 seconds late 2015-03-19 15:38:37,612 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 15:38:37,613 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 15:38:37,613 INFO repeater task os150bb_3dayplots starting 2.1 seconds late 2015-03-19 15:38:39,427 INFO repeater task os150bb_3dayplots ended after 1.8 seconds 2015-03-19 15:38:39,427 INFO repeater task os150bb_tsstats starting 4.0 seconds late 2015-03-19 15:38:39,898 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 15:38:39,899 INFO repeater task os150nb_quick starting 4.4 seconds late 2015-03-19 15:38:41,364 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 15:38:41,364 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 15:38:41,364 INFO repeater task os150nb_3dayplots starting 5.9 seconds late 2015-03-19 15:38:43,187 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 15:38:43,188 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 15:38:43,188 INFO repeater task os150nb_tsstats starting 7.7 seconds late 2015-03-19 15:38:43,656 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 15:38:43,656 INFO repeater task os150bb_beamplots starting 8.2 seconds late 2015-03-19 15:38:44,442 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:38:44,442 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 15:38:44,443 INFO repeater task os150bb_beamplots starting 9.0 seconds late 2015-03-19 15:38:45,223 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:38:45,223 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 15:38:45,223 INFO repeater task os150nb_beamplots starting 9.8 seconds late 2015-03-19 15:38:46,029 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:38:46,029 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 15:38:46,029 INFO repeater task os150nb_beamplots starting 10.6 seconds late 2015-03-19 15:38:46,845 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:38:46,845 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 15:38:46,845 INFO repeater task posmv_hcorrstats starting 11.4 seconds late 2015-03-19 15:38:47,346 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 15:38:47,347 INFO repeater task posmv_plotposmv starting 11.9 seconds late 2015-03-19 15:38:47,752 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 15:38:52,758 INFO repeater task os150bb_lastensq starting 5.8 seconds late 2015-03-19 15:38:54,149 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 15:38:54,149 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:38:37 2015-03-19 15:38:54,150 INFO repeater task os150nb_lastensq starting 7.2 seconds late 2015-03-19 15:38:55,235 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 15:38:55,235 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:38:37 2015-03-19 15:41:35,598 INFO repeater task os150bb_10pings starting 0.1 seconds late 2015-03-19 15:41:35,704 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 15:41:35,705 INFO repeater task os150nb_10pings starting 0.2 seconds late 2015-03-19 15:41:35,796 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 15:43:36,075 INFO repeater task posmv_hcorrstats starting 0.6 seconds late 2015-03-19 15:43:36,584 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 15:43:36,585 INFO repeater task posmv_plotposmv starting 1.1 seconds late 2015-03-19 15:43:36,988 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 15:43:47,006 INFO repeater task os150bb_lastensq starting 0.0 seconds late 2015-03-19 15:43:48,452 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 15:43:48,452 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:43:37 2015-03-19 15:43:48,453 INFO repeater task os150nb_lastensq starting 1.5 seconds late 2015-03-19 15:43:49,536 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 15:43:49,537 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:43:37 2015-03-19 15:46:59,962 INFO repeater task os150bb_10pings starting 4.5 seconds late 2015-03-19 15:47:00,067 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 15:47:00,067 INFO repeater task os150nb_10pings starting 4.6 seconds late 2015-03-19 15:47:00,163 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 15:48:40,371 INFO repeater task posmv_hcorrstats starting 4.9 seconds late 2015-03-19 15:48:40,873 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 15:48:40,874 INFO repeater task posmv_plotposmv starting 5.4 seconds late 2015-03-19 15:48:41,274 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 15:48:51,292 INFO repeater task os150bb_lastensq starting 4.3 seconds late 2015-03-19 15:48:52,656 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 15:48:52,656 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:48:37 2015-03-19 15:48:52,657 INFO repeater task os150nb_lastensq starting 5.7 seconds late 2015-03-19 15:48:53,692 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 15:48:53,692 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:48:37 2015-03-19 15:52:19,189 INFO repeater task os150bb_10pings starting 3.7 seconds late 2015-03-19 15:52:19,288 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 15:52:19,289 INFO repeater task os150nb_10pings starting 3.8 seconds late 2015-03-19 15:52:19,388 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 15:53:39,570 INFO repeater task os150bb_quick starting 4.1 seconds late 2015-03-19 15:53:41,053 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 15:53:41,053 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 15:53:41,053 INFO repeater task os150bb_3dayplots starting 5.6 seconds late 2015-03-19 15:53:42,901 INFO repeater task os150bb_3dayplots ended after 1.8 seconds 2015-03-19 15:53:42,901 INFO repeater task os150bb_tsstats starting 7.4 seconds late 2015-03-19 15:53:43,366 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 15:53:43,367 INFO repeater task os150nb_quick starting 7.9 seconds late 2015-03-19 15:53:44,895 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 15:53:44,896 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 15:53:44,896 INFO repeater task os150nb_3dayplots starting 9.4 seconds late 2015-03-19 15:53:46,771 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 15:53:46,771 INFO repeater task os150nb_3dayplots ended after 1.9 seconds 2015-03-19 15:53:46,771 INFO repeater task os150nb_tsstats starting 11.3 seconds late 2015-03-19 15:53:47,245 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 15:53:47,245 INFO repeater task os150bb_beamplots starting 11.8 seconds late 2015-03-19 15:53:48,074 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:53:48,075 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 15:53:48,075 INFO repeater task os150bb_beamplots starting 12.6 seconds late 2015-03-19 15:53:48,892 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:53:48,892 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 15:53:48,893 INFO repeater task os150nb_beamplots starting 13.4 seconds late 2015-03-19 15:53:49,734 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:53:49,734 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 15:53:49,734 INFO repeater task os150nb_beamplots starting 14.3 seconds late 2015-03-19 15:53:50,645 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 15:53:50,646 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 15:53:50,646 INFO repeater task posmv_hcorrstats starting 15.2 seconds late 2015-03-19 15:53:51,162 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 15:53:51,162 INFO repeater task posmv_plotposmv starting 15.7 seconds late 2015-03-19 15:53:51,579 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 15:53:56,581 INFO repeater task os150bb_lastensq starting 9.6 seconds late 2015-03-19 15:53:57,977 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 15:53:57,977 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:53:37 2015-03-19 15:53:57,978 INFO repeater task os150nb_lastensq starting 11.0 seconds late 2015-03-19 15:53:59,035 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 15:53:59,035 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:53:37 2015-03-19 15:57:39,548 INFO repeater task os150bb_10pings starting 4.1 seconds late 2015-03-19 15:57:39,655 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 15:57:39,656 INFO repeater task os150nb_10pings starting 4.2 seconds late 2015-03-19 15:57:39,749 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 15:58:39,892 INFO repeater task posmv_hcorrstats starting 4.4 seconds late 2015-03-19 15:58:40,394 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 15:58:40,394 INFO repeater task posmv_plotposmv starting 4.9 seconds late 2015-03-19 15:58:40,796 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 15:58:50,816 INFO repeater task os150bb_lastensq starting 3.8 seconds late 2015-03-19 15:58:52,176 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 15:58:52,177 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 15:58:37 2015-03-19 15:58:52,177 INFO repeater task os150nb_lastensq starting 5.2 seconds late 2015-03-19 15:58:53,251 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 15:58:53,252 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 15:58:37 2015-03-19 16:02:58,797 INFO repeater task os150bb_10pings starting 3.3 seconds late 2015-03-19 16:02:58,901 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:02:58,902 INFO repeater task os150nb_10pings starting 3.4 seconds late 2015-03-19 16:02:58,998 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:03:39,088 INFO repeater task posmv_hcorrstats starting 3.6 seconds late 2015-03-19 16:03:39,602 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 16:03:39,602 INFO repeater task posmv_plotposmv starting 4.1 seconds late 2015-03-19 16:03:40,014 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:03:50,029 INFO repeater task os150bb_lastensq starting 3.0 seconds late 2015-03-19 16:03:51,479 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-19 16:03:51,479 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:03:37 2015-03-19 16:03:51,480 INFO repeater task os150nb_lastensq starting 4.5 seconds late 2015-03-19 16:03:52,543 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 16:03:52,544 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:03:37 2015-03-19 16:08:18,073 INFO repeater task os150bb_10pings starting 2.6 seconds late 2015-03-19 16:08:18,180 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:08:18,181 INFO repeater task os150nb_10pings starting 2.7 seconds late 2015-03-19 16:08:18,277 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:08:38,322 INFO repeater task os150bb_quick starting 2.9 seconds late 2015-03-19 16:08:39,848 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 16:08:39,848 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 16:08:39,848 INFO repeater task os150bb_3dayplots starting 4.4 seconds late 2015-03-19 16:08:41,598 INFO repeater task os150bb_3dayplots ended after 1.7 seconds 2015-03-19 16:08:41,599 INFO repeater task os150bb_tsstats starting 6.1 seconds late 2015-03-19 16:08:42,085 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 16:08:42,086 INFO repeater task os150nb_quick starting 6.6 seconds late 2015-03-19 16:08:43,580 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 16:08:43,580 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 16:08:43,580 INFO repeater task os150nb_3dayplots starting 8.1 seconds late 2015-03-19 16:08:45,363 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 16:08:45,363 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 16:08:45,363 INFO repeater task os150nb_tsstats starting 9.9 seconds late 2015-03-19 16:08:45,846 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 16:08:45,846 INFO repeater task os150bb_beamplots starting 10.4 seconds late 2015-03-19 16:08:46,669 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:08:46,669 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 16:08:46,670 INFO repeater task os150bb_beamplots starting 11.2 seconds late 2015-03-19 16:08:47,482 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:08:47,482 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 16:08:47,482 INFO repeater task os150nb_beamplots starting 12.0 seconds late 2015-03-19 16:08:48,354 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:08:48,354 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 16:08:48,354 INFO repeater task os150nb_beamplots starting 12.9 seconds late 2015-03-19 16:08:49,234 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:08:49,234 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 16:08:49,234 INFO repeater task posmv_hcorrstats starting 13.8 seconds late 2015-03-19 16:08:49,733 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 16:08:49,733 INFO repeater task posmv_plotposmv starting 14.3 seconds late 2015-03-19 16:08:50,148 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:08:55,154 INFO repeater task os150bb_lastensq starting 8.2 seconds late 2015-03-19 16:08:56,528 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:08:56,528 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:08:37 2015-03-19 16:08:56,529 INFO repeater task os150nb_lastensq starting 9.5 seconds late 2015-03-19 16:08:57,573 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 16:08:57,573 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:08:37 2015-03-19 16:13:38,225 INFO repeater task os150bb_10pings starting 2.8 seconds late 2015-03-19 16:13:38,332 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:13:38,333 INFO repeater task os150nb_10pings starting 2.9 seconds late 2015-03-19 16:13:38,437 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:13:38,438 INFO repeater task posmv_hcorrstats starting 3.0 seconds late 2015-03-19 16:13:38,984 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 16:13:38,984 INFO repeater task posmv_plotposmv starting 3.5 seconds late 2015-03-19 16:13:39,408 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:13:49,425 INFO repeater task os150bb_lastensq starting 2.4 seconds late 2015-03-19 16:13:50,833 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:13:50,833 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:13:37 2015-03-19 16:13:50,834 INFO repeater task os150nb_lastensq starting 3.8 seconds late 2015-03-19 16:13:51,894 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 16:13:51,894 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:13:37 2015-03-19 16:18:37,628 INFO repeater task posmv_hcorrstats starting 2.2 seconds late 2015-03-19 16:18:38,140 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 16:18:38,140 INFO repeater task posmv_plotposmv starting 2.7 seconds late 2015-03-19 16:18:38,545 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:18:48,564 INFO repeater task os150bb_lastensq starting 1.6 seconds late 2015-03-19 16:18:49,917 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:18:49,917 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:18:37 2015-03-19 16:18:49,918 INFO repeater task os150nb_lastensq starting 2.9 seconds late 2015-03-19 16:18:50,975 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 16:18:50,975 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:18:37 2015-03-19 16:18:55,981 INFO repeater task os150bb_10pings starting 0.5 seconds late 2015-03-19 16:18:56,081 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:18:56,082 INFO repeater task os150nb_10pings starting 0.6 seconds late 2015-03-19 16:18:56,176 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:23:36,850 INFO repeater task os150bb_quick starting 1.4 seconds late 2015-03-19 16:23:38,307 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 16:23:38,307 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 16:23:38,307 INFO repeater task os150bb_3dayplots starting 2.8 seconds late 2015-03-19 16:23:40,023 INFO repeater task os150bb_3dayplots ended after 1.7 seconds 2015-03-19 16:23:40,024 INFO repeater task os150bb_tsstats starting 4.6 seconds late 2015-03-19 16:23:40,486 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 16:23:40,487 INFO repeater task os150nb_quick starting 5.0 seconds late 2015-03-19 16:23:41,960 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 16:23:41,960 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 16:23:41,961 INFO repeater task os150nb_3dayplots starting 6.5 seconds late 2015-03-19 16:23:43,730 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 16:23:43,730 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 16:23:43,730 INFO repeater task os150nb_tsstats starting 8.3 seconds late 2015-03-19 16:23:44,204 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 16:23:44,205 INFO repeater task os150bb_beamplots starting 8.7 seconds late 2015-03-19 16:23:45,013 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:23:45,013 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 16:23:45,013 INFO repeater task os150bb_beamplots starting 9.5 seconds late 2015-03-19 16:23:45,833 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:23:45,833 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 16:23:45,834 INFO repeater task os150nb_beamplots starting 10.4 seconds late 2015-03-19 16:23:46,713 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:23:46,713 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 16:23:46,714 INFO repeater task os150nb_beamplots starting 11.2 seconds late 2015-03-19 16:23:47,601 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:23:47,601 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 16:23:47,602 INFO repeater task posmv_hcorrstats starting 12.1 seconds late 2015-03-19 16:23:48,111 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 16:23:48,111 INFO repeater task posmv_plotposmv starting 12.6 seconds late 2015-03-19 16:23:48,505 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:23:53,510 INFO repeater task os150bb_lastensq starting 6.5 seconds late 2015-03-19 16:23:54,915 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:23:54,915 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:23:37 2015-03-19 16:23:54,916 INFO repeater task os150nb_lastensq starting 7.9 seconds late 2015-03-19 16:23:56,037 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 16:23:56,037 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:23:37 2015-03-19 16:24:16,064 INFO repeater task os150bb_10pings starting 0.6 seconds late 2015-03-19 16:24:16,162 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:24:16,163 INFO repeater task os150nb_10pings starting 0.7 seconds late 2015-03-19 16:24:16,254 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:28:36,771 INFO repeater task posmv_hcorrstats starting 1.3 seconds late 2015-03-19 16:28:37,326 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-19 16:28:37,326 INFO repeater task posmv_plotposmv starting 1.9 seconds late 2015-03-19 16:28:37,729 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:28:47,747 INFO repeater task os150bb_lastensq starting 0.7 seconds late 2015-03-19 16:28:49,102 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:28:49,102 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:28:37 2015-03-19 16:28:49,103 INFO repeater task os150nb_lastensq starting 2.1 seconds late 2015-03-19 16:28:50,146 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 16:28:50,146 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:28:37 2015-03-19 16:29:40,245 INFO repeater task os150bb_10pings starting 4.8 seconds late 2015-03-19 16:29:40,346 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:29:40,347 INFO repeater task os150nb_10pings starting 4.9 seconds late 2015-03-19 16:29:40,442 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:33:35,981 INFO repeater task posmv_hcorrstats starting 0.5 seconds late 2015-03-19 16:33:36,539 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-19 16:33:36,539 INFO repeater task posmv_plotposmv starting 1.1 seconds late 2015-03-19 16:33:36,956 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:33:51,986 INFO repeater task os150bb_lastensq starting 5.0 seconds late 2015-03-19 16:33:53,341 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:33:53,341 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:33:37 2015-03-19 16:33:53,342 INFO repeater task os150nb_lastensq starting 6.3 seconds late 2015-03-19 16:33:54,388 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 16:33:54,388 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:33:37 2015-03-19 16:34:59,534 INFO repeater task os150bb_10pings starting 4.1 seconds late 2015-03-19 16:34:59,650 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:34:59,650 INFO repeater task os150nb_10pings starting 4.2 seconds late 2015-03-19 16:34:59,743 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:39:57,908 INFO root Starting DAS_while_logging.py 2015-03-19 16:39:57,974 INFO root Cruiseid: NF1501_Tb 2015-03-19 16:39:58,001 INFO root starting run method 2015-03-19 16:39:58,019 INFO Translate gyro hnc 1 2015-03-19 16:39:58,019 INFO Translate 2015-03-19 16:39:58,019 INFO Translate gpsnav gps 1 2015-03-19 16:39:58,019 INFO Translate 2015-03-19 16:39:58,019 INFO Translate posmv gps 1 2015-03-19 16:39:58,019 INFO Translate 2015-03-19 16:39:58,020 INFO Translate posmv pmv 0 2015-03-19 16:39:58,020 INFO Translate 2015-03-19 16:39:58,020 INFO root active_procdirnames: ['os150bb', 'os150nb'] 2015-03-19 16:39:58,020 INFO repeater PeriodicSystem: os150bb_lastensq interval is 310 seconds cd /home/adcp/uhdas_tmp; run_lastensq.py -d os150bb --update_pygbin --averages --plotens_mpl --kt_vecprof --pingwarnN 30 --ktsdir 2015-03-19 16:39:58,020 INFO repeater PeriodicSystem: os150bb_10pings interval is 320 seconds cd /home/adcp/uhdas_tmp; run_grab_lastpings.py -d os150bb 2015-03-19 16:39:58,020 INFO repeater PeriodicSystem: os150bb_quick interval is 900 seconds cd /home/adcp/uhdas_tmp; run_quick.py -d os150bb 2015-03-19 16:39:58,020 INFO repeater PeriodicSystem: os150bb_3dayplots interval is 900 seconds cd /home/adcp/uhdas_tmp; run_3dayplots_mpl.py -d os150bb 2015-03-19 16:39:58,020 INFO repeater PeriodicSystem: os150bb_tsstats interval is 900 seconds cd /home/adcp/uhdas_tmp; run_plot_tsstats.py os150bb 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150nb_lastensq interval is 310 seconds cd /home/adcp/uhdas_tmp; run_lastensq.py -d os150nb --update_pygbin --averages --plotens_mpl --kt_vecprof --pingwarnN 30 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150nb_10pings interval is 320 seconds cd /home/adcp/uhdas_tmp; run_grab_lastpings.py -d os150nb 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150nb_quick interval is 900 seconds cd /home/adcp/uhdas_tmp; run_quick.py -d os150nb 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150nb_3dayplots interval is 900 seconds cd /home/adcp/uhdas_tmp; run_3dayplots_mpl.py -d os150nb 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150nb_tsstats interval is 900 seconds cd /home/adcp/uhdas_tmp; run_plot_tsstats.py os150nb 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150bb_beamplots interval is 900 seconds cd /home/adcp/uhdas_tmp; plot_beamdiagnostics.py -d os150bb --savefigs --webcopy -p scattering 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150bb_beamplots interval is 900 seconds cd /home/adcp/uhdas_tmp; plot_beamdiagnostics.py -d os150bb --savefigs --webcopy -p velocity 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150nb_beamplots interval is 900 seconds cd /home/adcp/uhdas_tmp; plot_beamdiagnostics.py -d os150nb --savefigs --webcopy -p scattering 2015-03-19 16:39:58,021 INFO repeater PeriodicSystem: os150nb_beamplots interval is 900 seconds cd /home/adcp/uhdas_tmp; plot_beamdiagnostics.py -d os150nb --savefigs --webcopy -p velocity 2015-03-19 16:39:58,021 INFO uhdas_webgen generating /home/adcp/www/figures/thumbnails.html 2015-03-19 16:39:58,021 INFO uhdas_webgen generating /home/adcp/www/figures/beam_diagnostics.html 2015-03-19 16:39:58,021 INFO uhdas_webgen ptype=scattering 2015-03-19 16:39:58,021 INFO uhdas_webgen title=UNCALIBRATED scattering, dB 2015-03-19 16:39:58,021 INFO uhdas_webgen inst=os150bb 2015-03-19 16:39:58,021 INFO uhdas_webgen inst=os150nb 2015-03-19 16:39:58,021 INFO uhdas_webgen ptype=velocity 2015-03-19 16:39:58,021 INFO uhdas_webgen title=velocity, m/s 2015-03-19 16:39:58,021 INFO uhdas_webgen inst=os150bb 2015-03-19 16:39:58,022 INFO uhdas_webgen inst=os150nb 2015-03-19 16:39:58,022 INFO uhdas_webgen generating /home/adcp/www/figures/tsstats.html 2015-03-19 16:39:58,022 INFO uhdas_webgen ptype=tsstats 2015-03-19 16:39:58,022 INFO uhdas_webgen title=(some) ocean velocity errors 2015-03-19 16:39:58,022 INFO uhdas_webgen inst=os150bb 2015-03-19 16:39:58,022 INFO uhdas_webgen inst=os150nb 2015-03-19 16:39:58,022 INFO uhdas_webgen generating /home/adcp/www/figures/sci.html 2015-03-19 16:39:58,022 INFO uhdas_webgen ptype=ktvecprof 2015-03-19 16:39:58,022 INFO uhdas_webgen title=speed+direction profile 2015-03-19 16:39:58,022 INFO uhdas_webgen inst=os150bb 2015-03-19 16:39:58,022 INFO uhdas_webgen inst=os150nb 2015-03-19 16:39:58,022 INFO uhdas_webgen adding posmv to simplefiglinks 2015-03-19 16:39:58,022 INFO uhdas_webgen generating /home/adcp/www/simple_figlinks.html 2015-03-19 16:39:58,022 INFO repeater PeriodicSystem: posmv_hcorrstats interval is 300 seconds cd /home/adcp/uhdas_tmp; run_hbinhcorrstats.py --hcorr_inst posmv --plotdh --printstats 2015-03-19 16:39:58,022 INFO repeater PeriodicSystem: posmv_plotposmv interval is 300 seconds cd /home/adcp/uhdas_tmp; run_plotposmv.py -n25 -d posmv 2015-03-19 16:39:58,022 INFO root cleanup_figs no_figure 2015-03-19 16:44:58,837 INFO repeater task posmv_hcorrstats starting 0.8 seconds late 2015-03-19 16:44:59,971 INFO repeater task posmv_hcorrstats ended after 1.1 seconds 2015-03-19 16:44:59,971 INFO repeater task posmv_plotposmv starting 1.9 seconds late 2015-03-19 16:45:00,865 INFO repeater task posmv_plotposmv ended after 0.9 seconds 2015-03-19 16:45:10,883 INFO repeater task os150bb_lastensq starting 2.9 seconds late 2015-03-19 16:45:13,418 INFO repeater task os150bb_lastensq ended after 2.5 seconds 2015-03-19 16:45:13,444 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:44:59 2015-03-19 16:45:13,445 INFO repeater task os150nb_lastensq starting 5.4 seconds late 2015-03-19 16:45:14,559 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 16:45:14,559 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:44:59 2015-03-19 16:45:19,566 INFO repeater task os150bb_10pings starting 1.5 seconds late 2015-03-19 16:45:19,677 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:45:19,678 INFO repeater task os150nb_10pings starting 1.7 seconds late 2015-03-19 16:45:19,771 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:50:00,410 INFO repeater task posmv_hcorrstats starting 2.4 seconds late 2015-03-19 16:50:00,930 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 16:50:00,930 INFO repeater task posmv_plotposmv starting 2.9 seconds late 2015-03-19 16:50:01,339 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:50:11,356 INFO repeater task os150bb_lastensq starting 2.4 seconds late 2015-03-19 16:50:12,779 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:50:12,779 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:49:59 2015-03-19 16:50:12,780 INFO repeater task os150nb_lastensq starting 3.8 seconds late 2015-03-19 16:50:13,849 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 16:50:13,849 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:49:59 2015-03-19 16:50:38,898 INFO repeater task os150bb_10pings starting 0.9 seconds late 2015-03-19 16:50:39,007 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:50:39,008 INFO repeater task os150nb_10pings starting 1.0 seconds late 2015-03-19 16:50:39,098 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 16:54:59,685 INFO repeater task os150bb_quick starting 1.7 seconds late 2015-03-19 16:55:01,698 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 16:55:01,698 INFO repeater task os150bb_quick ended after 2.0 seconds 2015-03-19 16:55:01,698 INFO repeater task os150bb_3dayplots starting 3.7 seconds late 2015-03-19 16:55:03,665 INFO repeater task os150bb_3dayplots ended after 2.0 seconds 2015-03-19 16:55:03,666 INFO repeater task os150bb_tsstats starting 5.6 seconds late 2015-03-19 16:55:04,125 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 16:55:04,125 INFO repeater task os150nb_quick starting 6.1 seconds late 2015-03-19 16:55:05,756 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 16:55:05,756 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-19 16:55:05,757 INFO repeater task os150nb_3dayplots starting 7.7 seconds late 2015-03-19 16:55:07,583 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 16:55:07,583 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 16:55:07,583 INFO repeater task os150nb_tsstats starting 9.6 seconds late 2015-03-19 16:55:08,034 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 16:55:08,035 INFO repeater task os150bb_beamplots starting 10.0 seconds late 2015-03-19 16:55:08,833 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:55:08,833 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 16:55:08,833 INFO repeater task os150bb_beamplots starting 10.8 seconds late 2015-03-19 16:55:09,596 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:55:09,596 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 16:55:09,596 INFO repeater task os150nb_beamplots starting 11.6 seconds late 2015-03-19 16:55:10,383 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:55:10,383 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 16:55:10,383 INFO repeater task os150nb_beamplots starting 12.4 seconds late 2015-03-19 16:55:11,172 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 16:55:11,172 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 16:55:11,173 INFO repeater task posmv_hcorrstats starting 13.2 seconds late 2015-03-19 16:55:11,711 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 16:55:11,712 INFO repeater task posmv_plotposmv starting 13.7 seconds late 2015-03-19 16:55:12,112 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 16:55:17,118 INFO repeater task os150bb_lastensq starting 8.1 seconds late 2015-03-19 16:55:18,477 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 16:55:18,477 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:54:59 2015-03-19 16:55:18,478 INFO repeater task os150nb_lastensq starting 9.5 seconds late 2015-03-19 16:55:19,532 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 16:55:19,532 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:54:59 2015-03-19 16:55:59,624 INFO repeater task os150bb_10pings starting 1.6 seconds late 2015-03-19 16:55:59,725 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 16:55:59,726 INFO repeater task os150nb_10pings starting 1.7 seconds late 2015-03-19 16:55:59,820 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:00:00,342 INFO repeater task posmv_hcorrstats starting 2.3 seconds late 2015-03-19 17:00:00,875 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:00:00,875 INFO repeater task posmv_plotposmv starting 2.9 seconds late 2015-03-19 17:00:01,286 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:00:11,305 INFO repeater task os150bb_lastensq starting 2.3 seconds late 2015-03-19 17:00:12,723 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:00:12,723 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 16:59:59 2015-03-19 17:00:12,724 INFO repeater task os150nb_lastensq starting 3.7 seconds late 2015-03-19 17:00:13,794 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:00:13,794 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 16:59:59 2015-03-19 17:01:18,945 INFO repeater task os150bb_10pings starting 0.9 seconds late 2015-03-19 17:01:19,048 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:01:19,049 INFO repeater task os150nb_10pings starting 1.0 seconds late 2015-03-19 17:01:19,140 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:04:59,695 INFO repeater task posmv_hcorrstats starting 1.7 seconds late 2015-03-19 17:05:00,225 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:05:00,225 INFO repeater task posmv_plotposmv starting 2.2 seconds late 2015-03-19 17:05:00,631 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:05:10,649 INFO repeater task os150bb_lastensq starting 1.6 seconds late 2015-03-19 17:05:12,100 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-19 17:05:12,101 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:04:59 2015-03-19 17:05:12,101 INFO repeater task os150nb_lastensq starting 3.1 seconds late 2015-03-19 17:05:13,159 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:05:13,160 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:04:59 2015-03-19 17:06:38,347 INFO repeater task os150bb_10pings starting 0.3 seconds late 2015-03-19 17:06:38,448 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:06:38,449 INFO repeater task os150nb_10pings starting 0.4 seconds late 2015-03-19 17:06:38,541 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:09:58,990 INFO repeater task os150bb_quick starting 1.0 seconds late 2015-03-19 17:10:00,493 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:10:00,493 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 17:10:00,493 INFO repeater task os150bb_3dayplots starting 2.5 seconds late 2015-03-19 17:10:02,314 INFO repeater task os150bb_3dayplots ended after 1.8 seconds 2015-03-19 17:10:02,315 INFO repeater task os150bb_tsstats starting 4.3 seconds late 2015-03-19 17:10:02,787 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 17:10:02,787 INFO repeater task os150nb_quick starting 4.8 seconds late 2015-03-19 17:10:04,223 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:10:04,223 INFO repeater task os150nb_quick ended after 1.4 seconds 2015-03-19 17:10:04,223 INFO repeater task os150nb_3dayplots starting 6.2 seconds late 2015-03-19 17:10:06,035 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 17:10:06,035 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 17:10:06,035 INFO repeater task os150nb_tsstats starting 8.0 seconds late 2015-03-19 17:10:06,514 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 17:10:06,514 INFO repeater task os150bb_beamplots starting 8.5 seconds late 2015-03-19 17:10:07,329 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:10:07,329 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 17:10:07,329 INFO repeater task os150bb_beamplots starting 9.3 seconds late 2015-03-19 17:10:08,103 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:10:08,103 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 17:10:08,103 INFO repeater task os150nb_beamplots starting 10.1 seconds late 2015-03-19 17:10:08,918 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:10:08,918 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 17:10:08,918 INFO repeater task os150nb_beamplots starting 10.9 seconds late 2015-03-19 17:10:09,723 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:10:09,723 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 17:10:09,724 INFO repeater task posmv_hcorrstats starting 11.7 seconds late 2015-03-19 17:10:10,242 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:10:10,242 INFO repeater task posmv_plotposmv starting 12.2 seconds late 2015-03-19 17:10:10,641 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:10:15,647 INFO repeater task os150bb_lastensq starting 6.6 seconds late 2015-03-19 17:10:17,027 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:10:17,027 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:09:59 2015-03-19 17:10:17,028 INFO repeater task os150nb_lastensq starting 8.0 seconds late 2015-03-19 17:10:18,109 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:10:18,109 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:09:59 2015-03-19 17:11:58,322 INFO repeater task os150bb_10pings starting 0.3 seconds late 2015-03-19 17:11:58,415 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:11:58,416 INFO repeater task os150nb_10pings starting 0.4 seconds late 2015-03-19 17:11:58,513 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:14:58,902 INFO repeater task posmv_hcorrstats starting 0.9 seconds late 2015-03-19 17:14:59,450 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:14:59,450 INFO repeater task posmv_plotposmv starting 1.4 seconds late 2015-03-19 17:14:59,875 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:15:09,893 INFO repeater task os150bb_lastensq starting 0.9 seconds late 2015-03-19 17:15:11,320 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:15:11,321 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:14:59 2015-03-19 17:15:11,321 INFO repeater task os150nb_lastensq starting 2.3 seconds late 2015-03-19 17:15:12,380 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:15:12,381 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:14:59 2015-03-19 17:17:22,679 INFO repeater task os150bb_10pings starting 4.7 seconds late 2015-03-19 17:17:22,787 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:17:22,788 INFO repeater task os150nb_10pings starting 4.8 seconds late 2015-03-19 17:17:22,881 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:19:58,235 INFO repeater task posmv_hcorrstats starting 0.2 seconds late 2015-03-19 17:19:58,770 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:19:58,771 INFO repeater task posmv_plotposmv starting 0.7 seconds late 2015-03-19 17:19:59,183 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:20:09,199 INFO repeater task os150bb_lastensq starting 0.2 seconds late 2015-03-19 17:20:10,575 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:20:10,576 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:19:59 2015-03-19 17:20:10,577 INFO repeater task os150nb_lastensq starting 1.6 seconds late 2015-03-19 17:20:11,617 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 17:20:11,617 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:19:59 2015-03-19 17:22:41,926 INFO repeater task os150bb_10pings starting 3.9 seconds late 2015-03-19 17:22:42,034 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:22:42,035 INFO repeater task os150nb_10pings starting 4.0 seconds late 2015-03-19 17:22:42,130 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:25:02,490 INFO repeater task os150bb_quick starting 4.5 seconds late 2015-03-19 17:25:03,950 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:25:03,950 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 17:25:03,950 INFO repeater task os150bb_3dayplots starting 5.9 seconds late 2015-03-19 17:25:05,745 INFO repeater task os150bb_3dayplots ended after 1.8 seconds 2015-03-19 17:25:05,745 INFO repeater task os150bb_tsstats starting 7.7 seconds late 2015-03-19 17:25:06,196 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 17:25:06,197 INFO repeater task os150nb_quick starting 8.2 seconds late 2015-03-19 17:25:07,698 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:25:07,698 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 17:25:07,698 INFO repeater task os150nb_3dayplots starting 9.7 seconds late 2015-03-19 17:25:09,616 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 17:25:09,616 INFO repeater task os150nb_3dayplots ended after 1.9 seconds 2015-03-19 17:25:09,616 INFO repeater task os150nb_tsstats starting 11.6 seconds late 2015-03-19 17:25:10,066 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 17:25:10,067 INFO repeater task os150bb_beamplots starting 12.0 seconds late 2015-03-19 17:25:10,909 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:25:10,909 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 17:25:10,910 INFO repeater task os150bb_beamplots starting 12.9 seconds late 2015-03-19 17:25:11,712 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:25:11,712 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 17:25:11,713 INFO repeater task os150nb_beamplots starting 13.7 seconds late 2015-03-19 17:25:12,550 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:25:12,551 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 17:25:12,551 INFO repeater task os150nb_beamplots starting 14.5 seconds late 2015-03-19 17:25:13,375 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:25:13,375 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 17:25:13,376 INFO repeater task posmv_hcorrstats starting 15.4 seconds late 2015-03-19 17:25:13,909 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:25:13,909 INFO repeater task posmv_plotposmv starting 15.9 seconds late 2015-03-19 17:25:14,334 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:25:19,340 INFO repeater task os150bb_lastensq starting 10.3 seconds late 2015-03-19 17:25:20,767 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:25:20,767 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:24:59 2015-03-19 17:25:20,768 INFO repeater task os150nb_lastensq starting 11.8 seconds late 2015-03-19 17:25:21,873 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:25:21,873 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:24:59 2015-03-19 17:28:02,209 INFO repeater task os150bb_10pings starting 4.2 seconds late 2015-03-19 17:28:02,318 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:28:02,319 INFO repeater task os150nb_10pings starting 4.3 seconds late 2015-03-19 17:28:02,411 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:30:02,664 INFO repeater task posmv_hcorrstats starting 4.6 seconds late 2015-03-19 17:30:03,200 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:30:03,201 INFO repeater task posmv_plotposmv starting 5.2 seconds late 2015-03-19 17:30:03,614 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:30:13,631 INFO repeater task os150bb_lastensq starting 4.6 seconds late 2015-03-19 17:30:15,008 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:30:15,009 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:29:59 2015-03-19 17:30:15,009 INFO repeater task os150nb_lastensq starting 6.0 seconds late 2015-03-19 17:30:16,039 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 17:30:16,039 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:29:59 2015-03-19 17:33:21,494 INFO repeater task os150bb_10pings starting 3.5 seconds late 2015-03-19 17:33:21,603 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:33:21,604 INFO repeater task os150nb_10pings starting 3.6 seconds late 2015-03-19 17:33:21,699 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:35:01,891 INFO repeater task posmv_hcorrstats starting 3.9 seconds late 2015-03-19 17:35:02,435 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:35:02,435 INFO repeater task posmv_plotposmv starting 4.4 seconds late 2015-03-19 17:35:02,856 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:35:12,874 INFO repeater task os150bb_lastensq starting 3.9 seconds late 2015-03-19 17:35:14,335 INFO repeater task os150bb_lastensq ended after 1.5 seconds 2015-03-19 17:35:14,335 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:34:59 2015-03-19 17:35:14,336 INFO repeater task os150nb_lastensq starting 5.3 seconds late 2015-03-19 17:35:15,416 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:35:15,417 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:34:59 2015-03-19 17:38:40,923 INFO repeater task os150bb_10pings starting 2.9 seconds late 2015-03-19 17:38:41,028 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:38:41,028 INFO repeater task os150nb_10pings starting 3.0 seconds late 2015-03-19 17:38:41,118 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:40:01,303 INFO repeater task os150bb_quick starting 3.3 seconds late 2015-03-19 17:40:02,776 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:40:02,776 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 17:40:02,776 INFO repeater task os150bb_3dayplots starting 4.8 seconds late 2015-03-19 17:40:04,599 INFO repeater task os150bb_3dayplots ended after 1.8 seconds 2015-03-19 17:40:04,600 INFO repeater task os150bb_tsstats starting 6.6 seconds late 2015-03-19 17:40:05,070 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 17:40:05,071 INFO repeater task os150nb_quick starting 7.1 seconds late 2015-03-19 17:40:06,513 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:40:06,513 INFO repeater task os150nb_quick ended after 1.4 seconds 2015-03-19 17:40:06,514 INFO repeater task os150nb_3dayplots starting 8.5 seconds late 2015-03-19 17:40:08,340 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 17:40:08,340 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 17:40:08,341 INFO repeater task os150nb_tsstats starting 10.3 seconds late 2015-03-19 17:40:08,783 INFO repeater task os150nb_tsstats ended after 0.4 seconds 2015-03-19 17:40:08,784 INFO repeater task os150bb_beamplots starting 10.8 seconds late 2015-03-19 17:40:09,606 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:40:09,606 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 17:40:09,607 INFO repeater task os150bb_beamplots starting 11.6 seconds late 2015-03-19 17:40:10,411 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:40:10,411 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 17:40:10,411 INFO repeater task os150nb_beamplots starting 12.4 seconds late 2015-03-19 17:40:11,230 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:40:11,231 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 17:40:11,231 INFO repeater task os150nb_beamplots starting 13.2 seconds late 2015-03-19 17:40:12,075 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:40:12,076 INFO repeater task os150nb_beamplots ended after 0.8 seconds 2015-03-19 17:40:12,076 INFO repeater task posmv_hcorrstats starting 14.1 seconds late 2015-03-19 17:40:12,602 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:40:12,602 INFO repeater task posmv_plotposmv starting 14.6 seconds late 2015-03-19 17:40:13,013 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:40:18,018 INFO repeater task os150bb_lastensq starting 9.0 seconds late 2015-03-19 17:40:19,415 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:40:19,415 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:39:59 2015-03-19 17:40:19,416 INFO repeater task os150nb_lastensq starting 10.4 seconds late 2015-03-19 17:40:20,454 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 17:40:20,455 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:39:59 2015-03-19 17:44:00,962 INFO repeater task os150bb_10pings starting 2.9 seconds late 2015-03-19 17:44:01,061 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:44:01,062 INFO repeater task os150nb_10pings starting 3.0 seconds late 2015-03-19 17:44:01,152 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:45:01,292 INFO repeater task posmv_hcorrstats starting 3.3 seconds late 2015-03-19 17:45:01,827 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:45:01,828 INFO repeater task posmv_plotposmv starting 3.8 seconds late 2015-03-19 17:45:02,242 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:45:12,261 INFO repeater task os150bb_lastensq starting 3.3 seconds late 2015-03-19 17:45:13,631 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:45:13,632 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:44:59 2015-03-19 17:45:13,632 INFO repeater task os150nb_lastensq starting 4.6 seconds late 2015-03-19 17:45:14,700 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:45:14,700 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:44:59 2015-03-19 17:49:20,255 INFO repeater task os150bb_10pings starting 2.2 seconds late 2015-03-19 17:49:20,360 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:49:20,360 INFO repeater task os150nb_10pings starting 2.3 seconds late 2015-03-19 17:49:20,447 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:50:00,539 INFO repeater task posmv_hcorrstats starting 2.5 seconds late 2015-03-19 17:50:01,072 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:50:01,073 INFO repeater task posmv_plotposmv starting 3.1 seconds late 2015-03-19 17:50:01,500 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:50:11,518 INFO repeater task os150bb_lastensq starting 2.5 seconds late 2015-03-19 17:50:12,880 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:50:12,880 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:49:59 2015-03-19 17:50:12,881 INFO repeater task os150nb_lastensq starting 3.9 seconds late 2015-03-19 17:50:13,911 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 17:50:13,911 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:49:59 2015-03-19 17:54:39,541 INFO repeater task os150bb_10pings starting 1.5 seconds late 2015-03-19 17:54:39,639 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 17:54:39,640 INFO repeater task os150nb_10pings starting 1.6 seconds late 2015-03-19 17:54:39,732 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 17:54:59,774 INFO repeater task os150bb_quick starting 1.8 seconds late 2015-03-19 17:55:01,290 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:55:01,290 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 17:55:01,291 INFO repeater task os150bb_3dayplots starting 3.3 seconds late 2015-03-19 17:55:03,175 INFO repeater task os150bb_3dayplots ended after 1.9 seconds 2015-03-19 17:55:03,175 INFO repeater task os150bb_tsstats starting 5.2 seconds late 2015-03-19 17:55:03,657 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 17:55:03,657 INFO repeater task os150nb_quick starting 5.6 seconds late 2015-03-19 17:55:05,124 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 17:55:05,124 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 17:55:05,124 INFO repeater task os150nb_3dayplots starting 7.1 seconds late 2015-03-19 17:55:07,029 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 17:55:07,029 INFO repeater task os150nb_3dayplots ended after 1.9 seconds 2015-03-19 17:55:07,029 INFO repeater task os150nb_tsstats starting 9.0 seconds late 2015-03-19 17:55:07,500 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 17:55:07,501 INFO repeater task os150bb_beamplots starting 9.5 seconds late 2015-03-19 17:55:08,375 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:55:08,375 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-19 17:55:08,376 INFO repeater task os150bb_beamplots starting 10.4 seconds late 2015-03-19 17:55:09,208 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:55:09,208 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 17:55:09,208 INFO repeater task os150nb_beamplots starting 11.2 seconds late 2015-03-19 17:55:10,075 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:55:10,075 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 17:55:10,076 INFO repeater task os150nb_beamplots starting 12.1 seconds late 2015-03-19 17:55:10,941 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 17:55:10,941 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 17:55:10,942 INFO repeater task posmv_hcorrstats starting 12.9 seconds late 2015-03-19 17:55:11,476 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 17:55:11,476 INFO repeater task posmv_plotposmv starting 13.5 seconds late 2015-03-19 17:55:11,889 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 17:55:16,895 INFO repeater task os150bb_lastensq starting 7.9 seconds late 2015-03-19 17:55:18,300 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 17:55:18,301 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:54:59 2015-03-19 17:55:18,301 INFO repeater task os150nb_lastensq starting 9.3 seconds late 2015-03-19 17:55:19,367 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 17:55:19,367 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:54:59 2015-03-19 18:00:00,056 INFO repeater task os150bb_10pings starting 2.0 seconds late 2015-03-19 18:00:00,159 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:00:00,160 INFO repeater task os150nb_10pings starting 2.1 seconds late 2015-03-19 18:00:00,247 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:00:00,249 INFO repeater task posmv_hcorrstats starting 2.2 seconds late 2015-03-19 18:00:00,775 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 18:00:00,775 INFO repeater task posmv_plotposmv starting 2.8 seconds late 2015-03-19 18:00:01,192 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:00:11,210 INFO repeater task os150bb_lastensq starting 2.2 seconds late 2015-03-19 18:00:12,566 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:00:12,566 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 17:59:59 2015-03-19 18:00:12,567 INFO repeater task os150nb_lastensq starting 3.6 seconds late 2015-03-19 18:00:13,634 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 18:00:13,634 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 17:59:59 2015-03-19 18:04:59,245 INFO repeater task posmv_hcorrstats starting 1.2 seconds late 2015-03-19 18:04:59,829 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-19 18:04:59,830 INFO repeater task posmv_plotposmv starting 1.8 seconds late 2015-03-19 18:05:00,253 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:05:10,272 INFO repeater task os150bb_lastensq starting 1.3 seconds late 2015-03-19 18:05:11,635 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:05:11,635 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:04:59 2015-03-19 18:05:11,636 INFO repeater task os150nb_lastensq starting 2.6 seconds late 2015-03-19 18:05:12,683 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 18:05:12,683 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:04:59 2015-03-19 18:05:22,696 INFO repeater task os150bb_10pings starting 4.7 seconds late 2015-03-19 18:05:22,793 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:05:22,794 INFO repeater task os150nb_10pings starting 4.8 seconds late 2015-03-19 18:05:22,889 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:09:58,427 INFO repeater task os150bb_quick starting 0.4 seconds late 2015-03-19 18:09:59,933 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 18:09:59,933 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 18:09:59,933 INFO repeater task os150bb_3dayplots starting 1.9 seconds late 2015-03-19 18:10:01,730 INFO repeater task os150bb_3dayplots ended after 1.8 seconds 2015-03-19 18:10:01,731 INFO repeater task os150bb_tsstats starting 3.7 seconds late 2015-03-19 18:10:02,196 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 18:10:02,196 INFO repeater task os150nb_quick starting 4.2 seconds late 2015-03-19 18:10:03,714 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 18:10:03,714 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 18:10:03,714 INFO repeater task os150nb_3dayplots starting 5.7 seconds late 2015-03-19 18:10:05,594 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 18:10:05,594 INFO repeater task os150nb_3dayplots ended after 1.9 seconds 2015-03-19 18:10:05,594 INFO repeater task os150nb_tsstats starting 7.6 seconds late 2015-03-19 18:10:06,052 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 18:10:06,053 INFO repeater task os150bb_beamplots starting 8.0 seconds late 2015-03-19 18:10:06,924 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:10:06,924 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-19 18:10:06,924 INFO repeater task os150bb_beamplots starting 8.9 seconds late 2015-03-19 18:10:07,744 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:10:07,744 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 18:10:07,745 INFO repeater task os150nb_beamplots starting 9.7 seconds late 2015-03-19 18:10:08,616 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:10:08,617 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 18:10:08,617 INFO repeater task os150nb_beamplots starting 10.6 seconds late 2015-03-19 18:10:09,485 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:10:09,485 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 18:10:09,486 INFO repeater task posmv_hcorrstats starting 11.5 seconds late 2015-03-19 18:10:10,015 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 18:10:10,015 INFO repeater task posmv_plotposmv starting 12.0 seconds late 2015-03-19 18:10:10,442 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:10:15,448 INFO repeater task os150bb_lastensq starting 6.4 seconds late 2015-03-19 18:10:16,800 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:10:16,800 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:09:59 2015-03-19 18:10:16,801 INFO repeater task os150nb_lastensq starting 7.8 seconds late 2015-03-19 18:10:17,855 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 18:10:17,855 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:09:59 2015-03-19 18:10:42,910 INFO repeater task os150bb_10pings starting 4.9 seconds late 2015-03-19 18:10:43,017 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:10:43,018 INFO repeater task os150nb_10pings starting 5.0 seconds late 2015-03-19 18:10:43,112 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:14:58,722 INFO repeater task posmv_hcorrstats starting 0.7 seconds late 2015-03-19 18:14:59,293 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-19 18:14:59,294 INFO repeater task posmv_plotposmv starting 1.3 seconds late 2015-03-19 18:14:59,745 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-19 18:15:09,758 INFO repeater task os150bb_lastensq starting 0.8 seconds late 2015-03-19 18:15:11,119 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:15:11,120 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:14:59 2015-03-19 18:15:11,121 INFO repeater task os150nb_lastensq starting 2.1 seconds late 2015-03-19 18:15:12,178 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 18:15:12,178 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:14:59 2015-03-19 18:16:02,282 INFO repeater task os150bb_10pings starting 4.3 seconds late 2015-03-19 18:16:02,380 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:16:02,381 INFO repeater task os150nb_10pings starting 4.4 seconds late 2015-03-19 18:16:02,472 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:20:03,034 INFO repeater task posmv_hcorrstats starting 5.0 seconds late 2015-03-19 18:20:03,593 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-19 18:20:03,594 INFO repeater task posmv_plotposmv starting 5.6 seconds late 2015-03-19 18:20:04,018 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:20:09,024 INFO repeater task os150bb_lastensq starting 0.0 seconds late 2015-03-19 18:20:10,440 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:20:10,440 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:19:59 2015-03-19 18:20:10,441 INFO repeater task os150nb_lastensq starting 1.4 seconds late 2015-03-19 18:20:11,508 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 18:20:11,508 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:19:59 2015-03-19 18:21:21,662 INFO repeater task os150bb_10pings starting 3.6 seconds late 2015-03-19 18:21:21,762 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:21:21,763 INFO repeater task os150nb_10pings starting 3.7 seconds late 2015-03-19 18:21:21,863 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:25:02,345 INFO repeater task os150bb_quick starting 4.3 seconds late 2015-03-19 18:25:03,845 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 18:25:03,845 INFO repeater task os150bb_quick ended after 1.5 seconds 2015-03-19 18:25:03,845 INFO repeater task os150bb_3dayplots starting 5.8 seconds late 2015-03-19 18:25:05,588 INFO repeater task os150bb_3dayplots ended after 1.7 seconds 2015-03-19 18:25:05,589 INFO repeater task os150bb_tsstats starting 7.6 seconds late 2015-03-19 18:25:06,050 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 18:25:06,050 INFO repeater task os150nb_quick starting 8.0 seconds late 2015-03-19 18:25:07,516 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 18:25:07,516 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 18:25:07,517 INFO repeater task os150nb_3dayplots starting 9.5 seconds late 2015-03-19 18:25:09,303 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 18:25:09,303 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 18:25:09,303 INFO repeater task os150nb_tsstats starting 11.3 seconds late 2015-03-19 18:25:09,764 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 18:25:09,764 INFO repeater task os150bb_beamplots starting 11.7 seconds late 2015-03-19 18:25:10,576 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:25:10,576 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 18:25:10,576 INFO repeater task os150bb_beamplots starting 12.6 seconds late 2015-03-19 18:25:11,461 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:25:11,461 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2015-03-19 18:25:11,461 INFO repeater task os150nb_beamplots starting 13.4 seconds late 2015-03-19 18:25:12,317 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:25:12,317 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 18:25:12,317 INFO repeater task os150nb_beamplots starting 14.3 seconds late 2015-03-19 18:25:13,172 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:25:13,172 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 18:25:13,172 INFO repeater task posmv_hcorrstats starting 15.1 seconds late 2015-03-19 18:25:13,700 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 18:25:13,700 INFO repeater task posmv_plotposmv starting 15.7 seconds late 2015-03-19 18:25:14,120 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:25:19,126 INFO repeater task os150bb_lastensq starting 10.1 seconds late 2015-03-19 18:25:20,459 INFO repeater task os150bb_lastensq ended after 1.3 seconds 2015-03-19 18:25:20,459 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:24:59 2015-03-19 18:25:20,460 INFO repeater task os150nb_lastensq starting 11.5 seconds late 2015-03-19 18:25:21,522 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 18:25:21,522 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:24:59 2015-03-19 18:26:41,668 INFO repeater task os150bb_10pings starting 3.6 seconds late 2015-03-19 18:26:41,770 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:26:41,772 INFO repeater task os150nb_10pings starting 3.8 seconds late 2015-03-19 18:26:41,866 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:30:02,232 INFO repeater task posmv_hcorrstats starting 4.2 seconds late 2015-03-19 18:30:02,774 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 18:30:02,774 INFO repeater task posmv_plotposmv starting 4.8 seconds late 2015-03-19 18:30:03,202 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:30:13,216 INFO repeater task os150bb_lastensq starting 4.2 seconds late 2015-03-19 18:30:14,588 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:30:14,589 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:29:59 2015-03-19 18:30:14,589 INFO repeater task os150nb_lastensq starting 5.6 seconds late 2015-03-19 18:30:15,618 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 18:30:15,618 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:29:59 2015-03-19 18:32:00,856 INFO repeater task os150bb_10pings starting 2.8 seconds late 2015-03-19 18:32:00,963 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:32:00,964 INFO repeater task os150nb_10pings starting 2.9 seconds late 2015-03-19 18:32:01,057 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:35:01,483 INFO repeater task posmv_hcorrstats starting 3.5 seconds late 2015-03-19 18:35:02,028 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 18:35:02,028 INFO repeater task posmv_plotposmv starting 4.0 seconds late 2015-03-19 18:35:02,459 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:35:12,477 INFO repeater task os150bb_lastensq starting 3.5 seconds late 2015-03-19 18:35:13,831 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:35:13,831 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:34:59 2015-03-19 18:35:13,832 INFO repeater task os150nb_lastensq starting 4.8 seconds late 2015-03-19 18:35:14,891 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 18:35:14,891 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:34:59 2015-03-19 18:37:20,147 INFO repeater task os150bb_10pings starting 2.1 seconds late 2015-03-19 18:37:20,252 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:37:20,253 INFO repeater task os150nb_10pings starting 2.2 seconds late 2015-03-19 18:37:20,350 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:40:00,647 INFO repeater task os150bb_quick starting 2.6 seconds late 2015-03-19 18:40:02,199 INFO repeater task os150bb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 18:40:02,199 INFO repeater task os150bb_quick ended after 1.6 seconds 2015-03-19 18:40:02,199 INFO repeater task os150bb_3dayplots starting 4.2 seconds late 2015-03-19 18:40:04,051 INFO repeater task os150bb_3dayplots ended after 1.9 seconds 2015-03-19 18:40:04,051 INFO repeater task os150bb_tsstats starting 6.0 seconds late 2015-03-19 18:40:04,504 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2015-03-19 18:40:04,505 INFO repeater task os150nb_quick starting 6.5 seconds late 2015-03-19 18:40:06,035 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-19 18:40:06,036 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-19 18:40:06,036 INFO repeater task os150nb_3dayplots starting 8.0 seconds late 2015-03-19 18:40:07,886 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-19 18:40:07,886 INFO repeater task os150nb_3dayplots ended after 1.8 seconds 2015-03-19 18:40:07,886 INFO repeater task os150nb_tsstats starting 9.9 seconds late 2015-03-19 18:40:08,360 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-19 18:40:08,361 INFO repeater task os150bb_beamplots starting 10.3 seconds late 2015-03-19 18:40:09,206 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:40:09,207 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 18:40:09,207 INFO repeater task os150bb_beamplots starting 11.2 seconds late 2015-03-19 18:40:10,056 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:40:10,056 INFO repeater task os150bb_beamplots ended after 0.8 seconds 2015-03-19 18:40:10,057 INFO repeater task os150nb_beamplots starting 12.0 seconds late 2015-03-19 18:40:10,958 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:40:10,958 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 18:40:10,958 INFO repeater task os150nb_beamplots starting 12.9 seconds late 2015-03-19 18:40:11,811 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-19 18:40:11,811 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-19 18:40:11,811 INFO repeater task posmv_hcorrstats starting 13.8 seconds late 2015-03-19 18:40:12,376 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-19 18:40:12,376 INFO repeater task posmv_plotposmv starting 14.4 seconds late 2015-03-19 18:40:12,821 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:40:17,827 INFO repeater task os150bb_lastensq starting 8.8 seconds late 2015-03-19 18:40:19,232 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:40:19,232 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:39:59 2015-03-19 18:40:19,233 INFO repeater task os150nb_lastensq starting 10.2 seconds late 2015-03-19 18:40:20,305 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2015-03-19 18:40:20,306 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:39:59 2015-03-19 18:42:40,632 INFO repeater task os150bb_10pings starting 2.6 seconds late 2015-03-19 18:42:40,734 INFO repeater task os150bb_10pings ended after 0.1 seconds 2015-03-19 18:42:40,735 INFO repeater task os150nb_10pings starting 2.7 seconds late 2015-03-19 18:42:40,829 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-19 18:45:01,163 INFO repeater task posmv_hcorrstats starting 3.1 seconds late 2015-03-19 18:45:01,703 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-19 18:45:01,703 INFO repeater task posmv_plotposmv starting 3.7 seconds late 2015-03-19 18:45:02,124 INFO repeater task posmv_plotposmv ended after 0.4 seconds 2015-03-19 18:45:12,143 INFO repeater task os150bb_lastensq starting 3.1 seconds late 2015-03-19 18:45:13,511 INFO repeater task os150bb_lastensq ended after 1.4 seconds 2015-03-19 18:45:13,511 INFO repeater task os150bb_lastensq: Time from /home/data/NF1501_Tb/proc/os150bb/load/wrote_ens_time: 2015/03/19 18:44:59 2015-03-19 18:45:13,512 INFO repeater task os150nb_lastensq starting 4.5 seconds late 2015-03-19 18:45:14,548 INFO repeater task os150nb_lastensq ended after 1.0 seconds 2015-03-19 18:45:14,548 INFO repeater task os150nb_lastensq: Time from /home/data/NF1501_Tb/proc/os150nb/load/wrote_ens_time: 2015/03/19 18:44:59 2015-03-19 18:47:59,918 INFO repeater task os150bb_10pings starting 1.9 seconds late 2015-03-19 18:48:00,016 INFO repeater task os150bb_10pings ended after 0.1 seconds