2015-03-18 05:23:10,543 INFO repeater task os150nb_lastensq starting 4.5 seconds late 2015-03-18 05:23:11,990 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:23:11,990 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:22:56 2015-03-18 05:25:17,214 INFO repeater task os150nb_10pings starting 1.7 seconds late 2015-03-18 05:25:17,326 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 05:27:57,610 INFO repeater task posmv_hcorrstats starting 2.1 seconds late 2015-03-18 05:27:58,166 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 05:27:58,166 INFO repeater task posmv_plotposmv starting 2.7 seconds late 2015-03-18 05:27:58,633 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 05:28:08,650 INFO repeater task os150nb_lastensq starting 2.7 seconds late 2015-03-18 05:28:10,034 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:28:10,034 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:27:56 2015-03-18 05:30:40,300 INFO repeater task os150nb_10pings starting 4.8 seconds late 2015-03-18 05:30:40,406 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 05:32:55,652 INFO repeater task os150nb_quick starting 0.2 seconds late 2015-03-18 05:32:57,190 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 05:32:57,190 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 05:32:57,190 INFO repeater task os150nb_3dayplots starting 1.7 seconds late 2015-03-18 05:32:59,425 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 05:32:59,425 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 05:32:59,425 INFO repeater task os150nb_tsstats starting 4.0 seconds late 2015-03-18 05:32:59,904 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 05:32:59,904 INFO repeater task os150nb_beamplots starting 4.4 seconds late 2015-03-18 05:33:00,844 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 05:33:00,845 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 05:33:00,845 INFO repeater task os150nb_beamplots starting 5.4 seconds late 2015-03-18 05:33:01,800 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 05:33:01,801 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 05:33:01,801 INFO repeater task posmv_hcorrstats starting 6.3 seconds late 2015-03-18 05:33:02,351 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 05:33:02,352 INFO repeater task posmv_plotposmv starting 6.9 seconds late 2015-03-18 05:33:02,816 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 05:33:07,822 INFO repeater task os150nb_lastensq starting 1.8 seconds late 2015-03-18 05:33:09,235 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:33:09,235 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:32:56 2015-03-18 05:35:59,523 INFO repeater task os150nb_10pings starting 4.0 seconds late 2015-03-18 05:35:59,626 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 05:37:59,846 INFO repeater task posmv_hcorrstats starting 4.4 seconds late 2015-03-18 05:38:00,373 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 05:38:00,373 INFO repeater task posmv_plotposmv starting 4.9 seconds late 2015-03-18 05:38:00,826 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 05:38:10,841 INFO repeater task os150nb_lastensq starting 4.8 seconds late 2015-03-18 05:38:12,238 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:38:12,238 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:37:56 2015-03-18 05:41:17,505 INFO repeater task os150nb_10pings starting 2.0 seconds late 2015-03-18 05:41:17,615 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 05:42:57,759 INFO repeater task posmv_hcorrstats starting 2.3 seconds late 2015-03-18 05:42:58,326 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 05:42:58,326 INFO repeater task posmv_plotposmv starting 2.8 seconds late 2015-03-18 05:42:58,788 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 05:43:08,803 INFO repeater task os150nb_lastensq starting 2.8 seconds late 2015-03-18 05:43:10,189 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:43:10,189 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:42:56 2015-03-18 05:46:35,593 INFO repeater task os150nb_10pings starting 0.1 seconds late 2015-03-18 05:46:35,697 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 05:47:55,841 INFO repeater task os150nb_quick starting 0.4 seconds late 2015-03-18 05:47:57,386 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 05:47:57,386 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 05:47:57,386 INFO repeater task os150nb_3dayplots starting 1.9 seconds late 2015-03-18 05:47:59,560 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 05:47:59,560 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 05:47:59,560 INFO repeater task os150nb_tsstats starting 4.1 seconds late 2015-03-18 05:48:00,031 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 05:48:00,032 INFO repeater task os150nb_beamplots starting 4.6 seconds late 2015-03-18 05:48:00,963 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 05:48:00,964 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 05:48:00,964 INFO repeater task os150nb_beamplots starting 5.5 seconds late 2015-03-18 05:48:01,897 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 05:48:01,897 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 05:48:01,897 INFO repeater task posmv_hcorrstats starting 6.4 seconds late 2015-03-18 05:48:02,433 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 05:48:02,434 INFO repeater task posmv_plotposmv starting 7.0 seconds late 2015-03-18 05:48:02,891 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 05:48:07,896 INFO repeater task os150nb_lastensq starting 1.9 seconds late 2015-03-18 05:48:09,277 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:48:09,277 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:47:56 2015-03-18 05:51:59,638 INFO repeater task os150nb_10pings starting 4.2 seconds late 2015-03-18 05:51:59,737 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 05:52:59,820 INFO repeater task posmv_hcorrstats starting 4.3 seconds late 2015-03-18 05:53:00,379 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 05:53:00,380 INFO repeater task posmv_plotposmv starting 4.9 seconds late 2015-03-18 05:53:00,834 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 05:53:10,850 INFO repeater task os150nb_lastensq starting 4.9 seconds late 2015-03-18 05:53:12,225 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:53:12,225 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:52:56 2015-03-18 05:57:17,669 INFO repeater task os150nb_10pings starting 2.2 seconds late 2015-03-18 05:57:17,772 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 05:57:57,843 INFO repeater task posmv_hcorrstats starting 2.4 seconds late 2015-03-18 05:57:58,396 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 05:57:58,397 INFO repeater task posmv_plotposmv starting 2.9 seconds late 2015-03-18 05:57:58,850 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 05:58:08,866 INFO repeater task os150nb_lastensq starting 2.9 seconds late 2015-03-18 05:58:10,251 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 05:58:10,251 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 05:57:56 2015-03-18 06:02:35,736 INFO repeater task os150nb_10pings starting 0.3 seconds late 2015-03-18 06:02:35,835 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:02:55,869 INFO repeater task os150nb_quick starting 0.4 seconds late 2015-03-18 06:02:57,434 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 06:02:57,435 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-18 06:02:57,435 INFO repeater task os150nb_3dayplots starting 2.0 seconds late 2015-03-18 06:02:59,651 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 06:02:59,651 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 06:02:59,651 INFO repeater task os150nb_tsstats starting 4.2 seconds late 2015-03-18 06:03:00,130 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 06:03:00,130 INFO repeater task os150nb_beamplots starting 4.7 seconds late 2015-03-18 06:03:01,079 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:03:01,079 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 06:03:01,079 INFO repeater task os150nb_beamplots starting 5.6 seconds late 2015-03-18 06:03:02,042 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:03:02,042 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 06:03:02,042 INFO repeater task posmv_hcorrstats starting 6.6 seconds late 2015-03-18 06:03:02,619 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 06:03:02,619 INFO repeater task posmv_plotposmv starting 7.1 seconds late 2015-03-18 06:03:03,085 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:03:08,091 INFO repeater task os150nb_lastensq starting 2.1 seconds late 2015-03-18 06:03:09,558 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 06:03:09,558 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:02:56 2015-03-18 06:08:00,081 INFO repeater task os150nb_10pings starting 4.6 seconds late 2015-03-18 06:08:00,188 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:08:00,189 INFO repeater task posmv_hcorrstats starting 4.7 seconds late 2015-03-18 06:08:00,756 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 06:08:00,756 INFO repeater task posmv_plotposmv starting 5.3 seconds late 2015-03-18 06:08:01,222 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:08:06,227 INFO repeater task os150nb_lastensq starting 0.2 seconds late 2015-03-18 06:08:07,725 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 06:08:07,726 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:07:56 2015-03-18 06:12:58,178 INFO repeater task posmv_hcorrstats starting 2.7 seconds late 2015-03-18 06:12:58,753 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 06:12:58,753 INFO repeater task posmv_plotposmv starting 3.3 seconds late 2015-03-18 06:12:59,216 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:13:09,229 INFO repeater task os150nb_lastensq starting 3.2 seconds late 2015-03-18 06:13:10,636 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:13:10,636 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:12:56 2015-03-18 06:13:15,643 INFO repeater task os150nb_10pings starting 0.2 seconds late 2015-03-18 06:13:15,749 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:17:56,262 INFO repeater task os150nb_quick starting 0.8 seconds late 2015-03-18 06:17:57,786 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 06:17:57,786 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 06:17:57,786 INFO repeater task os150nb_3dayplots starting 2.3 seconds late 2015-03-18 06:18:00,068 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 06:18:00,068 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 06:18:00,068 INFO repeater task os150nb_tsstats starting 4.6 seconds late 2015-03-18 06:18:00,530 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 06:18:00,530 INFO repeater task os150nb_beamplots starting 5.1 seconds late 2015-03-18 06:18:01,494 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:18:01,495 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 06:18:01,495 INFO repeater task os150nb_beamplots starting 6.0 seconds late 2015-03-18 06:18:02,464 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:18:02,464 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 06:18:02,464 INFO repeater task posmv_hcorrstats starting 7.0 seconds late 2015-03-18 06:18:03,022 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 06:18:03,022 INFO repeater task posmv_plotposmv starting 7.5 seconds late 2015-03-18 06:18:03,485 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:18:08,491 INFO repeater task os150nb_lastensq starting 2.5 seconds late 2015-03-18 06:18:09,917 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:18:09,917 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:17:56 2015-03-18 06:18:39,968 INFO repeater task os150nb_10pings starting 4.5 seconds late 2015-03-18 06:18:40,071 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:22:55,518 INFO repeater task posmv_hcorrstats starting 0.0 seconds late 2015-03-18 06:22:56,062 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 06:22:56,062 INFO repeater task posmv_plotposmv starting 0.6 seconds late 2015-03-18 06:22:56,530 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:23:06,544 INFO repeater task os150nb_lastensq starting 0.5 seconds late 2015-03-18 06:23:08,000 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 06:23:08,001 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:22:56 2015-03-18 06:23:58,089 INFO repeater task os150nb_10pings starting 2.6 seconds late 2015-03-18 06:23:58,194 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:27:58,628 INFO repeater task posmv_hcorrstats starting 3.1 seconds late 2015-03-18 06:27:59,205 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 06:27:59,206 INFO repeater task posmv_plotposmv starting 3.7 seconds late 2015-03-18 06:27:59,685 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:28:09,700 INFO repeater task os150nb_lastensq starting 3.7 seconds late 2015-03-18 06:28:11,098 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:28:11,098 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:27:56 2015-03-18 06:29:16,208 INFO repeater task os150nb_10pings starting 0.7 seconds late 2015-03-18 06:29:16,318 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:32:56,694 INFO repeater task os150nb_quick starting 1.2 seconds late 2015-03-18 06:32:58,235 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 06:32:58,235 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 06:32:58,235 INFO repeater task os150nb_3dayplots starting 2.8 seconds late 2015-03-18 06:33:00,455 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 06:33:00,456 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 06:33:00,456 INFO repeater task os150nb_tsstats starting 5.0 seconds late 2015-03-18 06:33:00,903 INFO repeater task os150nb_tsstats ended after 0.4 seconds 2015-03-18 06:33:00,903 INFO repeater task os150nb_beamplots starting 5.4 seconds late 2015-03-18 06:33:01,849 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:33:01,849 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 06:33:01,850 INFO repeater task os150nb_beamplots starting 6.4 seconds late 2015-03-18 06:33:02,797 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:33:02,797 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 06:33:02,797 INFO repeater task posmv_hcorrstats starting 7.3 seconds late 2015-03-18 06:33:03,329 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 06:33:03,330 INFO repeater task posmv_plotposmv starting 7.9 seconds late 2015-03-18 06:33:03,816 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:33:08,822 INFO repeater task os150nb_lastensq starting 2.8 seconds late 2015-03-18 06:33:10,233 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:33:10,233 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:32:56 2015-03-18 06:34:40,393 INFO repeater task os150nb_10pings starting 4.9 seconds late 2015-03-18 06:34:40,500 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:37:55,852 INFO repeater task posmv_hcorrstats starting 0.4 seconds late 2015-03-18 06:37:56,393 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 06:37:56,393 INFO repeater task posmv_plotposmv starting 0.9 seconds late 2015-03-18 06:37:56,882 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:38:06,898 INFO repeater task os150nb_lastensq starting 0.9 seconds late 2015-03-18 06:38:08,346 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:38:08,347 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:37:56 2015-03-18 06:39:58,512 INFO repeater task os150nb_10pings starting 3.0 seconds late 2015-03-18 06:39:58,620 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:42:58,875 INFO repeater task posmv_hcorrstats starting 3.4 seconds late 2015-03-18 06:42:59,427 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 06:42:59,427 INFO repeater task posmv_plotposmv starting 3.9 seconds late 2015-03-18 06:42:59,917 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:43:09,932 INFO repeater task os150nb_lastensq starting 3.9 seconds late 2015-03-18 06:43:11,348 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:43:11,348 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:42:56 2015-03-18 06:45:16,614 INFO repeater task os150nb_10pings starting 1.1 seconds late 2015-03-18 06:45:16,717 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:47:57,058 INFO repeater task os150nb_quick starting 1.6 seconds late 2015-03-18 06:47:58,564 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 06:47:58,564 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 06:47:58,564 INFO repeater task os150nb_3dayplots starting 3.1 seconds late 2015-03-18 06:48:00,854 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 06:48:00,855 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 06:48:00,855 INFO repeater task os150nb_tsstats starting 5.4 seconds late 2015-03-18 06:48:01,314 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 06:48:01,314 INFO repeater task os150nb_beamplots starting 5.8 seconds late 2015-03-18 06:48:02,288 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:48:02,288 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 06:48:02,289 INFO repeater task os150nb_beamplots starting 6.8 seconds late 2015-03-18 06:48:03,229 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 06:48:03,229 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 06:48:03,230 INFO repeater task posmv_hcorrstats starting 7.8 seconds late 2015-03-18 06:48:03,773 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 06:48:03,773 INFO repeater task posmv_plotposmv starting 8.3 seconds late 2015-03-18 06:48:04,234 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:48:09,240 INFO repeater task os150nb_lastensq starting 3.2 seconds late 2015-03-18 06:48:10,640 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:48:10,640 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:47:56 2015-03-18 06:50:35,891 INFO repeater task os150nb_10pings starting 0.4 seconds late 2015-03-18 06:50:35,997 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:52:56,222 INFO repeater task posmv_hcorrstats starting 0.7 seconds late 2015-03-18 06:52:56,768 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 06:52:56,768 INFO repeater task posmv_plotposmv starting 1.3 seconds late 2015-03-18 06:52:57,228 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:53:07,241 INFO repeater task os150nb_lastensq starting 1.2 seconds late 2015-03-18 06:53:08,628 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:53:08,629 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:52:56 2015-03-18 06:55:58,927 INFO repeater task os150nb_10pings starting 3.5 seconds late 2015-03-18 06:55:59,030 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 06:57:59,244 INFO repeater task posmv_hcorrstats starting 3.8 seconds late 2015-03-18 06:57:59,803 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 06:57:59,803 INFO repeater task posmv_plotposmv starting 4.3 seconds late 2015-03-18 06:58:00,273 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 06:58:10,289 INFO repeater task os150nb_lastensq starting 4.3 seconds late 2015-03-18 06:58:11,671 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 06:58:11,671 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 06:57:56 2015-03-18 07:01:17,017 INFO repeater task os150nb_10pings starting 1.5 seconds late 2015-03-18 07:01:17,111 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:02:57,293 INFO repeater task os150nb_quick starting 1.8 seconds late 2015-03-18 07:02:58,843 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 07:02:58,843 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-18 07:02:58,844 INFO repeater task os150nb_3dayplots starting 3.4 seconds late 2015-03-18 07:03:01,112 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 07:03:01,112 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 07:03:01,112 INFO repeater task os150nb_tsstats starting 5.6 seconds late 2015-03-18 07:03:01,570 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 07:03:01,570 INFO repeater task os150nb_beamplots starting 6.1 seconds late 2015-03-18 07:03:02,545 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:03:02,545 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 07:03:02,545 INFO repeater task os150nb_beamplots starting 7.1 seconds late 2015-03-18 07:03:03,506 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:03:03,506 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 07:03:03,506 INFO repeater task posmv_hcorrstats starting 8.0 seconds late 2015-03-18 07:03:04,074 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 07:03:04,075 INFO repeater task posmv_plotposmv starting 8.6 seconds late 2015-03-18 07:03:04,558 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:03:09,564 INFO repeater task os150nb_lastensq starting 3.6 seconds late 2015-03-18 07:03:10,961 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:03:10,961 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:02:56 2015-03-18 07:06:36,326 INFO repeater task os150nb_10pings starting 0.9 seconds late 2015-03-18 07:06:36,426 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:07:56,607 INFO repeater task posmv_hcorrstats starting 1.1 seconds late 2015-03-18 07:07:57,165 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 07:07:57,166 INFO repeater task posmv_plotposmv starting 1.7 seconds late 2015-03-18 07:07:57,650 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:08:07,661 INFO repeater task os150nb_lastensq starting 1.7 seconds late 2015-03-18 07:08:09,132 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 07:08:09,132 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:07:56 2015-03-18 07:11:59,498 INFO repeater task os150nb_10pings starting 4.0 seconds late 2015-03-18 07:11:59,602 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:12:59,697 INFO repeater task posmv_hcorrstats starting 4.2 seconds late 2015-03-18 07:13:00,247 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 07:13:00,248 INFO repeater task posmv_plotposmv starting 4.8 seconds late 2015-03-18 07:13:00,715 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:13:10,730 INFO repeater task os150nb_lastensq starting 4.7 seconds late 2015-03-18 07:13:12,183 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 07:13:12,183 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:12:56 2015-03-18 07:17:17,611 INFO repeater task os150nb_10pings starting 2.1 seconds late 2015-03-18 07:17:17,713 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:17:57,783 INFO repeater task os150nb_quick starting 2.3 seconds late 2015-03-18 07:17:59,330 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 07:17:59,330 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 07:17:59,331 INFO repeater task os150nb_3dayplots starting 3.9 seconds late 2015-03-18 07:18:01,515 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 07:18:01,515 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 07:18:01,516 INFO repeater task os150nb_tsstats starting 6.0 seconds late 2015-03-18 07:18:01,974 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 07:18:01,974 INFO repeater task os150nb_beamplots starting 6.5 seconds late 2015-03-18 07:18:02,897 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:18:02,897 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 07:18:02,897 INFO repeater task os150nb_beamplots starting 7.4 seconds late 2015-03-18 07:18:03,827 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:18:03,828 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 07:18:03,828 INFO repeater task posmv_hcorrstats starting 8.3 seconds late 2015-03-18 07:18:04,372 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 07:18:04,373 INFO repeater task posmv_plotposmv starting 8.9 seconds late 2015-03-18 07:18:04,849 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:18:09,855 INFO repeater task os150nb_lastensq starting 3.9 seconds late 2015-03-18 07:18:11,275 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:18:11,275 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:17:56 2015-03-18 07:22:36,745 INFO repeater task os150nb_10pings starting 1.3 seconds late 2015-03-18 07:22:36,848 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:22:56,880 INFO repeater task posmv_hcorrstats starting 1.4 seconds late 2015-03-18 07:22:57,434 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 07:22:57,434 INFO repeater task posmv_plotposmv starting 2.0 seconds late 2015-03-18 07:22:57,921 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:23:07,937 INFO repeater task os150nb_lastensq starting 1.9 seconds late 2015-03-18 07:23:09,337 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:23:09,337 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:22:56 2015-03-18 07:27:59,851 INFO repeater task os150nb_10pings starting 4.4 seconds late 2015-03-18 07:27:59,957 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:27:59,958 INFO repeater task posmv_hcorrstats starting 4.5 seconds late 2015-03-18 07:28:00,504 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 07:28:00,504 INFO repeater task posmv_plotposmv starting 5.0 seconds late 2015-03-18 07:28:00,977 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:28:10,992 INFO repeater task os150nb_lastensq starting 5.0 seconds late 2015-03-18 07:28:12,374 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:28:12,375 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:27:56 2015-03-18 07:32:57,895 INFO repeater task os150nb_quick starting 2.4 seconds late 2015-03-18 07:32:59,426 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 07:32:59,426 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 07:32:59,426 INFO repeater task os150nb_3dayplots starting 4.0 seconds late 2015-03-18 07:33:01,632 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 07:33:01,632 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 07:33:01,632 INFO repeater task os150nb_tsstats starting 6.2 seconds late 2015-03-18 07:33:02,083 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 07:33:02,083 INFO repeater task os150nb_beamplots starting 6.6 seconds late 2015-03-18 07:33:03,021 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:33:03,021 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 07:33:03,022 INFO repeater task os150nb_beamplots starting 7.5 seconds late 2015-03-18 07:33:03,982 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:33:03,982 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 07:33:03,982 INFO repeater task posmv_hcorrstats starting 8.5 seconds late 2015-03-18 07:33:04,535 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 07:33:04,535 INFO repeater task posmv_plotposmv starting 9.1 seconds late 2015-03-18 07:33:05,025 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:33:10,027 INFO repeater task os150nb_lastensq starting 4.0 seconds late 2015-03-18 07:33:11,387 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:33:11,387 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:32:56 2015-03-18 07:33:16,395 INFO repeater task os150nb_10pings starting 0.9 seconds late 2015-03-18 07:33:16,493 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:37:56,997 INFO repeater task posmv_hcorrstats starting 1.5 seconds late 2015-03-18 07:37:57,565 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 07:37:57,565 INFO repeater task posmv_plotposmv starting 2.1 seconds late 2015-03-18 07:37:58,036 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:38:08,051 INFO repeater task os150nb_lastensq starting 2.1 seconds late 2015-03-18 07:38:09,469 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:38:09,469 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:37:56 2015-03-18 07:38:39,514 INFO repeater task os150nb_10pings starting 4.0 seconds late 2015-03-18 07:38:39,617 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:43:00,036 INFO repeater task posmv_hcorrstats starting 4.6 seconds late 2015-03-18 07:43:00,625 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 07:43:00,625 INFO repeater task posmv_plotposmv starting 5.1 seconds late 2015-03-18 07:43:01,117 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:43:06,122 INFO repeater task os150nb_lastensq starting 0.1 seconds late 2015-03-18 07:43:07,540 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:43:07,541 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:42:56 2015-03-18 07:43:57,652 INFO repeater task os150nb_10pings starting 2.2 seconds late 2015-03-18 07:43:57,763 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:47:58,199 INFO repeater task os150nb_quick starting 2.7 seconds late 2015-03-18 07:47:59,761 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 07:47:59,761 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-18 07:47:59,761 INFO repeater task os150nb_3dayplots starting 4.3 seconds late 2015-03-18 07:48:02,066 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 07:48:02,066 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 07:48:02,067 INFO repeater task os150nb_tsstats starting 6.6 seconds late 2015-03-18 07:48:02,546 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 07:48:02,547 INFO repeater task os150nb_beamplots starting 7.1 seconds late 2015-03-18 07:48:03,553 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:48:03,553 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 07:48:03,553 INFO repeater task os150nb_beamplots starting 8.1 seconds late 2015-03-18 07:48:04,539 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 07:48:04,539 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 07:48:04,539 INFO repeater task posmv_hcorrstats starting 9.1 seconds late 2015-03-18 07:48:05,116 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 07:48:05,116 INFO repeater task posmv_plotposmv starting 9.6 seconds late 2015-03-18 07:48:05,598 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:48:10,604 INFO repeater task os150nb_lastensq starting 4.6 seconds late 2015-03-18 07:48:12,015 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:48:12,015 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:47:56 2015-03-18 07:49:17,133 INFO repeater task os150nb_10pings starting 1.7 seconds late 2015-03-18 07:49:17,240 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:52:57,620 INFO repeater task posmv_hcorrstats starting 2.1 seconds late 2015-03-18 07:52:58,164 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 07:52:58,164 INFO repeater task posmv_plotposmv starting 2.7 seconds late 2015-03-18 07:52:58,643 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:53:08,658 INFO repeater task os150nb_lastensq starting 2.7 seconds late 2015-03-18 07:53:10,043 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:53:10,044 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:52:56 2015-03-18 07:54:40,195 INFO repeater task os150nb_10pings starting 4.7 seconds late 2015-03-18 07:54:40,302 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 07:57:55,683 INFO repeater task posmv_hcorrstats starting 0.2 seconds late 2015-03-18 07:57:56,230 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 07:57:56,230 INFO repeater task posmv_plotposmv starting 0.8 seconds late 2015-03-18 07:57:56,703 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 07:58:06,719 INFO repeater task os150nb_lastensq starting 0.7 seconds late 2015-03-18 07:58:08,103 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 07:58:08,103 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 07:57:56 2015-03-18 07:59:58,249 INFO repeater task os150nb_10pings starting 2.8 seconds late 2015-03-18 07:59:58,352 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:02:58,659 INFO repeater task os150nb_quick starting 3.2 seconds late 2015-03-18 08:03:00,177 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 08:03:00,177 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 08:03:00,178 INFO repeater task os150nb_3dayplots starting 4.7 seconds late 2015-03-18 08:03:02,504 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 08:03:02,504 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 08:03:02,504 INFO repeater task os150nb_tsstats starting 7.0 seconds late 2015-03-18 08:03:02,980 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 08:03:02,980 INFO repeater task os150nb_beamplots starting 7.5 seconds late 2015-03-18 08:03:03,999 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:03:03,999 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 08:03:04,000 INFO repeater task os150nb_beamplots starting 8.5 seconds late 2015-03-18 08:03:04,968 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:03:04,968 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 08:03:04,968 INFO repeater task posmv_hcorrstats starting 9.5 seconds late 2015-03-18 08:03:05,534 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:03:05,534 INFO repeater task posmv_plotposmv starting 10.1 seconds late 2015-03-18 08:03:06,016 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:03:11,022 INFO repeater task os150nb_lastensq starting 5.0 seconds late 2015-03-18 08:03:12,430 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:03:12,430 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:02:56 2015-03-18 08:05:17,652 INFO repeater task os150nb_10pings starting 2.2 seconds late 2015-03-18 08:05:17,762 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:07:58,052 INFO repeater task posmv_hcorrstats starting 2.6 seconds late 2015-03-18 08:07:58,624 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:07:58,624 INFO repeater task posmv_plotposmv starting 3.1 seconds late 2015-03-18 08:07:59,120 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:08:09,132 INFO repeater task os150nb_lastensq starting 3.1 seconds late 2015-03-18 08:08:10,548 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:08:10,548 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:07:56 2015-03-18 08:10:35,828 INFO repeater task os150nb_10pings starting 0.4 seconds late 2015-03-18 08:10:35,927 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:12:56,175 INFO repeater task posmv_hcorrstats starting 0.7 seconds late 2015-03-18 08:12:56,781 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:12:56,781 INFO repeater task posmv_plotposmv starting 1.3 seconds late 2015-03-18 08:12:57,264 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:13:07,279 INFO repeater task os150nb_lastensq starting 1.3 seconds late 2015-03-18 08:13:08,695 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:13:08,695 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:12:56 2015-03-18 08:15:58,998 INFO repeater task os150nb_10pings starting 3.5 seconds late 2015-03-18 08:15:59,097 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:17:59,308 INFO repeater task os150nb_quick starting 3.8 seconds late 2015-03-18 08:18:00,830 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 08:18:00,830 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 08:18:00,831 INFO repeater task os150nb_3dayplots starting 5.4 seconds late 2015-03-18 08:18:03,034 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 08:18:03,034 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 08:18:03,034 INFO repeater task os150nb_tsstats starting 7.6 seconds late 2015-03-18 08:18:03,491 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 08:18:03,492 INFO repeater task os150nb_beamplots starting 8.0 seconds late 2015-03-18 08:18:04,440 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:18:04,440 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 08:18:04,440 INFO repeater task os150nb_beamplots starting 9.0 seconds late 2015-03-18 08:18:05,390 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:18:05,390 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 08:18:05,391 INFO repeater task posmv_hcorrstats starting 9.9 seconds late 2015-03-18 08:18:05,964 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:18:05,965 INFO repeater task posmv_plotposmv starting 10.5 seconds late 2015-03-18 08:18:06,453 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:18:11,459 INFO repeater task os150nb_lastensq starting 5.5 seconds late 2015-03-18 08:18:12,870 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:18:12,870 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:17:56 2015-03-18 08:21:18,205 INFO repeater task os150nb_10pings starting 2.7 seconds late 2015-03-18 08:21:18,311 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:22:58,494 INFO repeater task posmv_hcorrstats starting 3.0 seconds late 2015-03-18 08:22:59,085 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:22:59,085 INFO repeater task posmv_plotposmv starting 3.6 seconds late 2015-03-18 08:22:59,571 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:23:09,586 INFO repeater task os150nb_lastensq starting 3.6 seconds late 2015-03-18 08:23:11,023 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:23:11,024 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:22:56 2015-03-18 08:26:36,376 INFO repeater task os150nb_10pings starting 0.9 seconds late 2015-03-18 08:26:36,476 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:27:56,662 INFO repeater task posmv_hcorrstats starting 1.2 seconds late 2015-03-18 08:27:57,212 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:27:57,212 INFO repeater task posmv_plotposmv starting 1.7 seconds late 2015-03-18 08:27:57,695 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:28:07,711 INFO repeater task os150nb_lastensq starting 1.7 seconds late 2015-03-18 08:28:09,188 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 08:28:09,188 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:27:56 2015-03-18 08:31:59,619 INFO repeater task os150nb_10pings starting 4.1 seconds late 2015-03-18 08:31:59,712 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:32:59,817 INFO repeater task os150nb_quick starting 4.3 seconds late 2015-03-18 08:33:01,332 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 08:33:01,332 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 08:33:01,332 INFO repeater task os150nb_3dayplots starting 5.9 seconds late 2015-03-18 08:33:03,568 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 08:33:03,568 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 08:33:03,568 INFO repeater task os150nb_tsstats starting 8.1 seconds late 2015-03-18 08:33:04,032 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 08:33:04,033 INFO repeater task os150nb_beamplots starting 8.6 seconds late 2015-03-18 08:33:04,991 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:33:04,991 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 08:33:04,992 INFO repeater task os150nb_beamplots starting 9.5 seconds late 2015-03-18 08:33:05,969 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:33:05,969 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 08:33:05,970 INFO repeater task posmv_hcorrstats starting 10.5 seconds late 2015-03-18 08:33:06,519 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 08:33:06,519 INFO repeater task posmv_plotposmv starting 11.0 seconds late 2015-03-18 08:33:07,010 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:33:12,016 INFO repeater task os150nb_lastensq starting 6.0 seconds late 2015-03-18 08:33:13,435 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:33:13,435 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:32:56 2015-03-18 08:37:18,913 INFO repeater task os150nb_10pings starting 3.4 seconds late 2015-03-18 08:37:19,013 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:37:59,084 INFO repeater task posmv_hcorrstats starting 3.6 seconds late 2015-03-18 08:37:59,643 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:37:59,644 INFO repeater task posmv_plotposmv starting 4.2 seconds late 2015-03-18 08:38:00,128 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:38:10,139 INFO repeater task os150nb_lastensq starting 4.1 seconds late 2015-03-18 08:38:11,560 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:38:11,561 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:37:56 2015-03-18 08:42:37,034 INFO repeater task os150nb_10pings starting 1.6 seconds late 2015-03-18 08:42:37,150 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:42:57,186 INFO repeater task posmv_hcorrstats starting 1.7 seconds late 2015-03-18 08:42:57,779 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:42:57,779 INFO repeater task posmv_plotposmv starting 2.3 seconds late 2015-03-18 08:42:58,263 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:43:08,278 INFO repeater task os150nb_lastensq starting 2.3 seconds late 2015-03-18 08:43:09,725 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:43:09,725 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:42:56 2015-03-18 08:48:00,240 INFO repeater task os150nb_10pings starting 4.8 seconds late 2015-03-18 08:48:00,339 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:48:00,339 INFO repeater task os150nb_quick starting 4.9 seconds late 2015-03-18 08:48:01,832 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 08:48:01,832 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 08:48:01,832 INFO repeater task os150nb_3dayplots starting 6.4 seconds late 2015-03-18 08:48:04,126 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 08:48:04,126 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 08:48:04,127 INFO repeater task os150nb_tsstats starting 8.7 seconds late 2015-03-18 08:48:04,594 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 08:48:04,594 INFO repeater task os150nb_beamplots starting 9.1 seconds late 2015-03-18 08:48:05,587 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:48:05,587 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 08:48:05,588 INFO repeater task os150nb_beamplots starting 10.1 seconds late 2015-03-18 08:48:06,529 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 08:48:06,529 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 08:48:06,529 INFO repeater task posmv_hcorrstats starting 11.1 seconds late 2015-03-18 08:48:07,077 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 08:48:07,078 INFO repeater task posmv_plotposmv starting 11.6 seconds late 2015-03-18 08:48:07,555 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:48:12,560 INFO repeater task os150nb_lastensq starting 6.6 seconds late 2015-03-18 08:48:13,956 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:48:13,957 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:47:56 2015-03-18 08:52:59,462 INFO repeater task posmv_hcorrstats starting 4.0 seconds late 2015-03-18 08:53:00,018 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:53:00,018 INFO repeater task posmv_plotposmv starting 4.5 seconds late 2015-03-18 08:53:00,503 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:53:10,514 INFO repeater task os150nb_lastensq starting 4.5 seconds late 2015-03-18 08:53:11,906 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:53:11,906 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:52:56 2015-03-18 08:53:16,913 INFO repeater task os150nb_10pings starting 1.4 seconds late 2015-03-18 08:53:17,013 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 08:57:57,503 INFO repeater task posmv_hcorrstats starting 2.0 seconds late 2015-03-18 08:57:58,073 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 08:57:58,073 INFO repeater task posmv_plotposmv starting 2.6 seconds late 2015-03-18 08:57:58,555 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 08:58:08,569 INFO repeater task os150nb_lastensq starting 2.6 seconds late 2015-03-18 08:58:10,000 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 08:58:10,000 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 08:57:56 2015-03-18 08:58:40,046 INFO repeater task os150nb_10pings starting 4.6 seconds late 2015-03-18 08:58:40,144 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:02:55,645 INFO repeater task os150nb_quick starting 0.2 seconds late 2015-03-18 09:02:57,184 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 09:02:57,184 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 09:02:57,185 INFO repeater task os150nb_3dayplots starting 1.7 seconds late 2015-03-18 09:02:59,415 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 09:02:59,416 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 09:02:59,416 INFO repeater task os150nb_tsstats starting 3.9 seconds late 2015-03-18 09:02:59,893 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 09:02:59,893 INFO repeater task os150nb_beamplots starting 4.4 seconds late 2015-03-18 09:03:00,863 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:03:00,863 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 09:03:00,864 INFO repeater task os150nb_beamplots starting 5.4 seconds late 2015-03-18 09:03:01,812 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:03:01,812 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 09:03:01,813 INFO repeater task posmv_hcorrstats starting 6.3 seconds late 2015-03-18 09:03:02,374 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:03:02,374 INFO repeater task posmv_plotposmv starting 6.9 seconds late 2015-03-18 09:03:02,868 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:03:07,874 INFO repeater task os150nb_lastensq starting 1.9 seconds late 2015-03-18 09:03:09,283 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:03:09,283 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:02:56 2015-03-18 09:03:59,375 INFO repeater task os150nb_10pings starting 3.9 seconds late 2015-03-18 09:03:59,482 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:07:59,911 INFO repeater task posmv_hcorrstats starting 4.4 seconds late 2015-03-18 09:08:00,479 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:08:00,479 INFO repeater task posmv_plotposmv starting 5.0 seconds late 2015-03-18 09:08:00,977 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:08:10,989 INFO repeater task os150nb_lastensq starting 5.0 seconds late 2015-03-18 09:08:12,414 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:08:12,414 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:07:56 2015-03-18 09:09:17,530 INFO repeater task os150nb_10pings starting 2.1 seconds late 2015-03-18 09:09:17,635 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:12:58,038 INFO repeater task posmv_hcorrstats starting 2.6 seconds late 2015-03-18 09:12:58,622 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:12:58,622 INFO repeater task posmv_plotposmv starting 3.1 seconds late 2015-03-18 09:12:59,111 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:13:09,126 INFO repeater task os150nb_lastensq starting 3.1 seconds late 2015-03-18 09:13:10,523 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:13:10,523 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:12:56 2015-03-18 09:14:35,671 INFO repeater task os150nb_10pings starting 0.2 seconds late 2015-03-18 09:14:35,778 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:17:56,131 INFO repeater task os150nb_quick starting 0.7 seconds late 2015-03-18 09:17:57,651 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 09:17:57,651 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 09:17:57,651 INFO repeater task os150nb_3dayplots starting 2.2 seconds late 2015-03-18 09:17:59,933 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 09:17:59,933 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 09:17:59,933 INFO repeater task os150nb_tsstats starting 4.5 seconds late 2015-03-18 09:18:00,398 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 09:18:00,398 INFO repeater task os150nb_beamplots starting 4.9 seconds late 2015-03-18 09:18:01,356 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:18:01,356 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 09:18:01,356 INFO repeater task os150nb_beamplots starting 5.9 seconds late 2015-03-18 09:18:02,329 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:18:02,329 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 09:18:02,330 INFO repeater task posmv_hcorrstats starting 6.9 seconds late 2015-03-18 09:18:02,910 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:18:02,910 INFO repeater task posmv_plotposmv starting 7.4 seconds late 2015-03-18 09:18:03,400 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:18:08,406 INFO repeater task os150nb_lastensq starting 2.4 seconds late 2015-03-18 09:18:09,787 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:18:09,787 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:17:56 2015-03-18 09:19:59,990 INFO repeater task os150nb_10pings starting 4.5 seconds late 2015-03-18 09:20:00,090 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:23:00,427 INFO repeater task posmv_hcorrstats starting 4.9 seconds late 2015-03-18 09:23:00,993 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:23:00,993 INFO repeater task posmv_plotposmv starting 5.5 seconds late 2015-03-18 09:23:01,491 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:23:06,497 INFO repeater task os150nb_lastensq starting 0.5 seconds late 2015-03-18 09:23:07,899 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:23:07,899 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:22:56 2015-03-18 09:25:18,137 INFO repeater task os150nb_10pings starting 2.7 seconds late 2015-03-18 09:25:18,237 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:27:58,579 INFO repeater task posmv_hcorrstats starting 3.1 seconds late 2015-03-18 09:27:59,168 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:27:59,168 INFO repeater task posmv_plotposmv starting 3.7 seconds late 2015-03-18 09:27:59,670 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:28:09,682 INFO repeater task os150nb_lastensq starting 3.7 seconds late 2015-03-18 09:28:11,140 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 09:28:11,140 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:27:56 2015-03-18 09:30:36,387 INFO repeater task os150nb_10pings starting 0.9 seconds late 2015-03-18 09:30:36,493 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:32:56,712 INFO repeater task os150nb_quick starting 1.2 seconds late 2015-03-18 09:32:58,248 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 09:32:58,248 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 09:32:58,248 INFO repeater task os150nb_3dayplots starting 2.8 seconds late 2015-03-18 09:33:00,422 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 09:33:00,422 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 09:33:00,422 INFO repeater task os150nb_tsstats starting 4.9 seconds late 2015-03-18 09:33:00,880 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 09:33:00,880 INFO repeater task os150nb_beamplots starting 5.4 seconds late 2015-03-18 09:33:01,817 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:33:01,818 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 09:33:01,818 INFO repeater task os150nb_beamplots starting 6.3 seconds late 2015-03-18 09:33:02,747 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:33:02,747 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 09:33:02,747 INFO repeater task posmv_hcorrstats starting 7.3 seconds late 2015-03-18 09:33:03,305 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:33:03,305 INFO repeater task posmv_plotposmv starting 7.8 seconds late 2015-03-18 09:33:03,802 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:33:08,808 INFO repeater task os150nb_lastensq starting 2.8 seconds late 2015-03-18 09:33:10,191 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:33:10,192 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:32:56 2015-03-18 09:35:55,484 INFO repeater task os150nb_10pings starting 0.0 seconds late 2015-03-18 09:35:55,595 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:37:55,807 INFO repeater task posmv_hcorrstats starting 0.3 seconds late 2015-03-18 09:37:56,348 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 09:37:56,348 INFO repeater task posmv_plotposmv starting 0.9 seconds late 2015-03-18 09:37:56,844 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:38:06,861 INFO repeater task os150nb_lastensq starting 0.9 seconds late 2015-03-18 09:38:08,333 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 09:38:08,333 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:37:56 2015-03-18 09:41:18,702 INFO repeater task os150nb_10pings starting 3.2 seconds late 2015-03-18 09:41:18,805 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:42:58,977 INFO repeater task posmv_hcorrstats starting 3.5 seconds late 2015-03-18 09:42:59,531 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:42:59,531 INFO repeater task posmv_plotposmv starting 4.1 seconds late 2015-03-18 09:43:00,025 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:43:10,040 INFO repeater task os150nb_lastensq starting 4.0 seconds late 2015-03-18 09:43:11,512 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 09:43:11,512 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:42:56 2015-03-18 09:46:36,896 INFO repeater task os150nb_10pings starting 1.4 seconds late 2015-03-18 09:46:37,002 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:47:57,145 INFO repeater task os150nb_quick starting 1.7 seconds late 2015-03-18 09:47:58,711 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 09:47:58,711 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-18 09:47:58,711 INFO repeater task os150nb_3dayplots starting 3.2 seconds late 2015-03-18 09:48:01,017 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 09:48:01,017 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 09:48:01,017 INFO repeater task os150nb_tsstats starting 5.5 seconds late 2015-03-18 09:48:01,492 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 09:48:01,493 INFO repeater task os150nb_beamplots starting 6.0 seconds late 2015-03-18 09:48:02,476 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:48:02,477 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 09:48:02,477 INFO repeater task os150nb_beamplots starting 7.0 seconds late 2015-03-18 09:48:03,437 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 09:48:03,437 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 09:48:03,438 INFO repeater task posmv_hcorrstats starting 8.0 seconds late 2015-03-18 09:48:04,001 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:48:04,001 INFO repeater task posmv_plotposmv starting 8.5 seconds late 2015-03-18 09:48:04,501 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:48:09,507 INFO repeater task os150nb_lastensq starting 3.5 seconds late 2015-03-18 09:48:10,922 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:48:10,922 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:47:56 2015-03-18 09:51:56,324 INFO repeater task os150nb_10pings starting 0.9 seconds late 2015-03-18 09:51:56,432 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:52:56,545 INFO repeater task posmv_hcorrstats starting 1.1 seconds late 2015-03-18 09:52:57,100 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:52:57,100 INFO repeater task posmv_plotposmv starting 1.6 seconds late 2015-03-18 09:52:57,592 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:53:07,608 INFO repeater task os150nb_lastensq starting 1.6 seconds late 2015-03-18 09:53:08,997 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 09:53:08,998 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:52:56 2015-03-18 09:57:19,445 INFO repeater task os150nb_10pings starting 4.0 seconds late 2015-03-18 09:57:19,544 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 09:57:59,616 INFO repeater task posmv_hcorrstats starting 4.1 seconds late 2015-03-18 09:58:00,182 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 09:58:00,182 INFO repeater task posmv_plotposmv starting 4.7 seconds late 2015-03-18 09:58:00,672 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 09:58:10,684 INFO repeater task os150nb_lastensq starting 4.7 seconds late 2015-03-18 09:58:12,139 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 09:58:12,139 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 09:57:56 2015-03-18 10:02:37,614 INFO repeater task os150nb_10pings starting 2.1 seconds late 2015-03-18 10:02:37,716 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:02:57,751 INFO repeater task os150nb_quick starting 2.3 seconds late 2015-03-18 10:02:59,276 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 10:02:59,277 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 10:02:59,277 INFO repeater task os150nb_3dayplots starting 3.8 seconds late 2015-03-18 10:03:01,477 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 10:03:01,477 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 10:03:01,477 INFO repeater task os150nb_tsstats starting 6.0 seconds late 2015-03-18 10:03:01,948 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 10:03:01,948 INFO repeater task os150nb_beamplots starting 6.5 seconds late 2015-03-18 10:03:02,872 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:03:02,873 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 10:03:02,873 INFO repeater task os150nb_beamplots starting 7.4 seconds late 2015-03-18 10:03:03,860 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:03:03,860 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 10:03:03,861 INFO repeater task posmv_hcorrstats starting 8.4 seconds late 2015-03-18 10:03:04,413 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:03:04,413 INFO repeater task posmv_plotposmv starting 8.9 seconds late 2015-03-18 10:03:04,909 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:03:09,915 INFO repeater task os150nb_lastensq starting 3.9 seconds late 2015-03-18 10:03:11,300 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:03:11,301 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:02:56 2015-03-18 10:07:56,794 INFO repeater task os150nb_10pings starting 1.3 seconds late 2015-03-18 10:07:56,900 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:07:56,901 INFO repeater task posmv_hcorrstats starting 1.4 seconds late 2015-03-18 10:07:57,486 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:07:57,487 INFO repeater task posmv_plotposmv starting 2.0 seconds late 2015-03-18 10:07:57,976 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:08:07,992 INFO repeater task os150nb_lastensq starting 2.0 seconds late 2015-03-18 10:08:09,376 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:08:09,376 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:07:56 2015-03-18 10:12:59,913 INFO repeater task posmv_hcorrstats starting 4.4 seconds late 2015-03-18 10:13:00,482 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:13:00,482 INFO repeater task posmv_plotposmv starting 5.0 seconds late 2015-03-18 10:13:00,974 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:13:10,990 INFO repeater task os150nb_lastensq starting 5.0 seconds late 2015-03-18 10:13:12,363 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:13:12,363 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:12:56 2015-03-18 10:13:17,371 INFO repeater task os150nb_10pings starting 1.9 seconds late 2015-03-18 10:13:17,474 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:17:57,984 INFO repeater task os150nb_quick starting 2.5 seconds late 2015-03-18 10:17:59,525 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 10:17:59,525 INFO repeater task os150nb_quick ended after 1.5 seconds 2015-03-18 10:17:59,525 INFO repeater task os150nb_3dayplots starting 4.1 seconds late 2015-03-18 10:18:01,726 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 10:18:01,726 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 10:18:01,726 INFO repeater task os150nb_tsstats starting 6.3 seconds late 2015-03-18 10:18:02,186 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 10:18:02,186 INFO repeater task os150nb_beamplots starting 6.7 seconds late 2015-03-18 10:18:03,117 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:18:03,117 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 10:18:03,118 INFO repeater task os150nb_beamplots starting 7.6 seconds late 2015-03-18 10:18:04,068 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:18:04,068 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 10:18:04,068 INFO repeater task posmv_hcorrstats starting 8.6 seconds late 2015-03-18 10:18:04,626 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:18:04,627 INFO repeater task posmv_plotposmv starting 9.1 seconds late 2015-03-18 10:18:05,128 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:18:10,134 INFO repeater task os150nb_lastensq starting 4.1 seconds late 2015-03-18 10:18:11,509 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:18:11,509 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:17:56 2015-03-18 10:18:36,554 INFO repeater task os150nb_10pings starting 1.1 seconds late 2015-03-18 10:18:36,668 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:22:57,141 INFO repeater task posmv_hcorrstats starting 1.7 seconds late 2015-03-18 10:22:57,725 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:22:57,726 INFO repeater task posmv_plotposmv starting 2.2 seconds late 2015-03-18 10:22:58,248 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:23:08,263 INFO repeater task os150nb_lastensq starting 2.3 seconds late 2015-03-18 10:23:09,726 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 10:23:09,726 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:22:56 2015-03-18 10:23:59,801 INFO repeater task os150nb_10pings starting 4.3 seconds late 2015-03-18 10:23:59,907 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:28:00,308 INFO repeater task posmv_hcorrstats starting 4.8 seconds late 2015-03-18 10:28:00,866 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:28:00,866 INFO repeater task posmv_plotposmv starting 5.4 seconds late 2015-03-18 10:28:01,355 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:28:06,361 INFO repeater task os150nb_lastensq starting 0.4 seconds late 2015-03-18 10:28:07,743 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:28:07,743 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:27:56 2015-03-18 10:29:17,865 INFO repeater task os150nb_10pings starting 2.4 seconds late 2015-03-18 10:29:17,963 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:32:58,353 INFO repeater task os150nb_quick starting 2.9 seconds late 2015-03-18 10:32:59,914 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 10:32:59,914 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-18 10:32:59,914 INFO repeater task os150nb_3dayplots starting 4.4 seconds late 2015-03-18 10:33:02,211 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 10:33:02,211 INFO repeater task os150nb_3dayplots ended after 2.3 seconds 2015-03-18 10:33:02,212 INFO repeater task os150nb_tsstats starting 6.7 seconds late 2015-03-18 10:33:02,685 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 10:33:02,685 INFO repeater task os150nb_beamplots starting 7.2 seconds late 2015-03-18 10:33:03,687 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:33:03,688 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 10:33:03,688 INFO repeater task os150nb_beamplots starting 8.2 seconds late 2015-03-18 10:33:04,634 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:33:04,634 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 10:33:04,634 INFO repeater task posmv_hcorrstats starting 9.2 seconds late 2015-03-18 10:33:05,183 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 10:33:05,183 INFO repeater task posmv_plotposmv starting 9.7 seconds late 2015-03-18 10:33:05,684 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:33:10,689 INFO repeater task os150nb_lastensq starting 4.7 seconds late 2015-03-18 10:33:12,139 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:33:12,139 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:32:56 2015-03-18 10:34:37,284 INFO repeater task os150nb_10pings starting 1.8 seconds late 2015-03-18 10:34:37,382 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:37:57,733 INFO repeater task posmv_hcorrstats starting 2.3 seconds late 2015-03-18 10:37:58,296 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:37:58,296 INFO repeater task posmv_plotposmv starting 2.8 seconds late 2015-03-18 10:37:58,801 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:38:08,817 INFO repeater task os150nb_lastensq starting 2.8 seconds late 2015-03-18 10:38:10,173 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:38:10,173 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:37:56 2015-03-18 10:40:00,373 INFO repeater task os150nb_10pings starting 4.9 seconds late 2015-03-18 10:40:00,473 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:42:55,787 INFO repeater task posmv_hcorrstats starting 0.3 seconds late 2015-03-18 10:42:56,386 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:42:56,387 INFO repeater task posmv_plotposmv starting 0.9 seconds late 2015-03-18 10:42:56,893 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:43:06,909 INFO repeater task os150nb_lastensq starting 0.9 seconds late 2015-03-18 10:43:08,305 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:43:08,305 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:42:56 2015-03-18 10:45:18,537 INFO repeater task os150nb_10pings starting 3.1 seconds late 2015-03-18 10:45:18,641 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:47:58,928 INFO repeater task os150nb_quick starting 3.5 seconds late 2015-03-18 10:48:00,481 INFO repeater task os150nb_quick output: /usr/lib/python2.7/dist-packages/numpy/core/_methods.py:55: RuntimeWarning: Mean of empty slice. warnings.warn("Mean of empty slice.", RuntimeWarning) 2015-03-18 10:48:00,481 INFO repeater task os150nb_quick ended after 1.6 seconds 2015-03-18 10:48:00,481 INFO repeater task os150nb_3dayplots starting 5.0 seconds late 2015-03-18 10:48:02,679 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2015-03-18 10:48:02,679 INFO repeater task os150nb_3dayplots ended after 2.2 seconds 2015-03-18 10:48:02,679 INFO repeater task os150nb_tsstats starting 7.2 seconds late 2015-03-18 10:48:03,141 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2015-03-18 10:48:03,141 INFO repeater task os150nb_beamplots starting 7.7 seconds late 2015-03-18 10:48:04,088 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:48:04,089 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2015-03-18 10:48:04,089 INFO repeater task os150nb_beamplots starting 8.6 seconds late 2015-03-18 10:48:05,108 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2015-03-18 10:48:05,108 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2015-03-18 10:48:05,108 INFO repeater task posmv_hcorrstats starting 9.6 seconds late 2015-03-18 10:48:05,658 INFO repeater task posmv_hcorrstats ended after 0.5 seconds 2015-03-18 10:48:05,658 INFO repeater task posmv_plotposmv starting 10.2 seconds late 2015-03-18 10:48:06,187 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:48:11,193 INFO repeater task os150nb_lastensq starting 5.2 seconds late 2015-03-18 10:48:12,668 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 10:48:12,668 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:47:56 2015-03-18 10:50:37,921 INFO repeater task os150nb_10pings starting 2.4 seconds late 2015-03-18 10:50:38,024 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:52:58,278 INFO repeater task posmv_hcorrstats starting 2.8 seconds late 2015-03-18 10:52:58,860 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:52:58,861 INFO repeater task posmv_plotposmv starting 3.4 seconds late 2015-03-18 10:52:59,377 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:53:09,392 INFO repeater task os150nb_lastensq starting 3.4 seconds late 2015-03-18 10:53:10,772 INFO repeater task os150nb_lastensq ended after 1.4 seconds 2015-03-18 10:53:10,772 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:52:56 2015-03-18 10:55:56,040 INFO repeater task os150nb_10pings starting 0.6 seconds late 2015-03-18 10:55:56,146 INFO repeater task os150nb_10pings ended after 0.1 seconds 2015-03-18 10:57:56,329 INFO repeater task posmv_hcorrstats starting 0.8 seconds late 2015-03-18 10:57:56,909 INFO repeater task posmv_hcorrstats ended after 0.6 seconds 2015-03-18 10:57:56,910 INFO repeater task posmv_plotposmv starting 1.4 seconds late 2015-03-18 10:57:57,420 INFO repeater task posmv_plotposmv ended after 0.5 seconds 2015-03-18 10:58:07,436 INFO repeater task os150nb_lastensq starting 1.4 seconds late 2015-03-18 10:58:08,908 INFO repeater task os150nb_lastensq ended after 1.5 seconds 2015-03-18 10:58:08,908 INFO repeater task os150nb_lastensq: Time from /home/data/jtest15/proc/os150nb/load/wrote_ens_time: 2015/03/18 10:57:56 2015-03-18 11:01:19,247 INFO repeater task os150nb_10pings starting 3.8 seconds late 2015-03-18 11:01:19,353 INFO repeater task os150nb_10pings ended after 0.1 seconds