2010-10-19 19:05:59,062 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:05:16 2010-10-19 19:06:29,126 INFO repeater task os75nb_quick starting 3.2 seconds late 2010-10-19 19:07:03,873 INFO repeater task os75nb_quick ended after 34.7 seconds 2010-10-19 19:07:03,874 INFO repeater task os75nb_3dayplots starting 38.0 seconds late 2010-10-19 19:07:17,478 INFO repeater task os75nb_3dayplots ended after 13.6 seconds 2010-10-19 19:07:17,480 INFO repeater task os75nb_beamplots starting 51.6 seconds late 2010-10-19 19:07:20,941 INFO repeater task os75nb_beamplots ended after 3.5 seconds 2010-10-19 19:07:20,942 INFO repeater task os75nb_beamhistory starting 55.0 seconds late 2010-10-19 19:08:44,339 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-19 19:08:44,340 INFO repeater task os75nb_beamhistory ended after 83.4 seconds 2010-10-19 19:08:44,341 INFO repeater task phins_hcorrstats starting 138.4 seconds late 2010-10-19 19:08:58,120 INFO repeater task phins_hcorrstats ended after 13.8 seconds 2010-10-19 19:10:28,265 INFO repeater task os75nb_lastensq starting 2.3 seconds late 2010-10-19 19:10:59,652 INFO repeater task os75nb_lastensq ended after 31.4 seconds 2010-10-19 19:10:59,653 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:10:17 2010-10-19 19:11:29,698 INFO repeater task phins_hcorrstats starting 3.8 seconds late 2010-10-19 19:11:44,091 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 19:15:29,466 INFO repeater task os75nb_lastensq starting 2.5 seconds late 2010-10-19 19:16:00,029 INFO repeater task os75nb_lastensq ended after 30.6 seconds 2010-10-19 19:16:00,030 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:15:18 2010-10-19 19:16:30,117 INFO repeater task os75nb_beamplots starting 4.2 seconds late 2010-10-19 19:16:33,853 INFO repeater task os75nb_beamplots ended after 3.7 seconds 2010-10-19 19:16:33,855 INFO repeater task phins_hcorrstats starting 7.9 seconds late 2010-10-19 19:16:52,812 INFO repeater task phins_hcorrstats ended after 19.0 seconds 2010-10-19 19:20:28,267 INFO repeater task os75nb_lastensq starting 0.3 seconds late 2010-10-19 19:21:00,062 INFO repeater task os75nb_lastensq ended after 31.8 seconds 2010-10-19 19:21:00,063 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:20:19 2010-10-19 19:21:30,113 INFO repeater task phins_hcorrstats starting 4.2 seconds late 2010-10-19 19:21:43,999 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 19:25:29,364 INFO repeater task os75nb_lastensq starting 0.4 seconds late 2010-10-19 19:26:01,635 INFO repeater task os75nb_lastensq ended after 32.3 seconds 2010-10-19 19:26:01,636 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:25:20 2010-10-19 19:26:26,672 INFO repeater task os75nb_beamplots starting 0.8 seconds late 2010-10-19 19:26:30,694 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 19:26:30,696 INFO repeater task phins_hcorrstats starting 4.8 seconds late 2010-10-19 19:26:45,118 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 19:30:30,649 INFO repeater task os75nb_lastensq starting 0.6 seconds late 2010-10-19 19:31:04,032 INFO repeater task os75nb_lastensq ended after 33.4 seconds 2010-10-19 19:31:04,033 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:30:20 2010-10-19 19:31:29,076 INFO repeater task phins_hcorrstats starting 3.1 seconds late 2010-10-19 19:31:42,952 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 19:35:33,325 INFO repeater task os75nb_lastensq starting 3.3 seconds late 2010-10-19 19:36:07,107 INFO repeater task os75nb_lastensq ended after 33.8 seconds 2010-10-19 19:36:07,108 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:35:21 2010-10-19 19:36:27,175 INFO repeater task os75nb_quick starting 1.3 seconds late 2010-10-19 19:37:02,043 INFO repeater task os75nb_quick ended after 34.9 seconds 2010-10-19 19:37:02,044 INFO repeater task os75nb_3dayplots starting 36.1 seconds late 2010-10-19 19:37:15,474 INFO repeater task os75nb_3dayplots ended after 13.4 seconds 2010-10-19 19:37:15,475 INFO repeater task os75nb_beamplots starting 49.6 seconds late 2010-10-19 19:37:19,502 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 19:37:19,504 INFO repeater task phins_hcorrstats starting 53.6 seconds late 2010-10-19 19:37:33,356 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 19:40:33,649 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2010-10-19 19:41:08,051 INFO repeater task os75nb_lastensq ended after 34.4 seconds 2010-10-19 19:41:08,052 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:40:22 2010-10-19 19:41:28,084 INFO repeater task phins_hcorrstats starting 2.2 seconds late 2010-10-19 19:41:41,940 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 19:45:32,322 INFO repeater task os75nb_lastensq starting 0.3 seconds late 2010-10-19 19:46:07,055 INFO repeater task os75nb_lastensq ended after 34.7 seconds 2010-10-19 19:46:07,055 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:45:23 2010-10-19 19:46:27,087 INFO repeater task os75nb_beamplots starting 1.2 seconds late 2010-10-19 19:46:30,560 INFO repeater task os75nb_beamplots ended after 3.5 seconds 2010-10-19 19:46:30,562 INFO repeater task phins_hcorrstats starting 4.6 seconds late 2010-10-19 19:46:44,978 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 19:50:35,357 INFO repeater task os75nb_lastensq starting 2.4 seconds late 2010-10-19 19:51:09,330 INFO repeater task os75nb_lastensq ended after 34.0 seconds 2010-10-19 19:51:09,331 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:50:24 2010-10-19 19:51:29,364 INFO repeater task phins_hcorrstats starting 3.4 seconds late 2010-10-19 19:51:43,806 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 19:55:34,185 INFO repeater task os75nb_lastensq starting 0.2 seconds late 2010-10-19 19:56:08,655 INFO repeater task os75nb_lastensq ended after 34.5 seconds 2010-10-19 19:56:08,657 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 19:55:25 2010-10-19 19:56:28,691 INFO repeater task os75nb_beamplots starting 2.8 seconds late 2010-10-19 19:56:32,725 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 19:56:32,727 INFO repeater task phins_hcorrstats starting 6.8 seconds late 2010-10-19 19:56:47,034 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-19 20:00:37,571 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2010-10-19 20:01:09,864 INFO repeater task os75nb_lastensq ended after 32.3 seconds 2010-10-19 20:01:09,865 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:00:25 2010-10-19 20:01:29,896 INFO repeater task phins_hcorrstats starting 4.0 seconds late 2010-10-19 20:01:43,771 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 20:05:39,149 INFO repeater task os75nb_lastensq starting 4.1 seconds late 2010-10-19 20:06:03,966 INFO repeater task os75nb_lastensq ended after 24.8 seconds 2010-10-19 20:06:03,967 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:05:26 2010-10-19 20:06:29,006 INFO repeater task os75nb_quick starting 3.1 seconds late 2010-10-19 20:07:03,474 INFO repeater task os75nb_quick ended after 34.5 seconds 2010-10-19 20:07:03,475 INFO repeater task os75nb_3dayplots starting 37.6 seconds late 2010-10-19 20:07:16,976 INFO repeater task os75nb_3dayplots ended after 13.5 seconds 2010-10-19 20:07:16,977 INFO repeater task os75nb_beamplots starting 51.1 seconds late 2010-10-19 20:07:21,003 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 20:07:21,005 INFO repeater task os75nb_beamhistory starting 55.1 seconds late 2010-10-19 20:08:41,776 INFO repeater task os75nb_beamhistory output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") saving file to os75nb_bin_history.png 2010-10-19 20:08:41,777 INFO repeater task os75nb_beamhistory ended after 80.8 seconds 2010-10-19 20:08:41,785 INFO repeater task phins_hcorrstats starting 135.9 seconds late 2010-10-19 20:08:55,713 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 20:10:40,885 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2010-10-19 20:11:06,251 INFO repeater task os75nb_lastensq ended after 25.4 seconds 2010-10-19 20:11:06,252 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:10:27 2010-10-19 20:11:26,292 INFO repeater task phins_hcorrstats starting 0.4 seconds late 2010-10-19 20:11:40,965 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-19 20:15:41,489 INFO repeater task os75nb_lastensq starting 4.5 seconds late 2010-10-19 20:16:06,805 INFO repeater task os75nb_lastensq ended after 25.3 seconds 2010-10-19 20:16:06,806 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:15:28 2010-10-19 20:16:26,837 INFO repeater task os75nb_beamplots starting 0.9 seconds late 2010-10-19 20:16:30,883 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 20:16:30,885 INFO repeater task phins_hcorrstats starting 5.0 seconds late 2010-10-19 20:16:45,365 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 20:20:40,847 INFO repeater task os75nb_lastensq starting 2.8 seconds late 2010-10-19 20:21:06,545 INFO repeater task os75nb_lastensq ended after 25.7 seconds 2010-10-19 20:21:06,546 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:20:29 2010-10-19 20:21:26,606 INFO repeater task phins_hcorrstats starting 0.7 seconds late 2010-10-19 20:21:40,930 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-19 20:25:41,329 INFO repeater task os75nb_lastensq starting 2.3 seconds late 2010-10-19 20:26:07,724 INFO repeater task os75nb_lastensq ended after 26.4 seconds 2010-10-19 20:26:07,725 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:25:29 2010-10-19 20:26:27,763 INFO repeater task os75nb_beamplots starting 1.8 seconds late 2010-10-19 20:26:31,782 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 20:26:31,784 INFO repeater task phins_hcorrstats starting 5.9 seconds late 2010-10-19 20:26:45,831 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-19 20:30:41,221 INFO repeater task os75nb_lastensq starting 2.2 seconds late 2010-10-19 20:31:08,020 INFO repeater task os75nb_lastensq ended after 26.8 seconds 2010-10-19 20:31:08,021 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:30:30 2010-10-19 20:31:28,056 INFO repeater task phins_hcorrstats starting 2.1 seconds late 2010-10-19 20:31:42,901 INFO repeater task phins_hcorrstats ended after 14.8 seconds 2010-10-19 20:35:43,335 INFO repeater task os75nb_lastensq starting 3.3 seconds late 2010-10-19 20:36:10,363 INFO repeater task os75nb_lastensq ended after 27.0 seconds 2010-10-19 20:36:10,364 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:35:31 2010-10-19 20:36:30,392 INFO repeater task os75nb_quick starting 4.5 seconds late 2010-10-19 20:37:05,403 INFO repeater task os75nb_quick ended after 35.0 seconds 2010-10-19 20:37:05,404 INFO repeater task os75nb_3dayplots starting 39.5 seconds late 2010-10-19 20:37:18,433 INFO repeater task os75nb_3dayplots ended after 13.0 seconds 2010-10-19 20:37:18,434 INFO repeater task os75nb_beamplots starting 52.5 seconds late 2010-10-19 20:37:22,495 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-19 20:37:22,497 INFO repeater task phins_hcorrstats starting 56.6 seconds late 2010-10-19 20:37:36,952 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 20:40:42,373 INFO repeater task os75nb_lastensq starting 1.4 seconds late 2010-10-19 20:41:10,652 INFO repeater task os75nb_lastensq ended after 28.3 seconds 2010-10-19 20:41:10,653 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:40:32 2010-10-19 20:41:30,689 INFO repeater task phins_hcorrstats starting 4.8 seconds late 2010-10-19 20:41:45,124 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 20:45:45,681 INFO repeater task os75nb_lastensq starting 3.7 seconds late 2010-10-19 20:46:14,743 INFO repeater task os75nb_lastensq ended after 29.1 seconds 2010-10-19 20:46:14,744 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:45:33 2010-10-19 20:46:29,767 INFO repeater task os75nb_beamplots starting 3.8 seconds late 2010-10-19 20:46:33,799 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 20:46:33,800 INFO repeater task phins_hcorrstats starting 7.9 seconds late 2010-10-19 20:46:47,643 INFO repeater task phins_hcorrstats ended after 13.8 seconds 2010-10-19 20:50:43,049 INFO repeater task os75nb_lastensq starting 0.0 seconds late 2010-10-19 20:51:11,624 INFO repeater task os75nb_lastensq ended after 28.6 seconds 2010-10-19 20:51:11,625 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:50:34 2010-10-19 20:51:26,660 INFO repeater task phins_hcorrstats starting 0.7 seconds late 2010-10-19 20:51:41,231 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-19 20:55:46,653 INFO repeater task os75nb_lastensq starting 2.7 seconds late 2010-10-19 20:56:17,741 INFO repeater task os75nb_lastensq ended after 31.1 seconds 2010-10-19 20:56:17,742 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 20:55:34 2010-10-19 20:56:27,762 INFO repeater task os75nb_beamplots starting 1.8 seconds late 2010-10-19 20:56:31,370 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2010-10-19 20:56:31,373 INFO repeater task phins_hcorrstats starting 5.4 seconds late 2010-10-19 20:56:45,696 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-19 21:00:46,093 INFO repeater task os75nb_lastensq starting 2.1 seconds late 2010-10-19 21:01:15,932 INFO repeater task os75nb_lastensq ended after 29.8 seconds 2010-10-19 21:01:15,933 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:00:35 2010-10-19 21:01:25,973 INFO repeater task phins_hcorrstats starting 0.0 seconds late 2010-10-19 21:01:39,858 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 21:05:45,274 INFO repeater task os75nb_lastensq starting 0.3 seconds late 2010-10-19 21:06:15,926 INFO repeater task os75nb_lastensq ended after 30.7 seconds 2010-10-19 21:06:15,927 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:05:36 2010-10-19 21:06:25,942 INFO repeater task os75nb_quick starting 0.0 seconds late 2010-10-19 21:07:00,857 INFO repeater task os75nb_quick ended after 34.9 seconds 2010-10-19 21:07:00,861 INFO repeater task os75nb_3dayplots starting 34.9 seconds late 2010-10-19 21:07:13,879 INFO repeater task os75nb_3dayplots ended after 13.0 seconds 2010-10-19 21:07:13,880 INFO repeater task os75nb_beamplots starting 48.0 seconds late 2010-10-19 21:07:17,911 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 21:07:17,912 INFO repeater task os75nb_beamhistory starting 52.0 seconds late 2010-10-19 21:08:44,382 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-19 21:08:44,382 INFO repeater task os75nb_beamhistory ended after 86.5 seconds 2010-10-19 21:08:44,383 INFO repeater task phins_hcorrstats starting 138.5 seconds late 2010-10-19 21:08:58,882 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 21:10:49,177 INFO repeater task os75nb_lastensq starting 3.2 seconds late 2010-10-19 21:11:19,899 INFO repeater task os75nb_lastensq ended after 30.7 seconds 2010-10-19 21:11:19,900 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:10:37 2010-10-19 21:11:29,920 INFO repeater task phins_hcorrstats starting 4.0 seconds late 2010-10-19 21:11:44,362 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 21:15:49,794 INFO repeater task os75nb_lastensq starting 2.8 seconds late 2010-10-19 21:16:20,650 INFO repeater task os75nb_lastensq ended after 30.9 seconds 2010-10-19 21:16:20,651 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:15:38 2010-10-19 21:16:30,667 INFO repeater task os75nb_beamplots starting 4.7 seconds late 2010-10-19 21:16:34,107 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-10-19 21:16:34,109 INFO repeater task phins_hcorrstats starting 8.2 seconds late 2010-10-19 21:16:48,505 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 21:20:48,909 INFO repeater task os75nb_lastensq starting 0.9 seconds late 2010-10-19 21:21:20,524 INFO repeater task os75nb_lastensq ended after 31.6 seconds 2010-10-19 21:21:20,525 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:20:38 2010-10-19 21:21:30,544 INFO repeater task phins_hcorrstats starting 4.6 seconds late 2010-10-19 21:21:45,050 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 21:25:50,580 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2010-10-19 21:26:23,667 INFO repeater task os75nb_lastensq ended after 33.1 seconds 2010-10-19 21:26:23,668 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:25:39 2010-10-19 21:26:28,685 INFO repeater task os75nb_beamplots starting 2.8 seconds late 2010-10-19 21:26:32,146 INFO repeater task os75nb_beamplots ended after 3.5 seconds 2010-10-19 21:26:32,147 INFO repeater task phins_hcorrstats starting 6.2 seconds late 2010-10-19 21:26:46,551 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 21:30:51,941 INFO repeater task os75nb_lastensq starting 2.9 seconds late 2010-10-19 21:31:23,802 INFO repeater task os75nb_lastensq ended after 31.9 seconds 2010-10-19 21:31:23,803 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:30:40 2010-10-19 21:31:28,820 INFO repeater task phins_hcorrstats starting 2.9 seconds late 2010-10-19 21:31:43,299 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 21:35:53,897 INFO repeater task os75nb_lastensq starting 3.9 seconds late 2010-10-19 21:36:27,818 INFO repeater task os75nb_lastensq ended after 33.9 seconds 2010-10-19 21:36:27,819 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:35:41 2010-10-19 21:36:27,820 INFO repeater task os75nb_quick starting 1.9 seconds late 2010-10-19 21:37:03,045 INFO repeater task os75nb_quick ended after 35.2 seconds 2010-10-19 21:37:03,047 INFO repeater task os75nb_3dayplots starting 37.1 seconds late 2010-10-19 21:37:15,921 INFO repeater task os75nb_3dayplots ended after 12.9 seconds 2010-10-19 21:37:15,922 INFO repeater task os75nb_beamplots starting 50.0 seconds late 2010-10-19 21:37:19,984 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-19 21:37:19,993 INFO repeater task phins_hcorrstats starting 54.1 seconds late 2010-10-19 21:37:34,433 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 21:40:54,883 INFO repeater task os75nb_lastensq starting 3.9 seconds late 2010-10-19 21:41:28,895 INFO repeater task os75nb_lastensq ended after 34.0 seconds 2010-10-19 21:41:28,896 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:40:42 2010-10-19 21:41:28,899 INFO repeater task phins_hcorrstats starting 3.0 seconds late 2010-10-19 21:41:43,505 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-19 21:45:54,025 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2010-10-19 21:46:28,566 INFO repeater task os75nb_lastensq ended after 34.5 seconds 2010-10-19 21:46:28,567 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:45:42 2010-10-19 21:46:28,569 INFO repeater task os75nb_beamplots starting 2.7 seconds late 2010-10-19 21:46:32,583 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 21:46:32,585 INFO repeater task phins_hcorrstats starting 6.7 seconds late 2010-10-19 21:46:47,198 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-19 21:50:52,725 INFO repeater task os75nb_lastensq starting 0.7 seconds late 2010-10-19 21:51:28,077 INFO repeater task os75nb_lastensq ended after 35.4 seconds 2010-10-19 21:51:28,078 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:50:43 2010-10-19 21:51:28,082 INFO repeater task phins_hcorrstats starting 2.2 seconds late 2010-10-19 21:51:42,526 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 21:55:53,019 INFO repeater task os75nb_lastensq starting 0.0 seconds late 2010-10-19 21:56:27,744 INFO repeater task os75nb_lastensq ended after 34.7 seconds 2010-10-19 21:56:27,745 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 21:55:44 2010-10-19 21:56:27,747 INFO repeater task os75nb_beamplots starting 1.8 seconds late 2010-10-19 21:56:31,767 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 21:56:31,769 INFO repeater task phins_hcorrstats starting 5.8 seconds late 2010-10-19 21:56:46,188 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 22:00:56,774 INFO repeater task os75nb_lastensq starting 2.8 seconds late 2010-10-19 22:01:28,906 INFO repeater task os75nb_lastensq ended after 32.1 seconds 2010-10-19 22:01:28,907 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:00:45 2010-10-19 22:01:28,910 INFO repeater task phins_hcorrstats starting 3.0 seconds late 2010-10-19 22:01:43,953 INFO repeater task phins_hcorrstats ended after 15.0 seconds 2010-10-19 22:05:59,493 INFO repeater task os75nb_lastensq starting 4.5 seconds late 2010-10-19 22:06:24,361 INFO repeater task os75nb_lastensq ended after 24.9 seconds 2010-10-19 22:06:24,362 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:05:45 2010-10-19 22:06:29,370 INFO repeater task os75nb_quick starting 3.5 seconds late 2010-10-19 22:07:04,395 INFO repeater task os75nb_quick ended after 35.0 seconds 2010-10-19 22:07:04,396 INFO repeater task os75nb_3dayplots starting 38.5 seconds late 2010-10-19 22:07:17,365 INFO repeater task os75nb_3dayplots ended after 13.0 seconds 2010-10-19 22:07:17,366 INFO repeater task os75nb_beamplots starting 51.4 seconds late 2010-10-19 22:07:21,407 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 22:07:21,408 INFO repeater task os75nb_beamhistory starting 55.5 seconds late 2010-10-19 22:08:42,366 INFO repeater task os75nb_beamhistory output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") saving file to os75nb_bin_history.png 2010-10-19 22:08:42,366 INFO repeater task os75nb_beamhistory ended after 81.0 seconds 2010-10-19 22:08:42,367 INFO repeater task phins_hcorrstats starting 136.4 seconds late 2010-10-19 22:08:56,870 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 22:10:57,173 INFO repeater task os75nb_lastensq starting 2.2 seconds late 2010-10-19 22:11:22,698 INFO repeater task os75nb_lastensq ended after 25.5 seconds 2010-10-19 22:11:22,699 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:10:46 2010-10-19 22:11:27,727 INFO repeater task phins_hcorrstats starting 1.8 seconds late 2010-10-19 22:11:42,088 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 22:15:57,509 INFO repeater task os75nb_lastensq starting 1.5 seconds late 2010-10-19 22:16:22,919 INFO repeater task os75nb_lastensq ended after 25.4 seconds 2010-10-19 22:16:22,920 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:15:47 2010-10-19 22:16:27,930 INFO repeater task os75nb_beamplots starting 2.0 seconds late 2010-10-19 22:16:31,361 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-10-19 22:16:31,363 INFO repeater task phins_hcorrstats starting 5.4 seconds late 2010-10-19 22:16:46,310 INFO repeater task phins_hcorrstats ended after 14.9 seconds 2010-10-19 22:21:01,750 INFO repeater task os75nb_lastensq starting 4.8 seconds late 2010-10-19 22:21:27,543 INFO repeater task os75nb_lastensq ended after 25.8 seconds 2010-10-19 22:21:27,544 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:20:48 2010-10-19 22:21:27,547 INFO repeater task phins_hcorrstats starting 1.6 seconds late 2010-10-19 22:21:42,297 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-19 22:26:02,871 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2010-10-19 22:26:29,472 INFO repeater task os75nb_lastensq ended after 26.6 seconds 2010-10-19 22:26:29,473 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:25:48 2010-10-19 22:26:29,475 INFO repeater task os75nb_beamplots starting 3.6 seconds late 2010-10-19 22:26:33,490 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 22:26:33,492 INFO repeater task phins_hcorrstats starting 7.6 seconds late 2010-10-19 22:26:48,070 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-19 22:30:58,599 INFO repeater task os75nb_lastensq starting 0.6 seconds late 2010-10-19 22:31:26,030 INFO repeater task os75nb_lastensq ended after 27.4 seconds 2010-10-19 22:31:26,031 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:30:49 2010-10-19 22:31:26,034 INFO repeater task phins_hcorrstats starting 0.1 seconds late 2010-10-19 22:31:40,339 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-19 22:36:00,909 INFO repeater task os75nb_lastensq starting 1.9 seconds late 2010-10-19 22:36:28,321 INFO repeater task os75nb_lastensq ended after 27.4 seconds 2010-10-19 22:36:28,322 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:35:50 2010-10-19 22:36:28,323 INFO repeater task os75nb_quick starting 2.4 seconds late 2010-10-19 22:37:03,614 INFO repeater task os75nb_quick ended after 35.3 seconds 2010-10-19 22:37:03,615 INFO repeater task os75nb_3dayplots starting 37.7 seconds late 2010-10-19 22:37:17,206 INFO repeater task os75nb_3dayplots ended after 13.6 seconds 2010-10-19 22:37:17,207 INFO repeater task os75nb_beamplots starting 51.3 seconds late 2010-10-19 22:37:21,244 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 22:37:21,245 INFO repeater task phins_hcorrstats starting 55.3 seconds late 2010-10-19 22:37:36,536 INFO repeater task phins_hcorrstats ended after 15.3 seconds 2010-10-19 22:41:02,009 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2010-10-19 22:41:30,604 INFO repeater task os75nb_lastensq ended after 28.6 seconds 2010-10-19 22:41:30,605 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:40:51 2010-10-19 22:41:30,609 INFO repeater task phins_hcorrstats starting 4.7 seconds late 2010-10-19 22:41:45,249 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-19 22:46:05,845 INFO repeater task os75nb_lastensq starting 4.8 seconds late 2010-10-19 22:46:34,886 INFO repeater task os75nb_lastensq ended after 29.0 seconds 2010-10-19 22:46:34,887 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:45:51 2010-10-19 22:46:34,889 INFO repeater task os75nb_beamplots starting 9.0 seconds late 2010-10-19 22:46:38,916 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 22:46:38,917 INFO repeater task phins_hcorrstats starting 13.0 seconds late 2010-10-19 22:46:52,884 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-19 22:51:03,301 INFO repeater task os75nb_lastensq starting 2.3 seconds late 2010-10-19 22:51:32,199 INFO repeater task os75nb_lastensq ended after 28.9 seconds 2010-10-19 22:51:32,200 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:50:52 2010-10-19 22:51:32,209 INFO repeater task phins_hcorrstats starting 6.3 seconds late 2010-10-19 22:51:46,516 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-19 22:56:06,961 INFO repeater task os75nb_lastensq starting 5.0 seconds late 2010-10-19 22:56:36,132 INFO repeater task os75nb_lastensq ended after 29.2 seconds 2010-10-19 22:56:36,133 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 22:55:53 2010-10-19 22:56:36,141 INFO repeater task os75nb_beamplots starting 10.2 seconds late 2010-10-19 22:56:40,103 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 22:56:40,105 INFO repeater task phins_hcorrstats starting 14.2 seconds late 2010-10-19 22:56:54,629 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 23:01:05,069 INFO repeater task os75nb_lastensq starting 2.1 seconds late 2010-10-19 23:01:34,194 INFO repeater task os75nb_lastensq ended after 29.1 seconds 2010-10-19 23:01:34,195 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:00:54 2010-10-19 23:01:34,198 INFO repeater task phins_hcorrstats starting 8.3 seconds late 2010-10-19 23:01:48,578 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 23:06:04,059 INFO repeater task os75nb_lastensq starting 0.1 seconds late 2010-10-19 23:06:33,590 INFO repeater task os75nb_lastensq ended after 29.5 seconds 2010-10-19 23:06:33,591 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:05:55 2010-10-19 23:06:33,592 INFO repeater task os75nb_quick starting 7.7 seconds late 2010-10-19 23:07:08,099 INFO repeater task os75nb_quick ended after 34.5 seconds 2010-10-19 23:07:08,100 INFO repeater task os75nb_3dayplots starting 42.2 seconds late 2010-10-19 23:07:21,675 INFO repeater task os75nb_3dayplots ended after 13.6 seconds 2010-10-19 23:07:21,676 INFO repeater task os75nb_beamplots starting 55.8 seconds late 2010-10-19 23:07:25,124 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-10-19 23:07:25,126 INFO repeater task os75nb_beamhistory starting 59.2 seconds late 2010-10-19 23:08:50,912 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-19 23:08:50,912 INFO repeater task os75nb_beamhistory ended after 85.8 seconds 2010-10-19 23:08:50,919 INFO repeater task phins_hcorrstats starting 145.0 seconds late 2010-10-19 23:09:05,404 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 23:11:05,603 INFO repeater task os75nb_lastensq starting 0.6 seconds late 2010-10-19 23:11:36,430 INFO repeater task os75nb_lastensq ended after 30.8 seconds 2010-10-19 23:11:36,431 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:10:55 2010-10-19 23:11:36,434 INFO repeater task phins_hcorrstats starting 10.5 seconds late 2010-10-19 23:11:50,467 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-19 23:16:05,905 INFO repeater task os75nb_lastensq starting 0.9 seconds late 2010-10-19 23:16:37,430 INFO repeater task os75nb_lastensq ended after 31.5 seconds 2010-10-19 23:16:37,431 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:15:56 2010-10-19 23:16:37,433 INFO repeater task os75nb_beamplots starting 11.5 seconds late 2010-10-19 23:16:41,445 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 23:16:41,447 INFO repeater task phins_hcorrstats starting 15.5 seconds late 2010-10-19 23:16:56,515 INFO repeater task phins_hcorrstats ended after 15.1 seconds 2010-10-19 23:21:07,037 INFO repeater task os75nb_lastensq starting 1.0 seconds late 2010-10-19 23:21:39,531 INFO repeater task os75nb_lastensq ended after 32.5 seconds 2010-10-19 23:21:39,532 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:20:57 2010-10-19 23:21:39,541 INFO repeater task phins_hcorrstats starting 13.6 seconds late 2010-10-19 23:21:53,418 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 23:26:08,855 INFO repeater task os75nb_lastensq starting 1.9 seconds late 2010-10-19 23:26:41,057 INFO repeater task os75nb_lastensq ended after 32.2 seconds 2010-10-19 23:26:41,058 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:25:58 2010-10-19 23:26:41,060 INFO repeater task os75nb_beamplots starting 15.1 seconds late 2010-10-19 23:26:45,096 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 23:26:45,097 INFO repeater task phins_hcorrstats starting 19.2 seconds late 2010-10-19 23:26:59,536 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-19 23:31:10,073 INFO repeater task os75nb_lastensq starting 2.1 seconds late 2010-10-19 23:31:43,577 INFO repeater task os75nb_lastensq ended after 33.5 seconds 2010-10-19 23:31:43,578 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:30:58 2010-10-19 23:31:43,581 INFO repeater task phins_hcorrstats starting 17.7 seconds late 2010-10-19 23:31:57,464 INFO repeater task phins_hcorrstats ended after 13.9 seconds 2010-10-19 23:36:12,893 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2010-10-19 23:36:46,058 INFO repeater task os75nb_lastensq ended after 33.2 seconds 2010-10-19 23:36:46,058 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:35:59 2010-10-19 23:36:46,060 INFO repeater task os75nb_quick starting 20.1 seconds late 2010-10-19 23:37:21,209 INFO repeater task os75nb_quick ended after 35.1 seconds 2010-10-19 23:37:21,210 INFO repeater task os75nb_3dayplots starting 55.3 seconds late 2010-10-19 23:37:34,555 INFO repeater task os75nb_3dayplots ended after 13.3 seconds 2010-10-19 23:37:34,556 INFO repeater task os75nb_beamplots starting 68.6 seconds late 2010-10-19 23:37:38,464 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2010-10-19 23:37:38,470 INFO repeater task phins_hcorrstats starting 72.5 seconds late 2010-10-19 23:37:52,619 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-19 23:41:12,967 INFO repeater task os75nb_lastensq starting 4.0 seconds late 2010-10-19 23:41:47,163 INFO repeater task os75nb_lastensq ended after 34.2 seconds 2010-10-19 23:41:47,164 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:41:00 2010-10-19 23:41:47,180 INFO repeater task phins_hcorrstats starting 21.3 seconds late 2010-10-19 23:42:01,490 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-19 23:46:11,911 INFO repeater task os75nb_lastensq starting 1.9 seconds late 2010-10-19 23:46:47,975 INFO repeater task os75nb_lastensq ended after 36.1 seconds 2010-10-19 23:46:47,976 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:46:01 2010-10-19 23:46:47,980 INFO repeater task os75nb_beamplots starting 22.1 seconds late 2010-10-19 23:46:51,999 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 23:46:52,001 INFO repeater task phins_hcorrstats starting 26.1 seconds late 2010-10-19 23:47:06,232 INFO repeater task phins_hcorrstats ended after 14.2 seconds 2010-10-19 23:51:11,665 INFO repeater task os75nb_lastensq starting 0.7 seconds late 2010-10-19 23:51:47,090 INFO repeater task os75nb_lastensq ended after 35.4 seconds 2010-10-19 23:51:47,092 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:51:01 2010-10-19 23:51:47,095 INFO repeater task phins_hcorrstats starting 21.2 seconds late 2010-10-19 23:52:01,605 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-19 23:56:12,177 INFO repeater task os75nb_lastensq starting 1.2 seconds late 2010-10-19 23:56:47,779 INFO repeater task os75nb_lastensq ended after 35.6 seconds 2010-10-19 23:56:47,780 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/19 23:56:02 2010-10-19 23:56:47,782 INFO repeater task os75nb_beamplots starting 21.9 seconds late 2010-10-19 23:56:51,787 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-19 23:56:51,788 INFO repeater task phins_hcorrstats starting 25.9 seconds late 2010-10-19 23:57:06,373 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 00:01:16,929 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2010-10-20 00:01:49,134 INFO repeater task os75nb_lastensq ended after 32.2 seconds 2010-10-20 00:01:49,134 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:01:03 2010-10-20 00:01:49,145 INFO repeater task phins_hcorrstats starting 23.2 seconds late 2010-10-20 00:02:03,228 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-20 00:06:13,645 INFO repeater task os75nb_lastensq starting 0.6 seconds late 2010-10-20 00:06:38,028 INFO repeater task os75nb_lastensq ended after 24.4 seconds 2010-10-20 00:06:38,029 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:06:04 2010-10-20 00:06:38,033 INFO repeater task os75nb_quick starting 12.1 seconds late 2010-10-20 00:07:15,187 INFO repeater task os75nb_quick ended after 37.2 seconds 2010-10-20 00:07:15,188 INFO repeater task os75nb_3dayplots starting 49.3 seconds late 2010-10-20 00:07:28,125 INFO repeater task os75nb_3dayplots ended after 12.9 seconds 2010-10-20 00:07:28,126 INFO repeater task os75nb_beamplots starting 62.2 seconds late 2010-10-20 00:07:32,168 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 00:07:32,169 INFO repeater task os75nb_beamhistory starting 66.3 seconds late 2010-10-20 00:08:53,053 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-20 00:08:53,054 INFO repeater task os75nb_beamhistory ended after 80.9 seconds 2010-10-20 00:08:53,055 INFO repeater task phins_hcorrstats starting 147.1 seconds late 2010-10-20 00:09:07,589 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 00:11:17,877 INFO repeater task os75nb_lastensq starting 3.9 seconds late 2010-10-20 00:11:42,467 INFO repeater task os75nb_lastensq ended after 24.6 seconds 2010-10-20 00:11:42,468 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:11:05 2010-10-20 00:11:42,471 INFO repeater task phins_hcorrstats starting 16.5 seconds late 2010-10-20 00:11:57,021 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 00:16:17,449 INFO repeater task os75nb_lastensq starting 2.4 seconds late 2010-10-20 00:16:41,966 INFO repeater task os75nb_lastensq ended after 24.5 seconds 2010-10-20 00:16:41,967 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:16:05 2010-10-20 00:16:41,970 INFO repeater task os75nb_beamplots starting 16.1 seconds late 2010-10-20 00:16:46,061 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 00:16:46,062 INFO repeater task phins_hcorrstats starting 20.1 seconds late 2010-10-20 00:17:00,663 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 00:21:16,117 INFO repeater task os75nb_lastensq starting 1.1 seconds late 2010-10-20 00:21:41,681 INFO repeater task os75nb_lastensq ended after 25.6 seconds 2010-10-20 00:21:41,682 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:21:06 2010-10-20 00:21:41,693 INFO repeater task phins_hcorrstats starting 15.8 seconds late 2010-10-20 00:21:56,104 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-20 00:26:16,529 INFO repeater task os75nb_lastensq starting 0.5 seconds late 2010-10-20 00:26:43,065 INFO repeater task os75nb_lastensq ended after 26.5 seconds 2010-10-20 00:26:43,066 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:26:07 2010-10-20 00:26:43,068 INFO repeater task os75nb_beamplots starting 17.1 seconds late 2010-10-20 00:26:47,099 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 00:26:47,106 INFO repeater task phins_hcorrstats starting 21.2 seconds late 2010-10-20 00:27:01,702 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 00:31:17,239 INFO repeater task os75nb_lastensq starting 0.2 seconds late 2010-10-20 00:31:44,203 INFO repeater task os75nb_lastensq ended after 27.0 seconds 2010-10-20 00:31:44,205 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:31:08 2010-10-20 00:31:44,208 INFO repeater task phins_hcorrstats starting 18.3 seconds late 2010-10-20 00:31:58,671 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 00:36:19,110 INFO repeater task os75nb_lastensq starting 1.1 seconds late 2010-10-20 00:36:45,685 INFO repeater task os75nb_lastensq ended after 26.6 seconds 2010-10-20 00:36:45,686 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:36:09 2010-10-20 00:36:45,687 INFO repeater task os75nb_quick starting 19.8 seconds late 2010-10-20 00:37:22,687 INFO repeater task os75nb_quick ended after 37.0 seconds 2010-10-20 00:37:22,688 INFO repeater task os75nb_3dayplots starting 56.8 seconds late 2010-10-20 00:37:36,206 INFO repeater task os75nb_3dayplots ended after 13.5 seconds 2010-10-20 00:37:36,208 INFO repeater task os75nb_beamplots starting 70.3 seconds late 2010-10-20 00:37:39,631 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-10-20 00:37:39,632 INFO repeater task phins_hcorrstats starting 73.7 seconds late 2010-10-20 00:37:54,143 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 00:41:19,481 INFO repeater task os75nb_lastensq starting 0.5 seconds late 2010-10-20 00:41:47,193 INFO repeater task os75nb_lastensq ended after 27.7 seconds 2010-10-20 00:41:47,194 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:41:09 2010-10-20 00:41:47,197 INFO repeater task phins_hcorrstats starting 21.3 seconds late 2010-10-20 00:42:01,821 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 00:46:22,323 INFO repeater task os75nb_lastensq starting 3.3 seconds late 2010-10-20 00:46:50,465 INFO repeater task os75nb_lastensq ended after 28.1 seconds 2010-10-20 00:46:50,466 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:46:10 2010-10-20 00:46:50,468 INFO repeater task os75nb_beamplots starting 24.5 seconds late 2010-10-20 00:46:54,500 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 00:46:54,502 INFO repeater task phins_hcorrstats starting 28.6 seconds late 2010-10-20 00:47:09,244 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 00:51:24,811 INFO repeater task os75nb_lastensq starting 4.8 seconds late 2010-10-20 00:51:54,044 INFO repeater task os75nb_lastensq ended after 29.2 seconds 2010-10-20 00:51:54,045 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:51:11 2010-10-20 00:51:54,049 INFO repeater task phins_hcorrstats starting 28.1 seconds late 2010-10-20 00:52:08,617 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 00:56:24,181 INFO repeater task os75nb_lastensq starting 3.2 seconds late 2010-10-20 00:56:53,979 INFO repeater task os75nb_lastensq ended after 29.8 seconds 2010-10-20 00:56:53,980 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 00:56:12 2010-10-20 00:56:53,982 INFO repeater task os75nb_beamplots starting 28.1 seconds late 2010-10-20 00:56:57,978 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 00:56:57,980 INFO repeater task phins_hcorrstats starting 32.1 seconds late 2010-10-20 00:57:12,103 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-20 01:01:22,597 INFO repeater task os75nb_lastensq starting 0.6 seconds late 2010-10-20 01:01:53,089 INFO repeater task os75nb_lastensq ended after 30.5 seconds 2010-10-20 01:01:53,090 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:01:12 2010-10-20 01:01:53,094 INFO repeater task phins_hcorrstats starting 27.2 seconds late 2010-10-20 01:02:07,634 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 01:06:23,189 INFO repeater task os75nb_lastensq starting 1.2 seconds late 2010-10-20 01:06:53,915 INFO repeater task os75nb_lastensq ended after 30.7 seconds 2010-10-20 01:06:53,916 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:06:13 2010-10-20 01:06:53,917 INFO repeater task os75nb_quick starting 28.0 seconds late 2010-10-20 01:07:31,118 INFO repeater task os75nb_quick ended after 37.2 seconds 2010-10-20 01:07:31,121 INFO repeater task os75nb_3dayplots starting 65.2 seconds late 2010-10-20 01:07:44,200 INFO repeater task os75nb_3dayplots ended after 13.1 seconds 2010-10-20 01:07:44,201 INFO repeater task os75nb_beamplots starting 78.3 seconds late 2010-10-20 01:07:48,260 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 01:07:48,261 INFO repeater task os75nb_beamhistory starting 82.3 seconds late 2010-10-20 01:09:10,688 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-20 01:09:10,689 INFO repeater task os75nb_beamhistory ended after 82.4 seconds 2010-10-20 01:09:10,689 INFO repeater task phins_hcorrstats starting 164.8 seconds late 2010-10-20 01:09:25,291 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 01:11:25,490 INFO repeater task os75nb_lastensq starting 2.5 seconds late 2010-10-20 01:11:55,245 INFO repeater task os75nb_lastensq ended after 29.8 seconds 2010-10-20 01:11:55,246 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:11:14 2010-10-20 01:11:55,269 INFO repeater task phins_hcorrstats starting 29.3 seconds late 2010-10-20 01:12:09,626 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-20 01:16:25,049 INFO repeater task os75nb_lastensq starting 1.0 seconds late 2010-10-20 01:16:56,686 INFO repeater task os75nb_lastensq ended after 31.6 seconds 2010-10-20 01:16:56,687 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:16:15 2010-10-20 01:16:56,689 INFO repeater task os75nb_beamplots starting 30.8 seconds late 2010-10-20 01:17:00,724 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 01:17:00,725 INFO repeater task phins_hcorrstats starting 34.8 seconds late 2010-10-20 01:17:14,693 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-20 01:21:25,097 INFO repeater task os75nb_lastensq starting 0.1 seconds late 2010-10-20 01:21:56,956 INFO repeater task os75nb_lastensq ended after 31.9 seconds 2010-10-20 01:21:56,957 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:21:15 2010-10-20 01:21:56,960 INFO repeater task phins_hcorrstats starting 31.0 seconds late 2010-10-20 01:22:11,461 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 01:26:27,034 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2010-10-20 01:26:59,599 INFO repeater task os75nb_lastensq ended after 32.6 seconds 2010-10-20 01:26:59,600 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:26:16 2010-10-20 01:26:59,602 INFO repeater task os75nb_beamplots starting 33.7 seconds late 2010-10-20 01:27:03,284 INFO repeater task os75nb_beamplots ended after 3.7 seconds 2010-10-20 01:27:03,293 INFO repeater task phins_hcorrstats starting 37.4 seconds late 2010-10-20 01:27:17,643 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-20 01:31:28,046 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2010-10-20 01:32:00,651 INFO repeater task os75nb_lastensq ended after 32.6 seconds 2010-10-20 01:32:00,652 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:31:17 2010-10-20 01:32:00,655 INFO repeater task phins_hcorrstats starting 34.7 seconds late 2010-10-20 01:32:15,073 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-20 01:36:30,587 INFO repeater task os75nb_lastensq starting 3.6 seconds late 2010-10-20 01:37:03,669 INFO repeater task os75nb_lastensq ended after 33.1 seconds 2010-10-20 01:37:03,670 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:36:18 2010-10-20 01:37:03,671 INFO repeater task os75nb_quick starting 37.8 seconds late 2010-10-20 01:37:40,192 INFO repeater task os75nb_quick ended after 36.5 seconds 2010-10-20 01:37:40,193 INFO repeater task os75nb_3dayplots starting 74.3 seconds late 2010-10-20 01:37:53,831 INFO repeater task os75nb_3dayplots ended after 13.6 seconds 2010-10-20 01:37:53,832 INFO repeater task os75nb_beamplots starting 87.9 seconds late 2010-10-20 01:37:57,353 INFO repeater task os75nb_beamplots ended after 3.5 seconds 2010-10-20 01:37:57,357 INFO repeater task phins_hcorrstats starting 91.4 seconds late 2010-10-20 01:38:12,058 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 01:41:27,380 INFO repeater task phins_hcorrstats starting 1.5 seconds late 2010-10-20 01:41:41,947 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 01:41:46,953 INFO repeater task os75nb_lastensq starting 19.0 seconds late 2010-10-20 01:42:20,497 INFO repeater task os75nb_lastensq ended after 33.5 seconds 2010-10-20 01:42:20,498 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:41:19 2010-10-20 01:46:30,917 INFO repeater task os75nb_lastensq starting 1.9 seconds late 2010-10-20 01:47:04,970 INFO repeater task os75nb_lastensq ended after 34.1 seconds 2010-10-20 01:47:04,971 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:46:19 2010-10-20 01:47:04,973 INFO repeater task os75nb_beamplots starting 39.1 seconds late 2010-10-20 01:47:08,951 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 01:47:08,953 INFO repeater task phins_hcorrstats starting 43.0 seconds late 2010-10-20 01:47:23,521 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 01:51:28,973 INFO repeater task phins_hcorrstats starting 3.0 seconds late 2010-10-20 01:51:43,389 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-20 01:51:48,396 INFO repeater task os75nb_lastensq starting 19.4 seconds late 2010-10-20 01:52:23,843 INFO repeater task os75nb_lastensq ended after 35.4 seconds 2010-10-20 01:52:23,844 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:51:20 2010-10-20 01:56:29,236 INFO repeater task os75nb_beamplots starting 3.3 seconds late 2010-10-20 01:56:32,666 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-10-20 01:56:32,667 INFO repeater task phins_hcorrstats starting 6.7 seconds late 2010-10-20 01:56:47,118 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 01:56:52,121 INFO repeater task os75nb_lastensq starting 22.1 seconds late 2010-10-20 01:57:27,772 INFO repeater task os75nb_lastensq ended after 35.7 seconds 2010-10-20 01:57:27,773 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 01:56:21 2010-10-20 02:01:28,174 INFO repeater task phins_hcorrstats starting 2.2 seconds late 2010-10-20 02:01:42,152 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-20 02:01:47,157 INFO repeater task os75nb_lastensq starting 16.2 seconds late 2010-10-20 02:02:19,205 INFO repeater task os75nb_lastensq ended after 32.0 seconds 2010-10-20 02:02:19,206 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:01:22 2010-10-20 02:06:29,750 INFO repeater task os75nb_quick starting 3.8 seconds late 2010-10-20 02:07:06,344 INFO repeater task os75nb_quick ended after 36.6 seconds 2010-10-20 02:07:06,346 INFO repeater task os75nb_3dayplots starting 40.4 seconds late 2010-10-20 02:07:19,823 INFO repeater task os75nb_3dayplots ended after 13.5 seconds 2010-10-20 02:07:19,824 INFO repeater task os75nb_beamplots starting 53.9 seconds late 2010-10-20 02:07:23,876 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 02:07:23,877 INFO repeater task os75nb_beamhistory starting 58.0 seconds late 2010-10-20 02:08:44,031 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-20 02:08:44,031 INFO repeater task os75nb_beamhistory ended after 80.2 seconds 2010-10-20 02:08:44,032 INFO repeater task phins_hcorrstats starting 138.1 seconds late 2010-10-20 02:08:58,711 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 02:09:03,717 INFO repeater task os75nb_lastensq starting 151.7 seconds late 2010-10-20 02:09:28,990 INFO repeater task os75nb_lastensq ended after 25.3 seconds 2010-10-20 02:09:28,991 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:06:22 2010-10-20 02:11:29,198 INFO repeater task phins_hcorrstats starting 3.3 seconds late 2010-10-20 02:11:43,620 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-20 02:11:48,626 INFO repeater task os75nb_lastensq starting 16.6 seconds late 2010-10-20 02:12:13,385 INFO repeater task os75nb_lastensq ended after 24.8 seconds 2010-10-20 02:12:13,386 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:11:23 2010-10-20 02:16:28,876 INFO repeater task os75nb_beamplots starting 3.0 seconds late 2010-10-20 02:16:32,892 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 02:16:32,894 INFO repeater task phins_hcorrstats starting 7.0 seconds late 2010-10-20 02:16:47,393 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 02:16:52,401 INFO repeater task os75nb_lastensq starting 19.4 seconds late 2010-10-20 02:17:17,223 INFO repeater task os75nb_lastensq ended after 24.8 seconds 2010-10-20 02:17:17,224 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:16:24 2010-10-20 02:21:27,687 INFO repeater task phins_hcorrstats starting 1.8 seconds late 2010-10-20 02:21:42,229 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 02:21:47,233 INFO repeater task os75nb_lastensq starting 13.2 seconds late 2010-10-20 02:22:13,182 INFO repeater task os75nb_lastensq ended after 25.9 seconds 2010-10-20 02:22:13,183 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:21:25 2010-10-20 02:26:28,740 INFO repeater task os75nb_beamplots starting 2.8 seconds late 2010-10-20 02:26:32,809 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 02:26:32,810 INFO repeater task phins_hcorrstats starting 6.9 seconds late 2010-10-20 02:26:47,411 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 02:26:52,413 INFO repeater task os75nb_lastensq starting 17.4 seconds late 2010-10-20 02:27:19,073 INFO repeater task os75nb_lastensq ended after 26.7 seconds 2010-10-20 02:27:19,074 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:26:26 2010-10-20 02:31:29,485 INFO repeater task phins_hcorrstats starting 3.6 seconds late 2010-10-20 02:31:43,472 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-20 02:31:48,479 INFO repeater task os75nb_lastensq starting 12.5 seconds late 2010-10-20 02:32:16,295 INFO repeater task os75nb_lastensq ended after 27.8 seconds 2010-10-20 02:32:16,296 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:31:26 2010-10-20 02:36:26,904 INFO repeater task os75nb_quick starting 1.0 seconds late 2010-10-20 02:37:03,877 INFO repeater task os75nb_quick ended after 37.0 seconds 2010-10-20 02:37:03,881 INFO repeater task os75nb_3dayplots starting 38.0 seconds late 2010-10-20 02:37:17,255 INFO repeater task os75nb_3dayplots ended after 13.4 seconds 2010-10-20 02:37:17,256 INFO repeater task os75nb_beamplots starting 51.3 seconds late 2010-10-20 02:37:21,291 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 02:37:21,293 INFO repeater task phins_hcorrstats starting 55.4 seconds late 2010-10-20 02:37:35,808 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 02:37:40,809 INFO repeater task os75nb_lastensq starting 64.8 seconds late 2010-10-20 02:38:08,049 INFO repeater task os75nb_lastensq ended after 27.2 seconds 2010-10-20 02:38:08,049 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:36:27 2010-10-20 02:41:28,390 INFO repeater task phins_hcorrstats starting 2.5 seconds late 2010-10-20 02:41:42,364 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-20 02:41:47,369 INFO repeater task os75nb_lastensq starting 10.4 seconds late 2010-10-20 02:42:16,064 INFO repeater task os75nb_lastensq ended after 28.7 seconds 2010-10-20 02:42:16,065 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:41:28 2010-10-20 02:46:26,608 INFO repeater task os75nb_beamplots starting 0.7 seconds late 2010-10-20 02:46:30,660 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 02:46:30,662 INFO repeater task phins_hcorrstats starting 4.7 seconds late 2010-10-20 02:46:45,273 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 02:46:50,277 INFO repeater task os75nb_lastensq starting 12.3 seconds late 2010-10-20 02:47:19,246 INFO repeater task os75nb_lastensq ended after 29.0 seconds 2010-10-20 02:47:19,246 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:46:29 2010-10-20 02:51:29,835 INFO repeater task phins_hcorrstats starting 3.9 seconds late 2010-10-20 02:51:44,600 INFO repeater task phins_hcorrstats ended after 14.8 seconds 2010-10-20 02:51:49,607 INFO repeater task os75nb_lastensq starting 10.6 seconds late 2010-10-20 02:52:19,117 INFO repeater task os75nb_lastensq ended after 29.5 seconds 2010-10-20 02:52:19,118 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:51:29 2010-10-20 02:56:29,652 INFO repeater task os75nb_beamplots starting 3.7 seconds late 2010-10-20 02:56:33,663 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 02:56:33,665 INFO repeater task phins_hcorrstats starting 7.7 seconds late 2010-10-20 02:56:48,235 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 02:56:53,241 INFO repeater task os75nb_lastensq starting 14.2 seconds late 2010-10-20 02:57:23,680 INFO repeater task os75nb_lastensq ended after 30.4 seconds 2010-10-20 02:57:23,681 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 02:56:30 2010-10-20 03:01:29,209 INFO repeater task phins_hcorrstats starting 3.3 seconds late 2010-10-20 03:01:43,649 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-20 03:01:48,655 INFO repeater task os75nb_lastensq starting 8.7 seconds late 2010-10-20 03:02:19,036 INFO repeater task os75nb_lastensq ended after 30.4 seconds 2010-10-20 03:02:19,037 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:01:31 2010-10-20 03:06:29,469 INFO repeater task os75nb_quick starting 3.6 seconds late 2010-10-20 03:07:06,342 INFO repeater task os75nb_quick ended after 36.9 seconds 2010-10-20 03:07:06,344 INFO repeater task os75nb_3dayplots starting 40.4 seconds late 2010-10-20 03:07:19,203 INFO repeater task os75nb_3dayplots ended after 12.9 seconds 2010-10-20 03:07:19,204 INFO repeater task os75nb_beamplots starting 53.3 seconds late 2010-10-20 03:07:23,242 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 03:07:23,243 INFO repeater task os75nb_beamhistory starting 57.3 seconds late 2010-10-20 03:08:45,331 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-20 03:08:45,332 INFO repeater task os75nb_beamhistory ended after 82.1 seconds 2010-10-20 03:08:45,333 INFO repeater task phins_hcorrstats starting 139.4 seconds late 2010-10-20 03:08:59,951 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 03:09:04,954 INFO repeater task os75nb_lastensq starting 144.0 seconds late 2010-10-20 03:09:35,958 INFO repeater task os75nb_lastensq ended after 31.0 seconds 2010-10-20 03:09:35,959 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:06:32 2010-10-20 03:11:26,150 INFO repeater task phins_hcorrstats starting 0.2 seconds late 2010-10-20 03:11:40,296 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-20 03:11:45,305 INFO repeater task os75nb_lastensq starting 3.3 seconds late 2010-10-20 03:12:15,858 INFO repeater task os75nb_lastensq ended after 30.6 seconds 2010-10-20 03:12:15,859 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:11:33 2010-10-20 03:16:26,304 INFO repeater task os75nb_beamplots starting 0.4 seconds late 2010-10-20 03:16:30,324 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 03:16:30,326 INFO repeater task phins_hcorrstats starting 4.4 seconds late 2010-10-20 03:16:44,385 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-20 03:16:49,393 INFO repeater task os75nb_lastensq starting 6.4 seconds late 2010-10-20 03:17:20,835 INFO repeater task os75nb_lastensq ended after 31.4 seconds 2010-10-20 03:17:20,836 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:16:33 2010-10-20 03:21:26,361 INFO repeater task phins_hcorrstats starting 0.4 seconds late 2010-10-20 03:21:41,037 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 03:21:46,041 INFO repeater task os75nb_lastensq starting 3.0 seconds late 2010-10-20 03:22:18,243 INFO repeater task os75nb_lastensq ended after 32.2 seconds 2010-10-20 03:22:18,244 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:21:34 2010-10-20 03:26:28,666 INFO repeater task os75nb_beamplots starting 2.7 seconds late 2010-10-20 03:26:32,086 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-10-20 03:26:32,087 INFO repeater task phins_hcorrstats starting 6.2 seconds late 2010-10-20 03:26:46,689 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 03:26:51,693 INFO repeater task os75nb_lastensq starting 7.7 seconds late 2010-10-20 03:27:24,689 INFO repeater task os75nb_lastensq ended after 33.0 seconds 2010-10-20 03:27:24,690 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:26:35 2010-10-20 03:31:30,253 INFO repeater task phins_hcorrstats starting 4.3 seconds late 2010-10-20 03:31:44,832 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 03:31:49,838 INFO repeater task os75nb_lastensq starting 4.8 seconds late 2010-10-20 03:32:22,630 INFO repeater task os75nb_lastensq ended after 32.8 seconds 2010-10-20 03:32:22,631 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:31:36 2010-10-20 03:36:28,066 INFO repeater task os75nb_quick starting 2.1 seconds late 2010-10-20 03:37:05,046 INFO repeater task os75nb_quick ended after 37.0 seconds 2010-10-20 03:37:05,047 INFO repeater task os75nb_3dayplots starting 39.1 seconds late 2010-10-20 03:37:18,525 INFO repeater task os75nb_3dayplots ended after 13.5 seconds 2010-10-20 03:37:18,527 INFO repeater task os75nb_beamplots starting 52.6 seconds late 2010-10-20 03:37:21,995 INFO repeater task os75nb_beamplots ended after 3.5 seconds 2010-10-20 03:37:21,997 INFO repeater task phins_hcorrstats starting 56.1 seconds late 2010-10-20 03:37:36,651 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 03:37:41,657 INFO repeater task os75nb_lastensq starting 55.7 seconds late 2010-10-20 03:38:15,910 INFO repeater task os75nb_lastensq ended after 34.3 seconds 2010-10-20 03:38:15,911 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:36:37 2010-10-20 03:41:26,233 INFO repeater task phins_hcorrstats starting 0.3 seconds late 2010-10-20 03:41:40,539 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-20 03:41:50,549 INFO repeater task os75nb_lastensq starting 3.5 seconds late 2010-10-20 03:42:24,692 INFO repeater task os75nb_lastensq ended after 34.1 seconds 2010-10-20 03:42:24,693 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:41:37 2010-10-20 03:46:30,149 INFO repeater task os75nb_beamplots starting 4.2 seconds late 2010-10-20 03:46:33,846 INFO repeater task os75nb_beamplots ended after 3.7 seconds 2010-10-20 03:46:33,848 INFO repeater task phins_hcorrstats starting 7.9 seconds late 2010-10-20 03:46:48,366 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 03:46:53,369 INFO repeater task os75nb_lastensq starting 6.4 seconds late 2010-10-20 03:47:28,382 INFO repeater task os75nb_lastensq ended after 35.0 seconds 2010-10-20 03:47:28,383 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:46:38 2010-10-20 03:51:28,917 INFO repeater task phins_hcorrstats starting 3.0 seconds late 2010-10-20 03:51:43,476 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 03:51:48,481 INFO repeater task os75nb_lastensq starting 0.5 seconds late 2010-10-20 03:52:23,699 INFO repeater task os75nb_lastensq ended after 35.2 seconds 2010-10-20 03:52:23,700 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:51:39 2010-10-20 03:56:29,100 INFO repeater task os75nb_beamplots starting 3.2 seconds late 2010-10-20 03:56:32,513 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-10-20 03:56:32,515 INFO repeater task phins_hcorrstats starting 6.6 seconds late 2010-10-20 03:56:47,045 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 03:56:52,049 INFO repeater task os75nb_lastensq starting 3.0 seconds late 2010-10-20 03:57:28,055 INFO repeater task os75nb_lastensq ended after 36.0 seconds 2010-10-20 03:57:28,056 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 03:56:40 2010-10-20 04:01:28,463 INFO repeater task phins_hcorrstats starting 2.5 seconds late 2010-10-20 04:01:42,486 INFO repeater task phins_hcorrstats ended after 14.0 seconds 2010-10-20 04:01:52,500 INFO repeater task os75nb_lastensq starting 2.5 seconds late 2010-10-20 04:02:24,889 INFO repeater task os75nb_lastensq ended after 32.4 seconds 2010-10-20 04:02:24,890 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:01:41 2010-10-20 04:06:30,484 INFO repeater task os75nb_quick starting 4.6 seconds late 2010-10-20 04:07:07,091 INFO repeater task os75nb_quick ended after 36.6 seconds 2010-10-20 04:07:07,093 INFO repeater task os75nb_3dayplots starting 41.2 seconds late 2010-10-20 04:07:20,646 INFO repeater task os75nb_3dayplots ended after 13.6 seconds 2010-10-20 04:07:20,647 INFO repeater task os75nb_beamplots starting 54.7 seconds late 2010-10-20 04:07:24,710 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 04:07:24,711 INFO repeater task os75nb_beamhistory starting 58.8 seconds late 2010-10-20 04:08:44,411 INFO repeater task os75nb_beamhistory output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") saving file to os75nb_bin_history.png 2010-10-20 04:08:44,412 INFO repeater task os75nb_beamhistory ended after 79.7 seconds 2010-10-20 04:08:44,413 INFO repeater task phins_hcorrstats starting 138.5 seconds late 2010-10-20 04:08:58,941 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 04:09:03,945 INFO repeater task os75nb_lastensq starting 132.9 seconds late 2010-10-20 04:09:29,044 INFO repeater task os75nb_lastensq ended after 25.1 seconds 2010-10-20 04:09:29,045 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:06:41 2010-10-20 04:11:29,229 INFO repeater task phins_hcorrstats starting 3.3 seconds late 2010-10-20 04:11:43,808 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 04:11:53,825 INFO repeater task os75nb_lastensq starting 2.8 seconds late 2010-10-20 04:12:18,038 INFO repeater task os75nb_lastensq ended after 24.2 seconds 2010-10-20 04:12:18,039 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:11:42 2010-10-20 04:16:28,464 INFO repeater task os75nb_beamplots starting 2.5 seconds late 2010-10-20 04:16:32,350 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2010-10-20 04:16:32,357 INFO repeater task phins_hcorrstats starting 6.4 seconds late 2010-10-20 04:16:46,527 INFO repeater task phins_hcorrstats ended after 14.2 seconds 2010-10-20 04:16:56,542 INFO repeater task os75nb_lastensq starting 4.5 seconds late 2010-10-20 04:17:22,499 INFO repeater task os75nb_lastensq ended after 26.0 seconds 2010-10-20 04:17:22,500 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:16:43 2010-10-20 04:21:27,897 INFO repeater task phins_hcorrstats starting 2.0 seconds late 2010-10-20 04:21:42,392 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 04:21:57,410 INFO repeater task os75nb_lastensq starting 4.4 seconds late 2010-10-20 04:22:24,065 INFO repeater task os75nb_lastensq ended after 26.7 seconds 2010-10-20 04:22:24,066 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:21:44 2010-10-20 04:26:29,604 INFO repeater task os75nb_beamplots starting 3.7 seconds late 2010-10-20 04:26:33,628 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 04:26:33,629 INFO repeater task phins_hcorrstats starting 7.7 seconds late 2010-10-20 04:26:48,202 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 04:26:58,213 INFO repeater task os75nb_lastensq starting 4.2 seconds late 2010-10-20 04:27:25,523 INFO repeater task os75nb_lastensq ended after 27.3 seconds 2010-10-20 04:27:25,524 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:26:45 2010-10-20 04:31:30,933 INFO repeater task phins_hcorrstats starting 5.0 seconds late 2010-10-20 04:31:45,494 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 04:31:55,508 INFO repeater task os75nb_lastensq starting 0.5 seconds late 2010-10-20 04:32:22,033 INFO repeater task os75nb_lastensq ended after 26.5 seconds 2010-10-20 04:32:22,034 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:31:45 2010-10-20 04:36:27,600 INFO repeater task os75nb_quick starting 1.7 seconds late 2010-10-20 04:37:05,251 INFO repeater task os75nb_quick ended after 37.7 seconds 2010-10-20 04:37:05,252 INFO repeater task os75nb_3dayplots starting 39.3 seconds late 2010-10-20 04:37:18,386 INFO repeater task os75nb_3dayplots ended after 13.1 seconds 2010-10-20 04:37:18,387 INFO repeater task os75nb_beamplots starting 52.5 seconds late 2010-10-20 04:37:22,423 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 04:37:22,425 INFO repeater task phins_hcorrstats starting 56.5 seconds late 2010-10-20 04:37:37,086 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 04:37:42,089 INFO repeater task os75nb_lastensq starting 47.1 seconds late 2010-10-20 04:38:09,671 INFO repeater task os75nb_lastensq ended after 27.6 seconds 2010-10-20 04:38:09,672 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:36:46 2010-10-20 04:41:30,000 INFO repeater task phins_hcorrstats starting 4.1 seconds late 2010-10-20 04:41:44,583 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 04:41:59,605 INFO repeater task os75nb_lastensq starting 3.6 seconds late 2010-10-20 04:42:27,064 INFO repeater task os75nb_lastensq ended after 27.5 seconds 2010-10-20 04:42:27,065 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:41:47 2010-10-20 04:46:27,502 INFO repeater task os75nb_beamplots starting 1.6 seconds late 2010-10-20 04:46:31,067 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2010-10-20 04:46:31,069 INFO repeater task phins_hcorrstats starting 5.1 seconds late 2010-10-20 04:46:45,644 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 04:47:00,665 INFO repeater task os75nb_lastensq starting 3.7 seconds late 2010-10-20 04:47:29,573 INFO repeater task os75nb_lastensq ended after 28.9 seconds 2010-10-20 04:47:29,574 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:46:48 2010-10-20 04:51:30,141 INFO repeater task phins_hcorrstats starting 4.2 seconds late 2010-10-20 04:51:44,938 INFO repeater task phins_hcorrstats ended after 14.8 seconds 2010-10-20 04:51:59,957 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2010-10-20 04:52:29,274 INFO repeater task os75nb_lastensq ended after 29.3 seconds 2010-10-20 04:52:29,275 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:51:49 2010-10-20 04:56:29,828 INFO repeater task os75nb_beamplots starting 3.9 seconds late 2010-10-20 04:56:33,811 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 04:56:33,813 INFO repeater task phins_hcorrstats starting 7.9 seconds late 2010-10-20 04:56:48,420 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 04:57:03,442 INFO repeater task os75nb_lastensq starting 4.4 seconds late 2010-10-20 04:57:33,249 INFO repeater task os75nb_lastensq ended after 29.8 seconds 2010-10-20 04:57:33,250 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 04:56:49 2010-10-20 05:01:28,769 INFO repeater task phins_hcorrstats starting 2.8 seconds late 2010-10-20 05:01:43,289 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 05:02:03,317 INFO repeater task os75nb_lastensq starting 4.3 seconds late 2010-10-20 05:02:33,897 INFO repeater task os75nb_lastensq ended after 30.6 seconds 2010-10-20 05:02:33,898 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:01:50 2010-10-20 05:06:29,341 INFO repeater task os75nb_quick starting 3.4 seconds late 2010-10-20 05:07:06,753 INFO repeater task os75nb_quick ended after 37.4 seconds 2010-10-20 05:07:06,754 INFO repeater task os75nb_3dayplots starting 40.8 seconds late 2010-10-20 05:07:19,916 INFO repeater task os75nb_3dayplots ended after 13.2 seconds 2010-10-20 05:07:19,917 INFO repeater task os75nb_beamplots starting 54.0 seconds late 2010-10-20 05:07:23,945 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 05:07:23,946 INFO repeater task os75nb_beamhistory starting 58.0 seconds late 2010-10-20 05:08:46,087 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-10-20 05:08:46,088 INFO repeater task os75nb_beamhistory ended after 82.1 seconds 2010-10-20 05:08:46,094 INFO repeater task phins_hcorrstats starting 140.2 seconds late 2010-10-20 05:09:00,704 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 05:09:05,710 INFO repeater task os75nb_lastensq starting 125.7 seconds late 2010-10-20 05:09:36,662 INFO repeater task os75nb_lastensq ended after 31.0 seconds 2010-10-20 05:09:36,663 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:06:51 2010-10-20 05:11:26,852 INFO repeater task phins_hcorrstats starting 0.9 seconds late 2010-10-20 05:11:41,420 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 05:12:01,450 INFO repeater task os75nb_lastensq starting 0.5 seconds late 2010-10-20 05:12:31,666 INFO repeater task os75nb_lastensq ended after 30.2 seconds 2010-10-20 05:12:31,667 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:11:52 2010-10-20 05:16:27,180 INFO repeater task os75nb_beamplots starting 1.3 seconds late 2010-10-20 05:16:31,193 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 05:16:31,195 INFO repeater task phins_hcorrstats starting 5.3 seconds late 2010-10-20 05:16:45,633 INFO repeater task phins_hcorrstats ended after 14.4 seconds 2010-10-20 05:17:05,661 INFO repeater task os75nb_lastensq starting 3.7 seconds late 2010-10-20 05:17:38,838 INFO repeater task os75nb_lastensq ended after 33.2 seconds 2010-10-20 05:17:38,839 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:16:52 2010-10-20 05:21:29,245 INFO repeater task phins_hcorrstats starting 3.3 seconds late 2010-10-20 05:21:43,306 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-20 05:22:03,334 INFO repeater task os75nb_lastensq starting 1.3 seconds late 2010-10-20 05:22:35,714 INFO repeater task os75nb_lastensq ended after 32.4 seconds 2010-10-20 05:22:35,715 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:21:53 2010-10-20 05:26:26,220 INFO repeater task os75nb_beamplots starting 0.3 seconds late 2010-10-20 05:26:30,233 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 05:26:30,235 INFO repeater task phins_hcorrstats starting 4.3 seconds late 2010-10-20 05:26:44,802 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 05:27:04,833 INFO repeater task os75nb_lastensq starting 1.8 seconds late 2010-10-20 05:27:37,153 INFO repeater task os75nb_lastensq ended after 32.3 seconds 2010-10-20 05:27:37,154 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:26:54 2010-10-20 05:31:27,534 INFO repeater task phins_hcorrstats starting 1.6 seconds late 2010-10-20 05:31:41,664 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-20 05:32:06,699 INFO repeater task os75nb_lastensq starting 2.7 seconds late 2010-10-20 05:32:40,360 INFO repeater task os75nb_lastensq ended after 33.7 seconds 2010-10-20 05:32:40,361 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:31:55 2010-10-20 05:36:30,890 INFO repeater task os75nb_quick starting 5.0 seconds late 2010-10-20 05:37:08,963 INFO repeater task os75nb_quick ended after 38.1 seconds 2010-10-20 05:37:08,965 INFO repeater task os75nb_3dayplots starting 43.0 seconds late 2010-10-20 05:37:21,981 INFO repeater task os75nb_3dayplots ended after 13.0 seconds 2010-10-20 05:37:21,982 INFO repeater task os75nb_beamplots starting 56.1 seconds late 2010-10-20 05:37:26,006 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 05:37:26,008 INFO repeater task phins_hcorrstats starting 60.1 seconds late 2010-10-20 05:37:40,689 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 05:37:45,695 INFO repeater task os75nb_lastensq starting 40.7 seconds late 2010-10-20 05:38:19,646 INFO repeater task os75nb_lastensq ended after 34.0 seconds 2010-10-20 05:38:19,647 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:36:56 2010-10-20 05:41:30,088 INFO repeater task phins_hcorrstats starting 4.2 seconds late 2010-10-20 05:41:44,661 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 05:42:09,697 INFO repeater task os75nb_lastensq starting 3.7 seconds late 2010-10-20 05:42:44,008 INFO repeater task os75nb_lastensq ended after 34.3 seconds 2010-10-20 05:42:44,009 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:41:56 2010-10-20 05:46:29,562 INFO repeater task os75nb_beamplots starting 3.6 seconds late 2010-10-20 05:46:33,560 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 05:46:33,562 INFO repeater task phins_hcorrstats starting 7.6 seconds late 2010-10-20 05:46:48,557 INFO repeater task phins_hcorrstats ended after 15.0 seconds 2010-10-20 05:47:08,585 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2010-10-20 05:47:43,369 INFO repeater task os75nb_lastensq ended after 34.8 seconds 2010-10-20 05:47:43,370 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:46:57 2010-10-20 05:51:28,875 INFO repeater task phins_hcorrstats starting 2.9 seconds late 2010-10-20 05:51:43,414 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 05:52:08,458 INFO repeater task os75nb_lastensq starting 1.5 seconds late 2010-10-20 05:52:43,874 INFO repeater task os75nb_lastensq ended after 35.4 seconds 2010-10-20 05:52:43,875 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:51:58 2010-10-20 05:56:29,289 INFO repeater task os75nb_beamplots starting 3.4 seconds late 2010-10-20 05:56:32,920 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2010-10-20 05:56:32,922 INFO repeater task phins_hcorrstats starting 7.0 seconds late 2010-10-20 05:56:47,487 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 05:57:12,526 INFO repeater task os75nb_lastensq starting 4.5 seconds late 2010-10-20 05:57:48,397 INFO repeater task os75nb_lastensq ended after 35.9 seconds 2010-10-20 05:57:48,398 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 05:56:59 2010-10-20 06:01:28,789 INFO repeater task phins_hcorrstats starting 2.9 seconds late 2010-10-20 06:01:42,899 INFO repeater task phins_hcorrstats ended after 14.1 seconds 2010-10-20 06:02:12,941 INFO repeater task os75nb_lastensq starting 3.9 seconds late 2010-10-20 06:02:45,847 INFO repeater task os75nb_lastensq ended after 32.9 seconds 2010-10-20 06:02:45,848 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:01:59 2010-10-20 06:06:26,398 INFO repeater task os75nb_quick starting 0.5 seconds late 2010-10-20 06:07:04,322 INFO repeater task os75nb_quick ended after 37.9 seconds 2010-10-20 06:07:04,323 INFO repeater task os75nb_3dayplots starting 38.4 seconds late 2010-10-20 06:07:17,481 INFO repeater task os75nb_3dayplots ended after 13.2 seconds 2010-10-20 06:07:17,482 INFO repeater task os75nb_beamplots starting 51.6 seconds late 2010-10-20 06:07:21,540 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 06:07:21,541 INFO repeater task os75nb_beamhistory starting 55.6 seconds late 2010-10-20 06:08:42,093 INFO repeater task os75nb_beamhistory output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") saving file to os75nb_bin_history.png 2010-10-20 06:08:42,094 INFO repeater task os75nb_beamhistory ended after 80.6 seconds 2010-10-20 06:08:42,095 INFO repeater task phins_hcorrstats starting 136.2 seconds late 2010-10-20 06:08:56,553 INFO repeater task phins_hcorrstats ended after 14.5 seconds 2010-10-20 06:09:01,559 INFO repeater task os75nb_lastensq starting 112.6 seconds late 2010-10-20 06:09:25,697 INFO repeater task os75nb_lastensq ended after 24.1 seconds 2010-10-20 06:09:25,698 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:07:00 2010-10-20 06:11:30,917 INFO repeater task phins_hcorrstats starting 5.0 seconds late 2010-10-20 06:11:45,658 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 06:12:10,693 INFO repeater task os75nb_lastensq starting 0.7 seconds late 2010-10-20 06:12:36,024 INFO repeater task os75nb_lastensq ended after 25.3 seconds 2010-10-20 06:12:36,025 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:12:01 2010-10-20 06:16:26,528 INFO repeater task os75nb_beamplots starting 0.6 seconds late 2010-10-20 06:16:30,530 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 06:16:30,532 INFO repeater task phins_hcorrstats starting 4.6 seconds late 2010-10-20 06:16:45,095 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 06:17:15,141 INFO repeater task os75nb_lastensq starting 4.1 seconds late 2010-10-20 06:17:42,622 INFO repeater task os75nb_lastensq ended after 27.5 seconds 2010-10-20 06:17:42,623 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:17:02 2010-10-20 06:21:28,002 INFO repeater task phins_hcorrstats starting 2.1 seconds late 2010-10-20 06:21:42,581 INFO repeater task phins_hcorrstats ended after 14.6 seconds 2010-10-20 06:22:12,649 INFO repeater task os75nb_lastensq starting 0.6 seconds late 2010-10-20 06:22:38,524 INFO repeater task os75nb_lastensq ended after 25.9 seconds 2010-10-20 06:22:38,525 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:22:02 2010-10-20 06:26:29,065 INFO repeater task os75nb_beamplots starting 3.1 seconds late 2010-10-20 06:26:33,103 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-10-20 06:26:33,105 INFO repeater task phins_hcorrstats starting 7.2 seconds late 2010-10-20 06:26:47,814 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 06:27:12,845 INFO repeater task os75nb_lastensq starting 0.8 seconds late 2010-10-20 06:27:39,357 INFO repeater task os75nb_lastensq ended after 26.5 seconds 2010-10-20 06:27:39,358 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:27:03 2010-10-20 06:31:29,823 INFO repeater task phins_hcorrstats starting 3.9 seconds late 2010-10-20 06:31:44,172 INFO repeater task phins_hcorrstats ended after 14.3 seconds 2010-10-20 06:32:14,217 INFO repeater task os75nb_lastensq starting 1.2 seconds late 2010-10-20 06:32:42,138 INFO repeater task os75nb_lastensq ended after 27.9 seconds 2010-10-20 06:32:42,139 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:32:04 2010-10-20 06:36:27,663 INFO repeater task os75nb_quick starting 1.7 seconds late 2010-10-20 06:37:05,448 INFO repeater task os75nb_quick ended after 37.8 seconds 2010-10-20 06:37:05,453 INFO repeater task os75nb_3dayplots starting 39.5 seconds late 2010-10-20 06:37:18,557 INFO repeater task os75nb_3dayplots ended after 13.1 seconds 2010-10-20 06:37:18,559 INFO repeater task os75nb_beamplots starting 52.6 seconds late 2010-10-20 06:37:22,615 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2010-10-20 06:37:22,617 INFO repeater task phins_hcorrstats starting 56.7 seconds late 2010-10-20 06:37:37,329 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 06:37:42,333 INFO repeater task os75nb_lastensq starting 28.3 seconds late 2010-10-20 06:38:10,232 INFO repeater task os75nb_lastensq ended after 27.9 seconds 2010-10-20 06:38:10,233 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:37:05 2010-10-20 06:41:30,593 INFO repeater task phins_hcorrstats starting 4.7 seconds late 2010-10-20 06:41:45,315 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 06:42:15,361 INFO repeater task os75nb_lastensq starting 0.4 seconds late 2010-10-20 06:42:43,321 INFO repeater task os75nb_lastensq ended after 28.0 seconds 2010-10-20 06:42:43,322 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:42:06 2010-10-20 06:46:28,714 INFO repeater task os75nb_beamplots starting 2.8 seconds late 2010-10-20 06:46:32,185 INFO repeater task os75nb_beamplots ended after 3.5 seconds 2010-10-20 06:46:32,187 INFO repeater task phins_hcorrstats starting 6.3 seconds late 2010-10-20 06:46:46,845 INFO repeater task phins_hcorrstats ended after 14.7 seconds 2010-10-20 06:47:16,889 INFO repeater task os75nb_lastensq starting 0.9 seconds late 2010-10-20 06:47:46,000 INFO repeater task os75nb_lastensq ended after 29.1 seconds 2010-10-20 06:47:46,001 INFO repeater task os75nb_lastensq: Time from /home/data/at17_1/proc/os75nb/load/wrote_ens_time: 2010/10/20 06:47:06 2010-10-20 06:51:26,522 INFO repeater task phins_hcorrstats starting 0.6 seconds late