2010-09-25 22:54:47,272 INFO repeater task os75bb_lastensq ended after 15.6 seconds 2010-09-25 22:54:47,285 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 22:54:20 2010-09-25 22:54:47,286 INFO repeater task os75nb_lastensq starting 19.3 seconds late 2010-09-25 22:55:02,947 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 22:55:02,948 INFO repeater task os75nb_lastensq ended after 15.7 seconds 2010-09-25 22:55:02,948 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 22:54:20 2010-09-25 22:55:02,960 INFO repeater task os75bb_beamplots starting 21.7 seconds late 2010-09-25 22:55:06,533 INFO repeater task os75bb_beamplots ended after 3.6 seconds 2010-09-25 22:55:06,534 INFO repeater task os75nb_beamplots starting 25.3 seconds late 2010-09-25 22:55:10,480 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2010-09-25 22:55:10,482 INFO repeater task posmv_hcorrstats starting 29.3 seconds late 2010-09-25 22:55:14,674 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-25 22:55:14,675 INFO repeater task phins_hcorrstats starting 33.4 seconds late 2010-09-25 22:55:18,777 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2010-09-25 22:55:53,800 INFO repeater task wh300_lastensq starting 0.8 seconds late 2010-09-25 22:56:14,477 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 22:56:14,478 INFO repeater task wh300_lastensq ended after 20.7 seconds 2010-09-25 22:56:14,478 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 22:55:44 2010-09-25 22:57:55,208 INFO repeater task wh300_lastensq starting 1.2 seconds late 2010-09-25 22:58:15,946 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 22:58:15,946 INFO repeater task wh300_lastensq ended after 20.7 seconds 2010-09-25 22:58:15,947 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 22:57:44 2010-09-25 22:59:32,101 INFO repeater task os75bb_lastensq starting 2.1 seconds late 2010-09-25 22:59:47,278 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 22:59:47,278 INFO repeater task os75bb_lastensq ended after 15.2 seconds 2010-09-25 22:59:47,279 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 22:59:21 2010-09-25 22:59:47,299 INFO repeater task os75nb_lastensq starting 17.3 seconds late 2010-09-25 23:00:02,691 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:00:02,691 INFO repeater task os75nb_lastensq ended after 15.4 seconds 2010-09-25 23:00:02,692 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 22:59:21 2010-09-25 23:00:02,709 INFO repeater task posmv_hcorrstats starting 21.5 seconds late 2010-09-25 23:00:06,449 INFO repeater task posmv_hcorrstats ended after 3.7 seconds 2010-09-25 23:00:06,450 INFO repeater task phins_hcorrstats starting 25.2 seconds late 2010-09-25 23:00:10,532 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2010-09-25 23:00:15,532 INFO repeater task wh300_lastensq starting 21.5 seconds late 2010-09-25 23:00:35,511 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:00:35,512 INFO repeater task wh300_lastensq ended after 20.0 seconds 2010-09-25 23:00:35,512 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 22:59:45 2010-09-25 23:01:55,611 INFO repeater task wh300_lastensq starting 0.6 seconds late 2010-09-25 23:02:17,727 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:02:17,727 INFO repeater task wh300_lastensq ended after 22.1 seconds 2010-09-25 23:02:17,728 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:01:45 2010-09-25 23:03:58,124 INFO repeater task wh300_lastensq starting 3.1 seconds late 2010-09-25 23:04:17,937 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:04:17,937 INFO repeater task wh300_lastensq ended after 19.8 seconds 2010-09-25 23:04:17,938 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:03:46 2010-09-25 23:04:32,949 INFO repeater task os75bb_lastensq starting 1.9 seconds late 2010-09-25 23:04:48,043 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:04:48,044 INFO repeater task os75bb_lastensq ended after 15.1 seconds 2010-09-25 23:04:48,045 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:04:22 2010-09-25 23:04:48,045 INFO repeater task os75bb_quick starting 6.8 seconds late 2010-09-25 23:05:13,133 INFO repeater task os75bb_quick ended after 25.1 seconds 2010-09-25 23:05:13,139 INFO repeater task os75bb_3dayplots starting 31.9 seconds late 2010-09-25 23:05:27,122 INFO repeater task os75bb_3dayplots ended after 14.0 seconds 2010-09-25 23:05:27,132 INFO repeater task os75nb_lastensq starting 56.1 seconds late 2010-09-25 23:05:44,266 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:05:44,266 INFO repeater task os75nb_lastensq ended after 17.1 seconds 2010-09-25 23:05:44,267 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:04:22 2010-09-25 23:05:44,268 INFO repeater task os75nb_quick starting 63.0 seconds late 2010-09-25 23:06:09,192 INFO repeater task os75nb_quick output: Warning: invalid value encountered in divide 2010-09-25 23:06:09,193 INFO repeater task os75nb_quick ended after 24.9 seconds 2010-09-25 23:06:09,194 INFO repeater task os75nb_3dayplots starting 88.0 seconds late 2010-09-25 23:06:21,721 INFO repeater task os75nb_3dayplots output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:06:21,722 INFO repeater task os75nb_3dayplots ended after 12.5 seconds 2010-09-25 23:06:21,723 INFO repeater task os75bb_beamplots starting 100.5 seconds late 2010-09-25 23:06:25,327 INFO repeater task os75bb_beamplots ended after 3.6 seconds 2010-09-25 23:06:25,328 INFO repeater task os75nb_beamplots starting 104.1 seconds late 2010-09-25 23:06:28,551 INFO repeater task os75nb_beamplots ended after 3.2 seconds 2010-09-25 23:06:28,554 INFO repeater task posmv_hcorrstats starting 107.3 seconds late 2010-09-25 23:06:32,891 INFO repeater task posmv_hcorrstats ended after 4.3 seconds 2010-09-25 23:06:32,893 INFO repeater task phins_hcorrstats starting 111.7 seconds late 2010-09-25 23:06:37,047 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-25 23:06:42,048 INFO repeater task wh300_lastensq starting 46.0 seconds late 2010-09-25 23:07:01,887 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:07:01,887 INFO repeater task wh300_lastensq ended after 19.8 seconds 2010-09-25 23:07:01,888 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:05:46 2010-09-25 23:07:01,889 INFO repeater task wh300_quick starting 140.7 seconds late 2010-09-25 23:07:29,395 INFO repeater task wh300_quick ended after 27.5 seconds 2010-09-25 23:07:29,407 INFO repeater task wh300_3dayplots starting 168.2 seconds late 2010-09-25 23:07:44,247 INFO repeater task wh300_3dayplots ended after 14.8 seconds 2010-09-25 23:07:59,260 INFO repeater task wh300_lastensq starting 3.3 seconds late 2010-09-25 23:08:19,253 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:08:19,254 INFO repeater task wh300_lastensq ended after 20.0 seconds 2010-09-25 23:08:19,254 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:07:46 2010-09-25 23:09:34,439 INFO repeater task os75bb_lastensq starting 2.4 seconds late 2010-09-25 23:09:49,585 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:09:49,586 INFO repeater task os75bb_lastensq ended after 15.1 seconds 2010-09-25 23:09:49,587 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:09:24 2010-09-25 23:09:49,588 INFO repeater task os75nb_lastensq starting 17.6 seconds late 2010-09-25 23:10:04,791 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:10:04,792 INFO repeater task os75nb_lastensq ended after 15.2 seconds 2010-09-25 23:10:04,793 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:09:24 2010-09-25 23:10:04,796 INFO repeater task posmv_hcorrstats starting 23.6 seconds late 2010-09-25 23:10:08,848 INFO repeater task posmv_hcorrstats ended after 4.1 seconds 2010-09-25 23:10:08,862 INFO repeater task phins_hcorrstats starting 27.6 seconds late 2010-09-25 23:10:12,530 INFO repeater task phins_hcorrstats ended after 3.7 seconds 2010-09-25 23:10:17,528 INFO repeater task wh300_lastensq starting 21.5 seconds late 2010-09-25 23:10:37,562 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:10:37,563 INFO repeater task wh300_lastensq ended after 20.0 seconds 2010-09-25 23:10:37,563 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:09:47 2010-09-25 23:11:57,780 INFO repeater task wh300_lastensq starting 0.8 seconds late 2010-09-25 23:12:17,518 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:12:17,518 INFO repeater task wh300_lastensq ended after 19.7 seconds 2010-09-25 23:12:17,519 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:11:47 2010-09-25 23:13:58,853 INFO repeater task wh300_lastensq starting 1.9 seconds late 2010-09-25 23:14:18,394 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:14:18,395 INFO repeater task wh300_lastensq ended after 19.5 seconds 2010-09-25 23:14:18,396 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:13:47 2010-09-25 23:14:38,435 INFO repeater task os75bb_lastensq starting 4.4 seconds late 2010-09-25 23:14:53,864 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:14:53,865 INFO repeater task os75bb_lastensq ended after 15.4 seconds 2010-09-25 23:14:53,866 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:14:25 2010-09-25 23:14:53,867 INFO repeater task os75nb_lastensq starting 19.9 seconds late 2010-09-25 23:15:09,242 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:15:09,242 INFO repeater task os75nb_lastensq ended after 15.4 seconds 2010-09-25 23:15:09,243 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:14:25 2010-09-25 23:15:09,244 INFO repeater task os75bb_beamplots starting 28.0 seconds late 2010-09-25 23:15:12,410 INFO repeater task os75bb_beamplots ended after 3.2 seconds 2010-09-25 23:15:12,411 INFO repeater task os75nb_beamplots starting 31.2 seconds late 2010-09-25 23:15:16,160 INFO repeater task os75nb_beamplots ended after 3.7 seconds 2010-09-25 23:15:16,162 INFO repeater task posmv_hcorrstats starting 34.9 seconds late 2010-09-25 23:15:20,182 INFO repeater task posmv_hcorrstats ended after 4.0 seconds 2010-09-25 23:15:20,183 INFO repeater task phins_hcorrstats starting 39.0 seconds late 2010-09-25 23:15:24,230 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2010-09-25 23:15:59,523 INFO repeater task wh300_lastensq starting 2.5 seconds late 2010-09-25 23:16:19,153 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:16:19,153 INFO repeater task wh300_lastensq ended after 19.6 seconds 2010-09-25 23:16:19,154 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:15:48 2010-09-25 23:18:00,569 INFO repeater task wh300_lastensq starting 2.6 seconds late 2010-09-25 23:18:20,832 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:18:20,833 INFO repeater task wh300_lastensq ended after 20.3 seconds 2010-09-25 23:18:20,833 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:17:48 2010-09-25 23:19:35,893 INFO repeater task os75bb_lastensq starting 0.9 seconds late 2010-09-25 23:19:52,473 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:19:52,474 INFO repeater task os75bb_lastensq ended after 16.6 seconds 2010-09-25 23:19:52,475 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:19:26 2010-09-25 23:19:52,476 INFO repeater task os75nb_lastensq starting 17.5 seconds late 2010-09-25 23:20:08,567 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:20:08,567 INFO repeater task os75nb_lastensq ended after 16.1 seconds 2010-09-25 23:20:08,568 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:19:26 2010-09-25 23:20:08,572 INFO repeater task posmv_hcorrstats starting 27.3 seconds late 2010-09-25 23:20:12,423 INFO repeater task posmv_hcorrstats ended after 3.9 seconds 2010-09-25 23:20:12,424 INFO repeater task phins_hcorrstats starting 31.2 seconds late 2010-09-25 23:20:16,586 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-25 23:20:21,584 INFO repeater task wh300_lastensq starting 23.6 seconds late 2010-09-25 23:20:41,694 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:20:41,695 INFO repeater task wh300_lastensq ended after 20.1 seconds 2010-09-25 23:20:41,696 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:19:48 2010-09-25 23:22:02,176 INFO repeater task wh300_lastensq starting 4.2 seconds late 2010-09-25 23:22:22,345 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:22:22,346 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-25 23:22:22,346 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:21:48 2010-09-25 23:24:02,711 INFO repeater task wh300_lastensq starting 4.7 seconds late 2010-09-25 23:24:22,235 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:24:22,236 INFO repeater task wh300_lastensq ended after 19.5 seconds 2010-09-25 23:24:22,236 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:23:49 2010-09-25 23:24:37,400 INFO repeater task os75bb_lastensq starting 1.4 seconds late 2010-09-25 23:24:53,953 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:24:53,953 INFO repeater task os75bb_lastensq ended after 16.6 seconds 2010-09-25 23:24:53,954 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:24:28 2010-09-25 23:24:53,957 INFO repeater task os75nb_lastensq starting 18.0 seconds late 2010-09-25 23:25:09,487 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:25:09,488 INFO repeater task os75nb_lastensq ended after 15.5 seconds 2010-09-25 23:25:09,489 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:24:28 2010-09-25 23:25:09,490 INFO repeater task os75bb_beamplots starting 28.3 seconds late 2010-09-25 23:25:12,620 INFO repeater task os75bb_beamplots ended after 3.1 seconds 2010-09-25 23:25:12,621 INFO repeater task os75nb_beamplots starting 31.4 seconds late 2010-09-25 23:25:16,364 INFO repeater task os75nb_beamplots ended after 3.7 seconds 2010-09-25 23:25:16,366 INFO repeater task posmv_hcorrstats starting 35.1 seconds late 2010-09-25 23:25:20,411 INFO repeater task posmv_hcorrstats ended after 4.0 seconds 2010-09-25 23:25:20,412 INFO repeater task phins_hcorrstats starting 39.2 seconds late 2010-09-25 23:25:24,573 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-25 23:26:00,009 INFO repeater task wh300_lastensq starting 1.0 seconds late 2010-09-25 23:26:19,982 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:26:19,983 INFO repeater task wh300_lastensq ended after 20.0 seconds 2010-09-25 23:26:19,983 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:25:49 2010-09-25 23:28:01,103 INFO repeater task wh300_lastensq starting 2.1 seconds late 2010-09-25 23:28:21,049 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:28:21,049 INFO repeater task wh300_lastensq ended after 19.9 seconds 2010-09-25 23:28:21,050 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:27:49 2010-09-25 23:29:41,125 INFO repeater task os75bb_lastensq starting 3.1 seconds late 2010-09-25 23:29:57,161 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:29:57,162 INFO repeater task os75bb_lastensq ended after 16.0 seconds 2010-09-25 23:29:57,162 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:29:29 2010-09-25 23:29:57,164 INFO repeater task os75nb_lastensq starting 19.2 seconds late 2010-09-25 23:30:12,962 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:30:12,962 INFO repeater task os75nb_lastensq ended after 15.8 seconds 2010-09-25 23:30:12,963 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:29:29 2010-09-25 23:30:12,966 INFO repeater task posmv_hcorrstats starting 31.7 seconds late 2010-09-25 23:30:17,311 INFO repeater task posmv_hcorrstats ended after 4.3 seconds 2010-09-25 23:30:17,312 INFO repeater task phins_hcorrstats starting 36.1 seconds late 2010-09-25 23:30:21,587 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2010-09-25 23:30:26,588 INFO repeater task wh300_lastensq starting 27.6 seconds late 2010-09-25 23:30:46,971 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:30:46,972 INFO repeater task wh300_lastensq ended after 20.4 seconds 2010-09-25 23:30:46,973 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:29:49 2010-09-25 23:32:02,239 INFO repeater task wh300_lastensq starting 3.2 seconds late 2010-09-25 23:32:22,252 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:32:22,252 INFO repeater task wh300_lastensq ended after 20.0 seconds 2010-09-25 23:32:22,253 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:31:50 2010-09-25 23:34:02,955 INFO repeater task wh300_lastensq starting 3.0 seconds late 2010-09-25 23:34:23,026 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:34:23,027 INFO repeater task wh300_lastensq ended after 20.1 seconds 2010-09-25 23:34:23,027 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:33:50 2010-09-25 23:34:43,128 INFO repeater task wh300_quick starting 1.9 seconds late 2010-09-25 23:35:11,288 INFO repeater task wh300_quick ended after 28.2 seconds 2010-09-25 23:35:11,289 INFO repeater task wh300_3dayplots starting 30.1 seconds late 2010-09-25 23:35:25,214 INFO repeater task wh300_3dayplots ended after 13.9 seconds 2010-09-25 23:35:25,215 INFO repeater task os75bb_lastensq starting 46.2 seconds late 2010-09-25 23:35:41,717 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:35:41,718 INFO repeater task os75bb_lastensq ended after 16.5 seconds 2010-09-25 23:35:41,718 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:34:31 2010-09-25 23:35:41,719 INFO repeater task os75bb_quick starting 60.5 seconds late 2010-09-25 23:36:06,701 INFO repeater task os75bb_quick ended after 25.0 seconds 2010-09-25 23:36:06,702 INFO repeater task os75bb_3dayplots starting 85.5 seconds late 2010-09-25 23:36:20,772 INFO repeater task os75bb_3dayplots ended after 14.1 seconds 2010-09-25 23:36:20,780 INFO repeater task os75nb_lastensq starting 101.8 seconds late 2010-09-25 23:36:36,228 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:36:36,228 INFO repeater task os75nb_lastensq ended after 15.4 seconds 2010-09-25 23:36:36,229 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:34:31 2010-09-25 23:36:36,230 INFO repeater task os75nb_quick starting 115.0 seconds late 2010-09-25 23:37:01,490 INFO repeater task os75nb_quick output: Warning: invalid value encountered in divide 2010-09-25 23:37:01,491 INFO repeater task os75nb_quick ended after 25.3 seconds 2010-09-25 23:37:01,494 INFO repeater task os75nb_3dayplots starting 140.3 seconds late 2010-09-25 23:37:14,552 INFO repeater task os75nb_3dayplots output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:37:14,553 INFO repeater task os75nb_3dayplots ended after 13.1 seconds 2010-09-25 23:37:14,554 INFO repeater task os75bb_beamplots starting 153.3 seconds late 2010-09-25 23:37:18,198 INFO repeater task os75bb_beamplots ended after 3.6 seconds 2010-09-25 23:37:18,199 INFO repeater task os75nb_beamplots starting 157.0 seconds late 2010-09-25 23:37:21,627 INFO repeater task os75nb_beamplots ended after 3.4 seconds 2010-09-25 23:37:21,634 INFO repeater task os75bb_beamhistory starting 160.4 seconds late 2010-09-25 23:38:13,075 INFO repeater task os75bb_beamhistory output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide saving file to os75bb_bin_history.png 2010-09-25 23:38:13,085 INFO repeater task os75bb_beamhistory ended after 51.5 seconds 2010-09-25 23:38:13,085 INFO repeater task os75nb_beamhistory starting 211.9 seconds late 2010-09-25 23:38:48,594 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-09-25 23:38:48,594 INFO repeater task os75nb_beamhistory ended after 35.5 seconds 2010-09-25 23:38:48,602 INFO repeater task posmv_hcorrstats starting 247.4 seconds late 2010-09-25 23:38:52,608 INFO repeater task posmv_hcorrstats ended after 4.0 seconds 2010-09-25 23:38:52,609 INFO repeater task phins_hcorrstats starting 251.4 seconds late 2010-09-25 23:38:56,820 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-25 23:39:01,820 INFO repeater task wh300_lastensq starting 181.8 seconds late 2010-09-25 23:39:23,735 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:39:23,736 INFO repeater task wh300_lastensq ended after 21.9 seconds 2010-09-25 23:39:23,736 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:37:50 2010-09-25 23:39:43,753 INFO repeater task os75bb_lastensq starting 2.8 seconds late 2010-09-25 23:40:00,540 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:40:00,541 INFO repeater task os75bb_lastensq ended after 16.8 seconds 2010-09-25 23:40:00,541 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:39:32 2010-09-25 23:40:00,543 INFO repeater task os75nb_lastensq starting 19.5 seconds late 2010-09-25 23:40:16,503 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:40:16,503 INFO repeater task os75nb_lastensq ended after 16.0 seconds 2010-09-25 23:40:16,504 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:39:32 2010-09-25 23:40:16,507 INFO repeater task posmv_hcorrstats starting 35.3 seconds late 2010-09-25 23:40:20,228 INFO repeater task posmv_hcorrstats ended after 3.7 seconds 2010-09-25 23:40:20,229 INFO repeater task phins_hcorrstats starting 39.0 seconds late 2010-09-25 23:40:24,368 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2010-09-25 23:40:29,368 INFO repeater task wh300_lastensq starting 29.4 seconds late 2010-09-25 23:40:50,050 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:40:50,050 INFO repeater task wh300_lastensq ended after 20.7 seconds 2010-09-25 23:40:50,051 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:39:50 2010-09-25 23:42:00,108 INFO repeater task wh300_lastensq starting 0.1 seconds late 2010-09-25 23:42:20,418 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:42:20,419 INFO repeater task wh300_lastensq ended after 20.3 seconds 2010-09-25 23:42:20,419 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:41:51 2010-09-25 23:44:05,807 INFO repeater task wh300_lastensq starting 4.8 seconds late 2010-09-25 23:44:25,930 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:44:25,930 INFO repeater task wh300_lastensq ended after 20.1 seconds 2010-09-25 23:44:25,931 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:43:51 2010-09-25 23:44:45,949 INFO repeater task os75bb_lastensq starting 3.9 seconds late 2010-09-25 23:45:01,595 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:45:01,595 INFO repeater task os75bb_lastensq ended after 15.6 seconds 2010-09-25 23:45:01,596 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:44:33 2010-09-25 23:45:01,597 INFO repeater task os75nb_lastensq starting 19.6 seconds late 2010-09-25 23:45:17,052 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:45:17,052 INFO repeater task os75nb_lastensq ended after 15.5 seconds 2010-09-25 23:45:17,053 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:44:33 2010-09-25 23:45:17,054 INFO repeater task os75bb_beamplots starting 35.8 seconds late 2010-09-25 23:45:20,382 INFO repeater task os75bb_beamplots ended after 3.3 seconds 2010-09-25 23:45:20,390 INFO repeater task os75nb_beamplots starting 39.2 seconds late 2010-09-25 23:45:23,957 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2010-09-25 23:45:23,960 INFO repeater task posmv_hcorrstats starting 42.7 seconds late 2010-09-25 23:45:28,150 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-25 23:45:28,151 INFO repeater task phins_hcorrstats starting 46.9 seconds late 2010-09-25 23:45:32,277 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2010-09-25 23:46:02,404 INFO repeater task wh300_lastensq starting 1.4 seconds late 2010-09-25 23:46:22,533 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:46:22,533 INFO repeater task wh300_lastensq ended after 20.1 seconds 2010-09-25 23:46:22,534 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:45:51 2010-09-25 23:48:03,767 INFO repeater task wh300_lastensq starting 2.8 seconds late 2010-09-25 23:48:23,955 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:48:23,956 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-25 23:48:23,956 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:47:51 2010-09-25 23:49:45,240 INFO repeater task os75bb_lastensq starting 2.2 seconds late 2010-09-25 23:50:02,968 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:50:02,969 INFO repeater task os75bb_lastensq ended after 17.7 seconds 2010-09-25 23:50:02,969 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:49:35 2010-09-25 23:50:02,971 INFO repeater task os75nb_lastensq starting 20.0 seconds late 2010-09-25 23:50:18,774 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:50:18,774 INFO repeater task os75nb_lastensq ended after 15.8 seconds 2010-09-25 23:50:18,775 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:49:35 2010-09-25 23:50:18,778 INFO repeater task posmv_hcorrstats starting 37.5 seconds late 2010-09-25 23:50:23,015 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-25 23:50:23,016 INFO repeater task phins_hcorrstats starting 41.8 seconds late 2010-09-25 23:50:27,059 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2010-09-25 23:50:32,060 INFO repeater task wh300_lastensq starting 31.1 seconds late 2010-09-25 23:50:52,222 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:50:52,223 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-25 23:50:52,223 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:49:51 2010-09-25 23:52:03,007 INFO repeater task wh300_lastensq starting 2.0 seconds late 2010-09-25 23:52:23,283 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:52:23,283 INFO repeater task wh300_lastensq ended after 20.3 seconds 2010-09-25 23:52:23,284 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:51:51 2010-09-25 23:54:04,808 INFO repeater task wh300_lastensq starting 3.8 seconds late 2010-09-25 23:54:25,051 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:54:25,051 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-25 23:54:25,052 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:53:52 2010-09-25 23:54:45,295 INFO repeater task os75bb_lastensq starting 0.3 seconds late 2010-09-25 23:55:01,631 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:55:01,632 INFO repeater task os75bb_lastensq ended after 16.3 seconds 2010-09-25 23:55:01,632 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:54:36 2010-09-25 23:55:01,634 INFO repeater task os75nb_lastensq starting 16.6 seconds late 2010-09-25 23:55:16,995 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:55:16,995 INFO repeater task os75nb_lastensq ended after 15.4 seconds 2010-09-25 23:55:16,996 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:54:36 2010-09-25 23:55:16,997 INFO repeater task os75bb_beamplots starting 35.8 seconds late 2010-09-25 23:55:20,498 INFO repeater task os75bb_beamplots ended after 3.5 seconds 2010-09-25 23:55:20,508 INFO repeater task os75nb_beamplots starting 39.3 seconds late 2010-09-25 23:55:24,069 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2010-09-25 23:55:24,071 INFO repeater task posmv_hcorrstats starting 42.8 seconds late 2010-09-25 23:55:28,305 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-25 23:55:28,306 INFO repeater task phins_hcorrstats starting 47.1 seconds late 2010-09-25 23:55:32,435 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2010-09-25 23:56:02,456 INFO repeater task wh300_lastensq starting 0.5 seconds late 2010-09-25 23:56:22,651 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:56:22,652 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-25 23:56:22,652 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:55:52 2010-09-25 23:58:03,920 INFO repeater task wh300_lastensq starting 1.9 seconds late 2010-09-25 23:58:24,249 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-25 23:58:24,250 INFO repeater task wh300_lastensq ended after 20.3 seconds 2010-09-25 23:58:24,250 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:57:52 2010-09-25 23:59:45,494 INFO repeater task posmv_hcorrstats starting 4.3 seconds late 2010-09-25 23:59:49,175 INFO repeater task posmv_hcorrstats ended after 3.7 seconds 2010-09-25 23:59:49,176 INFO repeater task phins_hcorrstats starting 7.9 seconds late 2010-09-25 23:59:54,837 INFO repeater task phins_hcorrstats ended after 5.7 seconds 2010-09-25 23:59:59,837 INFO repeater task os75bb_lastensq starting 13.8 seconds late 2010-09-26 00:00:16,809 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:00:16,809 INFO repeater task os75bb_lastensq ended after 17.0 seconds 2010-09-26 00:00:16,810 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/25 23:59:37 2010-09-26 00:00:16,812 INFO repeater task os75nb_lastensq starting 30.8 seconds late 2010-09-26 00:00:33,178 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:00:33,179 INFO repeater task os75nb_lastensq ended after 16.4 seconds 2010-09-26 00:00:33,179 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/25 23:59:37 2010-09-26 00:00:38,180 INFO repeater task wh300_lastensq starting 36.2 seconds late 2010-09-26 00:00:59,146 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:00:59,146 INFO repeater task wh300_lastensq ended after 21.0 seconds 2010-09-26 00:00:59,147 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/25 23:59:52 2010-09-26 00:02:04,312 INFO repeater task wh300_lastensq starting 2.3 seconds late 2010-09-26 00:02:23,936 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:02:23,936 INFO repeater task wh300_lastensq ended after 19.6 seconds 2010-09-26 00:02:23,937 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:01:52 2010-09-26 00:04:05,075 INFO repeater task wh300_lastensq starting 3.1 seconds late 2010-09-26 00:04:23,646 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:04:23,646 INFO repeater task wh300_lastensq ended after 18.6 seconds 2010-09-26 00:04:23,648 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:03:53 2010-09-26 00:04:43,664 INFO repeater task wh300_quick starting 2.4 seconds late 2010-09-26 00:05:13,665 INFO repeater task wh300_quick ended after 30.0 seconds 2010-09-26 00:05:13,666 INFO repeater task wh300_3dayplots starting 32.4 seconds late 2010-09-26 00:05:27,826 INFO repeater task wh300_3dayplots ended after 14.2 seconds 2010-09-26 00:05:27,827 INFO repeater task os75bb_lastensq starting 40.8 seconds late 2010-09-26 00:05:43,084 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:05:43,085 INFO repeater task os75bb_lastensq ended after 15.3 seconds 2010-09-26 00:05:43,085 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:04:39 2010-09-26 00:05:43,086 INFO repeater task os75bb_quick starting 61.9 seconds late 2010-09-26 00:06:09,037 INFO repeater task os75bb_quick ended after 26.0 seconds 2010-09-26 00:06:09,038 INFO repeater task os75bb_3dayplots starting 87.8 seconds late 2010-09-26 00:06:23,024 INFO repeater task os75bb_3dayplots ended after 14.0 seconds 2010-09-26 00:06:23,025 INFO repeater task os75nb_lastensq starting 96.0 seconds late 2010-09-26 00:06:37,963 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:06:37,963 INFO repeater task os75nb_lastensq ended after 14.9 seconds 2010-09-26 00:06:37,964 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:04:39 2010-09-26 00:06:37,964 INFO repeater task os75nb_quick starting 116.7 seconds late 2010-09-26 00:07:03,076 INFO repeater task os75nb_quick output: Warning: invalid value encountered in divide 2010-09-26 00:07:03,076 INFO repeater task os75nb_quick ended after 25.1 seconds 2010-09-26 00:07:03,085 INFO repeater task os75nb_3dayplots starting 141.9 seconds late 2010-09-26 00:07:15,858 INFO repeater task os75nb_3dayplots output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:07:15,859 INFO repeater task os75nb_3dayplots ended after 12.8 seconds 2010-09-26 00:07:15,860 INFO repeater task os75bb_beamplots starting 154.6 seconds late 2010-09-26 00:07:19,493 INFO repeater task os75bb_beamplots ended after 3.6 seconds 2010-09-26 00:07:19,494 INFO repeater task os75nb_beamplots starting 158.3 seconds late 2010-09-26 00:07:22,662 INFO repeater task os75nb_beamplots ended after 3.2 seconds 2010-09-26 00:07:22,664 INFO repeater task posmv_hcorrstats starting 161.4 seconds late 2010-09-26 00:07:27,008 INFO repeater task posmv_hcorrstats ended after 4.3 seconds 2010-09-26 00:07:27,009 INFO repeater task phins_hcorrstats starting 165.8 seconds late 2010-09-26 00:07:31,185 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-26 00:07:36,184 INFO repeater task wh300_lastensq starting 93.2 seconds late 2010-09-26 00:07:50,982 INFO repeater task wh300_lastensq ended after 14.8 seconds 2010-09-26 00:07:50,983 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:05:53 2010-09-26 00:08:06,067 INFO repeater task wh300_lastensq starting 3.1 seconds late 2010-09-26 00:08:24,185 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:08:24,185 INFO repeater task wh300_lastensq ended after 18.1 seconds 2010-09-26 00:08:24,186 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:07:53 2010-09-26 00:09:44,353 INFO repeater task posmv_hcorrstats starting 3.1 seconds late 2010-09-26 00:09:48,478 INFO repeater task posmv_hcorrstats ended after 4.1 seconds 2010-09-26 00:09:48,479 INFO repeater task phins_hcorrstats starting 7.2 seconds late 2010-09-26 00:09:52,520 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2010-09-26 00:09:57,522 INFO repeater task os75bb_lastensq starting 8.5 seconds late 2010-09-26 00:10:12,443 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:10:12,444 INFO repeater task os75bb_lastensq ended after 14.9 seconds 2010-09-26 00:10:12,445 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:09:40 2010-09-26 00:10:12,446 INFO repeater task os75nb_lastensq starting 23.4 seconds late 2010-09-26 00:10:27,189 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:10:27,190 INFO repeater task os75nb_lastensq ended after 14.7 seconds 2010-09-26 00:10:27,190 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:09:40 2010-09-26 00:10:32,199 INFO repeater task wh300_lastensq starting 29.2 seconds late 2010-09-26 00:10:51,028 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:10:51,028 INFO repeater task wh300_lastensq ended after 18.8 seconds 2010-09-26 00:10:51,029 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:09:53 2010-09-26 00:12:06,088 INFO repeater task wh300_lastensq starting 3.1 seconds late 2010-09-26 00:12:25,064 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:12:25,065 INFO repeater task wh300_lastensq ended after 19.0 seconds 2010-09-26 00:12:25,065 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:11:53 2010-09-26 00:14:05,728 INFO repeater task wh300_lastensq starting 2.7 seconds late 2010-09-26 00:14:24,536 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:14:24,537 INFO repeater task wh300_lastensq ended after 18.8 seconds 2010-09-26 00:14:24,537 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:13:53 2010-09-26 00:14:44,559 INFO repeater task os75bb_beamplots starting 3.3 seconds late 2010-09-26 00:14:48,278 INFO repeater task os75bb_beamplots ended after 3.7 seconds 2010-09-26 00:14:48,279 INFO repeater task os75nb_beamplots starting 7.1 seconds late 2010-09-26 00:14:51,923 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2010-09-26 00:14:51,924 INFO repeater task posmv_hcorrstats starting 10.7 seconds late 2010-09-26 00:14:55,504 INFO repeater task posmv_hcorrstats ended after 3.6 seconds 2010-09-26 00:14:55,505 INFO repeater task phins_hcorrstats starting 14.3 seconds late 2010-09-26 00:14:59,890 INFO repeater task phins_hcorrstats ended after 4.4 seconds 2010-09-26 00:15:04,889 INFO repeater task os75bb_lastensq starting 14.9 seconds late 2010-09-26 00:15:20,056 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:15:20,057 INFO repeater task os75bb_lastensq ended after 15.2 seconds 2010-09-26 00:15:20,057 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:14:42 2010-09-26 00:15:20,059 INFO repeater task os75nb_lastensq starting 30.1 seconds late 2010-09-26 00:15:35,294 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:15:35,295 INFO repeater task os75nb_lastensq ended after 15.2 seconds 2010-09-26 00:15:35,296 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:14:42 2010-09-26 00:16:05,316 INFO repeater task wh300_lastensq starting 2.3 seconds late 2010-09-26 00:16:24,301 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:16:24,302 INFO repeater task wh300_lastensq ended after 19.0 seconds 2010-09-26 00:16:24,302 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:15:53 2010-09-26 00:18:04,844 INFO repeater task wh300_lastensq starting 1.8 seconds late 2010-09-26 00:18:23,559 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:18:23,559 INFO repeater task wh300_lastensq ended after 18.7 seconds 2010-09-26 00:18:23,560 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:17:53 2010-09-26 00:19:43,630 INFO repeater task posmv_hcorrstats starting 2.4 seconds late 2010-09-26 00:19:47,830 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-26 00:19:47,831 INFO repeater task phins_hcorrstats starting 6.6 seconds late 2010-09-26 00:19:51,862 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2010-09-26 00:19:56,861 INFO repeater task os75bb_lastensq starting 4.9 seconds late 2010-09-26 00:20:13,631 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:20:13,633 INFO repeater task os75bb_lastensq ended after 16.8 seconds 2010-09-26 00:20:13,634 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:19:43 2010-09-26 00:20:13,636 INFO repeater task os75nb_lastensq starting 21.6 seconds late 2010-09-26 00:20:28,751 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:20:28,752 INFO repeater task os75nb_lastensq ended after 15.1 seconds 2010-09-26 00:20:28,753 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:19:43 2010-09-26 00:20:33,828 INFO repeater task wh300_lastensq starting 30.8 seconds late 2010-09-26 00:20:52,566 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:20:52,566 INFO repeater task wh300_lastensq ended after 18.7 seconds 2010-09-26 00:20:52,567 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:19:54 2010-09-26 00:22:08,287 INFO repeater task wh300_lastensq starting 4.3 seconds late 2010-09-26 00:22:27,466 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:22:27,467 INFO repeater task wh300_lastensq ended after 19.2 seconds 2010-09-26 00:22:27,467 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:21:54 2010-09-26 00:24:07,656 INFO repeater task wh300_lastensq starting 3.7 seconds late 2010-09-26 00:24:26,781 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:24:26,782 INFO repeater task wh300_lastensq ended after 19.1 seconds 2010-09-26 00:24:26,782 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:23:55 2010-09-26 00:24:41,799 INFO repeater task os75bb_beamplots starting 0.6 seconds late 2010-09-26 00:24:45,028 INFO repeater task os75bb_beamplots ended after 3.2 seconds 2010-09-26 00:24:45,029 INFO repeater task os75nb_beamplots starting 3.8 seconds late 2010-09-26 00:24:48,863 INFO repeater task os75nb_beamplots ended after 3.8 seconds 2010-09-26 00:24:48,864 INFO repeater task posmv_hcorrstats starting 7.6 seconds late 2010-09-26 00:24:52,996 INFO repeater task posmv_hcorrstats ended after 4.1 seconds 2010-09-26 00:24:52,997 INFO repeater task phins_hcorrstats starting 11.8 seconds late 2010-09-26 00:24:57,012 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2010-09-26 00:25:02,013 INFO repeater task os75bb_lastensq starting 9.0 seconds late 2010-09-26 00:25:16,859 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:25:16,860 INFO repeater task os75bb_lastensq ended after 14.8 seconds 2010-09-26 00:25:16,861 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:24:45 2010-09-26 00:25:16,862 INFO repeater task os75nb_lastensq starting 23.9 seconds late 2010-09-26 00:25:31,931 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:25:31,931 INFO repeater task os75nb_lastensq ended after 15.1 seconds 2010-09-26 00:25:31,932 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:24:45 2010-09-26 00:26:07,340 INFO repeater task wh300_lastensq starting 2.3 seconds late 2010-09-26 00:26:26,412 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:26:26,413 INFO repeater task wh300_lastensq ended after 19.1 seconds 2010-09-26 00:26:26,413 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:25:55 2010-09-26 00:28:06,544 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-09-26 00:28:25,730 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:28:25,731 INFO repeater task wh300_lastensq ended after 19.2 seconds 2010-09-26 00:28:25,732 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:27:55 2010-09-26 00:29:41,357 INFO repeater task posmv_hcorrstats starting 0.1 seconds late 2010-09-26 00:29:44,977 INFO repeater task posmv_hcorrstats ended after 3.6 seconds 2010-09-26 00:29:44,978 INFO repeater task phins_hcorrstats starting 3.7 seconds late 2010-09-26 00:29:49,139 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-26 00:29:59,145 INFO repeater task os75bb_lastensq starting 4.1 seconds late 2010-09-26 00:30:15,617 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:30:15,618 INFO repeater task os75bb_lastensq ended after 16.5 seconds 2010-09-26 00:30:15,618 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:29:46 2010-09-26 00:30:15,620 INFO repeater task os75nb_lastensq starting 20.6 seconds late 2010-09-26 00:30:30,658 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:30:30,659 INFO repeater task os75nb_lastensq ended after 15.0 seconds 2010-09-26 00:30:30,660 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:29:46 2010-09-26 00:30:35,660 INFO repeater task wh300_lastensq starting 30.7 seconds late 2010-09-26 00:30:55,106 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:30:55,106 INFO repeater task wh300_lastensq ended after 19.4 seconds 2010-09-26 00:30:55,107 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:29:55 2010-09-26 00:32:05,164 INFO repeater task wh300_lastensq starting 0.2 seconds late 2010-09-26 00:32:25,370 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:32:25,370 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-26 00:32:25,371 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:31:55 2010-09-26 00:34:06,691 INFO repeater task wh300_lastensq starting 1.7 seconds late 2010-09-26 00:34:26,890 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:34:26,891 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-26 00:34:26,891 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:33:55 2010-09-26 00:34:41,928 INFO repeater task wh300_quick starting 0.7 seconds late 2010-09-26 00:35:13,288 INFO repeater task wh300_quick ended after 31.4 seconds 2010-09-26 00:35:13,289 INFO repeater task wh300_3dayplots starting 32.1 seconds late 2010-09-26 00:35:27,166 INFO repeater task wh300_3dayplots ended after 13.9 seconds 2010-09-26 00:35:27,167 INFO repeater task os75bb_lastensq starting 31.2 seconds late 2010-09-26 00:35:42,845 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:35:42,846 INFO repeater task os75bb_lastensq ended after 15.7 seconds 2010-09-26 00:35:42,847 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:34:47 2010-09-26 00:35:42,848 INFO repeater task os75bb_quick starting 61.6 seconds late 2010-09-26 00:36:08,985 INFO repeater task os75bb_quick ended after 26.1 seconds 2010-09-26 00:36:08,986 INFO repeater task os75bb_3dayplots starting 87.8 seconds late 2010-09-26 00:36:23,361 INFO repeater task os75bb_3dayplots ended after 14.4 seconds 2010-09-26 00:36:23,362 INFO repeater task os75nb_lastensq starting 87.4 seconds late 2010-09-26 00:36:38,506 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:36:38,507 INFO repeater task os75nb_lastensq ended after 15.1 seconds 2010-09-26 00:36:38,507 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:34:47 2010-09-26 00:36:38,508 INFO repeater task os75nb_quick starting 117.3 seconds late 2010-09-26 00:37:08,050 INFO repeater task os75nb_quick output: Warning: invalid value encountered in divide 2010-09-26 00:37:08,050 INFO repeater task os75nb_quick ended after 29.5 seconds 2010-09-26 00:37:08,051 INFO repeater task os75nb_3dayplots starting 146.8 seconds late 2010-09-26 00:37:20,731 INFO repeater task os75nb_3dayplots output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:37:20,731 INFO repeater task os75nb_3dayplots ended after 12.7 seconds 2010-09-26 00:37:20,732 INFO repeater task os75bb_beamplots starting 159.5 seconds late 2010-09-26 00:37:24,538 INFO repeater task os75bb_beamplots ended after 3.8 seconds 2010-09-26 00:37:24,539 INFO repeater task os75nb_beamplots starting 163.3 seconds late 2010-09-26 00:37:28,421 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2010-09-26 00:37:28,422 INFO repeater task os75bb_beamhistory starting 167.2 seconds late 2010-09-26 00:38:17,667 INFO repeater task os75bb_beamhistory output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide saving file to os75bb_bin_history.png 2010-09-26 00:38:17,668 INFO repeater task os75bb_beamhistory ended after 49.2 seconds 2010-09-26 00:38:17,676 INFO repeater task os75nb_beamhistory starting 216.4 seconds late 2010-09-26 00:38:54,520 INFO repeater task os75nb_beamhistory output: saving file to os75nb_bin_history.png 2010-09-26 00:38:54,520 INFO repeater task os75nb_beamhistory ended after 36.8 seconds 2010-09-26 00:38:54,521 INFO repeater task posmv_hcorrstats starting 253.3 seconds late 2010-09-26 00:38:58,405 INFO repeater task posmv_hcorrstats ended after 3.9 seconds 2010-09-26 00:38:58,406 INFO repeater task phins_hcorrstats starting 257.2 seconds late 2010-09-26 00:39:02,551 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2010-09-26 00:39:07,552 INFO repeater task wh300_lastensq starting 182.6 seconds late 2010-09-26 00:39:28,909 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:39:28,910 INFO repeater task wh300_lastensq ended after 21.4 seconds 2010-09-26 00:39:28,910 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:37:56 2010-09-26 00:39:43,929 INFO repeater task posmv_hcorrstats starting 2.7 seconds late 2010-09-26 00:39:48,289 INFO repeater task posmv_hcorrstats ended after 4.4 seconds 2010-09-26 00:39:48,290 INFO repeater task phins_hcorrstats starting 7.1 seconds late 2010-09-26 00:39:52,549 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2010-09-26 00:39:57,549 INFO repeater task os75bb_lastensq starting 0.5 seconds late 2010-09-26 00:40:12,867 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:40:12,867 INFO repeater task os75bb_lastensq ended after 15.3 seconds 2010-09-26 00:40:12,868 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:39:49 2010-09-26 00:40:12,870 INFO repeater task os75nb_lastensq starting 15.9 seconds late 2010-09-26 00:40:28,119 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:40:28,119 INFO repeater task os75nb_lastensq ended after 15.2 seconds 2010-09-26 00:40:28,120 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:39:49 2010-09-26 00:40:33,124 INFO repeater task wh300_lastensq starting 27.1 seconds late 2010-09-26 00:40:53,971 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:40:53,971 INFO repeater task wh300_lastensq ended after 20.8 seconds 2010-09-26 00:40:53,972 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:39:57 2010-09-26 00:42:09,032 INFO repeater task wh300_lastensq starting 2.0 seconds late 2010-09-26 00:42:28,015 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:42:28,015 INFO repeater task wh300_lastensq ended after 19.0 seconds 2010-09-26 00:42:28,016 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:41:57 2010-09-26 00:44:09,171 INFO repeater task wh300_lastensq starting 2.2 seconds late 2010-09-26 00:44:28,784 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:44:28,785 INFO repeater task wh300_lastensq ended after 19.6 seconds 2010-09-26 00:44:28,785 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:43:57 2010-09-26 00:44:43,799 INFO repeater task os75bb_beamplots starting 2.6 seconds late 2010-09-26 00:44:48,464 INFO repeater task os75bb_beamplots ended after 4.7 seconds 2010-09-26 00:44:48,466 INFO repeater task os75nb_beamplots starting 7.2 seconds late 2010-09-26 00:44:52,850 INFO repeater task os75nb_beamplots ended after 4.4 seconds 2010-09-26 00:44:52,852 INFO repeater task posmv_hcorrstats starting 11.6 seconds late 2010-09-26 00:44:57,018 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-26 00:44:57,019 INFO repeater task phins_hcorrstats starting 15.8 seconds late 2010-09-26 00:45:01,045 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2010-09-26 00:45:06,045 INFO repeater task os75bb_lastensq starting 7.0 seconds late 2010-09-26 00:45:21,498 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:45:21,498 INFO repeater task os75bb_lastensq ended after 15.5 seconds 2010-09-26 00:45:21,499 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:44:50 2010-09-26 00:45:21,500 INFO repeater task os75nb_lastensq starting 22.5 seconds late 2010-09-26 00:45:36,312 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:45:36,312 INFO repeater task os75nb_lastensq ended after 14.8 seconds 2010-09-26 00:45:36,313 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:44:50 2010-09-26 00:46:11,412 INFO repeater task wh300_lastensq starting 4.4 seconds late 2010-09-26 00:46:30,984 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:46:30,985 INFO repeater task wh300_lastensq ended after 19.6 seconds 2010-09-26 00:46:30,985 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:45:57 2010-09-26 00:48:11,064 INFO repeater task wh300_lastensq starting 4.1 seconds late 2010-09-26 00:48:31,109 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:48:31,109 INFO repeater task wh300_lastensq ended after 20.0 seconds 2010-09-26 00:48:31,110 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:47:57 2010-09-26 00:49:46,195 INFO repeater task posmv_hcorrstats starting 5.0 seconds late 2010-09-26 00:49:50,084 INFO repeater task posmv_hcorrstats ended after 3.9 seconds 2010-09-26 00:49:50,091 INFO repeater task phins_hcorrstats starting 8.9 seconds late 2010-09-26 00:49:54,062 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2010-09-26 00:50:04,065 INFO repeater task os75bb_lastensq starting 4.1 seconds late 2010-09-26 00:50:19,487 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:50:19,488 INFO repeater task os75bb_lastensq ended after 15.4 seconds 2010-09-26 00:50:19,489 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:49:52 2010-09-26 00:50:19,490 INFO repeater task os75nb_lastensq starting 19.5 seconds late 2010-09-26 00:50:34,958 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:50:34,958 INFO repeater task os75nb_lastensq ended after 15.5 seconds 2010-09-26 00:50:34,959 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:49:52 2010-09-26 00:50:39,960 INFO repeater task wh300_lastensq starting 33.0 seconds late 2010-09-26 00:51:01,159 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:51:01,160 INFO repeater task wh300_lastensq ended after 21.2 seconds 2010-09-26 00:51:01,161 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:49:58 2010-09-26 00:52:12,340 INFO repeater task wh300_lastensq starting 4.3 seconds late 2010-09-26 00:52:31,946 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:52:31,946 INFO repeater task wh300_lastensq ended after 19.6 seconds 2010-09-26 00:52:31,947 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:51:58 2010-09-26 00:54:12,028 INFO repeater task wh300_lastensq starting 4.0 seconds late 2010-09-26 00:54:32,107 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:54:32,107 INFO repeater task wh300_lastensq ended after 20.1 seconds 2010-09-26 00:54:32,108 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:53:58 2010-09-26 00:54:42,119 INFO repeater task os75bb_beamplots starting 0.9 seconds late 2010-09-26 00:54:46,090 INFO repeater task os75bb_beamplots ended after 4.0 seconds 2010-09-26 00:54:46,091 INFO repeater task os75nb_beamplots starting 4.9 seconds late 2010-09-26 00:54:49,325 INFO repeater task os75nb_beamplots ended after 3.2 seconds 2010-09-26 00:54:49,326 INFO repeater task posmv_hcorrstats starting 8.1 seconds late 2010-09-26 00:54:54,370 INFO repeater task posmv_hcorrstats ended after 5.0 seconds 2010-09-26 00:54:54,371 INFO repeater task phins_hcorrstats starting 13.1 seconds late 2010-09-26 00:54:58,977 INFO repeater task phins_hcorrstats ended after 4.6 seconds 2010-09-26 00:55:03,977 INFO repeater task os75bb_lastensq starting 2.0 seconds late 2010-09-26 00:55:19,445 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:55:19,446 INFO repeater task os75bb_lastensq ended after 15.5 seconds 2010-09-26 00:55:19,446 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:54:54 2010-09-26 00:55:19,448 INFO repeater task os75nb_lastensq starting 17.4 seconds late 2010-09-26 00:55:34,992 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:55:34,993 INFO repeater task os75nb_lastensq ended after 15.5 seconds 2010-09-26 00:55:34,993 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:54:54 2010-09-26 00:56:10,020 INFO repeater task wh300_lastensq starting 2.0 seconds late 2010-09-26 00:56:30,148 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:56:30,149 INFO repeater task wh300_lastensq ended after 20.1 seconds 2010-09-26 00:56:30,150 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:55:59 2010-09-26 00:58:10,232 INFO repeater task wh300_lastensq starting 1.2 seconds late 2010-09-26 00:58:29,859 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 00:58:29,860 INFO repeater task wh300_lastensq ended after 19.6 seconds 2010-09-26 00:58:29,860 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 00:58:00 2010-09-26 00:59:45,614 INFO repeater task posmv_hcorrstats starting 4.4 seconds late 2010-09-26 00:59:49,450 INFO repeater task posmv_hcorrstats ended after 3.8 seconds 2010-09-26 00:59:49,451 INFO repeater task phins_hcorrstats starting 8.2 seconds late 2010-09-26 00:59:53,666 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-26 01:00:08,674 INFO repeater task os75bb_lastensq starting 4.7 seconds late 2010-09-26 01:00:24,458 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:00:24,458 INFO repeater task os75bb_lastensq ended after 15.8 seconds 2010-09-26 01:00:24,459 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 00:59:56 2010-09-26 01:00:24,460 INFO repeater task os75nb_lastensq starting 20.5 seconds late 2010-09-26 01:00:39,853 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:00:39,854 INFO repeater task os75nb_lastensq ended after 15.4 seconds 2010-09-26 01:00:39,855 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 00:59:56 2010-09-26 01:00:44,856 INFO repeater task wh300_lastensq starting 34.9 seconds late 2010-09-26 01:01:06,100 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:01:06,101 INFO repeater task wh300_lastensq ended after 21.2 seconds 2010-09-26 01:01:06,101 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:00:01 2010-09-26 01:02:12,048 INFO repeater task wh300_lastensq starting 1.0 seconds late 2010-09-26 01:02:32,104 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:02:32,105 INFO repeater task wh300_lastensq ended after 20.1 seconds 2010-09-26 01:02:32,106 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:02:03 2010-09-26 01:04:17,208 INFO repeater task wh300_lastensq starting 4.2 seconds late 2010-09-26 01:04:37,086 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:04:37,086 INFO repeater task wh300_lastensq ended after 19.9 seconds 2010-09-26 01:04:37,087 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:04:03 2010-09-26 01:04:42,092 INFO repeater task wh300_quick starting 0.9 seconds late 2010-09-26 01:05:12,570 INFO repeater task wh300_quick ended after 30.5 seconds 2010-09-26 01:05:12,571 INFO repeater task wh300_3dayplots starting 31.3 seconds late 2010-09-26 01:05:26,126 INFO repeater task wh300_3dayplots output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:05:26,126 INFO repeater task wh300_3dayplots ended after 13.6 seconds 2010-09-26 01:05:26,138 INFO repeater task os75bb_lastensq starting 20.1 seconds late 2010-09-26 01:05:42,067 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:05:42,067 INFO repeater task os75bb_lastensq ended after 15.9 seconds 2010-09-26 01:05:42,068 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 01:04:58 2010-09-26 01:05:42,069 INFO repeater task os75bb_quick starting 60.8 seconds late 2010-09-26 01:06:10,017 INFO repeater task os75bb_quick ended after 27.9 seconds 2010-09-26 01:06:10,018 INFO repeater task os75bb_3dayplots starting 88.8 seconds late 2010-09-26 01:06:24,079 INFO repeater task os75bb_3dayplots ended after 14.1 seconds 2010-09-26 01:06:24,080 INFO repeater task os75nb_lastensq starting 78.1 seconds late 2010-09-26 01:06:39,280 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:06:39,280 INFO repeater task os75nb_lastensq ended after 15.2 seconds 2010-09-26 01:06:39,281 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 01:04:58 2010-09-26 01:06:39,282 INFO repeater task os75nb_quick starting 118.1 seconds late 2010-09-26 01:07:08,419 INFO repeater task os75nb_quick output: Warning: invalid value encountered in divide 2010-09-26 01:07:08,419 INFO repeater task os75nb_quick ended after 29.1 seconds 2010-09-26 01:07:08,425 INFO repeater task os75nb_3dayplots starting 147.2 seconds late 2010-09-26 01:07:21,516 INFO repeater task os75nb_3dayplots output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:07:21,517 INFO repeater task os75nb_3dayplots ended after 13.1 seconds 2010-09-26 01:07:21,517 INFO repeater task os75bb_beamplots starting 160.3 seconds late 2010-09-26 01:07:25,342 INFO repeater task os75bb_beamplots ended after 3.8 seconds 2010-09-26 01:07:25,343 INFO repeater task os75nb_beamplots starting 164.1 seconds late 2010-09-26 01:07:28,593 INFO repeater task os75nb_beamplots ended after 3.3 seconds 2010-09-26 01:07:28,595 INFO repeater task posmv_hcorrstats starting 167.4 seconds late 2010-09-26 01:07:32,803 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-26 01:07:32,804 INFO repeater task phins_hcorrstats starting 171.6 seconds late 2010-09-26 01:07:36,984 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2010-09-26 01:07:41,984 INFO repeater task wh300_lastensq starting 89.0 seconds late 2010-09-26 01:07:58,096 INFO repeater task wh300_lastensq ended after 16.1 seconds 2010-09-26 01:07:58,097 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:06:03 2010-09-26 01:08:13,176 INFO repeater task wh300_lastensq starting 0.2 seconds late 2010-09-26 01:08:33,430 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:08:33,431 INFO repeater task wh300_lastensq ended after 20.3 seconds 2010-09-26 01:08:33,432 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:08:03 2010-09-26 01:09:43,493 INFO repeater task posmv_hcorrstats starting 2.3 seconds late 2010-09-26 01:09:47,685 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-26 01:09:47,695 INFO repeater task phins_hcorrstats starting 6.5 seconds late 2010-09-26 01:09:51,511 INFO repeater task phins_hcorrstats ended after 3.8 seconds 2010-09-26 01:10:11,602 INFO repeater task os75bb_lastensq starting 3.6 seconds late 2010-09-26 01:10:27,397 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:10:27,398 INFO repeater task os75bb_lastensq ended after 15.8 seconds 2010-09-26 01:10:27,399 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 01:10:00 2010-09-26 01:10:27,400 INFO repeater task os75nb_lastensq starting 19.4 seconds late 2010-09-26 01:10:42,961 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:10:42,961 INFO repeater task os75nb_lastensq ended after 15.6 seconds 2010-09-26 01:10:42,962 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 01:10:00 2010-09-26 01:10:48,013 INFO repeater task wh300_lastensq starting 35.0 seconds late 2010-09-26 01:11:09,410 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:11:09,411 INFO repeater task wh300_lastensq ended after 21.4 seconds 2010-09-26 01:11:09,412 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:10:04 2010-09-26 01:12:15,244 INFO repeater task wh300_lastensq starting 1.2 seconds late 2010-09-26 01:12:34,926 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:12:34,926 INFO repeater task wh300_lastensq ended after 19.7 seconds 2010-09-26 01:12:34,927 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:12:05 2010-09-26 01:14:16,532 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-09-26 01:14:35,952 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:14:35,953 INFO repeater task wh300_lastensq ended after 19.4 seconds 2010-09-26 01:14:35,953 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:14:05 2010-09-26 01:14:46,175 INFO repeater task os75bb_beamplots starting 5.0 seconds late 2010-09-26 01:14:49,689 INFO repeater task os75bb_beamplots ended after 3.5 seconds 2010-09-26 01:14:49,690 INFO repeater task os75nb_beamplots starting 8.5 seconds late 2010-09-26 01:14:53,679 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2010-09-26 01:14:53,681 INFO repeater task posmv_hcorrstats starting 12.5 seconds late 2010-09-26 01:14:57,731 INFO repeater task posmv_hcorrstats ended after 4.1 seconds 2010-09-26 01:14:57,732 INFO repeater task phins_hcorrstats starting 16.5 seconds late 2010-09-26 01:15:02,798 INFO repeater task phins_hcorrstats ended after 5.1 seconds 2010-09-26 01:15:12,801 INFO repeater task os75bb_lastensq starting 2.8 seconds late 2010-09-26 01:15:28,238 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:15:28,239 INFO repeater task os75bb_lastensq ended after 15.4 seconds 2010-09-26 01:15:28,239 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 01:15:02 2010-09-26 01:15:28,242 INFO repeater task os75nb_lastensq starting 18.2 seconds late 2010-09-26 01:15:43,502 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:15:43,503 INFO repeater task os75nb_lastensq ended after 15.3 seconds 2010-09-26 01:15:43,504 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 01:15:02 2010-09-26 01:16:18,847 INFO repeater task wh300_lastensq starting 3.8 seconds late 2010-09-26 01:16:38,336 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:16:38,336 INFO repeater task wh300_lastensq ended after 19.5 seconds 2010-09-26 01:16:38,337 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:16:06 2010-09-26 01:18:19,791 INFO repeater task wh300_lastensq starting 3.8 seconds late 2010-09-26 01:18:39,721 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:18:39,721 INFO repeater task wh300_lastensq ended after 19.9 seconds 2010-09-26 01:18:39,722 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:18:06 2010-09-26 01:19:45,710 INFO repeater task posmv_hcorrstats starting 4.5 seconds late 2010-09-26 01:19:49,832 INFO repeater task posmv_hcorrstats ended after 4.1 seconds 2010-09-26 01:19:49,833 INFO repeater task phins_hcorrstats starting 8.6 seconds late 2010-09-26 01:19:54,508 INFO repeater task phins_hcorrstats ended after 4.7 seconds 2010-09-26 01:20:14,526 INFO repeater task os75bb_lastensq starting 2.5 seconds late 2010-09-26 01:20:30,184 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:20:30,184 INFO repeater task os75bb_lastensq ended after 15.7 seconds 2010-09-26 01:20:30,185 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 01:20:05 2010-09-26 01:20:30,186 INFO repeater task os75nb_lastensq starting 18.2 seconds late 2010-09-26 01:20:45,842 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:20:45,843 INFO repeater task os75nb_lastensq ended after 15.7 seconds 2010-09-26 01:20:45,843 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 01:20:05 2010-09-26 01:20:50,844 INFO repeater task wh300_lastensq starting 34.8 seconds late 2010-09-26 01:21:12,214 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:21:12,214 INFO repeater task wh300_lastensq ended after 21.4 seconds 2010-09-26 01:21:12,215 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:20:06 2010-09-26 01:22:17,280 INFO repeater task wh300_lastensq starting 1.3 seconds late 2010-09-26 01:22:37,527 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:22:37,528 INFO repeater task wh300_lastensq ended after 20.2 seconds 2010-09-26 01:22:37,528 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:22:06 2010-09-26 01:24:17,700 INFO repeater task wh300_lastensq starting 1.7 seconds late 2010-09-26 01:24:37,401 INFO repeater task wh300_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:24:37,402 INFO repeater task wh300_lastensq ended after 19.7 seconds 2010-09-26 01:24:37,402 INFO repeater task wh300_lastensq: Time from /home/data/kn199_2a/proc/wh300/load/wrote_ens_time: 2010/09/26 01:24:07 2010-09-26 01:24:42,414 INFO repeater task os75bb_beamplots starting 1.2 seconds late 2010-09-26 01:24:45,628 INFO repeater task os75bb_beamplots ended after 3.2 seconds 2010-09-26 01:24:45,629 INFO repeater task os75nb_beamplots starting 4.4 seconds late 2010-09-26 01:24:49,406 INFO repeater task os75nb_beamplots ended after 3.8 seconds 2010-09-26 01:24:49,408 INFO repeater task posmv_hcorrstats starting 8.2 seconds late 2010-09-26 01:24:53,621 INFO repeater task posmv_hcorrstats ended after 4.2 seconds 2010-09-26 01:24:53,622 INFO repeater task phins_hcorrstats starting 12.4 seconds late 2010-09-26 01:24:58,296 INFO repeater task phins_hcorrstats ended after 4.7 seconds 2010-09-26 01:25:18,450 INFO repeater task os75bb_lastensq starting 3.5 seconds late 2010-09-26 01:25:33,953 INFO repeater task os75bb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:25:33,953 INFO repeater task os75bb_lastensq ended after 15.5 seconds 2010-09-26 01:25:33,954 INFO repeater task os75bb_lastensq: Time from /home/data/kn199_2a/proc/os75bb/load/wrote_ens_time: 2010/09/26 01:25:07 2010-09-26 01:25:33,956 INFO repeater task os75nb_lastensq starting 19.0 seconds late 2010-09-26 01:25:49,241 INFO repeater task os75nb_lastensq output: Warning: invalid value encountered in divide Warning: invalid value encountered in divide 2010-09-26 01:25:49,241 INFO repeater task os75nb_lastensq ended after 15.3 seconds 2010-09-26 01:25:49,242 INFO repeater task os75nb_lastensq: Time from /home/data/kn199_2a/proc/os75nb/load/wrote_ens_time: 2010/09/26 01:25:07