2010-06-16 17:48:09,031 INFO repeater Extra increment added to time_to_run 2010-06-16 17:48:29,045 INFO repeater task ashtech_hcorrstats starting 3.9 seconds late 2010-06-16 17:48:36,955 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 17:49:26,957 INFO repeater task wh300_beamplots starting 1.8 seconds late 2010-06-16 17:49:29,042 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 17:50:04,043 INFO repeater task wh300_lastensq starting 3.0 seconds late 2010-06-16 17:50:18,996 INFO repeater task wh300_lastensq ended after 15.0 seconds 2010-06-16 17:50:18,997 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 17:49:52 2010-06-16 17:51:29,000 INFO repeater task wh300_beamplots starting 3.9 seconds late 2010-06-16 17:51:31,074 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 17:52:06,076 INFO repeater task wh300_lastensq starting 4.1 seconds late 2010-06-16 17:52:21,090 INFO repeater task wh300_lastensq ended after 15.0 seconds 2010-06-16 17:52:21,090 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 17:51:52 2010-06-16 17:53:26,092 INFO repeater task wh300_beamplots starting 1.0 seconds late 2010-06-16 17:53:28,346 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 17:53:28,347 INFO repeater task wh300_beamplots starting 3.2 seconds late 2010-06-16 17:53:38,512 INFO repeater task wh300_beamplots ended after 10.2 seconds 2010-06-16 17:53:38,514 INFO repeater task ashtech_hcorrstats starting 13.4 seconds late 2010-06-16 17:53:46,223 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 17:54:06,224 INFO repeater task wh300_lastensq starting 4.2 seconds late 2010-06-16 17:54:21,161 INFO repeater task wh300_lastensq ended after 14.9 seconds 2010-06-16 17:54:21,162 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 17:53:52 2010-06-16 17:55:26,168 INFO repeater task wh300_beamplots starting 1.0 seconds late 2010-06-16 17:55:28,270 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 17:56:03,276 INFO repeater task wh300_lastensq starting 1.3 seconds late 2010-06-16 17:56:18,377 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 17:56:18,377 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 17:55:52 2010-06-16 17:57:28,381 INFO repeater task wh300_beamplots starting 3.3 seconds late 2010-06-16 17:57:30,571 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 17:58:05,572 INFO repeater task wh300_lastensq starting 3.6 seconds late 2010-06-16 17:58:20,706 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 17:58:20,707 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 17:57:52 2010-06-16 17:58:25,710 INFO repeater task ashtech_hcorrstats starting 0.6 seconds late 2010-06-16 17:58:33,728 INFO repeater task ashtech_hcorrstats ended after 8.0 seconds 2010-06-16 17:59:28,732 INFO repeater task wh300_beamplots starting 3.6 seconds late 2010-06-16 17:59:30,810 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:00:05,812 INFO repeater task wh300_lastensq starting 3.8 seconds late 2010-06-16 18:00:21,223 INFO repeater task wh300_lastensq ended after 15.4 seconds 2010-06-16 18:00:21,223 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 17:59:52 2010-06-16 18:01:26,225 INFO repeater task wh300_beamplots starting 1.1 seconds late 2010-06-16 18:01:28,522 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:02:03,524 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-06-16 18:02:17,897 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 18:02:17,898 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:01:52 2010-06-16 18:03:27,904 INFO repeater task wh300_beamplots starting 2.8 seconds late 2010-06-16 18:03:30,201 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:03:30,201 INFO repeater task wh300_beamplots starting 5.1 seconds late 2010-06-16 18:03:40,322 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 18:03:40,324 INFO repeater task ashtech_hcorrstats starting 15.2 seconds late 2010-06-16 18:03:47,591 INFO repeater task ashtech_hcorrstats ended after 7.3 seconds 2010-06-16 18:04:02,595 INFO repeater task wh300_lastensq starting 0.6 seconds late 2010-06-16 18:04:16,286 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 18:04:16,286 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:03:52 2010-06-16 18:05:26,288 INFO repeater task wh300_beamplots starting 1.2 seconds late 2010-06-16 18:05:28,363 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:06:03,364 INFO repeater task wh300_lastensq starting 1.4 seconds late 2010-06-16 18:06:17,202 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 18:06:17,203 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:05:52 2010-06-16 18:07:27,205 INFO repeater task wh300_beamplots starting 2.1 seconds late 2010-06-16 18:07:29,325 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:08:04,336 INFO repeater task wh300_lastensq starting 2.3 seconds late 2010-06-16 18:08:18,052 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 18:08:18,053 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:07:53 2010-06-16 18:08:28,057 INFO repeater task ashtech_hcorrstats starting 2.9 seconds late 2010-06-16 18:08:35,339 INFO repeater task ashtech_hcorrstats ended after 7.3 seconds 2010-06-16 18:09:25,349 INFO repeater task wh300_beamplots starting 0.2 seconds late 2010-06-16 18:09:27,407 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:10:07,410 INFO repeater task wh300_lastensq starting 4.4 seconds late 2010-06-16 18:10:21,549 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 18:10:21,550 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:09:53 2010-06-16 18:11:26,552 INFO repeater task wh300_beamplots starting 1.4 seconds late 2010-06-16 18:11:28,659 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:12:03,668 INFO repeater task wh300_lastensq starting 0.7 seconds late 2010-06-16 18:12:17,512 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 18:12:17,513 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:11:53 2010-06-16 18:13:27,516 INFO repeater task wh300_quick starting 2.4 seconds late 2010-06-16 18:13:52,280 INFO repeater task wh300_quick ended after 24.8 seconds 2010-06-16 18:13:52,281 INFO repeater task wh300_3dayplots starting 27.2 seconds late 2010-06-16 18:14:00,530 INFO repeater task wh300_3dayplots ended after 8.2 seconds 2010-06-16 18:14:00,532 INFO repeater task wh300_beamplots starting 35.4 seconds late 2010-06-16 18:14:02,753 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 18:14:02,753 INFO repeater task wh300_beamplots starting 37.6 seconds late 2010-06-16 18:14:12,706 INFO repeater task wh300_beamplots ended after 10.0 seconds 2010-06-16 18:14:12,708 INFO repeater task ashtech_hcorrstats starting 47.6 seconds late 2010-06-16 18:14:19,996 INFO repeater task ashtech_hcorrstats ended after 7.3 seconds 2010-06-16 18:14:24,996 INFO repeater task wh300_lastensq starting 22.0 seconds late 2010-06-16 18:14:38,865 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 18:14:38,866 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:13:53 2010-06-16 18:15:28,869 INFO repeater task wh300_beamplots starting 3.7 seconds late 2010-06-16 18:15:30,943 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:16:05,944 INFO repeater task wh300_lastensq starting 2.9 seconds late 2010-06-16 18:16:19,878 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 18:16:19,879 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:15:53 2010-06-16 18:17:29,881 INFO repeater task wh300_beamplots starting 4.8 seconds late 2010-06-16 18:17:32,009 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:18:07,007 INFO repeater task wh300_lastensq starting 4.0 seconds late 2010-06-16 18:18:20,836 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 18:18:20,837 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:17:53 2010-06-16 18:18:25,841 INFO repeater task ashtech_hcorrstats starting 0.7 seconds late 2010-06-16 18:18:33,206 INFO repeater task ashtech_hcorrstats ended after 7.4 seconds 2010-06-16 18:19:28,205 INFO repeater task wh300_beamplots starting 3.1 seconds late 2010-06-16 18:19:30,528 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:20:05,528 INFO repeater task wh300_lastensq starting 2.5 seconds late 2010-06-16 18:20:19,357 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 18:20:19,358 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:19:53 2010-06-16 18:21:29,372 INFO repeater task wh300_beamplots starting 4.2 seconds late 2010-06-16 18:21:31,680 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:22:06,680 INFO repeater task wh300_lastensq starting 3.7 seconds late 2010-06-16 18:22:20,528 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 18:22:20,529 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:21:53 2010-06-16 18:23:25,537 INFO repeater task wh300_beamplots starting 0.4 seconds late 2010-06-16 18:23:27,855 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:23:27,856 INFO repeater task wh300_beamplots starting 2.7 seconds late 2010-06-16 18:23:37,994 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 18:23:37,995 INFO repeater task ashtech_hcorrstats starting 12.9 seconds late 2010-06-16 18:23:45,469 INFO repeater task ashtech_hcorrstats ended after 7.5 seconds 2010-06-16 18:24:05,467 INFO repeater task wh300_lastensq starting 2.5 seconds late 2010-06-16 18:24:19,383 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 18:24:19,383 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:23:53 2010-06-16 18:25:29,385 INFO repeater task wh300_beamplots starting 4.3 seconds late 2010-06-16 18:25:31,467 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:26:06,468 INFO repeater task wh300_lastensq starting 3.5 seconds late 2010-06-16 18:26:20,561 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 18:26:20,562 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:25:53 2010-06-16 18:27:25,569 INFO repeater task wh300_beamplots starting 0.4 seconds late 2010-06-16 18:27:27,685 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:28:07,684 INFO repeater task wh300_lastensq starting 4.7 seconds late 2010-06-16 18:28:21,627 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 18:28:21,627 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:27:53 2010-06-16 18:28:26,631 INFO repeater task ashtech_hcorrstats starting 1.5 seconds late 2010-06-16 18:28:34,090 INFO repeater task ashtech_hcorrstats ended after 7.5 seconds 2010-06-16 18:29:29,100 INFO repeater task wh300_beamplots starting 4.0 seconds late 2010-06-16 18:29:31,397 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:30:06,395 INFO repeater task wh300_lastensq starting 3.4 seconds late 2010-06-16 18:30:20,285 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 18:30:20,286 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:29:53 2010-06-16 18:31:25,305 INFO repeater task wh300_beamplots starting 0.2 seconds late 2010-06-16 18:31:27,627 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:32:07,633 INFO repeater task wh300_lastensq starting 4.6 seconds late 2010-06-16 18:32:21,534 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 18:32:21,535 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:31:53 2010-06-16 18:33:26,540 INFO repeater task wh300_beamplots starting 1.4 seconds late 2010-06-16 18:33:28,796 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:33:28,797 INFO repeater task wh300_beamplots starting 3.7 seconds late 2010-06-16 18:33:38,743 INFO repeater task wh300_beamplots ended after 9.9 seconds 2010-06-16 18:33:38,745 INFO repeater task ashtech_hcorrstats starting 13.6 seconds late 2010-06-16 18:33:46,206 INFO repeater task ashtech_hcorrstats ended after 7.5 seconds 2010-06-16 18:34:06,204 INFO repeater task wh300_lastensq starting 3.2 seconds late 2010-06-16 18:34:20,381 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 18:34:20,381 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:33:53 2010-06-16 18:35:25,381 INFO repeater task wh300_beamplots starting 0.3 seconds late 2010-06-16 18:35:27,515 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:36:07,516 INFO repeater task wh300_lastensq starting 4.5 seconds late 2010-06-16 18:36:21,543 INFO repeater task wh300_lastensq ended after 14.0 seconds 2010-06-16 18:36:21,543 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:35:53 2010-06-16 18:37:26,546 INFO repeater task wh300_beamplots starting 1.4 seconds late 2010-06-16 18:37:28,656 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:38:03,656 INFO repeater task wh300_lastensq starting 0.7 seconds late 2010-06-16 18:38:17,732 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 18:38:17,733 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:37:53 2010-06-16 18:38:27,738 INFO repeater task ashtech_hcorrstats starting 2.6 seconds late 2010-06-16 18:38:35,418 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 18:39:25,429 INFO repeater task wh300_beamplots starting 0.3 seconds late 2010-06-16 18:39:27,739 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 18:40:07,740 INFO repeater task wh300_lastensq starting 4.7 seconds late 2010-06-16 18:40:21,878 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 18:40:21,879 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:39:54 2010-06-16 18:41:26,886 INFO repeater task wh300_beamplots starting 1.8 seconds late 2010-06-16 18:41:28,999 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:42:04,001 INFO repeater task wh300_lastensq starting 0.0 seconds late 2010-06-16 18:42:17,882 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 18:42:17,883 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:41:54 2010-06-16 18:43:28,048 INFO repeater task wh300_quick starting 2.9 seconds late 2010-06-16 18:43:52,055 INFO repeater task wh300_quick ended after 24.0 seconds 2010-06-16 18:43:52,056 INFO repeater task wh300_3dayplots starting 26.9 seconds late 2010-06-16 18:44:00,285 INFO repeater task wh300_3dayplots ended after 8.2 seconds 2010-06-16 18:44:00,286 INFO repeater task wh300_beamplots starting 35.2 seconds late 2010-06-16 18:44:02,416 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:44:02,417 INFO repeater task wh300_beamplots starting 37.3 seconds late 2010-06-16 18:44:12,377 INFO repeater task wh300_beamplots ended after 10.0 seconds 2010-06-16 18:44:12,378 INFO repeater task wh300_beamhistory starting 47.2 seconds late 2010-06-16 18:47:01,581 INFO repeater task wh300_beamhistory output: saving file to wh300_bin_history.png 2010-06-16 18:47:01,589 INFO repeater task wh300_beamhistory ended after 169.2 seconds 2010-06-16 18:47:01,597 INFO repeater task ashtech_hcorrstats starting 216.5 seconds late 2010-06-16 18:47:34,657 INFO repeater task ashtech_hcorrstats ended after 33.1 seconds 2010-06-16 18:47:39,656 INFO repeater task wh300_lastensq starting 215.7 seconds late 2010-06-16 18:47:58,591 INFO repeater task wh300_lastensq ended after 18.9 seconds 2010-06-16 18:47:58,591 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:45:54 2010-06-16 18:47:58,593 INFO repeater task wh300_beamplots starting 153.5 seconds late 2010-06-16 18:48:00,753 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 18:48:00,753 INFO repeater Extra increment added to time_to_run 2010-06-16 18:48:05,751 INFO repeater task wh300_lastensq starting 1.8 seconds late 2010-06-16 18:48:19,964 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 18:48:19,965 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:47:54 2010-06-16 18:48:29,965 INFO repeater task ashtech_hcorrstats starting 4.8 seconds late 2010-06-16 18:48:37,630 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 18:49:27,629 INFO repeater task wh300_beamplots starting 2.5 seconds late 2010-06-16 18:49:29,776 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:50:04,776 INFO repeater task wh300_lastensq starting 0.8 seconds late 2010-06-16 18:50:18,889 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 18:50:18,890 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:49:54 2010-06-16 18:51:28,892 INFO repeater task wh300_beamplots starting 3.8 seconds late 2010-06-16 18:51:31,008 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:52:06,007 INFO repeater task wh300_lastensq starting 2.0 seconds late 2010-06-16 18:52:20,060 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 18:52:20,060 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:51:54 2010-06-16 18:53:30,060 INFO repeater task wh300_beamplots starting 4.9 seconds late 2010-06-16 18:53:32,140 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:53:32,141 INFO repeater task wh300_beamplots starting 7.0 seconds late 2010-06-16 18:53:42,091 INFO repeater task wh300_beamplots ended after 9.9 seconds 2010-06-16 18:53:42,092 INFO repeater task ashtech_hcorrstats starting 17.0 seconds late 2010-06-16 18:53:49,554 INFO repeater task ashtech_hcorrstats ended after 7.5 seconds 2010-06-16 18:54:04,554 INFO repeater task wh300_lastensq starting 0.6 seconds late 2010-06-16 18:54:18,766 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 18:54:18,767 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:53:54 2010-06-16 18:55:28,773 INFO repeater task wh300_beamplots starting 3.6 seconds late 2010-06-16 18:55:30,839 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 18:56:05,840 INFO repeater task wh300_lastensq starting 1.8 seconds late 2010-06-16 18:56:20,049 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 18:56:20,049 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:55:54 2010-06-16 18:57:30,064 INFO repeater task wh300_beamplots starting 4.9 seconds late 2010-06-16 18:57:32,233 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 18:58:07,236 INFO repeater task wh300_lastensq starting 3.2 seconds late 2010-06-16 18:58:21,572 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 18:58:21,573 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:57:54 2010-06-16 18:58:26,573 INFO repeater task ashtech_hcorrstats starting 1.4 seconds late 2010-06-16 18:58:34,313 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 18:59:29,313 INFO repeater task wh300_beamplots starting 4.2 seconds late 2010-06-16 18:59:31,449 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:00:06,452 INFO repeater task wh300_lastensq starting 2.5 seconds late 2010-06-16 19:00:20,677 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 19:00:20,678 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 18:59:54 2010-06-16 19:01:25,681 INFO repeater task wh300_beamplots starting 0.6 seconds late 2010-06-16 19:01:27,813 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:02:07,811 INFO repeater task wh300_lastensq starting 3.8 seconds late 2010-06-16 19:02:22,222 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 19:02:22,223 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:01:54 2010-06-16 19:03:27,226 INFO repeater task wh300_beamplots starting 2.1 seconds late 2010-06-16 19:03:29,362 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:03:29,363 INFO repeater task wh300_beamplots starting 4.2 seconds late 2010-06-16 19:03:39,483 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 19:03:39,484 INFO repeater task ashtech_hcorrstats starting 14.3 seconds late 2010-06-16 19:03:47,314 INFO repeater task ashtech_hcorrstats ended after 7.8 seconds 2010-06-16 19:04:07,312 INFO repeater task wh300_lastensq starting 3.3 seconds late 2010-06-16 19:04:21,752 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 19:04:21,752 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:03:54 2010-06-16 19:05:26,768 INFO repeater task wh300_beamplots starting 1.6 seconds late 2010-06-16 19:05:29,060 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 19:06:04,060 INFO repeater task wh300_lastensq starting 0.1 seconds late 2010-06-16 19:06:18,358 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 19:06:18,358 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:05:54 2010-06-16 19:07:28,361 INFO repeater task wh300_beamplots starting 3.2 seconds late 2010-06-16 19:07:30,483 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:08:05,484 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-06-16 19:08:19,655 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 19:08:19,656 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:07:54 2010-06-16 19:08:29,659 INFO repeater task ashtech_hcorrstats starting 4.5 seconds late 2010-06-16 19:08:37,242 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 19:09:27,241 INFO repeater task wh300_beamplots starting 2.1 seconds late 2010-06-16 19:09:29,443 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 19:10:04,456 INFO repeater task wh300_lastensq starting 0.5 seconds late 2010-06-16 19:10:18,872 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 19:10:18,872 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:09:54 2010-06-16 19:11:28,872 INFO repeater task wh300_beamplots starting 3.7 seconds late 2010-06-16 19:11:31,178 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 19:12:06,179 INFO repeater task wh300_lastensq starting 2.2 seconds late 2010-06-16 19:12:20,521 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 19:12:20,522 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:11:55 2010-06-16 19:13:25,525 INFO repeater task wh300_quick starting 0.4 seconds late 2010-06-16 19:13:50,031 INFO repeater task wh300_quick ended after 24.5 seconds 2010-06-16 19:13:50,032 INFO repeater task wh300_3dayplots starting 24.9 seconds late 2010-06-16 19:13:58,163 INFO repeater task wh300_3dayplots ended after 8.1 seconds 2010-06-16 19:13:58,166 INFO repeater task wh300_beamplots starting 33.0 seconds late 2010-06-16 19:14:00,277 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:14:00,278 INFO repeater task wh300_beamplots starting 35.1 seconds late 2010-06-16 19:14:10,373 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 19:14:10,374 INFO repeater task ashtech_hcorrstats starting 45.2 seconds late 2010-06-16 19:14:18,361 INFO repeater task ashtech_hcorrstats ended after 8.0 seconds 2010-06-16 19:14:23,360 INFO repeater task wh300_lastensq starting 18.4 seconds late 2010-06-16 19:14:37,595 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 19:14:37,596 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:13:55 2010-06-16 19:15:27,608 INFO repeater task wh300_beamplots starting 2.5 seconds late 2010-06-16 19:15:29,876 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 19:16:09,876 INFO repeater task wh300_lastensq starting 4.9 seconds late 2010-06-16 19:16:24,410 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 19:16:24,411 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:15:55 2010-06-16 19:17:29,442 INFO repeater task wh300_beamplots starting 4.3 seconds late 2010-06-16 19:17:31,597 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 19:18:06,604 INFO repeater task wh300_lastensq starting 1.6 seconds late 2010-06-16 19:18:21,095 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 19:18:21,096 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:17:55 2010-06-16 19:18:26,098 INFO repeater task ashtech_hcorrstats starting 1.0 seconds late 2010-06-16 19:18:33,674 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 19:19:28,674 INFO repeater task wh300_beamplots starting 3.5 seconds late 2010-06-16 19:19:31,024 INFO repeater task wh300_beamplots ended after 2.4 seconds 2010-06-16 19:20:06,026 INFO repeater task wh300_lastensq starting 1.0 seconds late 2010-06-16 19:20:20,354 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 19:20:20,355 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:19:55 2010-06-16 19:21:25,361 INFO repeater task wh300_beamplots starting 0.2 seconds late 2010-06-16 19:21:27,644 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 19:22:07,644 INFO repeater task wh300_lastensq starting 2.6 seconds late 2010-06-16 19:22:22,090 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 19:22:22,091 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:21:55 2010-06-16 19:23:27,104 INFO repeater task wh300_beamplots starting 2.0 seconds late 2010-06-16 19:23:29,375 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 19:23:29,375 INFO repeater task wh300_beamplots starting 4.2 seconds late 2010-06-16 19:23:39,502 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 19:23:39,503 INFO repeater task ashtech_hcorrstats starting 14.4 seconds late 2010-06-16 19:23:47,198 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 19:24:07,196 INFO repeater task wh300_lastensq starting 2.2 seconds late 2010-06-16 19:24:21,599 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 19:24:21,600 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:23:55 2010-06-16 19:25:26,600 INFO repeater task wh300_beamplots starting 1.5 seconds late 2010-06-16 19:25:28,681 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:26:08,680 INFO repeater task wh300_lastensq starting 3.7 seconds late 2010-06-16 19:26:23,192 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 19:26:23,192 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:25:55 2010-06-16 19:27:28,192 INFO repeater task wh300_beamplots starting 3.1 seconds late 2010-06-16 19:27:30,452 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 19:28:05,457 INFO repeater task wh300_lastensq starting 0.5 seconds late 2010-06-16 19:28:19,798 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 19:28:19,798 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:27:55 2010-06-16 19:28:29,806 INFO repeater task ashtech_hcorrstats starting 4.7 seconds late 2010-06-16 19:28:37,756 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 19:29:27,756 INFO repeater task wh300_beamplots starting 2.6 seconds late 2010-06-16 19:29:29,858 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:30:09,856 INFO repeater task wh300_lastensq starting 4.9 seconds late 2010-06-16 19:30:24,451 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 19:30:24,452 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:29:55 2010-06-16 19:31:29,457 INFO repeater task wh300_beamplots starting 4.3 seconds late 2010-06-16 19:31:31,515 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:32:06,520 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-06-16 19:32:21,104 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 19:32:21,104 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:31:55 2010-06-16 19:33:26,105 INFO repeater task wh300_beamplots starting 1.0 seconds late 2010-06-16 19:33:28,227 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:33:28,228 INFO repeater task wh300_beamplots starting 3.1 seconds late 2010-06-16 19:33:38,389 INFO repeater task wh300_beamplots ended after 10.2 seconds 2010-06-16 19:33:38,390 INFO repeater task ashtech_hcorrstats starting 13.3 seconds late 2010-06-16 19:33:46,407 INFO repeater task ashtech_hcorrstats ended after 8.0 seconds 2010-06-16 19:34:06,404 INFO repeater task wh300_lastensq starting 1.4 seconds late 2010-06-16 19:34:20,976 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 19:34:20,977 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:33:55 2010-06-16 19:35:25,981 INFO repeater task wh300_beamplots starting 0.9 seconds late 2010-06-16 19:35:28,058 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:36:08,060 INFO repeater task wh300_lastensq starting 3.1 seconds late 2010-06-16 19:36:22,813 INFO repeater task wh300_lastensq ended after 14.8 seconds 2010-06-16 19:36:22,814 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:35:55 2010-06-16 19:37:27,817 INFO repeater task wh300_beamplots starting 2.7 seconds late 2010-06-16 19:37:29,899 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:38:09,909 INFO repeater task wh300_lastensq starting 4.9 seconds late 2010-06-16 19:38:24,661 INFO repeater task wh300_lastensq ended after 14.8 seconds 2010-06-16 19:38:24,662 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:37:55 2010-06-16 19:38:29,667 INFO repeater task ashtech_hcorrstats starting 4.5 seconds late 2010-06-16 19:38:37,673 INFO repeater task ashtech_hcorrstats ended after 8.0 seconds 2010-06-16 19:39:27,672 INFO repeater task wh300_beamplots starting 2.5 seconds late 2010-06-16 19:39:29,781 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:40:09,788 INFO repeater task wh300_lastensq starting 4.8 seconds late 2010-06-16 19:40:24,378 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 19:40:24,378 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:39:55 2010-06-16 19:41:29,396 INFO repeater task wh300_beamplots starting 4.3 seconds late 2010-06-16 19:41:31,467 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:42:06,471 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-06-16 19:42:21,157 INFO repeater task wh300_lastensq ended after 14.7 seconds 2010-06-16 19:42:21,158 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:41:56 2010-06-16 19:43:26,164 INFO repeater task wh300_quick starting 1.0 seconds late 2010-06-16 19:43:50,736 INFO repeater task wh300_quick ended after 24.6 seconds 2010-06-16 19:43:50,737 INFO repeater task wh300_3dayplots starting 25.6 seconds late 2010-06-16 19:43:58,813 INFO repeater task wh300_3dayplots ended after 8.1 seconds 2010-06-16 19:43:58,814 INFO repeater task wh300_beamplots starting 33.7 seconds late 2010-06-16 19:44:01,111 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 19:44:01,112 INFO repeater task wh300_beamplots starting 36.0 seconds late 2010-06-16 19:44:11,255 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 19:44:11,256 INFO repeater task wh300_beamhistory starting 46.1 seconds late 2010-06-16 19:47:05,572 INFO repeater task wh300_beamhistory output: saving file to wh300_bin_history.png 2010-06-16 19:47:05,585 INFO repeater task wh300_beamhistory ended after 174.3 seconds 2010-06-16 19:47:05,602 INFO repeater task ashtech_hcorrstats starting 220.5 seconds late 2010-06-16 19:47:39,182 INFO repeater task ashtech_hcorrstats ended after 33.6 seconds 2010-06-16 19:47:44,180 INFO repeater task wh300_lastensq starting 218.2 seconds late 2010-06-16 19:48:04,022 INFO repeater task wh300_lastensq ended after 19.8 seconds 2010-06-16 19:48:04,023 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:45:56 2010-06-16 19:48:04,024 INFO repeater task wh300_beamplots starting 158.9 seconds late 2010-06-16 19:48:06,167 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:48:06,167 INFO repeater Extra increment added to time_to_run 2010-06-16 19:48:11,168 INFO repeater task wh300_lastensq starting 5.2 seconds late 2010-06-16 19:48:26,266 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 19:48:26,267 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:47:56 2010-06-16 19:48:26,269 INFO repeater task ashtech_hcorrstats starting 1.1 seconds late 2010-06-16 19:48:34,150 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 19:49:29,165 INFO repeater task wh300_beamplots starting 4.0 seconds late 2010-06-16 19:49:31,336 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 19:50:06,340 INFO repeater task wh300_lastensq starting 0.3 seconds late 2010-06-16 19:50:21,051 INFO repeater task wh300_lastensq ended after 14.7 seconds 2010-06-16 19:50:21,051 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:49:56 2010-06-16 19:51:26,063 INFO repeater task wh300_beamplots starting 0.9 seconds late 2010-06-16 19:51:28,180 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:52:08,180 INFO repeater task wh300_lastensq starting 2.2 seconds late 2010-06-16 19:52:23,056 INFO repeater task wh300_lastensq ended after 14.9 seconds 2010-06-16 19:52:23,057 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:51:56 2010-06-16 19:53:28,061 INFO repeater task wh300_beamplots starting 2.9 seconds late 2010-06-16 19:53:30,170 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:53:30,170 INFO repeater task wh300_beamplots starting 5.0 seconds late 2010-06-16 19:53:40,732 INFO repeater task wh300_beamplots ended after 10.6 seconds 2010-06-16 19:53:40,733 INFO repeater task ashtech_hcorrstats starting 15.6 seconds late 2010-06-16 19:53:48,661 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 19:54:08,660 INFO repeater task wh300_lastensq starting 2.7 seconds late 2010-06-16 19:54:23,444 INFO repeater task wh300_lastensq ended after 14.8 seconds 2010-06-16 19:54:23,445 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:53:56 2010-06-16 19:55:28,452 INFO repeater task wh300_beamplots starting 3.3 seconds late 2010-06-16 19:55:30,531 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:56:10,532 INFO repeater task wh300_lastensq starting 4.5 seconds late 2010-06-16 19:56:25,392 INFO repeater task wh300_lastensq ended after 14.9 seconds 2010-06-16 19:56:25,392 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:55:56 2010-06-16 19:57:25,442 INFO repeater task wh300_beamplots starting 0.3 seconds late 2010-06-16 19:57:27,546 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 19:58:07,548 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-06-16 19:58:22,501 INFO repeater task wh300_lastensq ended after 15.0 seconds 2010-06-16 19:58:22,501 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:57:56 2010-06-16 19:58:27,505 INFO repeater task ashtech_hcorrstats starting 2.4 seconds late 2010-06-16 19:58:35,669 INFO repeater task ashtech_hcorrstats ended after 8.2 seconds 2010-06-16 19:59:25,669 INFO repeater task wh300_beamplots starting 0.5 seconds late 2010-06-16 19:59:27,778 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:00:07,775 INFO repeater task wh300_lastensq starting 1.8 seconds late 2010-06-16 20:00:22,889 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 20:00:22,889 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 19:59:56 2010-06-16 20:01:27,900 INFO repeater task wh300_beamplots starting 2.8 seconds late 2010-06-16 20:01:29,974 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:02:09,981 INFO repeater task wh300_lastensq starting 4.0 seconds late 2010-06-16 20:02:24,394 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 20:02:24,395 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:01:56 2010-06-16 20:03:29,405 INFO repeater task wh300_beamplots starting 4.3 seconds late 2010-06-16 20:03:31,526 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:03:31,527 INFO repeater task wh300_beamplots starting 6.4 seconds late 2010-06-16 20:03:41,469 INFO repeater task wh300_beamplots ended after 9.9 seconds 2010-06-16 20:03:41,470 INFO repeater task ashtech_hcorrstats starting 16.3 seconds late 2010-06-16 20:03:49,079 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 20:04:09,076 INFO repeater task wh300_lastensq starting 3.1 seconds late 2010-06-16 20:04:22,452 INFO repeater task wh300_lastensq ended after 13.4 seconds 2010-06-16 20:04:22,452 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:03:56 2010-06-16 20:05:27,452 INFO repeater task wh300_beamplots starting 2.3 seconds late 2010-06-16 20:05:29,710 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 20:06:09,716 INFO repeater task wh300_lastensq starting 3.7 seconds late 2010-06-16 20:06:23,198 INFO repeater task wh300_lastensq ended after 13.5 seconds 2010-06-16 20:06:23,199 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:05:56 2010-06-16 20:07:28,205 INFO repeater task wh300_beamplots starting 3.1 seconds late 2010-06-16 20:07:30,509 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 20:08:10,512 INFO repeater task wh300_lastensq starting 4.5 seconds late 2010-06-16 20:08:24,126 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 20:08:24,126 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:07:56 2010-06-16 20:08:29,130 INFO repeater task ashtech_hcorrstats starting 4.0 seconds late 2010-06-16 20:08:36,683 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 20:09:26,689 INFO repeater task wh300_beamplots starting 1.6 seconds late 2010-06-16 20:09:28,785 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:10:08,784 INFO repeater task wh300_lastensq starting 2.8 seconds late 2010-06-16 20:10:22,417 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 20:10:22,417 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:09:56 2010-06-16 20:11:27,443 INFO repeater task wh300_beamplots starting 2.3 seconds late 2010-06-16 20:11:29,530 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:12:09,532 INFO repeater task wh300_lastensq starting 3.5 seconds late 2010-06-16 20:12:23,116 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 20:12:23,117 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:11:56 2010-06-16 20:13:28,132 INFO repeater task wh300_quick starting 3.0 seconds late 2010-06-16 20:13:52,812 INFO repeater task wh300_quick ended after 24.7 seconds 2010-06-16 20:13:52,812 INFO repeater task wh300_3dayplots starting 27.7 seconds late 2010-06-16 20:14:00,998 INFO repeater task wh300_3dayplots ended after 8.2 seconds 2010-06-16 20:14:00,999 INFO repeater task wh300_beamplots starting 35.9 seconds late 2010-06-16 20:14:03,115 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:14:03,116 INFO repeater task wh300_beamplots starting 38.0 seconds late 2010-06-16 20:14:13,238 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 20:14:13,239 INFO repeater task ashtech_hcorrstats starting 48.1 seconds late 2010-06-16 20:14:20,864 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 20:14:25,864 INFO repeater task wh300_lastensq starting 19.9 seconds late 2010-06-16 20:14:31,550 ERROR repeater task wh300_lastensq returncode 17 2010-06-16 20:14:31,566 INFO repeater task wh300_lastensq output: In body of run_lastensq.py Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_lastensq.py", line 207, in proc.update_gbin() File "/home/currents/programs/pycurrents/adcp/quick_subs.py", line 552, in update_gbin (runstr, output) = opts['M'].matlab(mfilename[:-2], verbose=1) File "/home/currents/programs/pycurrents/system/call_matlab.py", line 387, in matlab raise MatlabError(runstr, output) MatlabError: Executing string: clear all close all cd /home/adcp/uhdas_tmp update_wh300_gbin With output: >> >> >> getting config files from "/home/data/w1006a_moum/proc/wh300/config" running "w1006a_moum_cfg.m" running "w1006a_moum_proc.m" 97 files found about to REDO gbin file from we2010_166_64800.raw about to REDO gbin file from we2010_166_72000.raw writing errors to /home/adcp/daily_report/wh300_gbin.txt gps_rule: best comes from gpsnav heading_rule: best comes from gyro pitch_rule: best comes from ashtech roll_rule: best comes from ashtech removing adu2 from list removing adu_at2 from list removing ashpaq2 from list removing ashpaq5 from list removing csi from list removing genhdg from list removing mahrs from list removing pcode from list removing phins from list removing posmv from list removing seapath from list removing simrad from list removing sndspd from list checking gbin dirs from /home/adcp/uhdas_tmp ... last file is /home/data/w1006a_moum/raw/wh300/we2010_166_72000.raw paused for 1 seconds please be patient... processing file we2010_166_64800.raw, 1 out of 2 redo: deleting /home/data/w1006a_moum/gbin/wh300/time/we2010_166_64800.tim.gbin redo: deleting /home/data/w1006a_moum/gbin/wh300/time/we2010_166_64800.best.gbin ans = 47 deleting 0 nonmonotonic timestamps success: writing to /home/data/w1006a_moum/gbin/wh300/time/we2010_166_64800.tim.gbin deleting 0 nonmonotonic timestamps deleting 0 nonmonotonic timestamps deleting 0 nonmonotonic timestamps fixing cfg.proc_yearbase for pitch_rule (ashtech and adu) deleting 0 nonmonotonic timestamps fixing cfg.proc_yearbase for roll_rule (ashtech and adu) deleting 0 nonmonotonic timestamps deleting 0 nonmonotonic timestamps fixing cfg.proc_yearbase for gga: msg_info is: instrument = gpsnav, message = gps deleting 0 nonmonotonic timestamps fixing cfg.proc_yearbase for gga: msg_info is: instrument = ashtech, message = gps deleting 0 nonmonotonic timestamps fixing cfg.proc_yearbase for gga: msg_info is: instrument = ashtech, message = adu processing file we2010_166_72000.raw, 2 out of 2 redo: deleting /home/data/w1006a_moum/gbin/wh300/time/we2010_166_72000.tim.gbin redo: deleting /home/data/w1006a_moum/gbin/wh300/time/we2010_166_72000.best.gbin ans = 47 deleting 0 nonmonotonic timestamps success: writing to /home/data/w1006a_moum/gbin/wh300/time/we2010_166_72000.tim.gbin deleting 0 nonmonotonic timestamps MATLAB_SCRIPT_ERROR LASTERR: Error using ==> vertcat All rows in the bracketed expression must have the same number of columns. >> 2010-06-16 20:14:31,566 INFO repeater task wh300_lastensq ended after 5.7 seconds 2010-06-16 20:14:31,567 WARNING repeater Expected update of /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time did not occur, dt = -126.865 2010-06-16 20:15:26,573 INFO repeater task wh300_beamplots starting 1.4 seconds late 2010-06-16 20:15:28,661 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:16:18,660 INFO repeater task wh300_lastensq starting 2.7 seconds late 2010-06-16 20:16:34,182 INFO repeater task wh300_lastensq ended after 15.5 seconds 2010-06-16 20:16:34,182 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:15:57 2010-06-16 20:17:29,185 INFO repeater task wh300_beamplots starting 4.1 seconds late 2010-06-16 20:17:31,475 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 20:18:11,476 INFO repeater task wh300_lastensq starting 4.5 seconds late 2010-06-16 20:18:25,095 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 20:18:25,095 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:17:57 2010-06-16 20:18:30,098 INFO repeater task ashtech_hcorrstats starting 5.0 seconds late 2010-06-16 20:18:37,770 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 20:19:27,769 INFO repeater task wh300_beamplots starting 2.6 seconds late 2010-06-16 20:19:29,884 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:20:09,884 INFO repeater task wh300_lastensq starting 2.9 seconds late 2010-06-16 20:20:23,742 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 20:20:23,743 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:19:57 2010-06-16 20:21:28,745 INFO repeater task wh300_beamplots starting 3.6 seconds late 2010-06-16 20:21:30,828 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:22:10,827 INFO repeater task wh300_lastensq starting 3.8 seconds late 2010-06-16 20:22:24,591 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 20:22:24,592 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:21:57 2010-06-16 20:23:29,608 INFO repeater task wh300_beamplots starting 4.5 seconds late 2010-06-16 20:23:31,699 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:23:31,699 INFO repeater task wh300_beamplots starting 6.6 seconds late 2010-06-16 20:23:41,660 INFO repeater task wh300_beamplots ended after 10.0 seconds 2010-06-16 20:23:41,662 INFO repeater task ashtech_hcorrstats starting 16.5 seconds late 2010-06-16 20:23:49,103 INFO repeater task ashtech_hcorrstats ended after 7.4 seconds 2010-06-16 20:24:09,099 INFO repeater task wh300_lastensq starting 2.1 seconds late 2010-06-16 20:24:23,088 INFO repeater task wh300_lastensq ended after 14.0 seconds 2010-06-16 20:24:23,089 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:23:57 2010-06-16 20:25:28,092 INFO repeater task wh300_beamplots starting 3.0 seconds late 2010-06-16 20:25:30,196 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:26:10,200 INFO repeater task wh300_lastensq starting 3.2 seconds late 2010-06-16 20:26:24,082 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 20:26:24,082 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:25:57 2010-06-16 20:27:29,088 INFO repeater task wh300_beamplots starting 4.0 seconds late 2010-06-16 20:27:31,172 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:28:11,172 INFO repeater task wh300_lastensq starting 4.2 seconds late 2010-06-16 20:28:25,108 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 20:28:25,109 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:27:57 2010-06-16 20:28:30,113 INFO repeater task ashtech_hcorrstats starting 5.0 seconds late 2010-06-16 20:28:37,762 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 20:29:27,769 INFO repeater task wh300_beamplots starting 2.6 seconds late 2010-06-16 20:29:29,934 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 20:30:09,931 INFO repeater task wh300_lastensq starting 2.9 seconds late 2010-06-16 20:30:23,743 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 20:30:23,744 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:29:57 2010-06-16 20:31:28,746 INFO repeater task wh300_beamplots starting 3.6 seconds late 2010-06-16 20:31:30,978 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 20:32:10,979 INFO repeater task wh300_lastensq starting 4.0 seconds late 2010-06-16 20:32:24,861 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 20:32:24,861 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:31:57 2010-06-16 20:33:29,865 INFO repeater task wh300_beamplots starting 4.7 seconds late 2010-06-16 20:33:32,093 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 20:33:32,094 INFO repeater task wh300_beamplots starting 7.0 seconds late 2010-06-16 20:33:42,104 INFO repeater task wh300_beamplots ended after 10.0 seconds 2010-06-16 20:33:42,105 INFO repeater task ashtech_hcorrstats starting 17.0 seconds late 2010-06-16 20:33:49,492 INFO repeater task ashtech_hcorrstats ended after 7.4 seconds 2010-06-16 20:34:09,492 INFO repeater task wh300_lastensq starting 2.5 seconds late 2010-06-16 20:34:23,397 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 20:34:23,398 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:33:57 2010-06-16 20:35:28,405 INFO repeater task wh300_beamplots starting 3.3 seconds late 2010-06-16 20:35:30,490 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:36:10,492 INFO repeater task wh300_lastensq starting 3.5 seconds late 2010-06-16 20:36:24,785 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 20:36:24,786 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:35:57 2010-06-16 20:37:29,789 INFO repeater task wh300_beamplots starting 4.7 seconds late 2010-06-16 20:37:31,992 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 20:38:11,997 INFO repeater task wh300_lastensq starting 5.0 seconds late 2010-06-16 20:38:27,071 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 20:38:27,071 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:37:57 2010-06-16 20:38:27,073 INFO repeater task ashtech_hcorrstats starting 1.9 seconds late 2010-06-16 20:38:34,957 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 20:39:29,957 INFO repeater task wh300_beamplots starting 4.8 seconds late 2010-06-16 20:39:32,082 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:40:07,084 INFO repeater task wh300_lastensq starting 0.1 seconds late 2010-06-16 20:40:24,239 INFO repeater task wh300_lastensq ended after 17.2 seconds 2010-06-16 20:40:24,240 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:39:57 2010-06-16 20:41:25,785 INFO repeater task wh300_beamplots starting 0.7 seconds late 2010-06-16 20:41:28,016 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 20:42:08,024 INFO repeater task wh300_lastensq starting 1.0 seconds late 2010-06-16 20:42:24,883 INFO repeater task wh300_lastensq ended after 16.9 seconds 2010-06-16 20:42:24,884 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:41:57 2010-06-16 20:43:29,888 INFO repeater task wh300_quick starting 4.8 seconds late 2010-06-16 20:43:56,366 INFO repeater task wh300_quick ended after 26.5 seconds 2010-06-16 20:43:56,367 INFO repeater task wh300_3dayplots starting 31.2 seconds late 2010-06-16 20:44:04,864 INFO repeater task wh300_3dayplots ended after 8.5 seconds 2010-06-16 20:44:04,864 INFO repeater task wh300_beamplots starting 39.7 seconds late 2010-06-16 20:44:07,268 INFO repeater task wh300_beamplots ended after 2.4 seconds 2010-06-16 20:44:07,268 INFO repeater task wh300_beamplots starting 42.1 seconds late 2010-06-16 20:44:17,191 INFO repeater task wh300_beamplots ended after 9.9 seconds 2010-06-16 20:44:17,192 INFO repeater task wh300_beamhistory starting 52.1 seconds late 2010-06-16 20:47:10,676 INFO repeater task wh300_beamhistory output: saving file to wh300_bin_history.png 2010-06-16 20:47:10,686 INFO repeater task wh300_beamhistory ended after 173.5 seconds 2010-06-16 20:47:10,687 INFO repeater task ashtech_hcorrstats starting 225.6 seconds late 2010-06-16 20:47:43,004 INFO repeater task ashtech_hcorrstats ended after 32.3 seconds 2010-06-16 20:47:48,006 INFO repeater task wh300_lastensq starting 221.0 seconds late 2010-06-16 20:48:05,910 INFO repeater task wh300_lastensq ended after 17.9 seconds 2010-06-16 20:48:05,910 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:45:58 2010-06-16 20:48:05,912 INFO repeater task wh300_beamplots starting 160.8 seconds late 2010-06-16 20:48:08,022 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:48:08,023 INFO repeater Extra increment added to time_to_run 2010-06-16 20:48:13,023 INFO repeater task wh300_lastensq starting 5.0 seconds late 2010-06-16 20:48:27,324 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 20:48:27,329 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:47:58 2010-06-16 20:48:27,332 INFO repeater task ashtech_hcorrstats starting 2.2 seconds late 2010-06-16 20:48:34,873 INFO repeater task ashtech_hcorrstats ended after 7.5 seconds 2010-06-16 20:49:29,877 INFO repeater task wh300_beamplots starting 4.7 seconds late 2010-06-16 20:49:32,156 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 20:50:12,156 INFO repeater task wh300_lastensq starting 4.2 seconds late 2010-06-16 20:50:26,218 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 20:50:26,218 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:49:58 2010-06-16 20:51:26,221 INFO repeater task wh300_beamplots starting 1.1 seconds late 2010-06-16 20:51:28,554 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 20:52:08,552 INFO repeater task wh300_lastensq starting 0.6 seconds late 2010-06-16 20:52:22,678 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 20:52:22,679 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:51:58 2010-06-16 20:53:27,693 INFO repeater task wh300_beamplots starting 2.6 seconds late 2010-06-16 20:53:30,003 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 20:53:30,003 INFO repeater task wh300_beamplots starting 4.9 seconds late 2010-06-16 20:53:40,128 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 20:53:40,129 INFO repeater task ashtech_hcorrstats starting 15.0 seconds late 2010-06-16 20:53:47,720 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 20:54:12,724 INFO repeater task wh300_lastensq starting 4.7 seconds late 2010-06-16 20:54:27,055 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 20:54:27,055 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:53:58 2010-06-16 20:55:27,064 INFO repeater task wh300_beamplots starting 1.9 seconds late 2010-06-16 20:55:29,134 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 20:56:09,136 INFO repeater task wh300_lastensq starting 1.1 seconds late 2010-06-16 20:56:23,436 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 20:56:23,437 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:55:58 2010-06-16 20:57:28,449 INFO repeater task wh300_beamplots starting 3.3 seconds late 2010-06-16 20:57:30,606 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 20:58:10,612 INFO repeater task wh300_lastensq starting 2.6 seconds late 2010-06-16 20:58:24,889 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 20:58:24,889 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:57:58 2010-06-16 20:58:29,898 INFO repeater task ashtech_hcorrstats starting 4.8 seconds late 2010-06-16 20:58:37,649 INFO repeater task ashtech_hcorrstats ended after 7.8 seconds 2010-06-16 20:59:27,650 INFO repeater task wh300_beamplots starting 2.5 seconds late 2010-06-16 20:59:29,776 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:00:09,775 INFO repeater task wh300_lastensq starting 1.8 seconds late 2010-06-16 21:00:24,134 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 21:00:24,134 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 20:59:58 2010-06-16 21:01:29,138 INFO repeater task wh300_beamplots starting 4.0 seconds late 2010-06-16 21:01:31,222 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:02:11,224 INFO repeater task wh300_lastensq starting 3.2 seconds late 2010-06-16 21:02:25,681 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 21:02:25,682 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:01:58 2010-06-16 21:03:25,684 INFO repeater task wh300_beamplots starting 0.6 seconds late 2010-06-16 21:03:27,778 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:03:27,779 INFO repeater task wh300_beamplots starting 2.6 seconds late 2010-06-16 21:03:37,711 INFO repeater task wh300_beamplots ended after 9.9 seconds 2010-06-16 21:03:37,712 INFO repeater task ashtech_hcorrstats starting 12.6 seconds late 2010-06-16 21:03:45,650 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 21:04:10,648 INFO repeater task wh300_lastensq starting 2.6 seconds late 2010-06-16 21:04:25,140 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 21:04:25,141 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:03:58 2010-06-16 21:05:25,153 INFO repeater task wh300_beamplots starting 0.0 seconds late 2010-06-16 21:05:27,467 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:06:12,474 INFO repeater task wh300_lastensq starting 4.5 seconds late 2010-06-16 21:06:26,800 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 21:06:26,801 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:05:58 2010-06-16 21:07:26,800 INFO repeater task wh300_beamplots starting 1.7 seconds late 2010-06-16 21:07:28,892 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:08:08,891 INFO repeater task wh300_lastensq starting 0.9 seconds late 2010-06-16 21:08:23,100 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 21:08:23,101 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:07:58 2010-06-16 21:08:28,105 INFO repeater task ashtech_hcorrstats starting 3.0 seconds late 2010-06-16 21:08:35,807 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 21:09:25,808 INFO repeater task wh300_beamplots starting 0.7 seconds late 2010-06-16 21:09:28,103 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:10:08,103 INFO repeater task wh300_lastensq starting 0.1 seconds late 2010-06-16 21:10:22,406 INFO repeater task wh300_lastensq ended after 14.3 seconds 2010-06-16 21:10:22,407 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:09:58 2010-06-16 21:11:27,421 INFO repeater task wh300_beamplots starting 2.3 seconds late 2010-06-16 21:11:29,712 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:12:09,711 INFO repeater task wh300_lastensq starting 1.7 seconds late 2010-06-16 21:12:24,211 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 21:12:24,212 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:11:58 2010-06-16 21:13:29,213 INFO repeater task wh300_quick starting 4.1 seconds late 2010-06-16 21:13:57,055 INFO repeater task wh300_quick ended after 27.8 seconds 2010-06-16 21:13:57,056 INFO repeater task wh300_3dayplots starting 31.9 seconds late 2010-06-16 21:14:05,394 INFO repeater task wh300_3dayplots ended after 8.3 seconds 2010-06-16 21:14:05,395 INFO repeater task wh300_beamplots starting 40.3 seconds late 2010-06-16 21:14:07,646 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:14:07,647 INFO repeater task wh300_beamplots starting 42.5 seconds late 2010-06-16 21:14:17,744 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 21:14:17,745 INFO repeater task ashtech_hcorrstats starting 52.6 seconds late 2010-06-16 21:14:25,452 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 21:14:30,451 INFO repeater task wh300_lastensq starting 22.5 seconds late 2010-06-16 21:14:45,099 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 21:14:45,100 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:13:58 2010-06-16 21:15:30,105 INFO repeater task wh300_beamplots starting 5.0 seconds late 2010-06-16 21:15:32,372 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:16:12,371 INFO repeater task wh300_lastensq starting 4.4 seconds late 2010-06-16 21:16:26,734 INFO repeater task wh300_lastensq ended after 14.4 seconds 2010-06-16 21:16:26,734 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:15:59 2010-06-16 21:17:26,737 INFO repeater task wh300_beamplots starting 1.6 seconds late 2010-06-16 21:17:29,010 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:18:09,012 INFO repeater task wh300_lastensq starting 0.0 seconds late 2010-06-16 21:18:23,532 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 21:18:23,533 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:17:59 2010-06-16 21:18:28,534 INFO repeater task ashtech_hcorrstats starting 3.4 seconds late 2010-06-16 21:18:36,122 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 21:19:26,121 INFO repeater task wh300_beamplots starting 1.0 seconds late 2010-06-16 21:19:28,252 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:20:13,252 INFO repeater task wh300_lastensq starting 4.3 seconds late 2010-06-16 21:20:27,794 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 21:20:27,795 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:19:59 2010-06-16 21:21:27,805 INFO repeater task wh300_beamplots starting 2.7 seconds late 2010-06-16 21:21:30,055 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 21:22:10,056 INFO repeater task wh300_lastensq starting 1.1 seconds late 2010-06-16 21:22:24,546 INFO repeater task wh300_lastensq ended after 14.5 seconds 2010-06-16 21:22:24,547 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:21:59 2010-06-16 21:23:29,548 INFO repeater task wh300_beamplots starting 4.4 seconds late 2010-06-16 21:23:31,843 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:23:31,844 INFO repeater task wh300_beamplots starting 6.7 seconds late 2010-06-16 21:23:42,255 INFO repeater task wh300_beamplots ended after 10.4 seconds 2010-06-16 21:23:42,256 INFO repeater task ashtech_hcorrstats starting 17.1 seconds late 2010-06-16 21:23:50,022 INFO repeater task ashtech_hcorrstats ended after 7.8 seconds 2010-06-16 21:24:10,023 INFO repeater task wh300_lastensq starting 1.0 seconds late 2010-06-16 21:24:24,577 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 21:24:24,578 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:23:59 2010-06-16 21:25:29,581 INFO repeater task wh300_beamplots starting 4.5 seconds late 2010-06-16 21:25:31,717 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:26:11,716 INFO repeater task wh300_lastensq starting 2.7 seconds late 2010-06-16 21:26:26,277 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 21:26:26,278 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:25:59 2010-06-16 21:27:26,281 INFO repeater task wh300_beamplots starting 1.2 seconds late 2010-06-16 21:27:28,494 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 21:28:13,504 INFO repeater task wh300_lastensq starting 4.5 seconds late 2010-06-16 21:28:28,152 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 21:28:28,153 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:27:59 2010-06-16 21:28:28,155 INFO repeater task ashtech_hcorrstats starting 3.0 seconds late 2010-06-16 21:28:36,109 INFO repeater task ashtech_hcorrstats ended after 8.0 seconds 2010-06-16 21:29:26,109 INFO repeater task wh300_beamplots starting 1.0 seconds late 2010-06-16 21:29:28,206 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:30:13,208 INFO repeater task wh300_lastensq starting 4.2 seconds late 2010-06-16 21:30:27,985 INFO repeater task wh300_lastensq ended after 14.8 seconds 2010-06-16 21:30:27,986 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:29:59 2010-06-16 21:31:27,989 INFO repeater task wh300_beamplots starting 2.9 seconds late 2010-06-16 21:31:30,135 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:32:10,136 INFO repeater task wh300_lastensq starting 1.1 seconds late 2010-06-16 21:32:24,903 INFO repeater task wh300_lastensq ended after 14.8 seconds 2010-06-16 21:32:24,904 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:31:59 2010-06-16 21:33:29,917 INFO repeater task wh300_beamplots starting 4.8 seconds late 2010-06-16 21:33:32,098 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 21:33:32,099 INFO repeater task wh300_beamplots starting 7.0 seconds late 2010-06-16 21:33:41,945 INFO repeater task wh300_beamplots ended after 9.8 seconds 2010-06-16 21:33:41,946 INFO repeater task ashtech_hcorrstats starting 16.8 seconds late 2010-06-16 21:33:49,853 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 21:34:09,855 INFO repeater task wh300_lastensq starting 0.9 seconds late 2010-06-16 21:34:24,454 INFO repeater task wh300_lastensq ended after 14.6 seconds 2010-06-16 21:34:24,455 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:33:59 2010-06-16 21:35:29,457 INFO repeater task wh300_beamplots starting 4.3 seconds late 2010-06-16 21:35:31,594 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:36:11,600 INFO repeater task wh300_lastensq starting 2.6 seconds late 2010-06-16 21:36:26,676 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 21:36:26,677 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:35:59 2010-06-16 21:37:26,677 INFO repeater task wh300_beamplots starting 1.5 seconds late 2010-06-16 21:37:28,767 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:38:13,769 INFO repeater task wh300_lastensq starting 4.8 seconds late 2010-06-16 21:38:28,757 INFO repeater task wh300_lastensq ended after 15.0 seconds 2010-06-16 21:38:28,758 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:37:59 2010-06-16 21:38:28,760 INFO repeater task ashtech_hcorrstats starting 3.6 seconds late 2010-06-16 21:38:36,642 INFO repeater task ashtech_hcorrstats ended after 7.9 seconds 2010-06-16 21:39:26,645 INFO repeater task wh300_beamplots starting 1.5 seconds late 2010-06-16 21:39:28,782 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:40:13,780 INFO repeater task wh300_lastensq starting 4.8 seconds late 2010-06-16 21:40:28,671 INFO repeater task wh300_lastensq ended after 14.9 seconds 2010-06-16 21:40:28,671 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:39:59 2010-06-16 21:41:28,673 INFO repeater task wh300_beamplots starting 3.5 seconds late 2010-06-16 21:41:30,795 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:42:10,804 INFO repeater task wh300_lastensq starting 1.8 seconds late 2010-06-16 21:42:25,787 INFO repeater task wh300_lastensq ended after 15.0 seconds 2010-06-16 21:42:25,788 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:41:59 2010-06-16 21:43:25,789 INFO repeater task wh300_quick starting 0.7 seconds late 2010-06-16 21:43:50,854 INFO repeater task wh300_quick ended after 25.1 seconds 2010-06-16 21:43:50,855 INFO repeater task wh300_3dayplots starting 25.7 seconds late 2010-06-16 21:43:59,787 INFO repeater task wh300_3dayplots ended after 8.9 seconds 2010-06-16 21:43:59,788 INFO repeater task wh300_beamplots starting 34.7 seconds late 2010-06-16 21:44:01,927 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:44:01,928 INFO repeater task wh300_beamplots starting 36.8 seconds late 2010-06-16 21:44:12,133 INFO repeater task wh300_beamplots ended after 10.2 seconds 2010-06-16 21:44:12,134 INFO repeater task wh300_beamhistory starting 47.0 seconds late 2010-06-16 21:47:06,579 INFO repeater task wh300_beamhistory output: saving file to wh300_bin_history.png 2010-06-16 21:47:06,586 INFO repeater task wh300_beamhistory ended after 174.5 seconds 2010-06-16 21:47:06,587 INFO repeater task ashtech_hcorrstats starting 221.5 seconds late 2010-06-16 21:47:39,715 INFO repeater task ashtech_hcorrstats ended after 33.1 seconds 2010-06-16 21:47:44,712 INFO repeater task wh300_lastensq starting 215.7 seconds late 2010-06-16 21:48:02,115 INFO repeater task wh300_lastensq ended after 17.4 seconds 2010-06-16 21:48:02,116 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:45:59 2010-06-16 21:48:02,117 INFO repeater task wh300_beamplots starting 157.0 seconds late 2010-06-16 21:48:04,232 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:48:04,233 INFO repeater Extra increment added to time_to_run 2010-06-16 21:48:09,233 INFO repeater task wh300_lastensq starting 0.2 seconds late 2010-06-16 21:48:24,058 INFO repeater task wh300_lastensq ended after 14.8 seconds 2010-06-16 21:48:24,059 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:48:00 2010-06-16 21:48:29,062 INFO repeater task ashtech_hcorrstats starting 3.9 seconds late 2010-06-16 21:48:36,751 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 21:49:26,757 INFO repeater task wh300_beamplots starting 1.6 seconds late 2010-06-16 21:49:29,061 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 21:50:14,064 INFO repeater task wh300_lastensq starting 4.1 seconds late 2010-06-16 21:50:29,135 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 21:50:29,136 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:50:00 2010-06-16 21:51:29,137 INFO repeater task wh300_beamplots starting 4.0 seconds late 2010-06-16 21:51:31,254 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:52:11,252 INFO repeater task wh300_lastensq starting 1.3 seconds late 2010-06-16 21:52:26,459 INFO repeater task wh300_lastensq ended after 15.2 seconds 2010-06-16 21:52:26,460 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:52:00 2010-06-16 21:53:26,461 INFO repeater task wh300_beamplots starting 1.3 seconds late 2010-06-16 21:53:28,590 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:53:28,591 INFO repeater task wh300_beamplots starting 3.5 seconds late 2010-06-16 21:53:38,527 INFO repeater task wh300_beamplots ended after 9.9 seconds 2010-06-16 21:53:38,528 INFO repeater task ashtech_hcorrstats starting 13.4 seconds late 2010-06-16 21:53:46,548 INFO repeater task ashtech_hcorrstats ended after 8.0 seconds 2010-06-16 21:54:11,549 INFO repeater task wh300_lastensq starting 1.5 seconds late 2010-06-16 21:54:26,640 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 21:54:26,641 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:54:00 2010-06-16 21:55:26,641 INFO repeater task wh300_beamplots starting 1.5 seconds late 2010-06-16 21:55:28,763 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:56:13,764 INFO repeater task wh300_lastensq starting 3.8 seconds late 2010-06-16 21:56:28,655 INFO repeater task wh300_lastensq ended after 14.9 seconds 2010-06-16 21:56:28,656 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:56:00 2010-06-16 21:57:28,657 INFO repeater task wh300_beamplots starting 3.5 seconds late 2010-06-16 21:57:30,757 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 21:58:10,760 INFO repeater task wh300_lastensq starting 0.8 seconds late 2010-06-16 21:58:25,873 INFO repeater task wh300_lastensq ended after 15.1 seconds 2010-06-16 21:58:25,874 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:58:00 2010-06-16 21:58:25,876 INFO repeater task ashtech_hcorrstats starting 0.7 seconds late 2010-06-16 21:58:34,021 INFO repeater task ashtech_hcorrstats ended after 8.1 seconds 2010-06-16 21:59:29,201 INFO repeater task wh300_beamplots starting 4.1 seconds late 2010-06-16 21:59:31,342 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:00:11,365 INFO repeater task wh300_lastensq starting 1.4 seconds late 2010-06-16 22:00:26,948 INFO repeater task wh300_lastensq ended after 15.6 seconds 2010-06-16 22:00:26,949 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 21:59:59 2010-06-16 22:01:26,949 INFO repeater task wh300_beamplots starting 1.8 seconds late 2010-06-16 22:01:29,036 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:02:09,035 INFO repeater task wh300_lastensq starting 0.0 seconds late 2010-06-16 22:02:22,781 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 22:02:22,782 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:02:00 2010-06-16 22:03:27,785 INFO repeater task wh300_beamplots starting 2.7 seconds late 2010-06-16 22:03:29,918 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:03:29,919 INFO repeater task wh300_beamplots starting 4.8 seconds late 2010-06-16 22:03:40,032 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 22:03:40,034 INFO repeater task ashtech_hcorrstats starting 14.9 seconds late 2010-06-16 22:03:47,599 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 22:04:12,600 INFO repeater task wh300_lastensq starting 2.6 seconds late 2010-06-16 22:04:25,993 INFO repeater task wh300_lastensq ended after 13.4 seconds 2010-06-16 22:04:25,993 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:04:00 2010-06-16 22:05:26,000 INFO repeater task wh300_beamplots starting 0.9 seconds late 2010-06-16 22:05:28,284 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:06:13,283 INFO repeater task wh300_lastensq starting 3.3 seconds late 2010-06-16 22:06:26,700 INFO repeater task wh300_lastensq ended after 13.4 seconds 2010-06-16 22:06:26,700 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:06:00 2010-06-16 22:07:26,705 INFO repeater task wh300_beamplots starting 1.6 seconds late 2010-06-16 22:07:29,004 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:08:14,004 INFO repeater task wh300_lastensq starting 4.0 seconds late 2010-06-16 22:08:27,506 INFO repeater task wh300_lastensq ended after 13.5 seconds 2010-06-16 22:08:27,507 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:08:00 2010-06-16 22:08:27,509 INFO repeater task ashtech_hcorrstats starting 2.4 seconds late 2010-06-16 22:08:35,083 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 22:09:30,092 INFO repeater task wh300_beamplots starting 5.0 seconds late 2010-06-16 22:09:32,210 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:10:12,212 INFO repeater task wh300_lastensq starting 2.2 seconds late 2010-06-16 22:10:25,826 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 22:10:25,827 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:10:00 2010-06-16 22:11:25,831 INFO repeater task wh300_beamplots starting 0.7 seconds late 2010-06-16 22:11:27,914 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:12:12,919 INFO repeater task wh300_lastensq starting 2.9 seconds late 2010-06-16 22:12:26,517 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 22:12:26,518 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:12:00 2010-06-16 22:13:26,521 INFO repeater task wh300_quick starting 1.4 seconds late 2010-06-16 22:13:51,343 INFO repeater task wh300_quick ended after 24.8 seconds 2010-06-16 22:13:51,344 INFO repeater task wh300_3dayplots starting 26.2 seconds late 2010-06-16 22:13:59,710 INFO repeater task wh300_3dayplots ended after 8.4 seconds 2010-06-16 22:13:59,710 INFO repeater task wh300_beamplots starting 34.6 seconds late 2010-06-16 22:14:01,822 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:14:01,824 INFO repeater task wh300_beamplots starting 36.7 seconds late 2010-06-16 22:14:11,749 INFO repeater task wh300_beamplots ended after 9.9 seconds 2010-06-16 22:14:11,750 INFO repeater task ashtech_hcorrstats starting 46.6 seconds late 2010-06-16 22:14:19,344 INFO repeater task ashtech_hcorrstats ended after 7.6 seconds 2010-06-16 22:14:24,344 INFO repeater task wh300_lastensq starting 14.3 seconds late 2010-06-16 22:14:37,937 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 22:14:37,938 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:14:00 2010-06-16 22:15:27,945 INFO repeater task wh300_beamplots starting 2.8 seconds late 2010-06-16 22:15:30,106 INFO repeater task wh300_beamplots ended after 2.2 seconds 2010-06-16 22:16:10,108 INFO repeater task wh300_lastensq starting 0.1 seconds late 2010-06-16 22:16:23,700 INFO repeater task wh300_lastensq ended after 13.6 seconds 2010-06-16 22:16:23,701 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:16:00 2010-06-16 22:17:28,726 INFO repeater task wh300_beamplots starting 3.6 seconds late 2010-06-16 22:17:31,031 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:18:11,031 INFO repeater task wh300_lastensq starting 1.0 seconds late 2010-06-16 22:18:24,846 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 22:18:24,847 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:18:00 2010-06-16 22:18:29,850 INFO repeater task ashtech_hcorrstats starting 4.7 seconds late 2010-06-16 22:18:37,257 INFO repeater task ashtech_hcorrstats ended after 7.4 seconds 2010-06-16 22:19:27,257 INFO repeater task wh300_beamplots starting 2.1 seconds late 2010-06-16 22:19:29,384 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:20:14,388 INFO repeater task wh300_lastensq starting 4.4 seconds late 2010-06-16 22:20:28,141 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 22:20:28,142 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:20:01 2010-06-16 22:21:28,149 INFO repeater task wh300_beamplots starting 3.0 seconds late 2010-06-16 22:21:30,280 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:22:15,280 INFO repeater task wh300_lastensq starting 4.3 seconds late 2010-06-16 22:22:29,124 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 22:22:29,125 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:22:01 2010-06-16 22:23:29,125 INFO repeater task wh300_beamplots starting 4.0 seconds late 2010-06-16 22:23:31,258 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:23:31,259 INFO repeater task wh300_beamplots starting 6.1 seconds late 2010-06-16 22:23:41,383 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 22:23:41,384 INFO repeater task ashtech_hcorrstats starting 16.2 seconds late 2010-06-16 22:23:49,131 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 22:24:14,127 INFO repeater task wh300_lastensq starting 3.1 seconds late 2010-06-16 22:24:27,842 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 22:24:27,842 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:24:01 2010-06-16 22:25:27,849 INFO repeater task wh300_beamplots starting 2.7 seconds late 2010-06-16 22:25:30,149 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:26:15,147 INFO repeater task wh300_lastensq starting 4.1 seconds late 2010-06-16 22:26:28,840 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 22:26:28,840 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:26:01 2010-06-16 22:27:28,840 INFO repeater task wh300_beamplots starting 3.7 seconds late 2010-06-16 22:27:31,105 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:28:11,108 INFO repeater task wh300_lastensq starting 0.1 seconds late 2010-06-16 22:28:24,809 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 22:28:24,810 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:28:01 2010-06-16 22:28:29,815 INFO repeater task ashtech_hcorrstats starting 4.7 seconds late 2010-06-16 22:28:37,533 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 22:29:27,533 INFO repeater task wh300_beamplots starting 2.4 seconds late 2010-06-16 22:29:29,657 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:30:14,656 INFO repeater task wh300_lastensq starting 3.7 seconds late 2010-06-16 22:30:28,581 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 22:30:28,582 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:30:01 2010-06-16 22:31:28,606 INFO repeater task wh300_beamplots starting 3.5 seconds late 2010-06-16 22:31:30,725 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:32:15,728 INFO repeater task wh300_lastensq starting 4.7 seconds late 2010-06-16 22:32:29,738 INFO repeater task wh300_lastensq ended after 14.0 seconds 2010-06-16 22:32:29,739 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:32:01 2010-06-16 22:33:29,745 INFO repeater task wh300_beamplots starting 4.6 seconds late 2010-06-16 22:33:31,819 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:33:31,820 INFO repeater task wh300_beamplots starting 6.7 seconds late 2010-06-16 22:33:41,847 INFO repeater task wh300_beamplots ended after 10.0 seconds 2010-06-16 22:33:41,848 INFO repeater task ashtech_hcorrstats starting 16.7 seconds late 2010-06-16 22:33:49,599 INFO repeater task ashtech_hcorrstats ended after 7.8 seconds 2010-06-16 22:34:14,602 INFO repeater task wh300_lastensq starting 3.6 seconds late 2010-06-16 22:34:28,358 INFO repeater task wh300_lastensq ended after 13.8 seconds 2010-06-16 22:34:28,359 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:34:01 2010-06-16 22:35:28,365 INFO repeater task wh300_beamplots starting 3.2 seconds late 2010-06-16 22:35:30,620 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:36:15,620 INFO repeater task wh300_lastensq starting 4.6 seconds late 2010-06-16 22:36:29,291 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 22:36:29,291 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:36:01 2010-06-16 22:37:29,293 INFO repeater task wh300_beamplots starting 4.2 seconds late 2010-06-16 22:37:31,628 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:38:11,628 INFO repeater task wh300_lastensq starting 0.6 seconds late 2010-06-16 22:38:25,362 INFO repeater task wh300_lastensq ended after 13.7 seconds 2010-06-16 22:38:25,362 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:38:01 2010-06-16 22:38:25,365 INFO repeater task ashtech_hcorrstats starting 0.2 seconds late 2010-06-16 22:38:33,096 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 22:39:28,096 INFO repeater task wh300_beamplots starting 3.0 seconds late 2010-06-16 22:39:30,179 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:40:15,179 INFO repeater task wh300_lastensq starting 4.2 seconds late 2010-06-16 22:40:29,271 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 22:40:29,272 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:40:01 2010-06-16 22:41:29,272 INFO repeater task wh300_beamplots starting 4.1 seconds late 2010-06-16 22:41:31,356 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:42:11,360 INFO repeater task wh300_lastensq starting 0.4 seconds late 2010-06-16 22:42:25,561 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 22:42:25,562 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:42:01 2010-06-16 22:43:25,565 INFO repeater task wh300_quick starting 0.4 seconds late 2010-06-16 22:43:49,610 INFO repeater task wh300_quick ended after 24.0 seconds 2010-06-16 22:43:49,611 INFO repeater task wh300_3dayplots starting 24.5 seconds late 2010-06-16 22:43:57,698 INFO repeater task wh300_3dayplots ended after 8.1 seconds 2010-06-16 22:43:57,699 INFO repeater task wh300_beamplots starting 32.6 seconds late 2010-06-16 22:43:59,989 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:43:59,992 INFO repeater task wh300_beamplots starting 34.9 seconds late 2010-06-16 22:44:10,110 INFO repeater task wh300_beamplots ended after 10.1 seconds 2010-06-16 22:44:10,111 INFO repeater task wh300_beamhistory starting 45.0 seconds late 2010-06-16 22:46:59,752 INFO repeater task wh300_beamhistory output: saving file to wh300_bin_history.png 2010-06-16 22:46:59,770 INFO repeater task wh300_beamhistory ended after 169.7 seconds 2010-06-16 22:46:59,770 INFO repeater task ashtech_hcorrstats starting 214.6 seconds late 2010-06-16 22:47:33,361 INFO repeater task ashtech_hcorrstats ended after 33.6 seconds 2010-06-16 22:47:38,360 INFO repeater task wh300_lastensq starting 207.4 seconds late 2010-06-16 22:47:56,913 INFO repeater task wh300_lastensq ended after 18.6 seconds 2010-06-16 22:47:56,913 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:46:01 2010-06-16 22:47:56,914 INFO repeater task wh300_beamplots starting 151.8 seconds late 2010-06-16 22:47:59,196 INFO repeater task wh300_beamplots ended after 2.3 seconds 2010-06-16 22:47:59,196 INFO repeater Extra increment added to time_to_run 2010-06-16 22:48:14,196 INFO repeater task wh300_lastensq starting 3.2 seconds late 2010-06-16 22:48:28,123 INFO repeater task wh300_lastensq ended after 13.9 seconds 2010-06-16 22:48:28,124 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:48:01 2010-06-16 22:48:28,130 INFO repeater task ashtech_hcorrstats starting 3.0 seconds late 2010-06-16 22:48:35,837 INFO repeater task ashtech_hcorrstats ended after 7.7 seconds 2010-06-16 22:49:25,836 INFO repeater task wh300_beamplots starting 0.7 seconds late 2010-06-16 22:49:27,938 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:50:12,940 INFO repeater task wh300_lastensq starting 1.9 seconds late 2010-06-16 22:50:27,052 INFO repeater task wh300_lastensq ended after 14.1 seconds 2010-06-16 22:50:27,053 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:50:02 2010-06-16 22:51:27,060 INFO repeater task wh300_beamplots starting 1.9 seconds late 2010-06-16 22:51:29,117 INFO repeater task wh300_beamplots ended after 2.1 seconds 2010-06-16 22:52:14,127 INFO repeater task wh300_lastensq starting 2.1 seconds late 2010-06-16 22:52:28,322 INFO repeater task wh300_lastensq ended after 14.2 seconds 2010-06-16 22:52:28,323 INFO repeater Time from /home/data/w1006a_moum/proc/wh300/load/wrote_ens_time: 2010/06/16 22:52:02 2010-06-16 22:53:28,337 INFO repeater task wh300_beamplots starting 3.2 seconds late