2013-11-25 00:58:12,495 INFO     repeater     task nb150_3dayplots starting 13.5 seconds late
2013-11-25 00:58:22,187 INFO     repeater     task nb150_3dayplots ended after 9.7 seconds
2013-11-25 00:58:22,188 INFO     repeater     task os75nb_lastensq starting 14.2 seconds late
2013-11-25 00:58:23,334 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 00:58:23,335 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 00:57:58
2013-11-25 00:58:23,335 INFO     repeater     task os75nb_quick starting 24.4 seconds late
2013-11-25 00:58:31,907 INFO     repeater     task os75nb_quick ended after 8.6 seconds
2013-11-25 00:58:31,908 INFO     repeater     task os75nb_3dayplots starting 32.9 seconds late
2013-11-25 00:58:42,283 INFO     repeater     task os75nb_3dayplots ended after 10.4 seconds
2013-11-25 00:58:42,283 INFO     repeater     task ashtech_hcorrstats starting 43.3 seconds late
2013-11-25 00:58:43,211 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 00:58:43,211 INFO     repeater     task phins3_hcorrstats starting 44.2 seconds late
2013-11-25 00:58:44,142 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 00:58:49,144 INFO     repeater     task nb150_lastensq starting 42.1 seconds late
2013-11-25 00:58:51,455 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 00:58:51,455 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 00:57:57
2013-11-25 01:01:11,628 INFO     repeater     task nb150_lastensq starting 4.6 seconds late
2013-11-25 01:01:13,989 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:01:13,990 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:00:57
2013-11-25 01:01:13,991 INFO     repeater     task os75nb_lastensq starting 6.0 seconds late
2013-11-25 01:01:15,254 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-25 01:01:15,254 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:00:58
2013-11-25 01:03:00,384 INFO     repeater     task ashtech_hcorrstats starting 1.4 seconds late
2013-11-25 01:03:01,331 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:03:01,332 INFO     repeater     task phins3_hcorrstats starting 2.3 seconds late
2013-11-25 01:03:02,276 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 01:04:07,363 INFO     repeater     task nb150_lastensq starting 0.4 seconds late
2013-11-25 01:04:09,641 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:04:09,642 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:03:57
2013-11-25 01:04:09,642 INFO     repeater     task os75nb_lastensq starting 1.6 seconds late
2013-11-25 01:04:10,847 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:04:10,847 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:03:58
2013-11-25 01:07:11,081 INFO     repeater     task nb150_lastensq starting 4.1 seconds late
2013-11-25 01:07:13,369 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:07:13,369 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:06:57
2013-11-25 01:07:13,370 INFO     repeater     task os75nb_lastensq starting 5.4 seconds late
2013-11-25 01:07:14,569 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:07:14,570 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:06:58
2013-11-25 01:07:59,630 INFO     repeater     task ashtech_hcorrstats starting 0.6 seconds late
2013-11-25 01:08:00,561 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:08:00,561 INFO     repeater     task phins3_hcorrstats starting 1.6 seconds late
2013-11-25 01:08:01,493 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 01:10:11,645 INFO     repeater     task nb150_lastensq starting 4.6 seconds late
2013-11-25 01:10:13,908 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:10:13,909 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:09:57
2013-11-25 01:10:13,909 INFO     repeater     task os75nb_lastensq starting 5.9 seconds late
2013-11-25 01:10:15,128 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:10:15,128 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:09:58
2013-11-25 01:13:00,339 INFO     repeater     task nb150_quick starting 1.4 seconds late
2013-11-25 01:13:08,885 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 01:13:08,886 INFO     repeater     task nb150_3dayplots starting 9.9 seconds late
2013-11-25 01:13:18,456 INFO     repeater     task nb150_3dayplots ended after 9.6 seconds
2013-11-25 01:13:18,457 INFO     repeater     task os75nb_lastensq starting 10.5 seconds late
2013-11-25 01:13:19,879 INFO     repeater     task os75nb_lastensq ended after 1.4 seconds
2013-11-25 01:13:19,879 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:12:58
2013-11-25 01:13:19,880 INFO     repeater     task os75nb_quick starting 20.9 seconds late
2013-11-25 01:13:28,673 INFO     repeater     task os75nb_quick ended after 8.8 seconds
2013-11-25 01:13:28,674 INFO     repeater     task os75nb_3dayplots starting 29.7 seconds late
2013-11-25 01:13:39,559 INFO     repeater     task os75nb_3dayplots ended after 10.9 seconds
2013-11-25 01:13:39,560 INFO     repeater     task ashtech_hcorrstats starting 40.6 seconds late
2013-11-25 01:13:40,479 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:13:40,480 INFO     repeater     task phins3_hcorrstats starting 41.5 seconds late
2013-11-25 01:13:41,462 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 01:13:46,468 INFO     repeater     task nb150_lastensq starting 39.5 seconds late
2013-11-25 01:13:48,810 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:13:48,810 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:12:57
2013-11-25 01:16:09,014 INFO     repeater     task nb150_lastensq starting 2.0 seconds late
2013-11-25 01:16:11,455 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:16:11,456 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:15:57
2013-11-25 01:16:11,457 INFO     repeater     task os75nb_lastensq starting 3.5 seconds late
2013-11-25 01:16:12,660 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:16:12,661 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:15:58
2013-11-25 01:18:02,813 INFO     repeater     task ashtech_hcorrstats starting 3.8 seconds late
2013-11-25 01:18:03,716 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:18:03,717 INFO     repeater     task phins3_hcorrstats starting 4.7 seconds late
2013-11-25 01:18:04,665 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 01:19:09,738 INFO     repeater     task nb150_lastensq starting 2.7 seconds late
2013-11-25 01:19:12,047 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:19:12,047 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:18:57
2013-11-25 01:19:12,048 INFO     repeater     task os75nb_lastensq starting 4.0 seconds late
2013-11-25 01:19:13,241 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:19:13,241 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:18:58
2013-11-25 01:22:08,454 INFO     repeater     task nb150_lastensq starting 1.5 seconds late
2013-11-25 01:22:10,727 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:22:10,727 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:21:57
2013-11-25 01:22:10,728 INFO     repeater     task os75nb_lastensq starting 2.7 seconds late
2013-11-25 01:22:11,959 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:22:11,960 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:21:58
2013-11-25 01:23:02,022 INFO     repeater     task ashtech_hcorrstats starting 3.0 seconds late
2013-11-25 01:23:02,917 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:23:02,917 INFO     repeater     task phins3_hcorrstats starting 3.9 seconds late
2013-11-25 01:23:03,911 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 01:25:09,069 INFO     repeater     task nb150_lastensq starting 2.1 seconds late
2013-11-25 01:25:11,381 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:25:11,382 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:24:57
2013-11-25 01:25:11,382 INFO     repeater     task os75nb_lastensq starting 3.4 seconds late
2013-11-25 01:25:12,630 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:25:12,630 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:24:58
2013-11-25 01:28:02,845 INFO     repeater     task nb150_quick starting 3.9 seconds late
2013-11-25 01:28:11,452 INFO     repeater     task nb150_quick ended after 8.6 seconds
2013-11-25 01:28:11,453 INFO     repeater     task nb150_3dayplots starting 12.5 seconds late
2013-11-25 01:28:21,190 INFO     repeater     task nb150_3dayplots ended after 9.7 seconds
2013-11-25 01:28:21,191 INFO     repeater     task os75nb_lastensq starting 13.2 seconds late
2013-11-25 01:28:22,387 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:28:22,387 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:27:58
2013-11-25 01:28:22,387 INFO     repeater     task os75nb_quick starting 23.4 seconds late
2013-11-25 01:28:31,086 INFO     repeater     task os75nb_quick ended after 8.7 seconds
2013-11-25 01:28:31,087 INFO     repeater     task os75nb_3dayplots starting 32.1 seconds late
2013-11-25 01:28:41,765 INFO     repeater     task os75nb_3dayplots ended after 10.7 seconds
2013-11-25 01:28:41,766 INFO     repeater     task ashtech_hcorrstats starting 42.8 seconds late
2013-11-25 01:28:42,668 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:28:42,669 INFO     repeater     task phins3_hcorrstats starting 43.7 seconds late
2013-11-25 01:28:43,611 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 01:28:48,617 INFO     repeater     task nb150_lastensq starting 41.6 seconds late
2013-11-25 01:28:50,976 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:28:50,976 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:27:57
2013-11-25 01:31:11,151 INFO     repeater     task nb150_lastensq starting 4.2 seconds late
2013-11-25 01:31:13,508 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:31:13,508 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:30:57
2013-11-25 01:31:13,509 INFO     repeater     task os75nb_lastensq starting 5.5 seconds late
2013-11-25 01:31:14,713 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:31:14,713 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:30:58
2013-11-25 01:32:59,850 INFO     repeater     task ashtech_hcorrstats starting 0.9 seconds late
2013-11-25 01:33:00,737 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:33:00,738 INFO     repeater     task phins3_hcorrstats starting 1.7 seconds late
2013-11-25 01:33:01,737 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 01:34:11,819 INFO     repeater     task nb150_lastensq starting 4.8 seconds late
2013-11-25 01:34:14,161 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:34:14,162 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:33:57
2013-11-25 01:34:14,162 INFO     repeater     task os75nb_lastensq starting 6.2 seconds late
2013-11-25 01:34:15,338 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:34:15,338 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:33:58
2013-11-25 01:37:10,551 INFO     repeater     task nb150_lastensq starting 3.6 seconds late
2013-11-25 01:37:12,942 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:37:12,943 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:36:57
2013-11-25 01:37:12,943 INFO     repeater     task os75nb_lastensq starting 4.9 seconds late
2013-11-25 01:37:14,117 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:37:14,117 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:36:58
2013-11-25 01:37:59,180 INFO     repeater     task ashtech_hcorrstats starting 0.2 seconds late
2013-11-25 01:38:00,077 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:38:00,077 INFO     repeater     task phins3_hcorrstats starting 1.1 seconds late
2013-11-25 01:38:01,039 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 01:40:11,196 INFO     repeater     task nb150_lastensq starting 4.2 seconds late
2013-11-25 01:40:13,550 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:40:13,550 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:39:57
2013-11-25 01:40:13,551 INFO     repeater     task os75nb_lastensq starting 5.6 seconds late
2013-11-25 01:40:14,732 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:40:14,732 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:39:58
2013-11-25 01:42:59,902 INFO     repeater     task nb150_quick starting 0.9 seconds late
2013-11-25 01:43:08,645 INFO     repeater     task nb150_quick ended after 8.7 seconds
2013-11-25 01:43:08,646 INFO     repeater     task nb150_3dayplots starting 9.7 seconds late
2013-11-25 01:43:18,471 INFO     repeater     task nb150_3dayplots ended after 9.8 seconds
2013-11-25 01:43:18,471 INFO     repeater     task os75nb_lastensq starting 10.5 seconds late
2013-11-25 01:43:19,733 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-25 01:43:19,733 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:42:58
2013-11-25 01:43:19,734 INFO     repeater     task os75nb_quick starting 20.8 seconds late
2013-11-25 01:43:28,366 INFO     repeater     task os75nb_quick ended after 8.6 seconds
2013-11-25 01:43:28,367 INFO     repeater     task os75nb_3dayplots starting 29.4 seconds late
2013-11-25 01:43:38,809 INFO     repeater     task os75nb_3dayplots ended after 10.4 seconds
2013-11-25 01:43:38,810 INFO     repeater     task ashtech_hcorrstats starting 39.8 seconds late
2013-11-25 01:43:39,709 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:43:39,710 INFO     repeater     task phins3_hcorrstats starting 40.7 seconds late
2013-11-25 01:43:40,672 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 01:43:45,678 INFO     repeater     task nb150_lastensq starting 38.7 seconds late
2013-11-25 01:43:47,992 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:43:47,992 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:42:57
2013-11-25 01:46:08,178 INFO     repeater     task nb150_lastensq starting 1.2 seconds late
2013-11-25 01:46:10,563 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:46:10,564 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:45:57
2013-11-25 01:46:10,565 INFO     repeater     task os75nb_lastensq starting 2.6 seconds late
2013-11-25 01:46:11,800 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:46:11,800 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:45:58
2013-11-25 01:48:01,945 INFO     repeater     task ashtech_hcorrstats starting 3.0 seconds late
2013-11-25 01:48:02,843 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:48:02,843 INFO     repeater     task phins3_hcorrstats starting 3.9 seconds late
2013-11-25 01:48:03,773 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 01:49:08,859 INFO     repeater     task nb150_lastensq starting 1.9 seconds late
2013-11-25 01:49:11,246 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 01:49:11,246 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:48:57
2013-11-25 01:49:11,247 INFO     repeater     task os75nb_lastensq starting 3.2 seconds late
2013-11-25 01:49:12,428 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:49:12,429 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:48:58
2013-11-25 01:52:07,651 INFO     repeater     task nb150_lastensq starting 0.7 seconds late
2013-11-25 01:52:09,912 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:52:09,912 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:51:57
2013-11-25 01:52:09,913 INFO     repeater     task os75nb_lastensq starting 1.9 seconds late
2013-11-25 01:52:11,168 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-25 01:52:11,169 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:51:58
2013-11-25 01:53:01,240 INFO     repeater     task ashtech_hcorrstats starting 2.3 seconds late
2013-11-25 01:53:02,187 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 01:53:02,187 INFO     repeater     task phins3_hcorrstats starting 3.2 seconds late
2013-11-25 01:53:03,142 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 01:55:08,311 INFO     repeater     task nb150_lastensq starting 1.3 seconds late
2013-11-25 01:55:10,584 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:55:10,584 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:54:57
2013-11-25 01:55:10,585 INFO     repeater     task os75nb_lastensq starting 2.6 seconds late
2013-11-25 01:55:11,846 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-25 01:55:11,847 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:54:58
2013-11-25 01:58:02,076 INFO     repeater     task nb150_quick starting 3.1 seconds late
2013-11-25 01:58:10,581 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 01:58:10,582 INFO     repeater     task nb150_3dayplots starting 11.6 seconds late
2013-11-25 01:58:20,233 INFO     repeater     task nb150_3dayplots ended after 9.7 seconds
2013-11-25 01:58:20,234 INFO     repeater     task os75nb_lastensq starting 12.2 seconds late
2013-11-25 01:58:21,465 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 01:58:21,465 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 01:57:58
2013-11-25 01:58:21,465 INFO     repeater     task os75nb_quick starting 22.5 seconds late
2013-11-25 01:58:31,479 INFO     repeater     task os75nb_quick ended after 10.0 seconds
2013-11-25 01:58:31,480 INFO     repeater     task os75nb_3dayplots starting 32.5 seconds late
2013-11-25 01:58:42,716 INFO     repeater     task os75nb_3dayplots ended after 11.2 seconds
2013-11-25 01:58:42,721 INFO     repeater     task ashtech_hcorrstats starting 43.7 seconds late
2013-11-25 01:58:43,672 INFO     repeater     task ashtech_hcorrstats ended after 1.0 seconds
2013-11-25 01:58:43,673 INFO     repeater     task phins3_hcorrstats starting 44.7 seconds late
2013-11-25 01:58:44,614 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 01:58:49,620 INFO     repeater     task nb150_lastensq starting 42.6 seconds late
2013-11-25 01:58:51,906 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 01:58:51,907 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 01:57:57
2013-11-25 02:01:07,097 INFO     repeater     task nb150_lastensq starting 0.1 seconds late
2013-11-25 02:01:09,424 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:01:09,425 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:00:57
2013-11-25 02:01:09,426 INFO     repeater     task os75nb_lastensq starting 1.4 seconds late
2013-11-25 02:01:10,639 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:01:10,639 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:00:58
2013-11-25 02:03:00,773 INFO     repeater     task ashtech_hcorrstats starting 1.8 seconds late
2013-11-25 02:03:01,670 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:03:01,670 INFO     repeater     task phins3_hcorrstats starting 2.7 seconds late
2013-11-25 02:03:02,645 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:04:07,730 INFO     repeater     task nb150_lastensq starting 0.7 seconds late
2013-11-25 02:04:10,031 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:04:10,032 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:03:57
2013-11-25 02:04:10,033 INFO     repeater     task os75nb_lastensq starting 2.0 seconds late
2013-11-25 02:04:11,142 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 02:04:11,142 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:03:58
2013-11-25 02:07:11,348 INFO     repeater     task nb150_lastensq starting 4.3 seconds late
2013-11-25 02:07:13,556 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:07:13,557 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:06:57
2013-11-25 02:07:13,557 INFO     repeater     task os75nb_lastensq starting 5.6 seconds late
2013-11-25 02:07:14,703 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 02:07:14,703 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:06:58
2013-11-25 02:07:59,763 INFO     repeater     task ashtech_hcorrstats starting 0.8 seconds late
2013-11-25 02:08:00,670 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:08:00,671 INFO     repeater     task phins3_hcorrstats starting 1.7 seconds late
2013-11-25 02:08:01,628 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:10:11,781 INFO     repeater     task nb150_lastensq starting 4.8 seconds late
2013-11-25 02:10:13,998 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:10:13,999 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:09:57
2013-11-25 02:10:13,999 INFO     repeater     task os75nb_lastensq starting 6.0 seconds late
2013-11-25 02:10:15,120 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 02:10:15,121 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:09:58
2013-11-25 02:13:00,323 INFO     repeater     task nb150_quick starting 1.3 seconds late
2013-11-25 02:13:08,890 INFO     repeater     task nb150_quick ended after 8.6 seconds
2013-11-25 02:13:08,890 INFO     repeater     task nb150_3dayplots starting 9.9 seconds late
2013-11-25 02:13:18,675 INFO     repeater     task nb150_3dayplots ended after 9.8 seconds
2013-11-25 02:13:18,675 INFO     repeater     task os75nb_lastensq starting 10.7 seconds late
2013-11-25 02:13:19,814 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 02:13:19,815 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:12:58
2013-11-25 02:13:19,815 INFO     repeater     task os75nb_quick starting 20.8 seconds late
2013-11-25 02:13:28,552 INFO     repeater     task os75nb_quick ended after 8.7 seconds
2013-11-25 02:13:28,553 INFO     repeater     task os75nb_3dayplots starting 29.6 seconds late
2013-11-25 02:13:39,016 INFO     repeater     task os75nb_3dayplots ended after 10.5 seconds
2013-11-25 02:13:39,016 INFO     repeater     task ashtech_hcorrstats starting 40.0 seconds late
2013-11-25 02:13:39,902 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:13:39,902 INFO     repeater     task phins3_hcorrstats starting 40.9 seconds late
2013-11-25 02:13:40,864 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:13:45,870 INFO     repeater     task nb150_lastensq starting 38.9 seconds late
2013-11-25 02:13:48,181 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:13:48,182 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:12:57
2013-11-25 02:16:08,354 INFO     repeater     task nb150_lastensq starting 1.4 seconds late
2013-11-25 02:16:10,630 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:16:10,630 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:15:57
2013-11-25 02:16:10,631 INFO     repeater     task os75nb_lastensq starting 2.6 seconds late
2013-11-25 02:16:11,784 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:16:11,785 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:15:58
2013-11-25 02:18:01,910 INFO     repeater     task ashtech_hcorrstats starting 2.9 seconds late
2013-11-25 02:18:02,811 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:18:02,811 INFO     repeater     task phins3_hcorrstats starting 3.8 seconds late
2013-11-25 02:18:03,804 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:19:08,868 INFO     repeater     task nb150_lastensq starting 1.9 seconds late
2013-11-25 02:19:11,139 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:19:11,140 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:18:57
2013-11-25 02:19:11,140 INFO     repeater     task os75nb_lastensq starting 3.1 seconds late
2013-11-25 02:19:12,298 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:19:12,299 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:18:58
2013-11-25 02:22:07,584 INFO     repeater     task nb150_lastensq starting 0.6 seconds late
2013-11-25 02:22:09,909 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:22:09,909 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:21:57
2013-11-25 02:22:09,910 INFO     repeater     task os75nb_lastensq starting 1.9 seconds late
2013-11-25 02:22:11,078 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:22:11,078 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:21:58
2013-11-25 02:23:01,143 INFO     repeater     task ashtech_hcorrstats starting 2.2 seconds late
2013-11-25 02:23:02,034 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:23:02,035 INFO     repeater     task phins3_hcorrstats starting 3.0 seconds late
2013-11-25 02:23:03,000 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:25:08,174 INFO     repeater     task nb150_lastensq starting 1.2 seconds late
2013-11-25 02:25:10,387 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:25:10,388 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:24:57
2013-11-25 02:25:10,389 INFO     repeater     task os75nb_lastensq starting 2.4 seconds late
2013-11-25 02:25:11,542 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:25:11,543 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:24:58
2013-11-25 02:28:01,763 INFO     repeater     task nb150_quick starting 2.8 seconds late
2013-11-25 02:28:10,178 INFO     repeater     task nb150_quick ended after 8.4 seconds
2013-11-25 02:28:10,179 INFO     repeater     task nb150_3dayplots starting 11.2 seconds late
2013-11-25 02:28:19,768 INFO     repeater     task nb150_3dayplots ended after 9.6 seconds
2013-11-25 02:28:19,768 INFO     repeater     task os75nb_lastensq starting 11.8 seconds late
2013-11-25 02:28:20,923 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:28:20,924 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:27:58
2013-11-25 02:28:20,924 INFO     repeater     task os75nb_quick starting 21.9 seconds late
2013-11-25 02:28:29,715 INFO     repeater     task os75nb_quick ended after 8.8 seconds
2013-11-25 02:28:29,716 INFO     repeater     task os75nb_3dayplots starting 30.7 seconds late
2013-11-25 02:28:40,375 INFO     repeater     task os75nb_3dayplots ended after 10.7 seconds
2013-11-25 02:28:40,376 INFO     repeater     task ashtech_hcorrstats starting 41.4 seconds late
2013-11-25 02:28:41,279 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:28:41,279 INFO     repeater     task phins3_hcorrstats starting 42.3 seconds late
2013-11-25 02:28:42,254 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:28:47,260 INFO     repeater     task nb150_lastensq starting 40.3 seconds late
2013-11-25 02:28:49,472 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:28:49,472 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:27:57
2013-11-25 02:31:09,651 INFO     repeater     task nb150_lastensq starting 2.7 seconds late
2013-11-25 02:31:11,884 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:31:11,885 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:30:57
2013-11-25 02:31:11,886 INFO     repeater     task os75nb_lastensq starting 3.9 seconds late
2013-11-25 02:31:13,102 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:31:13,102 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:30:58
2013-11-25 02:33:03,243 INFO     repeater     task ashtech_hcorrstats starting 4.3 seconds late
2013-11-25 02:33:04,158 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:33:04,159 INFO     repeater     task phins3_hcorrstats starting 5.2 seconds late
2013-11-25 02:33:05,098 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 02:34:10,178 INFO     repeater     task nb150_lastensq starting 3.2 seconds late
2013-11-25 02:34:12,393 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:34:12,393 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:33:57
2013-11-25 02:34:12,394 INFO     repeater     task os75nb_lastensq starting 4.4 seconds late
2013-11-25 02:34:13,594 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:34:13,594 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:33:58
2013-11-25 02:37:08,807 INFO     repeater     task nb150_lastensq starting 1.8 seconds late
2013-11-25 02:37:11,042 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:37:11,042 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:36:57
2013-11-25 02:37:11,043 INFO     repeater     task os75nb_lastensq starting 3.0 seconds late
2013-11-25 02:37:12,208 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:37:12,209 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:36:58
2013-11-25 02:38:02,271 INFO     repeater     task ashtech_hcorrstats starting 3.3 seconds late
2013-11-25 02:38:03,195 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:38:03,195 INFO     repeater     task phins3_hcorrstats starting 4.2 seconds late
2013-11-25 02:38:04,180 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:40:09,321 INFO     repeater     task nb150_lastensq starting 2.3 seconds late
2013-11-25 02:40:11,607 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:40:11,607 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:39:57
2013-11-25 02:40:11,608 INFO     repeater     task os75nb_lastensq starting 3.6 seconds late
2013-11-25 02:40:12,739 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 02:40:12,740 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:39:58
2013-11-25 02:43:02,966 INFO     repeater     task nb150_quick starting 4.0 seconds late
2013-11-25 02:43:11,472 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 02:43:11,473 INFO     repeater     task nb150_3dayplots starting 12.5 seconds late
2013-11-25 02:43:23,117 INFO     repeater     task nb150_3dayplots ended after 11.6 seconds
2013-11-25 02:43:23,117 INFO     repeater     task os75nb_lastensq starting 15.1 seconds late
2013-11-25 02:43:24,255 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 02:43:24,255 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:42:58
2013-11-25 02:43:24,255 INFO     repeater     task os75nb_quick starting 25.3 seconds late
2013-11-25 02:43:34,669 INFO     repeater     task os75nb_quick ended after 10.4 seconds
2013-11-25 02:43:34,670 INFO     repeater     task os75nb_3dayplots starting 35.7 seconds late
2013-11-25 02:43:45,071 INFO     repeater     task os75nb_3dayplots ended after 10.4 seconds
2013-11-25 02:43:45,072 INFO     repeater     task ashtech_hcorrstats starting 46.1 seconds late
2013-11-25 02:43:46,033 INFO     repeater     task ashtech_hcorrstats ended after 1.0 seconds
2013-11-25 02:43:46,033 INFO     repeater     task phins3_hcorrstats starting 47.0 seconds late
2013-11-25 02:43:46,990 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:43:51,996 INFO     repeater     task nb150_lastensq starting 45.0 seconds late
2013-11-25 02:43:54,248 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:43:54,249 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:42:57
2013-11-25 02:46:09,434 INFO     repeater     task nb150_lastensq starting 2.4 seconds late
2013-11-25 02:46:11,691 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:46:11,691 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:45:57
2013-11-25 02:46:11,692 INFO     repeater     task os75nb_lastensq starting 3.7 seconds late
2013-11-25 02:46:12,849 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:46:12,849 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:45:58
2013-11-25 02:48:02,990 INFO     repeater     task ashtech_hcorrstats starting 4.0 seconds late
2013-11-25 02:48:03,902 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:48:03,903 INFO     repeater     task phins3_hcorrstats starting 4.9 seconds late
2013-11-25 02:48:04,868 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:49:09,948 INFO     repeater     task nb150_lastensq starting 2.9 seconds late
2013-11-25 02:49:12,274 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:49:12,274 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:48:57
2013-11-25 02:49:12,275 INFO     repeater     task os75nb_lastensq starting 4.3 seconds late
2013-11-25 02:49:13,467 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:49:13,468 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:48:58
2013-11-25 02:52:08,691 INFO     repeater     task nb150_lastensq starting 1.7 seconds late
2013-11-25 02:52:10,991 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:52:10,991 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:51:57
2013-11-25 02:52:10,992 INFO     repeater     task os75nb_lastensq starting 3.0 seconds late
2013-11-25 02:52:12,166 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:52:12,167 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:51:58
2013-11-25 02:53:02,228 INFO     repeater     task ashtech_hcorrstats starting 3.2 seconds late
2013-11-25 02:53:03,119 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:53:03,119 INFO     repeater     task phins3_hcorrstats starting 4.1 seconds late
2013-11-25 02:53:04,122 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:55:09,281 INFO     repeater     task nb150_lastensq starting 2.3 seconds late
2013-11-25 02:55:11,491 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 02:55:11,492 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:54:57
2013-11-25 02:55:11,493 INFO     repeater     task os75nb_lastensq starting 3.5 seconds late
2013-11-25 02:55:12,675 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:55:12,675 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:54:58
2013-11-25 02:58:02,891 INFO     repeater     task nb150_quick starting 3.9 seconds late
2013-11-25 02:58:11,356 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 02:58:11,357 INFO     repeater     task nb150_3dayplots starting 12.4 seconds late
2013-11-25 02:58:20,615 INFO     repeater     task nb150_3dayplots ended after 9.3 seconds
2013-11-25 02:58:20,615 INFO     repeater     task os75nb_lastensq starting 12.6 seconds late
2013-11-25 02:58:21,795 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 02:58:21,796 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 02:57:58
2013-11-25 02:58:21,796 INFO     repeater     task os75nb_quick starting 22.8 seconds late
2013-11-25 02:58:30,817 INFO     repeater     task os75nb_quick ended after 9.0 seconds
2013-11-25 02:58:30,818 INFO     repeater     task os75nb_3dayplots starting 31.8 seconds late
2013-11-25 02:58:41,399 INFO     repeater     task os75nb_3dayplots ended after 10.6 seconds
2013-11-25 02:58:41,400 INFO     repeater     task ashtech_hcorrstats starting 42.4 seconds late
2013-11-25 02:58:42,297 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 02:58:42,298 INFO     repeater     task phins3_hcorrstats starting 43.3 seconds late
2013-11-25 02:58:43,257 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 02:58:48,261 INFO     repeater     task nb150_lastensq starting 41.3 seconds late
2013-11-25 02:58:50,605 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 02:58:50,606 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 02:57:57
2013-11-25 03:01:10,781 INFO     repeater     task nb150_lastensq starting 3.8 seconds late
2013-11-25 03:01:13,013 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 03:01:13,014 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:00:57
2013-11-25 03:01:13,014 INFO     repeater     task os75nb_lastensq starting 5.0 seconds late
2013-11-25 03:01:14,201 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:01:14,202 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:00:58
2013-11-25 03:02:59,330 INFO     repeater     task ashtech_hcorrstats starting 0.3 seconds late
2013-11-25 03:03:00,225 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:03:00,226 INFO     repeater     task phins3_hcorrstats starting 1.2 seconds late
2013-11-25 03:03:01,177 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:04:11,261 INFO     repeater     task nb150_lastensq starting 4.3 seconds late
2013-11-25 03:04:13,531 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:04:13,531 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:03:57
2013-11-25 03:04:13,532 INFO     repeater     task os75nb_lastensq starting 5.5 seconds late
2013-11-25 03:04:14,684 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:04:14,684 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:03:58
2013-11-25 03:07:09,899 INFO     repeater     task nb150_lastensq starting 2.9 seconds late
2013-11-25 03:07:12,135 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 03:07:12,135 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:06:57
2013-11-25 03:07:12,136 INFO     repeater     task os75nb_lastensq starting 4.1 seconds late
2013-11-25 03:07:13,365 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:07:13,366 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:06:58
2013-11-25 03:08:03,433 INFO     repeater     task ashtech_hcorrstats starting 4.4 seconds late
2013-11-25 03:08:04,345 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:08:04,346 INFO     repeater     task phins3_hcorrstats starting 5.4 seconds late
2013-11-25 03:08:05,299 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:10:10,456 INFO     repeater     task nb150_lastensq starting 3.5 seconds late
2013-11-25 03:10:12,774 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:10:12,774 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:09:57
2013-11-25 03:10:12,775 INFO     repeater     task os75nb_lastensq starting 4.8 seconds late
2013-11-25 03:10:13,994 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:10:13,995 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:09:58
2013-11-25 03:12:59,203 INFO     repeater     task nb150_quick starting 0.2 seconds late
2013-11-25 03:13:07,672 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 03:13:07,673 INFO     repeater     task nb150_3dayplots starting 8.7 seconds late
2013-11-25 03:13:17,117 INFO     repeater     task nb150_3dayplots ended after 9.4 seconds
2013-11-25 03:13:17,117 INFO     repeater     task os75nb_lastensq starting 9.1 seconds late
2013-11-25 03:13:18,355 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:13:18,355 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:12:58
2013-11-25 03:13:18,356 INFO     repeater     task os75nb_quick starting 19.4 seconds late
2013-11-25 03:13:26,968 INFO     repeater     task os75nb_quick ended after 8.6 seconds
2013-11-25 03:13:26,969 INFO     repeater     task os75nb_3dayplots starting 28.0 seconds late
2013-11-25 03:13:37,109 INFO     repeater     task os75nb_3dayplots ended after 10.1 seconds
2013-11-25 03:13:37,109 INFO     repeater     task ashtech_hcorrstats starting 38.1 seconds late
2013-11-25 03:13:37,994 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:13:37,994 INFO     repeater     task phins3_hcorrstats starting 39.0 seconds late
2013-11-25 03:13:38,946 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:13:43,949 INFO     repeater     task nb150_lastensq starting 36.9 seconds late
2013-11-25 03:13:46,230 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:13:46,230 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:12:57
2013-11-25 03:16:11,416 INFO     repeater     task nb150_lastensq starting 4.4 seconds late
2013-11-25 03:16:13,726 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:16:13,726 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:15:57
2013-11-25 03:16:13,727 INFO     repeater     task os75nb_lastensq starting 5.7 seconds late
2013-11-25 03:16:14,906 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:16:14,906 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:15:58
2013-11-25 03:18:00,033 INFO     repeater     task ashtech_hcorrstats starting 1.0 seconds late
2013-11-25 03:18:00,950 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:18:00,951 INFO     repeater     task phins3_hcorrstats starting 2.0 seconds late
2013-11-25 03:18:01,892 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 03:19:11,987 INFO     repeater     task nb150_lastensq starting 5.0 seconds late
2013-11-25 03:19:14,255 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:19:14,256 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:18:57
2013-11-25 03:19:14,256 INFO     repeater     task os75nb_lastensq starting 6.3 seconds late
2013-11-25 03:19:15,414 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:19:15,415 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:18:58
2013-11-25 03:22:10,634 INFO     repeater     task nb150_lastensq starting 3.6 seconds late
2013-11-25 03:22:12,910 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:22:12,911 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:21:57
2013-11-25 03:22:12,911 INFO     repeater     task os75nb_lastensq starting 4.9 seconds late
2013-11-25 03:22:14,092 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:22:14,092 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:21:58
2013-11-25 03:22:59,158 INFO     repeater     task ashtech_hcorrstats starting 0.2 seconds late
2013-11-25 03:23:00,072 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:23:00,072 INFO     repeater     task phins3_hcorrstats starting 1.1 seconds late
2013-11-25 03:23:01,027 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:25:11,185 INFO     repeater     task nb150_lastensq starting 4.2 seconds late
2013-11-25 03:25:13,536 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 03:25:13,536 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:24:57
2013-11-25 03:25:13,537 INFO     repeater     task os75nb_lastensq starting 5.5 seconds late
2013-11-25 03:25:14,743 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:25:14,744 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:24:58
2013-11-25 03:27:59,960 INFO     repeater     task nb150_quick starting 1.0 seconds late
2013-11-25 03:28:08,430 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 03:28:08,430 INFO     repeater     task nb150_3dayplots starting 9.5 seconds late
2013-11-25 03:28:17,701 INFO     repeater     task nb150_3dayplots ended after 9.3 seconds
2013-11-25 03:28:17,702 INFO     repeater     task os75nb_lastensq starting 9.7 seconds late
2013-11-25 03:28:18,985 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-25 03:28:18,986 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:27:58
2013-11-25 03:28:18,986 INFO     repeater     task os75nb_quick starting 20.0 seconds late
2013-11-25 03:28:28,094 INFO     repeater     task os75nb_quick ended after 9.1 seconds
2013-11-25 03:28:28,094 INFO     repeater     task os75nb_3dayplots starting 29.1 seconds late
2013-11-25 03:28:38,568 INFO     repeater     task os75nb_3dayplots ended after 10.5 seconds
2013-11-25 03:28:38,569 INFO     repeater     task ashtech_hcorrstats starting 39.6 seconds late
2013-11-25 03:28:39,483 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:28:39,483 INFO     repeater     task phins3_hcorrstats starting 40.5 seconds late
2013-11-25 03:28:40,442 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:28:45,448 INFO     repeater     task nb150_lastensq starting 38.4 seconds late
2013-11-25 03:28:47,690 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 03:28:47,690 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:27:57
2013-11-25 03:31:07,886 INFO     repeater     task nb150_lastensq starting 0.9 seconds late
2013-11-25 03:31:10,208 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:31:10,208 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:30:57
2013-11-25 03:31:10,209 INFO     repeater     task os75nb_lastensq starting 2.2 seconds late
2013-11-25 03:31:11,418 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:31:11,418 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:30:58
2013-11-25 03:33:01,558 INFO     repeater     task ashtech_hcorrstats starting 2.6 seconds late
2013-11-25 03:33:02,451 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:33:02,452 INFO     repeater     task phins3_hcorrstats starting 3.5 seconds late
2013-11-25 03:33:03,392 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 03:34:08,481 INFO     repeater     task nb150_lastensq starting 1.5 seconds late
2013-11-25 03:34:10,807 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:34:10,807 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:33:57
2013-11-25 03:34:10,808 INFO     repeater     task os75nb_lastensq starting 2.8 seconds late
2013-11-25 03:34:12,019 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:34:12,020 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:33:58
2013-11-25 03:37:07,261 INFO     repeater     task nb150_lastensq starting 0.3 seconds late
2013-11-25 03:37:09,588 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:37:09,588 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:36:57
2013-11-25 03:37:09,589 INFO     repeater     task os75nb_lastensq starting 1.6 seconds late
2013-11-25 03:37:10,818 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:37:10,818 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:36:58
2013-11-25 03:38:00,874 INFO     repeater     task ashtech_hcorrstats starting 1.9 seconds late
2013-11-25 03:38:01,773 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:38:01,774 INFO     repeater     task phins3_hcorrstats starting 2.8 seconds late
2013-11-25 03:38:02,745 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:40:07,907 INFO     repeater     task nb150_lastensq starting 0.9 seconds late
2013-11-25 03:40:10,281 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 03:40:10,281 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:39:57
2013-11-25 03:40:10,282 INFO     repeater     task os75nb_lastensq starting 2.3 seconds late
2013-11-25 03:40:11,475 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:40:11,476 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:39:58
2013-11-25 03:43:01,699 INFO     repeater     task nb150_quick starting 2.7 seconds late
2013-11-25 03:43:10,126 INFO     repeater     task nb150_quick ended after 8.4 seconds
2013-11-25 03:43:10,126 INFO     repeater     task nb150_3dayplots starting 11.1 seconds late
2013-11-25 03:43:19,524 INFO     repeater     task nb150_3dayplots ended after 9.4 seconds
2013-11-25 03:43:19,525 INFO     repeater     task os75nb_lastensq starting 11.5 seconds late
2013-11-25 03:43:20,793 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-25 03:43:20,794 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:42:58
2013-11-25 03:43:20,794 INFO     repeater     task os75nb_quick starting 21.8 seconds late
2013-11-25 03:43:29,422 INFO     repeater     task os75nb_quick ended after 8.6 seconds
2013-11-25 03:43:29,423 INFO     repeater     task os75nb_3dayplots starting 30.4 seconds late
2013-11-25 03:43:39,605 INFO     repeater     task os75nb_3dayplots ended after 10.2 seconds
2013-11-25 03:43:39,606 INFO     repeater     task ashtech_hcorrstats starting 40.6 seconds late
2013-11-25 03:43:40,511 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:43:40,511 INFO     repeater     task phins3_hcorrstats starting 41.5 seconds late
2013-11-25 03:43:41,468 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:43:46,471 INFO     repeater     task nb150_lastensq starting 39.5 seconds late
2013-11-25 03:43:48,767 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:43:48,768 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:42:57
2013-11-25 03:46:08,953 INFO     repeater     task nb150_lastensq starting 2.0 seconds late
2013-11-25 03:46:11,274 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:46:11,275 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:45:57
2013-11-25 03:46:11,276 INFO     repeater     task os75nb_lastensq starting 3.3 seconds late
2013-11-25 03:46:12,502 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:46:12,503 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:45:58
2013-11-25 03:48:02,643 INFO     repeater     task ashtech_hcorrstats starting 3.7 seconds late
2013-11-25 03:48:03,543 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:48:03,543 INFO     repeater     task phins3_hcorrstats starting 4.6 seconds late
2013-11-25 03:48:04,552 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:49:09,643 INFO     repeater     task nb150_lastensq starting 2.6 seconds late
2013-11-25 03:49:11,940 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:49:11,940 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:48:57
2013-11-25 03:49:11,941 INFO     repeater     task os75nb_lastensq starting 3.9 seconds late
2013-11-25 03:49:13,174 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:49:13,174 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:48:58
2013-11-25 03:52:08,407 INFO     repeater     task nb150_lastensq starting 1.4 seconds late
2013-11-25 03:52:10,722 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:52:10,723 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:51:57
2013-11-25 03:52:10,723 INFO     repeater     task os75nb_lastensq starting 2.7 seconds late
2013-11-25 03:52:11,949 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:52:11,950 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:51:58
2013-11-25 03:53:02,010 INFO     repeater     task ashtech_hcorrstats starting 3.0 seconds late
2013-11-25 03:53:02,915 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:53:02,916 INFO     repeater     task phins3_hcorrstats starting 3.9 seconds late
2013-11-25 03:53:03,874 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:55:09,021 INFO     repeater     task nb150_lastensq starting 2.0 seconds late
2013-11-25 03:55:11,460 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 03:55:11,461 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:54:57
2013-11-25 03:55:11,462 INFO     repeater     task os75nb_lastensq starting 3.5 seconds late
2013-11-25 03:55:12,648 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:55:12,649 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:54:58
2013-11-25 03:58:02,854 INFO     repeater     task nb150_quick starting 3.9 seconds late
2013-11-25 03:58:12,851 INFO     repeater     task nb150_quick ended after 10.0 seconds
2013-11-25 03:58:12,851 INFO     repeater     task nb150_3dayplots starting 13.9 seconds late
2013-11-25 03:58:22,515 INFO     repeater     task nb150_3dayplots ended after 9.7 seconds
2013-11-25 03:58:22,515 INFO     repeater     task os75nb_lastensq starting 14.5 seconds late
2013-11-25 03:58:23,708 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 03:58:23,709 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 03:57:58
2013-11-25 03:58:23,709 INFO     repeater     task os75nb_quick starting 24.7 seconds late
2013-11-25 03:58:32,318 INFO     repeater     task os75nb_quick ended after 8.6 seconds
2013-11-25 03:58:32,319 INFO     repeater     task os75nb_3dayplots starting 33.3 seconds late
2013-11-25 03:58:42,464 INFO     repeater     task os75nb_3dayplots ended after 10.1 seconds
2013-11-25 03:58:42,465 INFO     repeater     task ashtech_hcorrstats starting 43.5 seconds late
2013-11-25 03:58:43,374 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 03:58:43,375 INFO     repeater     task phins3_hcorrstats starting 44.4 seconds late
2013-11-25 03:58:44,330 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 03:58:49,331 INFO     repeater     task nb150_lastensq starting 42.3 seconds late
2013-11-25 03:58:51,671 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 03:58:51,671 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 03:57:57
2013-11-25 04:01:11,845 INFO     repeater     task nb150_lastensq starting 4.8 seconds late
2013-11-25 04:01:14,260 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 04:01:14,260 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:00:57
2013-11-25 04:01:14,261 INFO     repeater     task os75nb_lastensq starting 6.3 seconds late
2013-11-25 04:01:15,426 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:01:15,427 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:00:58
2013-11-25 04:03:00,558 INFO     repeater     task ashtech_hcorrstats starting 1.6 seconds late
2013-11-25 04:03:01,462 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 04:03:01,462 INFO     repeater     task phins3_hcorrstats starting 2.5 seconds late
2013-11-25 04:03:02,423 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 04:04:07,509 INFO     repeater     task nb150_lastensq starting 0.5 seconds late
2013-11-25 04:04:09,816 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 04:04:09,816 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:03:57
2013-11-25 04:04:09,817 INFO     repeater     task os75nb_lastensq starting 1.8 seconds late
2013-11-25 04:04:10,922 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 04:04:10,922 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:03:58
2013-11-25 04:07:11,149 INFO     repeater     task nb150_lastensq starting 4.1 seconds late
2013-11-25 04:07:13,363 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 04:07:13,364 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:06:57
2013-11-25 04:07:13,365 INFO     repeater     task os75nb_lastensq starting 5.4 seconds late
2013-11-25 04:07:14,511 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 04:07:14,511 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:06:58
2013-11-25 04:07:59,560 INFO     repeater     task ashtech_hcorrstats starting 0.6 seconds late
2013-11-25 04:08:00,475 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 04:08:00,475 INFO     repeater     task phins3_hcorrstats starting 1.5 seconds late
2013-11-25 04:08:01,436 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 04:10:11,601 INFO     repeater     task nb150_lastensq starting 4.6 seconds late
2013-11-25 04:10:13,877 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 04:10:13,877 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:09:57
2013-11-25 04:10:13,878 INFO     repeater     task os75nb_lastensq starting 5.9 seconds late
2013-11-25 04:10:15,029 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:10:15,029 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:09:58
2013-11-25 04:13:00,231 INFO     repeater     task nb150_quick starting 1.3 seconds late
2013-11-25 04:13:08,706 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 04:13:08,707 INFO     repeater     task nb150_3dayplots starting 9.7 seconds late
2013-11-25 04:13:18,006 INFO     repeater     task nb150_3dayplots ended after 9.3 seconds
2013-11-25 04:13:18,007 INFO     repeater     task os75nb_lastensq starting 10.0 seconds late
2013-11-25 04:13:19,161 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:13:19,162 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:12:58
2013-11-25 04:13:19,162 INFO     repeater     task os75nb_quick starting 20.2 seconds late
2013-11-25 04:13:28,024 INFO     repeater     task os75nb_quick ended after 8.9 seconds
2013-11-25 04:13:28,025 INFO     repeater     task os75nb_3dayplots starting 29.0 seconds late
2013-11-25 04:13:38,150 INFO     repeater     task os75nb_3dayplots ended after 10.1 seconds
2013-11-25 04:13:38,151 INFO     repeater     task ashtech_hcorrstats starting 39.2 seconds late
2013-11-25 04:13:39,043 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 04:13:39,043 INFO     repeater     task phins3_hcorrstats starting 40.1 seconds late
2013-11-25 04:13:39,982 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 04:13:44,984 INFO     repeater     task nb150_lastensq starting 38.0 seconds late
2013-11-25 04:13:47,237 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 04:13:47,237 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:12:57
2013-11-25 04:16:07,448 INFO     repeater     task nb150_lastensq starting 0.4 seconds late
2013-11-25 04:16:09,646 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 04:16:09,646 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:15:57
2013-11-25 04:16:09,647 INFO     repeater     task os75nb_lastensq starting 1.6 seconds late
2013-11-25 04:16:10,799 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:16:10,800 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:15:58
2013-11-25 04:18:00,943 INFO     repeater     task ashtech_hcorrstats starting 2.0 seconds late
2013-11-25 04:18:01,832 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 04:18:01,833 INFO     repeater     task phins3_hcorrstats starting 2.8 seconds late
2013-11-25 04:18:02,810 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 04:19:07,888 INFO     repeater     task nb150_lastensq starting 0.9 seconds late
2013-11-25 04:19:10,091 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 04:19:10,092 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:18:57
2013-11-25 04:19:10,093 INFO     repeater     task os75nb_lastensq starting 2.1 seconds late
2013-11-25 04:19:11,250 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:19:11,251 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:18:58
2013-11-25 04:22:11,478 INFO     repeater     task nb150_lastensq starting 4.5 seconds late
2013-11-25 04:22:13,831 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-25 04:22:13,831 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:21:57
2013-11-25 04:22:13,832 INFO     repeater     task os75nb_lastensq starting 5.8 seconds late
2013-11-25 04:22:14,948 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 04:22:14,948 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:21:58
2013-11-25 04:23:00,012 INFO     repeater     task ashtech_hcorrstats starting 1.0 seconds late
2013-11-25 04:23:00,919 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 04:23:00,919 INFO     repeater     task phins3_hcorrstats starting 1.9 seconds late
2013-11-25 04:23:01,862 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 04:25:07,028 INFO     repeater     task nb150_lastensq starting 0.0 seconds late
2013-11-25 04:25:09,308 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 04:25:09,309 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:24:57
2013-11-25 04:25:09,309 INFO     repeater     task os75nb_lastensq starting 1.3 seconds late
2013-11-25 04:25:10,462 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:25:10,462 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:24:58
2013-11-25 04:28:00,681 INFO     repeater     task nb150_quick starting 1.7 seconds late
2013-11-25 04:28:09,211 INFO     repeater     task nb150_quick ended after 8.5 seconds
2013-11-25 04:28:09,211 INFO     repeater     task nb150_3dayplots starting 10.2 seconds late
2013-11-25 04:28:18,674 INFO     repeater     task nb150_3dayplots ended after 9.5 seconds
2013-11-25 04:28:18,674 INFO     repeater     task os75nb_lastensq starting 10.7 seconds late
2013-11-25 04:28:19,789 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-25 04:28:19,789 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:27:58
2013-11-25 04:28:19,789 INFO     repeater     task os75nb_quick starting 20.8 seconds late
2013-11-25 04:28:28,606 INFO     repeater     task os75nb_quick ended after 8.8 seconds
2013-11-25 04:28:28,607 INFO     repeater     task os75nb_3dayplots starting 29.6 seconds late
2013-11-25 04:28:38,978 INFO     repeater     task os75nb_3dayplots ended after 10.4 seconds
2013-11-25 04:28:38,978 INFO     repeater     task ashtech_hcorrstats starting 40.0 seconds late
2013-11-25 04:28:39,872 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 04:28:39,873 INFO     repeater     task phins3_hcorrstats starting 40.9 seconds late
2013-11-25 04:28:40,874 INFO     repeater     task phins3_hcorrstats ended after 1.0 seconds
2013-11-25 04:28:45,880 INFO     repeater     task nb150_lastensq starting 38.9 seconds late
2013-11-25 04:28:48,134 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 04:28:48,134 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:27:57
2013-11-25 04:31:08,312 INFO     repeater     task nb150_lastensq starting 1.3 seconds late
2013-11-25 04:31:10,533 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-25 04:31:10,533 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:30:57
2013-11-25 04:31:10,534 INFO     repeater     task os75nb_lastensq starting 2.5 seconds late
2013-11-25 04:31:11,722 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:31:11,722 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:30:58
2013-11-25 04:33:01,862 INFO     repeater     task ashtech_hcorrstats starting 2.9 seconds late
2013-11-25 04:33:02,772 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-25 04:33:02,773 INFO     repeater     task phins3_hcorrstats starting 3.8 seconds late
2013-11-25 04:33:03,715 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-25 04:34:08,799 INFO     repeater     task nb150_lastensq starting 1.8 seconds late
2013-11-25 04:34:11,089 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-25 04:34:11,090 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1316/proc/nb150/load/wrote_ens_time: 2013/11/25 04:33:57
2013-11-25 04:34:11,090 INFO     repeater     task os75nb_lastensq starting 3.1 seconds late
2013-11-25 04:34:12,279 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-25 04:34:12,279 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1316/proc/os75nb/load/wrote_ens_time: 2013/11/25 04:33:58
2013-11-25 04:34:38,390 INFO     Translate    translate exiting, gps /home/data/RR1316/rbin/hydrins 
2013-11-25 04:34:38,423 INFO     Translate    translate exiting, adu /home/data/RR1316/rbin/ashtech 
2013-11-25 04:34:38,424 INFO     Translate    translate exiting, gps /home/data/RR1316/rbin/ashtech 
2013-11-25 04:34:38,425 INFO     Translate    translate exiting, hdg /home/data/RR1316/rbin/phins3 
2013-11-25 04:34:38,426 INFO     Translate    translate exiting, gps /home/data/RR1316/rbin/gpsnav 
2013-11-25 04:34:38,429 INFO     Translate    translate exiting, hdg /home/data/RR1316/rbin/hydrins 
2013-11-25 04:34:42,318 INFO     root         cleanup_figs not_logging
2013-11-25 04:34:42,362 INFO     root         Exiting DAS_while_logging.py