2013-11-03 14:40:23,662 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 14:40:23,678 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 14:40:08
2013-11-03 14:40:23,680 INFO     repeater     task os75nb_lastensq starting 4.7 seconds late
2013-11-03 14:40:24,830 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 14:40:24,831 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 14:40:09
2013-11-03 14:43:20,065 INFO     repeater     task nb150_lastensq starting 2.1 seconds late
2013-11-03 14:43:22,324 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 14:43:22,324 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 14:43:08
2013-11-03 14:43:22,325 INFO     repeater     task os75nb_lastensq starting 3.3 seconds late
2013-11-03 14:43:23,494 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 14:43:23,495 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 14:43:09
2013-11-03 14:44:43,606 INFO     repeater     task ashtech_hcorrstats starting 1.9 seconds late
2013-11-03 14:44:44,450 INFO     repeater     task ashtech_hcorrstats ended after 0.8 seconds
2013-11-03 14:44:44,451 INFO     repeater     task phins3_hcorrstats starting 2.8 seconds late
2013-11-03 14:44:45,367 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 14:46:20,481 INFO     repeater     task nb150_lastensq starting 2.5 seconds late
2013-11-03 14:46:22,770 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 14:46:22,770 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 14:46:08
2013-11-03 14:46:22,771 INFO     repeater     task os75nb_lastensq starting 3.8 seconds late
2013-11-03 14:46:23,916 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 14:46:23,917 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 14:46:09
2013-11-03 14:49:19,129 INFO     repeater     task nb150_lastensq starting 1.1 seconds late
2013-11-03 14:49:21,381 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 14:49:21,381 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 14:49:08
2013-11-03 14:49:21,387 INFO     repeater     task os75nb_lastensq starting 2.4 seconds late
2013-11-03 14:49:22,500 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 14:49:22,500 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 14:49:09
2013-11-03 14:49:42,526 INFO     repeater     task nb150_quick starting 0.8 seconds late
2013-11-03 14:49:44,901 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 14:49:44,901 INFO     repeater     task nb150_3dayplots starting 3.2 seconds late
2013-11-03 14:49:47,609 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 14:49:47,610 INFO     repeater     task os75nb_quick starting 5.9 seconds late
2013-11-03 14:49:49,993 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 14:49:49,994 INFO     repeater     task os75nb_3dayplots starting 8.3 seconds late
2013-11-03 14:49:52,758 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 14:49:52,758 INFO     repeater     task ashtech_hcorrstats starting 11.1 seconds late
2013-11-03 14:49:53,599 INFO     repeater     task ashtech_hcorrstats ended after 0.8 seconds
2013-11-03 14:49:53,600 INFO     repeater     task phins3_hcorrstats starting 11.9 seconds late
2013-11-03 14:49:54,514 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 14:52:19,684 INFO     repeater     task nb150_lastensq starting 1.7 seconds late
2013-11-03 14:52:21,909 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 14:52:21,909 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 14:52:08
2013-11-03 14:52:21,910 INFO     repeater     task os75nb_lastensq starting 2.9 seconds late
2013-11-03 14:52:23,148 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 14:52:23,148 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 14:52:09
2013-11-03 14:54:43,313 INFO     repeater     task ashtech_hcorrstats starting 1.6 seconds late
2013-11-03 14:54:44,163 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 14:54:44,163 INFO     repeater     task phins3_hcorrstats starting 2.5 seconds late
2013-11-03 14:54:45,053 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 14:55:20,096 INFO     repeater     task nb150_lastensq starting 2.1 seconds late
2013-11-03 14:55:22,349 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 14:55:22,349 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 14:55:08
2013-11-03 14:55:22,350 INFO     repeater     task os75nb_lastensq starting 3.4 seconds late
2013-11-03 14:55:23,468 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 14:55:23,468 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 14:55:09
2013-11-03 14:58:18,671 INFO     repeater     task nb150_lastensq starting 0.7 seconds late
2013-11-03 14:58:20,881 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 14:58:20,881 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 14:58:08
2013-11-03 14:58:20,882 INFO     repeater     task os75nb_lastensq starting 1.9 seconds late
2013-11-03 14:58:22,017 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 14:58:22,017 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 14:58:09
2013-11-03 14:59:42,113 INFO     repeater     task ashtech_hcorrstats starting 0.4 seconds late
2013-11-03 14:59:42,992 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 14:59:42,993 INFO     repeater     task phins3_hcorrstats starting 1.3 seconds late
2013-11-03 14:59:43,892 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:01:19,028 INFO     repeater     task nb150_lastensq starting 1.0 seconds late
2013-11-03 15:01:21,237 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 15:01:21,238 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:01:08
2013-11-03 15:01:21,238 INFO     repeater     task os75nb_lastensq starting 2.2 seconds late
2013-11-03 15:01:22,370 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 15:01:22,371 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:01:09
2013-11-03 15:04:22,594 INFO     repeater     task nb150_lastensq starting 4.6 seconds late
2013-11-03 15:04:24,883 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:04:24,883 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:04:08
2013-11-03 15:04:24,884 INFO     repeater     task os75nb_lastensq starting 5.9 seconds late
2013-11-03 15:04:26,021 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 15:04:26,021 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:04:09
2013-11-03 15:04:46,048 INFO     repeater     task nb150_quick starting 4.4 seconds late
2013-11-03 15:04:48,438 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 15:04:48,438 INFO     repeater     task nb150_3dayplots starting 6.7 seconds late
2013-11-03 15:04:51,181 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 15:04:51,182 INFO     repeater     task os75nb_quick starting 9.5 seconds late
2013-11-03 15:04:53,566 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 15:04:53,581 INFO     repeater     task os75nb_3dayplots starting 11.9 seconds late
2013-11-03 15:04:56,475 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 15:04:56,476 INFO     repeater     task ashtech_hcorrstats starting 14.8 seconds late
2013-11-03 15:04:57,337 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:04:57,338 INFO     repeater     task phins3_hcorrstats starting 15.6 seconds late
2013-11-03 15:04:58,235 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:07:18,411 INFO     repeater     task nb150_lastensq starting 0.4 seconds late
2013-11-03 15:07:20,656 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 15:07:20,657 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:07:08
2013-11-03 15:07:20,658 INFO     repeater     task os75nb_lastensq starting 1.7 seconds late
2013-11-03 15:07:21,794 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 15:07:21,795 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:07:09
2013-11-03 15:09:41,978 INFO     repeater     task ashtech_hcorrstats starting 0.3 seconds late
2013-11-03 15:09:42,828 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:09:42,828 INFO     repeater     task phins3_hcorrstats starting 1.1 seconds late
2013-11-03 15:09:43,720 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:10:18,768 INFO     repeater     task nb150_lastensq starting 0.8 seconds late
2013-11-03 15:10:21,100 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:10:21,100 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:10:08
2013-11-03 15:10:21,101 INFO     repeater     task os75nb_lastensq starting 2.1 seconds late
2013-11-03 15:10:22,244 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 15:10:22,245 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:10:09
2013-11-03 15:13:22,448 INFO     repeater     task nb150_lastensq starting 4.4 seconds late
2013-11-03 15:13:24,754 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:13:24,754 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:13:08
2013-11-03 15:13:24,755 INFO     repeater     task os75nb_lastensq starting 5.8 seconds late
2013-11-03 15:13:25,934 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:13:25,934 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:13:09
2013-11-03 15:14:46,024 INFO     repeater     task ashtech_hcorrstats starting 4.3 seconds late
2013-11-03 15:14:46,904 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:14:46,905 INFO     repeater     task phins3_hcorrstats starting 5.2 seconds late
2013-11-03 15:14:47,807 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:16:22,937 INFO     repeater     task nb150_lastensq starting 4.9 seconds late
2013-11-03 15:16:25,239 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:16:25,239 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:16:08
2013-11-03 15:16:25,240 INFO     repeater     task os75nb_lastensq starting 6.2 seconds late
2013-11-03 15:16:26,373 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 15:16:26,374 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:16:09
2013-11-03 15:19:21,611 INFO     repeater     task nb150_lastensq starting 3.6 seconds late
2013-11-03 15:19:23,963 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 15:19:23,963 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:19:08
2013-11-03 15:19:23,964 INFO     repeater     task os75nb_lastensq starting 5.0 seconds late
2013-11-03 15:19:25,106 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 15:19:25,107 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:19:09
2013-11-03 15:19:45,132 INFO     repeater     task nb150_quick starting 3.4 seconds late
2013-11-03 15:19:47,559 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 15:19:47,560 INFO     repeater     task nb150_3dayplots starting 5.9 seconds late
2013-11-03 15:19:50,239 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 15:19:50,239 INFO     repeater     task os75nb_quick starting 8.5 seconds late
2013-11-03 15:19:52,639 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 15:19:52,640 INFO     repeater     task os75nb_3dayplots starting 10.9 seconds late
2013-11-03 15:19:55,508 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 15:19:55,509 INFO     repeater     task ashtech_hcorrstats starting 13.8 seconds late
2013-11-03 15:19:56,351 INFO     repeater     task ashtech_hcorrstats ended after 0.8 seconds
2013-11-03 15:19:56,351 INFO     repeater     task phins3_hcorrstats starting 14.7 seconds late
2013-11-03 15:19:57,262 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:22:22,447 INFO     repeater     task nb150_lastensq starting 4.4 seconds late
2013-11-03 15:22:24,799 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 15:22:24,800 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:22:08
2013-11-03 15:22:24,801 INFO     repeater     task os75nb_lastensq starting 5.8 seconds late
2013-11-03 15:22:25,981 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:22:25,982 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:22:09
2013-11-03 15:24:46,176 INFO     repeater     task ashtech_hcorrstats starting 4.5 seconds late
2013-11-03 15:24:47,047 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:24:47,047 INFO     repeater     task phins3_hcorrstats starting 5.4 seconds late
2013-11-03 15:24:47,943 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:25:22,981 INFO     repeater     task nb150_lastensq starting 5.0 seconds late
2013-11-03 15:25:25,328 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:25:25,328 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:25:08
2013-11-03 15:25:25,329 INFO     repeater     task os75nb_lastensq starting 6.3 seconds late
2013-11-03 15:25:26,517 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:25:26,518 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:25:09
2013-11-03 15:28:21,723 INFO     repeater     task nb150_lastensq starting 3.7 seconds late
2013-11-03 15:28:23,972 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 15:28:23,972 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:28:08
2013-11-03 15:28:23,973 INFO     repeater     task os75nb_lastensq starting 5.0 seconds late
2013-11-03 15:28:25,188 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:28:25,188 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:28:09
2013-11-03 15:29:45,280 INFO     repeater     task ashtech_hcorrstats starting 3.6 seconds late
2013-11-03 15:29:46,157 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:29:46,158 INFO     repeater     task phins3_hcorrstats starting 4.5 seconds late
2013-11-03 15:29:47,047 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:31:22,161 INFO     repeater     task nb150_lastensq starting 4.2 seconds late
2013-11-03 15:31:24,515 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 15:31:24,516 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:31:08
2013-11-03 15:31:24,516 INFO     repeater     task os75nb_lastensq starting 5.5 seconds late
2013-11-03 15:31:25,664 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 15:31:25,664 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:31:09
2013-11-03 15:34:20,890 INFO     repeater     task nb150_lastensq starting 2.9 seconds late
2013-11-03 15:34:23,194 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:34:23,195 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:34:08
2013-11-03 15:34:23,195 INFO     repeater     task os75nb_lastensq starting 4.2 seconds late
2013-11-03 15:34:24,351 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:34:24,351 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:34:09
2013-11-03 15:34:44,376 INFO     repeater     task nb150_quick starting 2.7 seconds late
2013-11-03 15:34:46,777 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 15:34:46,778 INFO     repeater     task nb150_3dayplots starting 5.1 seconds late
2013-11-03 15:34:49,498 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 15:34:49,499 INFO     repeater     task os75nb_quick starting 7.8 seconds late
2013-11-03 15:34:51,885 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 15:34:51,886 INFO     repeater     task os75nb_3dayplots starting 10.2 seconds late
2013-11-03 15:34:54,741 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 15:34:54,742 INFO     repeater     task ashtech_hcorrstats starting 13.0 seconds late
2013-11-03 15:34:55,603 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:34:55,604 INFO     repeater     task phins3_hcorrstats starting 13.9 seconds late
2013-11-03 15:34:56,528 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:37:21,704 INFO     repeater     task nb150_lastensq starting 3.7 seconds late
2013-11-03 15:37:24,054 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 15:37:24,055 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:37:08
2013-11-03 15:37:24,055 INFO     repeater     task os75nb_lastensq starting 5.1 seconds late
2013-11-03 15:37:25,210 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:37:25,210 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:37:09
2013-11-03 15:39:45,401 INFO     repeater     task ashtech_hcorrstats starting 3.7 seconds late
2013-11-03 15:39:46,247 INFO     repeater     task ashtech_hcorrstats ended after 0.8 seconds
2013-11-03 15:39:46,248 INFO     repeater     task phins3_hcorrstats starting 4.6 seconds late
2013-11-03 15:39:47,158 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:40:22,201 INFO     repeater     task nb150_lastensq starting 4.2 seconds late
2013-11-03 15:40:24,566 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 15:40:24,566 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:40:08
2013-11-03 15:40:24,567 INFO     repeater     task os75nb_lastensq starting 5.6 seconds late
2013-11-03 15:40:25,788 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:40:25,788 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:40:09
2013-11-03 15:43:20,998 INFO     repeater     task nb150_lastensq starting 3.0 seconds late
2013-11-03 15:43:23,332 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:43:23,338 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:43:08
2013-11-03 15:43:23,339 INFO     repeater     task os75nb_lastensq starting 4.3 seconds late
2013-11-03 15:43:24,519 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:43:24,520 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:43:09
2013-11-03 15:44:44,636 INFO     repeater     task ashtech_hcorrstats starting 2.9 seconds late
2013-11-03 15:44:45,520 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:44:45,520 INFO     repeater     task phins3_hcorrstats starting 3.8 seconds late
2013-11-03 15:44:46,414 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:46:21,524 INFO     repeater     task nb150_lastensq starting 3.5 seconds late
2013-11-03 15:46:23,842 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:46:23,843 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:46:08
2013-11-03 15:46:23,843 INFO     repeater     task os75nb_lastensq starting 4.8 seconds late
2013-11-03 15:46:25,031 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:46:25,032 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:46:09
2013-11-03 15:49:20,235 INFO     repeater     task nb150_lastensq starting 2.2 seconds late
2013-11-03 15:49:22,528 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:49:22,528 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:49:08
2013-11-03 15:49:22,529 INFO     repeater     task os75nb_lastensq starting 3.5 seconds late
2013-11-03 15:49:23,830 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-03 15:49:23,831 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:49:09
2013-11-03 15:49:43,857 INFO     repeater     task nb150_quick starting 2.2 seconds late
2013-11-03 15:49:46,296 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 15:49:46,297 INFO     repeater     task nb150_3dayplots starting 4.6 seconds late
2013-11-03 15:49:48,976 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 15:49:48,977 INFO     repeater     task os75nb_quick starting 7.3 seconds late
2013-11-03 15:49:51,415 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 15:49:51,415 INFO     repeater     task os75nb_3dayplots starting 9.7 seconds late
2013-11-03 15:49:54,205 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 15:49:54,206 INFO     repeater     task ashtech_hcorrstats starting 12.5 seconds late
2013-11-03 15:49:55,067 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:49:55,068 INFO     repeater     task phins3_hcorrstats starting 13.4 seconds late
2013-11-03 15:49:55,978 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:52:21,167 INFO     repeater     task nb150_lastensq starting 3.2 seconds late
2013-11-03 15:52:23,451 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:52:23,452 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:52:08
2013-11-03 15:52:23,453 INFO     repeater     task os75nb_lastensq starting 4.5 seconds late
2013-11-03 15:52:24,656 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:52:24,657 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:52:09
2013-11-03 15:54:44,813 INFO     repeater     task ashtech_hcorrstats starting 3.1 seconds late
2013-11-03 15:54:45,688 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:54:45,688 INFO     repeater     task phins3_hcorrstats starting 4.0 seconds late
2013-11-03 15:54:46,585 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 15:55:21,631 INFO     repeater     task nb150_lastensq starting 3.6 seconds late
2013-11-03 15:55:23,908 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:55:23,908 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:55:08
2013-11-03 15:55:23,909 INFO     repeater     task os75nb_lastensq starting 4.9 seconds late
2013-11-03 15:55:25,121 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:55:25,121 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:55:09
2013-11-03 15:58:20,331 INFO     repeater     task nb150_lastensq starting 2.3 seconds late
2013-11-03 15:58:22,656 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 15:58:22,656 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 15:58:08
2013-11-03 15:58:22,657 INFO     repeater     task os75nb_lastensq starting 3.7 seconds late
2013-11-03 15:58:23,906 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 15:58:23,907 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 15:58:09
2013-11-03 15:59:44,015 INFO     repeater     task ashtech_hcorrstats starting 2.3 seconds late
2013-11-03 15:59:44,895 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 15:59:44,895 INFO     repeater     task phins3_hcorrstats starting 3.2 seconds late
2013-11-03 15:59:45,806 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:01:20,918 INFO     repeater     task nb150_lastensq starting 2.9 seconds late
2013-11-03 16:01:23,238 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:01:23,238 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:01:08
2013-11-03 16:01:23,239 INFO     repeater     task os75nb_lastensq starting 4.2 seconds late
2013-11-03 16:01:24,426 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 16:01:24,426 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:01:09
2013-11-03 16:04:19,641 INFO     repeater     task nb150_lastensq starting 1.6 seconds late
2013-11-03 16:04:21,862 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:04:21,862 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:04:08
2013-11-03 16:04:21,863 INFO     repeater     task os75nb_lastensq starting 2.9 seconds late
2013-11-03 16:04:22,988 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:04:22,989 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:04:09
2013-11-03 16:04:43,011 INFO     repeater     task nb150_quick starting 1.3 seconds late
2013-11-03 16:04:45,432 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 16:04:45,433 INFO     repeater     task nb150_3dayplots starting 3.7 seconds late
2013-11-03 16:04:48,084 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 16:04:48,085 INFO     repeater     task os75nb_quick starting 6.4 seconds late
2013-11-03 16:04:50,498 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 16:04:50,498 INFO     repeater     task os75nb_3dayplots starting 8.8 seconds late
2013-11-03 16:04:53,271 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 16:04:53,271 INFO     repeater     task ashtech_hcorrstats starting 11.6 seconds late
2013-11-03 16:04:54,120 INFO     repeater     task ashtech_hcorrstats ended after 0.8 seconds
2013-11-03 16:04:54,121 INFO     repeater     task phins3_hcorrstats starting 12.4 seconds late
2013-11-03 16:04:55,014 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:07:20,206 INFO     repeater     task nb150_lastensq starting 2.2 seconds late
2013-11-03 16:07:22,406 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:07:22,407 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:07:08
2013-11-03 16:07:22,407 INFO     repeater     task os75nb_lastensq starting 3.4 seconds late
2013-11-03 16:07:23,491 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:07:23,491 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:07:09
2013-11-03 16:09:43,676 INFO     repeater     task ashtech_hcorrstats starting 2.0 seconds late
2013-11-03 16:09:44,559 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:09:44,560 INFO     repeater     task phins3_hcorrstats starting 2.9 seconds late
2013-11-03 16:09:45,472 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:10:20,508 INFO     repeater     task nb150_lastensq starting 2.5 seconds late
2013-11-03 16:10:22,760 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:10:22,760 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:10:08
2013-11-03 16:10:22,761 INFO     repeater     task os75nb_lastensq starting 3.8 seconds late
2013-11-03 16:10:23,848 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:10:23,849 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:10:09
2013-11-03 16:13:19,061 INFO     repeater     task nb150_lastensq starting 1.1 seconds late
2013-11-03 16:13:21,286 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:13:21,286 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:13:08
2013-11-03 16:13:21,287 INFO     repeater     task os75nb_lastensq starting 2.3 seconds late
2013-11-03 16:13:22,374 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:13:22,375 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:13:09
2013-11-03 16:14:42,480 INFO     repeater     task ashtech_hcorrstats starting 0.8 seconds late
2013-11-03 16:14:43,382 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:14:43,383 INFO     repeater     task phins3_hcorrstats starting 1.7 seconds late
2013-11-03 16:14:44,282 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:16:19,399 INFO     repeater     task nb150_lastensq starting 1.4 seconds late
2013-11-03 16:16:21,568 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:16:21,568 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:16:08
2013-11-03 16:16:21,569 INFO     repeater     task os75nb_lastensq starting 2.6 seconds late
2013-11-03 16:16:22,663 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:16:22,664 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:16:09
2013-11-03 16:19:22,896 INFO     repeater     task nb150_lastensq starting 4.9 seconds late
2013-11-03 16:19:25,096 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:19:25,098 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:19:08
2013-11-03 16:19:25,099 INFO     repeater     task os75nb_lastensq starting 6.1 seconds late
2013-11-03 16:19:26,197 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:19:26,198 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:19:09
2013-11-03 16:19:46,221 INFO     repeater     task nb150_quick starting 4.5 seconds late
2013-11-03 16:19:48,588 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 16:19:48,589 INFO     repeater     task nb150_3dayplots starting 6.9 seconds late
2013-11-03 16:19:51,260 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 16:19:51,261 INFO     repeater     task os75nb_quick starting 9.6 seconds late
2013-11-03 16:19:53,687 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 16:19:53,688 INFO     repeater     task os75nb_3dayplots starting 12.0 seconds late
2013-11-03 16:19:56,471 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 16:19:56,471 INFO     repeater     task ashtech_hcorrstats starting 14.8 seconds late
2013-11-03 16:19:57,326 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:19:57,326 INFO     repeater     task phins3_hcorrstats starting 15.6 seconds late
2013-11-03 16:19:58,219 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:22:18,381 INFO     repeater     task nb150_lastensq starting 0.4 seconds late
2013-11-03 16:22:20,684 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:22:20,684 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:22:08
2013-11-03 16:22:20,685 INFO     repeater     task os75nb_lastensq starting 1.7 seconds late
2013-11-03 16:22:21,822 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:22:21,822 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:22:09
2013-11-03 16:24:41,993 INFO     repeater     task ashtech_hcorrstats starting 0.3 seconds late
2013-11-03 16:24:42,960 INFO     repeater     task ashtech_hcorrstats ended after 1.0 seconds
2013-11-03 16:24:42,961 INFO     repeater     task phins3_hcorrstats starting 1.3 seconds late
2013-11-03 16:24:43,857 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:25:18,903 INFO     repeater     task nb150_lastensq starting 0.9 seconds late
2013-11-03 16:25:21,143 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:25:21,144 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:25:08
2013-11-03 16:25:21,145 INFO     repeater     task os75nb_lastensq starting 2.1 seconds late
2013-11-03 16:25:22,299 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 16:25:22,300 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:25:09
2013-11-03 16:28:22,519 INFO     repeater     task nb150_lastensq starting 4.5 seconds late
2013-11-03 16:28:24,792 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:28:24,793 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:28:08
2013-11-03 16:28:24,794 INFO     repeater     task os75nb_lastensq starting 5.8 seconds late
2013-11-03 16:28:25,935 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:28:25,935 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:28:09
2013-11-03 16:29:46,034 INFO     repeater     task ashtech_hcorrstats starting 4.3 seconds late
2013-11-03 16:29:46,907 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:29:46,908 INFO     repeater     task phins3_hcorrstats starting 5.2 seconds late
2013-11-03 16:29:47,847 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:31:22,971 INFO     repeater     task nb150_lastensq starting 5.0 seconds late
2013-11-03 16:31:25,208 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:31:25,209 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:31:08
2013-11-03 16:31:25,210 INFO     repeater     task os75nb_lastensq starting 6.2 seconds late
2013-11-03 16:31:26,314 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:31:26,314 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:31:09
2013-11-03 16:34:21,530 INFO     repeater     task nb150_lastensq starting 3.5 seconds late
2013-11-03 16:34:23,800 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:34:23,800 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:34:08
2013-11-03 16:34:23,801 INFO     repeater     task os75nb_lastensq starting 4.8 seconds late
2013-11-03 16:34:24,939 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:34:24,940 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:34:09
2013-11-03 16:34:44,954 INFO     repeater     task nb150_quick starting 3.3 seconds late
2013-11-03 16:34:47,389 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 16:34:47,389 INFO     repeater     task nb150_3dayplots starting 5.7 seconds late
2013-11-03 16:34:50,200 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 16:34:50,201 INFO     repeater     task os75nb_quick starting 8.5 seconds late
2013-11-03 16:34:52,629 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 16:34:52,629 INFO     repeater     task os75nb_3dayplots starting 10.9 seconds late
2013-11-03 16:34:55,515 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 16:34:55,516 INFO     repeater     task ashtech_hcorrstats starting 13.8 seconds late
2013-11-03 16:34:56,381 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:34:56,382 INFO     repeater     task phins3_hcorrstats starting 14.7 seconds late
2013-11-03 16:34:57,299 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:37:22,470 INFO     repeater     task nb150_lastensq starting 4.5 seconds late
2013-11-03 16:37:24,788 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:37:24,789 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:37:08
2013-11-03 16:37:24,789 INFO     repeater     task os75nb_lastensq starting 5.8 seconds late
2013-11-03 16:37:25,936 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:37:25,937 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:37:09
2013-11-03 16:39:46,113 INFO     repeater     task ashtech_hcorrstats starting 4.4 seconds late
2013-11-03 16:39:46,971 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:39:46,971 INFO     repeater     task phins3_hcorrstats starting 5.3 seconds late
2013-11-03 16:39:47,871 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:40:22,908 INFO     repeater     task nb150_lastensq starting 4.9 seconds late
2013-11-03 16:40:25,194 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:40:25,195 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:40:08
2013-11-03 16:40:25,195 INFO     repeater     task os75nb_lastensq starting 6.2 seconds late
2013-11-03 16:40:26,382 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 16:40:26,383 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:40:09
2013-11-03 16:43:21,601 INFO     repeater     task nb150_lastensq starting 3.6 seconds late
2013-11-03 16:43:23,793 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:43:23,793 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:43:08
2013-11-03 16:43:23,794 INFO     repeater     task os75nb_lastensq starting 4.8 seconds late
2013-11-03 16:43:24,905 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:43:24,905 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:43:09
2013-11-03 16:44:45,005 INFO     repeater     task ashtech_hcorrstats starting 3.3 seconds late
2013-11-03 16:44:45,864 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:44:45,865 INFO     repeater     task phins3_hcorrstats starting 4.2 seconds late
2013-11-03 16:44:46,801 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:46:21,927 INFO     repeater     task nb150_lastensq starting 3.9 seconds late
2013-11-03 16:46:24,213 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:46:24,213 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:46:08
2013-11-03 16:46:24,214 INFO     repeater     task os75nb_lastensq starting 5.2 seconds late
2013-11-03 16:46:25,329 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:46:25,330 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:46:09
2013-11-03 16:49:20,563 INFO     repeater     task nb150_lastensq starting 2.6 seconds late
2013-11-03 16:49:22,886 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:49:22,887 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:49:08
2013-11-03 16:49:22,888 INFO     repeater     task os75nb_lastensq starting 3.9 seconds late
2013-11-03 16:49:24,061 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 16:49:24,062 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:49:09
2013-11-03 16:49:44,084 INFO     repeater     task nb150_quick starting 2.4 seconds late
2013-11-03 16:49:46,523 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 16:49:46,523 INFO     repeater     task nb150_3dayplots starting 4.8 seconds late
2013-11-03 16:49:49,300 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 16:49:49,301 INFO     repeater     task os75nb_quick starting 7.6 seconds late
2013-11-03 16:49:51,731 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 16:49:51,732 INFO     repeater     task os75nb_3dayplots starting 10.0 seconds late
2013-11-03 16:49:54,539 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 16:49:54,540 INFO     repeater     task ashtech_hcorrstats starting 12.8 seconds late
2013-11-03 16:49:55,393 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:49:55,394 INFO     repeater     task phins3_hcorrstats starting 13.7 seconds late
2013-11-03 16:49:56,292 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:52:21,459 INFO     repeater     task nb150_lastensq starting 3.5 seconds late
2013-11-03 16:52:23,699 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:52:23,700 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:52:08
2013-11-03 16:52:23,701 INFO     repeater     task os75nb_lastensq starting 4.7 seconds late
2013-11-03 16:52:24,833 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 16:52:24,834 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:52:09
2013-11-03 16:54:45,015 INFO     repeater     task ashtech_hcorrstats starting 3.3 seconds late
2013-11-03 16:54:45,879 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:54:45,880 INFO     repeater     task phins3_hcorrstats starting 4.2 seconds late
2013-11-03 16:54:46,789 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 16:55:21,834 INFO     repeater     task nb150_lastensq starting 3.8 seconds late
2013-11-03 16:55:24,039 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 16:55:24,040 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:55:08
2013-11-03 16:55:24,041 INFO     repeater     task os75nb_lastensq starting 5.0 seconds late
2013-11-03 16:55:25,197 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 16:55:25,198 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:55:09
2013-11-03 16:58:20,421 INFO     repeater     task nb150_lastensq starting 2.4 seconds late
2013-11-03 16:58:22,695 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 16:58:22,696 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 16:58:08
2013-11-03 16:58:22,696 INFO     repeater     task os75nb_lastensq starting 3.7 seconds late
2013-11-03 16:58:23,864 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 16:58:23,864 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 16:58:09
2013-11-03 16:59:43,968 INFO     repeater     task ashtech_hcorrstats starting 2.3 seconds late
2013-11-03 16:59:44,842 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 16:59:44,843 INFO     repeater     task phins3_hcorrstats starting 3.1 seconds late
2013-11-03 16:59:45,785 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:01:20,888 INFO     repeater     task nb150_lastensq starting 2.9 seconds late
2013-11-03 17:01:23,208 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:01:23,209 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:01:08
2013-11-03 17:01:23,209 INFO     repeater     task os75nb_lastensq starting 4.2 seconds late
2013-11-03 17:01:24,372 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:01:24,372 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:01:09
2013-11-03 17:04:19,603 INFO     repeater     task nb150_lastensq starting 1.6 seconds late
2013-11-03 17:04:21,906 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:04:21,906 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:04:08
2013-11-03 17:04:21,907 INFO     repeater     task os75nb_lastensq starting 2.9 seconds late
2013-11-03 17:04:23,061 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:04:23,061 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:04:09
2013-11-03 17:04:43,090 INFO     repeater     task nb150_quick starting 1.4 seconds late
2013-11-03 17:04:45,510 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 17:04:45,511 INFO     repeater     task nb150_3dayplots starting 3.8 seconds late
2013-11-03 17:04:48,207 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 17:04:48,207 INFO     repeater     task os75nb_quick starting 6.5 seconds late
2013-11-03 17:04:50,638 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 17:04:50,638 INFO     repeater     task os75nb_3dayplots starting 8.9 seconds late
2013-11-03 17:04:53,530 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 17:04:53,530 INFO     repeater     task ashtech_hcorrstats starting 11.8 seconds late
2013-11-03 17:04:54,388 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:04:54,389 INFO     repeater     task phins3_hcorrstats starting 12.7 seconds late
2013-11-03 17:04:55,312 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:07:20,487 INFO     repeater     task nb150_lastensq starting 2.5 seconds late
2013-11-03 17:07:22,745 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:07:22,745 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:07:08
2013-11-03 17:07:22,746 INFO     repeater     task os75nb_lastensq starting 3.7 seconds late
2013-11-03 17:07:23,930 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:07:23,930 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:07:09
2013-11-03 17:09:44,223 INFO     repeater     task ashtech_hcorrstats starting 2.5 seconds late
2013-11-03 17:09:45,087 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:09:45,088 INFO     repeater     task phins3_hcorrstats starting 3.4 seconds late
2013-11-03 17:09:46,003 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:10:21,046 INFO     repeater     task nb150_lastensq starting 3.0 seconds late
2013-11-03 17:10:23,367 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:10:23,367 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:10:08
2013-11-03 17:10:23,368 INFO     repeater     task os75nb_lastensq starting 4.4 seconds late
2013-11-03 17:10:24,575 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:10:24,576 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:10:09
2013-11-03 17:13:19,774 INFO     repeater     task nb150_lastensq starting 1.8 seconds late
2013-11-03 17:13:21,997 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 17:13:21,997 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:13:08
2013-11-03 17:13:21,998 INFO     repeater     task os75nb_lastensq starting 3.0 seconds late
2013-11-03 17:13:23,159 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:13:23,160 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:13:09
2013-11-03 17:14:43,257 INFO     repeater     task ashtech_hcorrstats starting 1.6 seconds late
2013-11-03 17:14:44,122 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:14:44,122 INFO     repeater     task phins3_hcorrstats starting 2.4 seconds late
2013-11-03 17:14:45,009 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:16:20,116 INFO     repeater     task nb150_lastensq starting 2.1 seconds late
2013-11-03 17:16:22,434 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:16:22,435 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:16:08
2013-11-03 17:16:22,435 INFO     repeater     task os75nb_lastensq starting 3.4 seconds late
2013-11-03 17:16:23,585 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 17:16:23,585 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:16:09
2013-11-03 17:19:18,819 INFO     repeater     task nb150_lastensq starting 0.8 seconds late
2013-11-03 17:19:21,072 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:19:21,073 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:19:08
2013-11-03 17:19:21,073 INFO     repeater     task os75nb_lastensq starting 2.1 seconds late
2013-11-03 17:19:22,227 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:19:22,227 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:19:09
2013-11-03 17:19:42,253 INFO     repeater     task nb150_quick starting 0.6 seconds late
2013-11-03 17:19:44,666 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 17:19:44,667 INFO     repeater     task nb150_3dayplots starting 3.0 seconds late
2013-11-03 17:19:47,363 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 17:19:47,364 INFO     repeater     task os75nb_quick starting 5.7 seconds late
2013-11-03 17:19:49,805 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 17:19:49,806 INFO     repeater     task os75nb_3dayplots starting 8.1 seconds late
2013-11-03 17:19:52,618 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 17:19:52,618 INFO     repeater     task ashtech_hcorrstats starting 10.9 seconds late
2013-11-03 17:19:53,504 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:19:53,504 INFO     repeater     task phins3_hcorrstats starting 11.8 seconds late
2013-11-03 17:19:54,385 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:22:19,555 INFO     repeater     task nb150_lastensq starting 1.6 seconds late
2013-11-03 17:22:21,816 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:22:21,816 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:22:08
2013-11-03 17:22:21,817 INFO     repeater     task os75nb_lastensq starting 2.8 seconds late
2013-11-03 17:22:22,980 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:22:22,980 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:22:09
2013-11-03 17:24:43,163 INFO     repeater     task ashtech_hcorrstats starting 1.5 seconds late
2013-11-03 17:24:44,022 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:24:44,023 INFO     repeater     task phins3_hcorrstats starting 2.3 seconds late
2013-11-03 17:24:44,889 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:25:19,934 INFO     repeater     task nb150_lastensq starting 1.9 seconds late
2013-11-03 17:25:22,227 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:25:22,227 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:25:08
2013-11-03 17:25:22,228 INFO     repeater     task os75nb_lastensq starting 3.2 seconds late
2013-11-03 17:25:23,506 INFO     repeater     task os75nb_lastensq ended after 1.3 seconds
2013-11-03 17:25:23,506 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:25:09
2013-11-03 17:28:18,704 INFO     repeater     task nb150_lastensq starting 0.7 seconds late
2013-11-03 17:28:21,031 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:28:21,031 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:28:08
2013-11-03 17:28:21,032 INFO     repeater     task os75nb_lastensq starting 2.0 seconds late
2013-11-03 17:28:22,211 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:28:22,212 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:28:09
2013-11-03 17:29:42,304 INFO     repeater     task ashtech_hcorrstats starting 0.6 seconds late
2013-11-03 17:29:43,177 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:29:43,178 INFO     repeater     task phins3_hcorrstats starting 1.5 seconds late
2013-11-03 17:29:44,078 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:31:19,186 INFO     repeater     task nb150_lastensq starting 1.2 seconds late
2013-11-03 17:31:21,449 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:31:21,450 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:31:08
2013-11-03 17:31:21,451 INFO     repeater     task os75nb_lastensq starting 2.5 seconds late
2013-11-03 17:31:22,632 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:31:22,633 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:31:09
2013-11-03 17:34:22,861 INFO     repeater     task nb150_lastensq starting 4.9 seconds late
2013-11-03 17:34:25,096 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 17:34:25,097 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:34:08
2013-11-03 17:34:25,097 INFO     repeater     task os75nb_lastensq starting 6.1 seconds late
2013-11-03 17:34:26,304 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:34:26,305 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:34:09
2013-11-03 17:34:46,329 INFO     repeater     task nb150_quick starting 4.6 seconds late
2013-11-03 17:34:48,740 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 17:34:48,741 INFO     repeater     task nb150_3dayplots starting 7.0 seconds late
2013-11-03 17:34:51,520 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 17:34:51,521 INFO     repeater     task os75nb_quick starting 9.8 seconds late
2013-11-03 17:34:53,953 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 17:34:53,954 INFO     repeater     task os75nb_3dayplots starting 12.3 seconds late
2013-11-03 17:34:56,801 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 17:34:56,802 INFO     repeater     task ashtech_hcorrstats starting 15.1 seconds late
2013-11-03 17:34:57,682 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:34:57,682 INFO     repeater     task phins3_hcorrstats starting 16.0 seconds late
2013-11-03 17:34:58,566 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:37:19,088 INFO     repeater     task nb150_lastensq starting 1.1 seconds late
2013-11-03 17:37:21,473 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 17:37:21,473 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:37:08
2013-11-03 17:37:21,474 INFO     repeater     task os75nb_lastensq starting 2.5 seconds late
2013-11-03 17:37:22,670 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:37:22,670 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:37:09
2013-11-03 17:39:42,850 INFO     repeater     task ashtech_hcorrstats starting 1.2 seconds late
2013-11-03 17:39:43,717 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:39:43,721 INFO     repeater     task phins3_hcorrstats starting 2.0 seconds late
2013-11-03 17:39:44,596 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:40:19,639 INFO     repeater     task nb150_lastensq starting 1.6 seconds late
2013-11-03 17:40:22,030 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 17:40:22,030 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:40:08
2013-11-03 17:40:22,031 INFO     repeater     task os75nb_lastensq starting 3.0 seconds late
2013-11-03 17:40:23,223 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:40:23,224 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:40:09
2013-11-03 17:43:18,449 INFO     repeater     task nb150_lastensq starting 0.4 seconds late
2013-11-03 17:43:20,780 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:43:20,780 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:43:08
2013-11-03 17:43:20,781 INFO     repeater     task os75nb_lastensq starting 1.8 seconds late
2013-11-03 17:43:21,980 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:43:21,980 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:43:09
2013-11-03 17:44:42,074 INFO     repeater     task ashtech_hcorrstats starting 0.4 seconds late
2013-11-03 17:44:42,943 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:44:42,944 INFO     repeater     task phins3_hcorrstats starting 1.2 seconds late
2013-11-03 17:44:43,840 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:46:18,969 INFO     repeater     task nb150_lastensq starting 1.0 seconds late
2013-11-03 17:46:21,240 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:46:21,241 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:46:08
2013-11-03 17:46:21,241 INFO     repeater     task os75nb_lastensq starting 2.2 seconds late
2013-11-03 17:46:22,407 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:46:22,408 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:46:09
2013-11-03 17:49:22,641 INFO     repeater     task nb150_lastensq starting 4.6 seconds late
2013-11-03 17:49:24,957 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:49:24,958 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:49:08
2013-11-03 17:49:24,959 INFO     repeater     task os75nb_lastensq starting 6.0 seconds late
2013-11-03 17:49:26,121 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:49:26,122 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:49:09
2013-11-03 17:49:46,141 INFO     repeater     task nb150_quick starting 4.4 seconds late
2013-11-03 17:49:48,540 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 17:49:48,540 INFO     repeater     task nb150_3dayplots starting 6.8 seconds late
2013-11-03 17:49:51,329 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 17:49:51,330 INFO     repeater     task os75nb_quick starting 9.6 seconds late
2013-11-03 17:49:53,792 INFO     repeater     task os75nb_quick ended after 2.5 seconds
2013-11-03 17:49:53,792 INFO     repeater     task os75nb_3dayplots starting 12.1 seconds late
2013-11-03 17:49:56,698 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 17:49:56,698 INFO     repeater     task ashtech_hcorrstats starting 15.0 seconds late
2013-11-03 17:49:57,568 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:49:57,568 INFO     repeater     task phins3_hcorrstats starting 15.9 seconds late
2013-11-03 17:49:58,441 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:52:18,610 INFO     repeater     task nb150_lastensq starting 0.6 seconds late
2013-11-03 17:52:20,977 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 17:52:20,978 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:52:08
2013-11-03 17:52:20,978 INFO     repeater     task os75nb_lastensq starting 2.0 seconds late
2013-11-03 17:52:22,159 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:52:22,159 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:52:09
2013-11-03 17:54:42,326 INFO     repeater     task ashtech_hcorrstats starting 0.6 seconds late
2013-11-03 17:54:43,207 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:54:43,208 INFO     repeater     task phins3_hcorrstats starting 1.5 seconds late
2013-11-03 17:54:44,091 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 17:55:19,141 INFO     repeater     task nb150_lastensq starting 1.1 seconds late
2013-11-03 17:55:21,435 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:55:21,436 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:55:08
2013-11-03 17:55:21,436 INFO     repeater     task os75nb_lastensq starting 2.4 seconds late
2013-11-03 17:55:22,606 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:55:22,607 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:55:09
2013-11-03 17:58:22,814 INFO     repeater     task nb150_lastensq starting 4.8 seconds late
2013-11-03 17:58:25,148 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 17:58:25,149 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 17:58:08
2013-11-03 17:58:25,149 INFO     repeater     task os75nb_lastensq starting 6.1 seconds late
2013-11-03 17:58:26,362 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 17:58:26,362 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 17:58:09
2013-11-03 17:59:46,472 INFO     repeater     task ashtech_hcorrstats starting 4.8 seconds late
2013-11-03 17:59:47,369 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 17:59:47,370 INFO     repeater     task phins3_hcorrstats starting 5.7 seconds late
2013-11-03 17:59:48,258 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:01:18,361 INFO     repeater     task nb150_lastensq starting 0.4 seconds late
2013-11-03 18:01:20,732 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 18:01:20,733 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:01:08
2013-11-03 18:01:20,733 INFO     repeater     task os75nb_lastensq starting 1.7 seconds late
2013-11-03 18:01:21,925 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 18:01:21,926 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:01:09
2013-11-03 18:04:22,161 INFO     repeater     task nb150_lastensq starting 4.2 seconds late
2013-11-03 18:04:24,458 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:04:24,459 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:04:08
2013-11-03 18:04:24,459 INFO     repeater     task os75nb_lastensq starting 5.5 seconds late
2013-11-03 18:04:25,583 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:04:25,584 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:04:09
2013-11-03 18:04:45,609 INFO     repeater     task nb150_quick starting 3.9 seconds late
2013-11-03 18:04:48,054 INFO     repeater     task nb150_quick ended after 2.4 seconds
2013-11-03 18:04:48,054 INFO     repeater     task nb150_3dayplots starting 6.4 seconds late
2013-11-03 18:04:50,842 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 18:04:50,843 INFO     repeater     task os75nb_quick starting 9.1 seconds late
2013-11-03 18:04:53,316 INFO     repeater     task os75nb_quick ended after 2.5 seconds
2013-11-03 18:04:53,316 INFO     repeater     task os75nb_3dayplots starting 11.6 seconds late
2013-11-03 18:04:56,144 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 18:04:56,144 INFO     repeater     task ashtech_hcorrstats starting 14.5 seconds late
2013-11-03 18:04:57,007 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:04:57,007 INFO     repeater     task phins3_hcorrstats starting 15.3 seconds late
2013-11-03 18:04:57,899 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:07:18,066 INFO     repeater     task nb150_lastensq starting 0.1 seconds late
2013-11-03 18:07:20,299 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 18:07:20,300 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:07:08
2013-11-03 18:07:20,300 INFO     repeater     task os75nb_lastensq starting 1.3 seconds late
2013-11-03 18:07:21,425 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:07:21,426 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:07:09
2013-11-03 18:09:46,613 INFO     repeater     task ashtech_hcorrstats starting 4.9 seconds late
2013-11-03 18:09:47,486 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:09:47,486 INFO     repeater     task phins3_hcorrstats starting 5.8 seconds late
2013-11-03 18:09:48,360 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:10:18,391 INFO     repeater     task nb150_lastensq starting 0.4 seconds late
2013-11-03 18:10:20,649 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:10:20,650 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:10:08
2013-11-03 18:10:20,650 INFO     repeater     task os75nb_lastensq starting 1.7 seconds late
2013-11-03 18:10:21,772 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:10:21,772 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:10:09
2013-11-03 18:13:21,991 INFO     repeater     task nb150_lastensq starting 4.0 seconds late
2013-11-03 18:13:24,245 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:13:24,245 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:13:08
2013-11-03 18:13:24,246 INFO     repeater     task os75nb_lastensq starting 5.2 seconds late
2013-11-03 18:13:25,377 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:13:25,378 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:13:09
2013-11-03 18:14:45,468 INFO     repeater     task ashtech_hcorrstats starting 3.8 seconds late
2013-11-03 18:14:46,345 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:14:46,345 INFO     repeater     task phins3_hcorrstats starting 4.7 seconds late
2013-11-03 18:14:47,282 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:16:22,405 INFO     repeater     task nb150_lastensq starting 4.4 seconds late
2013-11-03 18:16:24,678 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:16:24,678 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:16:08
2013-11-03 18:16:24,679 INFO     repeater     task os75nb_lastensq starting 5.7 seconds late
2013-11-03 18:16:25,804 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:16:25,805 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:16:09
2013-11-03 18:19:21,036 INFO     repeater     task nb150_lastensq starting 3.0 seconds late
2013-11-03 18:19:23,340 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:19:23,341 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:19:08
2013-11-03 18:19:23,341 INFO     repeater     task os75nb_lastensq starting 4.3 seconds late
2013-11-03 18:19:24,475 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:19:24,475 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:19:09
2013-11-03 18:19:44,501 INFO     repeater     task nb150_quick starting 2.8 seconds late
2013-11-03 18:19:46,969 INFO     repeater     task nb150_quick ended after 2.5 seconds
2013-11-03 18:19:46,970 INFO     repeater     task nb150_3dayplots starting 5.3 seconds late
2013-11-03 18:19:49,762 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 18:19:49,763 INFO     repeater     task os75nb_quick starting 8.1 seconds late
2013-11-03 18:19:52,217 INFO     repeater     task os75nb_quick ended after 2.5 seconds
2013-11-03 18:19:52,218 INFO     repeater     task os75nb_3dayplots starting 10.5 seconds late
2013-11-03 18:19:55,039 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 18:19:55,040 INFO     repeater     task ashtech_hcorrstats starting 13.3 seconds late
2013-11-03 18:19:55,944 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:19:55,945 INFO     repeater     task phins3_hcorrstats starting 14.3 seconds late
2013-11-03 18:19:56,844 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:22:22,040 INFO     repeater     task nb150_lastensq starting 4.0 seconds late
2013-11-03 18:22:24,291 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:22:24,291 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:22:08
2013-11-03 18:22:24,292 INFO     repeater     task os75nb_lastensq starting 5.3 seconds late
2013-11-03 18:22:25,391 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:22:25,391 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:22:09
2013-11-03 18:24:45,563 INFO     repeater     task ashtech_hcorrstats starting 3.9 seconds late
2013-11-03 18:24:46,436 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:24:46,436 INFO     repeater     task phins3_hcorrstats starting 4.7 seconds late
2013-11-03 18:24:47,319 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:25:22,369 INFO     repeater     task nb150_lastensq starting 4.4 seconds late
2013-11-03 18:25:24,689 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:25:24,689 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:25:08
2013-11-03 18:25:24,690 INFO     repeater     task os75nb_lastensq starting 5.7 seconds late
2013-11-03 18:25:25,833 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:25:25,833 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:25:09
2013-11-03 18:28:21,061 INFO     repeater     task nb150_lastensq starting 3.1 seconds late
2013-11-03 18:28:23,381 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:28:23,382 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:28:08
2013-11-03 18:28:23,383 INFO     repeater     task os75nb_lastensq starting 4.4 seconds late
2013-11-03 18:28:24,496 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:28:24,496 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:28:09
2013-11-03 18:29:44,593 INFO     repeater     task ashtech_hcorrstats starting 2.9 seconds late
2013-11-03 18:29:45,484 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:29:45,484 INFO     repeater     task phins3_hcorrstats starting 3.8 seconds late
2013-11-03 18:29:46,421 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:31:21,546 INFO     repeater     task nb150_lastensq starting 3.5 seconds late
2013-11-03 18:31:23,735 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 18:31:23,735 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:31:08
2013-11-03 18:31:23,736 INFO     repeater     task os75nb_lastensq starting 4.7 seconds late
2013-11-03 18:31:24,850 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:31:24,850 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:31:09
2013-11-03 18:34:20,047 INFO     repeater     task nb150_lastensq starting 2.0 seconds late
2013-11-03 18:34:22,367 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:34:22,368 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:34:08
2013-11-03 18:34:22,368 INFO     repeater     task os75nb_lastensq starting 3.4 seconds late
2013-11-03 18:34:23,473 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:34:23,473 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:34:09
2013-11-03 18:34:43,494 INFO     repeater     task nb150_quick starting 1.8 seconds late
2013-11-03 18:34:46,005 INFO     repeater     task nb150_quick ended after 2.5 seconds
2013-11-03 18:34:46,005 INFO     repeater     task nb150_3dayplots starting 4.3 seconds late
2013-11-03 18:34:48,786 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 18:34:48,787 INFO     repeater     task os75nb_quick starting 7.1 seconds late
2013-11-03 18:34:51,317 INFO     repeater     task os75nb_quick ended after 2.5 seconds
2013-11-03 18:34:51,317 INFO     repeater     task os75nb_3dayplots starting 9.6 seconds late
2013-11-03 18:34:54,164 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 18:34:54,164 INFO     repeater     task ashtech_hcorrstats starting 12.5 seconds late
2013-11-03 18:34:55,038 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:34:55,039 INFO     repeater     task phins3_hcorrstats starting 13.3 seconds late
2013-11-03 18:34:55,923 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:37:21,096 INFO     repeater     task nb150_lastensq starting 3.1 seconds late
2013-11-03 18:37:23,410 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:37:23,410 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:37:08
2013-11-03 18:37:23,411 INFO     repeater     task os75nb_lastensq starting 4.4 seconds late
2013-11-03 18:37:24,553 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:37:24,554 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:37:09
2013-11-03 18:39:44,723 INFO     repeater     task ashtech_hcorrstats starting 3.0 seconds late
2013-11-03 18:39:45,620 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:39:45,620 INFO     repeater     task phins3_hcorrstats starting 3.9 seconds late
2013-11-03 18:39:46,518 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:40:21,563 INFO     repeater     task nb150_lastensq starting 3.6 seconds late
2013-11-03 18:40:23,864 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:40:23,865 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:40:08
2013-11-03 18:40:23,865 INFO     repeater     task os75nb_lastensq starting 4.9 seconds late
2013-11-03 18:40:25,019 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 18:40:25,019 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:40:09
2013-11-03 18:43:20,241 INFO     repeater     task nb150_lastensq starting 2.2 seconds late
2013-11-03 18:43:22,447 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 18:43:22,448 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:43:08
2013-11-03 18:43:22,448 INFO     repeater     task os75nb_lastensq starting 3.4 seconds late
2013-11-03 18:43:23,555 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:43:23,555 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:43:09
2013-11-03 18:44:43,670 INFO     repeater     task ashtech_hcorrstats starting 2.0 seconds late
2013-11-03 18:44:44,555 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:44:44,555 INFO     repeater     task phins3_hcorrstats starting 2.9 seconds late
2013-11-03 18:44:45,470 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:46:20,584 INFO     repeater     task nb150_lastensq starting 2.6 seconds late
2013-11-03 18:46:22,914 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:46:22,915 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:46:08
2013-11-03 18:46:22,915 INFO     repeater     task os75nb_lastensq starting 3.9 seconds late
2013-11-03 18:46:24,074 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 18:46:24,074 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:46:09
2013-11-03 18:49:19,298 INFO     repeater     task nb150_lastensq starting 1.3 seconds late
2013-11-03 18:49:21,559 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:49:21,560 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:49:08
2013-11-03 18:49:21,560 INFO     repeater     task os75nb_lastensq starting 2.6 seconds late
2013-11-03 18:49:22,709 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:49:22,709 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:49:09
2013-11-03 18:49:42,732 INFO     repeater     task nb150_quick starting 1.0 seconds late
2013-11-03 18:49:45,196 INFO     repeater     task nb150_quick ended after 2.5 seconds
2013-11-03 18:49:45,197 INFO     repeater     task nb150_3dayplots starting 3.5 seconds late
2013-11-03 18:49:48,012 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 18:49:48,013 INFO     repeater     task os75nb_quick starting 6.3 seconds late
2013-11-03 18:49:50,495 INFO     repeater     task os75nb_quick ended after 2.5 seconds
2013-11-03 18:49:50,495 INFO     repeater     task os75nb_3dayplots starting 8.8 seconds late
2013-11-03 18:49:53,396 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 18:49:53,396 INFO     repeater     task ashtech_hcorrstats starting 11.7 seconds late
2013-11-03 18:49:54,269 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:49:54,270 INFO     repeater     task phins3_hcorrstats starting 12.6 seconds late
2013-11-03 18:49:55,160 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:52:20,349 INFO     repeater     task nb150_lastensq starting 2.3 seconds late
2013-11-03 18:52:22,680 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:52:22,680 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:52:08
2013-11-03 18:52:22,681 INFO     repeater     task os75nb_lastensq starting 3.7 seconds late
2013-11-03 18:52:23,867 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 18:52:23,868 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:52:09
2013-11-03 18:54:44,057 INFO     repeater     task ashtech_hcorrstats starting 2.4 seconds late
2013-11-03 18:54:44,959 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:54:44,960 INFO     repeater     task phins3_hcorrstats starting 3.3 seconds late
2013-11-03 18:54:45,871 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 18:55:20,918 INFO     repeater     task nb150_lastensq starting 2.9 seconds late
2013-11-03 18:55:23,184 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:55:23,184 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:55:08
2013-11-03 18:55:23,185 INFO     repeater     task os75nb_lastensq starting 4.2 seconds late
2013-11-03 18:55:24,308 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 18:55:24,308 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:55:09
2013-11-03 18:58:19,523 INFO     repeater     task nb150_lastensq starting 1.5 seconds late
2013-11-03 18:58:21,814 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 18:58:21,815 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 18:58:08
2013-11-03 18:58:21,816 INFO     repeater     task os75nb_lastensq starting 2.8 seconds late
2013-11-03 18:58:22,970 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 18:58:22,971 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 18:58:09
2013-11-03 18:59:43,063 INFO     repeater     task ashtech_hcorrstats starting 1.4 seconds late
2013-11-03 18:59:43,962 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 18:59:43,963 INFO     repeater     task phins3_hcorrstats starting 2.3 seconds late
2013-11-03 18:59:44,888 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 19:01:19,995 INFO     repeater     task nb150_lastensq starting 2.0 seconds late
2013-11-03 19:01:22,275 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 19:01:22,276 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:01:08
2013-11-03 19:01:22,276 INFO     repeater     task os75nb_lastensq starting 3.3 seconds late
2013-11-03 19:01:23,447 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 19:01:23,448 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:01:09
2013-11-03 19:04:18,686 INFO     repeater     task nb150_lastensq starting 0.7 seconds late
2013-11-03 19:04:20,938 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 19:04:20,938 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:04:08
2013-11-03 19:04:20,939 INFO     repeater     task os75nb_lastensq starting 1.9 seconds late
2013-11-03 19:04:22,086 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 19:04:22,086 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:04:09
2013-11-03 19:04:42,111 INFO     repeater     task nb150_quick starting 0.4 seconds late
2013-11-03 19:04:44,597 INFO     repeater     task nb150_quick ended after 2.5 seconds
2013-11-03 19:04:44,597 INFO     repeater     task nb150_3dayplots starting 2.9 seconds late
2013-11-03 19:04:47,339 INFO     repeater     task nb150_3dayplots ended after 2.7 seconds
2013-11-03 19:04:47,340 INFO     repeater     task os75nb_quick starting 5.6 seconds late
2013-11-03 19:04:49,779 INFO     repeater     task os75nb_quick ended after 2.4 seconds
2013-11-03 19:04:49,779 INFO     repeater     task os75nb_3dayplots starting 8.1 seconds late
2013-11-03 19:04:52,639 INFO     repeater     task os75nb_3dayplots ended after 2.9 seconds
2013-11-03 19:04:52,640 INFO     repeater     task ashtech_hcorrstats starting 10.9 seconds late
2013-11-03 19:04:53,514 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 19:04:53,514 INFO     repeater     task phins3_hcorrstats starting 11.8 seconds late
2013-11-03 19:04:54,429 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 19:07:19,626 INFO     repeater     task nb150_lastensq starting 1.6 seconds late
2013-11-03 19:07:21,919 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 19:07:21,920 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:07:08
2013-11-03 19:07:21,920 INFO     repeater     task os75nb_lastensq starting 2.9 seconds late
2013-11-03 19:07:23,115 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 19:07:23,116 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:07:09
2013-11-03 19:09:43,290 INFO     repeater     task ashtech_hcorrstats starting 1.6 seconds late
2013-11-03 19:09:44,185 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 19:09:44,186 INFO     repeater     task phins3_hcorrstats starting 2.5 seconds late
2013-11-03 19:09:45,114 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 19:10:20,156 INFO     repeater     task nb150_lastensq starting 2.2 seconds late
2013-11-03 19:10:22,420 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 19:10:22,420 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:10:08
2013-11-03 19:10:22,421 INFO     repeater     task os75nb_lastensq starting 3.4 seconds late
2013-11-03 19:10:23,567 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 19:10:23,568 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:10:09
2013-11-03 19:13:18,768 INFO     repeater     task nb150_lastensq starting 0.8 seconds late
2013-11-03 19:13:20,999 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 19:13:21,000 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:13:08
2013-11-03 19:13:21,000 INFO     repeater     task os75nb_lastensq starting 2.0 seconds late
2013-11-03 19:13:22,151 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 19:13:22,151 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:13:09
2013-11-03 19:14:42,250 INFO     repeater     task ashtech_hcorrstats starting 0.6 seconds late
2013-11-03 19:14:43,145 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 19:14:43,146 INFO     repeater     task phins3_hcorrstats starting 1.5 seconds late
2013-11-03 19:14:44,083 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 19:16:19,209 INFO     repeater     task nb150_lastensq starting 1.2 seconds late
2013-11-03 19:16:21,452 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 19:16:21,452 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:16:08
2013-11-03 19:16:21,453 INFO     repeater     task os75nb_lastensq starting 2.5 seconds late
2013-11-03 19:16:22,612 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 19:16:22,613 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:16:09
2013-11-03 19:19:22,846 INFO     repeater     task nb150_lastensq starting 4.8 seconds late
2013-11-03 19:19:25,196 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 19:19:25,196 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:19:08
2013-11-03 19:19:25,197 INFO     repeater     task os75nb_lastensq starting 6.2 seconds late
2013-11-03 19:19:26,388 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 19:19:26,388 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:19:09
2013-11-03 19:19:46,416 INFO     repeater     task nb150_quick starting 4.7 seconds late
2013-11-03 19:19:48,909 INFO     repeater     task nb150_quick ended after 2.5 seconds
2013-11-03 19:19:48,910 INFO     repeater     task nb150_3dayplots starting 7.2 seconds late
2013-11-03 19:19:51,712 INFO     repeater     task nb150_3dayplots ended after 2.8 seconds
2013-11-03 19:19:51,713 INFO     repeater     task os75nb_quick starting 10.0 seconds late
2013-11-03 19:19:54,275 INFO     repeater     task os75nb_quick ended after 2.6 seconds
2013-11-03 19:19:54,276 INFO     repeater     task os75nb_3dayplots starting 12.6 seconds late
2013-11-03 19:19:57,117 INFO     repeater     task os75nb_3dayplots ended after 2.8 seconds
2013-11-03 19:19:57,118 INFO     repeater     task ashtech_hcorrstats starting 15.4 seconds late
2013-11-03 19:19:57,989 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 19:19:57,989 INFO     repeater     task phins3_hcorrstats starting 16.3 seconds late
2013-11-03 19:19:58,914 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 19:22:19,082 INFO     repeater     task nb150_lastensq starting 1.1 seconds late
2013-11-03 19:22:21,343 INFO     repeater     task nb150_lastensq ended after 2.3 seconds
2013-11-03 19:22:21,344 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:22:08
2013-11-03 19:22:21,344 INFO     repeater     task os75nb_lastensq starting 2.3 seconds late
2013-11-03 19:22:22,487 INFO     repeater     task os75nb_lastensq ended after 1.1 seconds
2013-11-03 19:22:22,487 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:22:09
2013-11-03 19:24:42,683 INFO     repeater     task ashtech_hcorrstats starting 1.0 seconds late
2013-11-03 19:24:43,557 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 19:24:43,557 INFO     repeater     task phins3_hcorrstats starting 1.9 seconds late
2013-11-03 19:24:44,483 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 19:25:19,531 INFO     repeater     task nb150_lastensq starting 1.5 seconds late
2013-11-03 19:25:21,910 INFO     repeater     task nb150_lastensq ended after 2.4 seconds
2013-11-03 19:25:21,911 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:25:08
2013-11-03 19:25:21,912 INFO     repeater     task os75nb_lastensq starting 2.9 seconds late
2013-11-03 19:25:23,083 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 19:25:23,084 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:25:09
2013-11-03 19:28:18,301 INFO     repeater     task nb150_lastensq starting 0.3 seconds late
2013-11-03 19:28:20,543 INFO     repeater     task nb150_lastensq ended after 2.2 seconds
2013-11-03 19:28:20,543 INFO     repeater     task nb150_lastensq: Time from /home/data/RR1315/proc/nb150/load/wrote_ens_time: 2013/11/03 19:28:08
2013-11-03 19:28:20,544 INFO     repeater     task os75nb_lastensq starting 1.5 seconds late
2013-11-03 19:28:21,695 INFO     repeater     task os75nb_lastensq ended after 1.2 seconds
2013-11-03 19:28:21,695 INFO     repeater     task os75nb_lastensq: Time from /home/data/RR1315/proc/os75nb/load/wrote_ens_time: 2013/11/03 19:28:09
2013-11-03 19:29:41,803 INFO     repeater     task ashtech_hcorrstats starting 0.1 seconds late
2013-11-03 19:29:42,696 INFO     repeater     task ashtech_hcorrstats ended after 0.9 seconds
2013-11-03 19:29:42,697 INFO     repeater     task phins3_hcorrstats starting 1.0 seconds late
2013-11-03 19:29:43,612 INFO     repeater     task phins3_hcorrstats ended after 0.9 seconds
2013-11-03 19:31:18,716 INFO     repeater     task nb150_lastensq starting 0.7 seconds late