2012-09-03 21:59:38,907 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 21:59:25 2012-09-03 21:59:38,908 INFO repeater task os75nb_lastensq starting 2.9 seconds late 2012-09-03 21:59:39,946 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 21:59:39,947 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 21:59:26 2012-09-03 22:04:25,328 INFO repeater task ashtech_hcorrstats starting 0.1 seconds late 2012-09-03 22:04:26,235 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:04:26,236 INFO repeater task phins_hcorrstats starting 1.0 seconds late 2012-09-03 22:04:27,066 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:04:27,066 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:04:37,075 INFO repeater task nb150_lastensq starting 2.1 seconds late 2012-09-03 22:04:39,282 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-03 22:04:39,283 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:04:25 2012-09-03 22:04:39,284 INFO repeater task os75nb_lastensq starting 3.3 seconds late 2012-09-03 22:04:40,304 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:04:40,305 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:04:26 2012-09-03 22:09:25,672 INFO repeater task nb150_quick starting 0.5 seconds late 2012-09-03 22:09:29,798 INFO repeater task nb150_quick ended after 4.1 seconds 2012-09-03 22:09:29,799 INFO repeater task nb150_3dayplots starting 4.6 seconds late 2012-09-03 22:09:34,534 INFO repeater task nb150_3dayplots ended after 4.7 seconds 2012-09-03 22:09:34,534 INFO repeater task os75nb_quick starting 9.3 seconds late 2012-09-03 22:09:38,798 INFO repeater task os75nb_quick ended after 4.3 seconds 2012-09-03 22:09:38,799 INFO repeater task os75nb_3dayplots starting 13.6 seconds late 2012-09-03 22:09:43,994 INFO repeater task os75nb_3dayplots ended after 5.2 seconds 2012-09-03 22:09:43,995 INFO repeater task ashtech_hcorrstats starting 18.8 seconds late 2012-09-03 22:09:44,884 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:09:44,885 INFO repeater task phins_hcorrstats starting 19.7 seconds late 2012-09-03 22:09:45,715 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:09:45,715 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:09:50,717 INFO repeater task nb150_lastensq starting 15.7 seconds late 2012-09-03 22:09:52,835 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:09:52,836 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:09:25 2012-09-03 22:09:52,837 INFO repeater task os75nb_lastensq starting 16.8 seconds late 2012-09-03 22:09:53,851 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:09:53,851 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:09:26 2012-09-03 22:14:29,193 INFO repeater task ashtech_hcorrstats starting 4.0 seconds late 2012-09-03 22:14:30,084 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:14:30,084 INFO repeater task phins_hcorrstats starting 4.9 seconds late 2012-09-03 22:14:30,903 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:14:30,903 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:14:35,907 INFO repeater task nb150_lastensq starting 0.9 seconds late 2012-09-03 22:14:38,038 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:14:38,038 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:14:25 2012-09-03 22:14:38,039 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2012-09-03 22:14:39,060 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:14:39,061 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:14:26 2012-09-03 22:19:29,426 INFO repeater task ashtech_hcorrstats starting 4.2 seconds late 2012-09-03 22:19:30,336 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:19:30,336 INFO repeater task phins_hcorrstats starting 5.1 seconds late 2012-09-03 22:19:31,166 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:19:31,167 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:19:36,172 INFO repeater task nb150_lastensq starting 1.2 seconds late 2012-09-03 22:19:38,226 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:19:38,226 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:19:25 2012-09-03 22:19:38,227 INFO repeater task os75nb_lastensq starting 2.2 seconds late 2012-09-03 22:19:39,236 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:19:39,236 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:19:26 2012-09-03 22:24:29,594 INFO repeater task nb150_quick starting 4.4 seconds late 2012-09-03 22:24:33,764 INFO repeater task nb150_quick ended after 4.2 seconds 2012-09-03 22:24:33,765 INFO repeater task nb150_3dayplots starting 8.6 seconds late 2012-09-03 22:24:38,557 INFO repeater task nb150_3dayplots ended after 4.8 seconds 2012-09-03 22:24:38,557 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2012-09-03 22:24:39,591 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:24:39,591 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:24:26 2012-09-03 22:24:39,591 INFO repeater task os75nb_quick starting 14.4 seconds late 2012-09-03 22:24:43,779 INFO repeater task os75nb_quick ended after 4.2 seconds 2012-09-03 22:24:43,780 INFO repeater task os75nb_3dayplots starting 18.6 seconds late 2012-09-03 22:24:49,050 INFO repeater task os75nb_3dayplots ended after 5.3 seconds 2012-09-03 22:24:49,051 INFO repeater task ashtech_hcorrstats starting 23.8 seconds late 2012-09-03 22:24:49,946 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:24:49,946 INFO repeater task phins_hcorrstats starting 24.7 seconds late 2012-09-03 22:24:50,775 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:24:50,776 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:24:55,781 INFO repeater task nb150_lastensq starting 20.8 seconds late 2012-09-03 22:24:57,839 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:24:57,840 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:24:25 2012-09-03 22:29:28,193 INFO repeater task ashtech_hcorrstats starting 3.0 seconds late 2012-09-03 22:29:29,096 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:29:29,096 INFO repeater task phins_hcorrstats starting 3.9 seconds late 2012-09-03 22:29:29,932 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:29:29,933 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:29:39,942 INFO repeater task nb150_lastensq starting 4.9 seconds late 2012-09-03 22:29:42,087 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:29:42,088 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:29:25 2012-09-03 22:29:42,088 INFO repeater task os75nb_lastensq starting 6.1 seconds late 2012-09-03 22:29:43,102 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:29:43,103 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:29:26 2012-09-03 22:34:28,446 INFO repeater task ashtech_hcorrstats starting 3.2 seconds late 2012-09-03 22:34:29,361 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:34:29,362 INFO repeater task phins_hcorrstats starting 4.2 seconds late 2012-09-03 22:34:30,189 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:34:30,189 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:34:35,194 INFO repeater task nb150_lastensq starting 0.2 seconds late 2012-09-03 22:34:37,259 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:34:37,260 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:34:25 2012-09-03 22:34:37,261 INFO repeater task os75nb_lastensq starting 1.3 seconds late 2012-09-03 22:34:38,273 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:34:38,274 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:34:26 2012-09-03 22:39:28,627 INFO repeater task nb150_quick starting 3.4 seconds late 2012-09-03 22:39:32,811 INFO repeater task nb150_quick ended after 4.2 seconds 2012-09-03 22:39:32,812 INFO repeater task nb150_3dayplots starting 7.6 seconds late 2012-09-03 22:39:37,655 INFO repeater task nb150_3dayplots ended after 4.8 seconds 2012-09-03 22:39:37,655 INFO repeater task os75nb_lastensq starting 1.7 seconds late 2012-09-03 22:39:38,653 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:39:38,654 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:39:26 2012-09-03 22:39:38,654 INFO repeater task os75nb_quick starting 13.5 seconds late 2012-09-03 22:39:42,888 INFO repeater task os75nb_quick ended after 4.2 seconds 2012-09-03 22:39:42,888 INFO repeater task os75nb_3dayplots starting 17.7 seconds late 2012-09-03 22:39:48,071 INFO repeater task os75nb_3dayplots ended after 5.2 seconds 2012-09-03 22:39:48,072 INFO repeater task ashtech_hcorrstats starting 22.9 seconds late 2012-09-03 22:39:48,959 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:39:48,960 INFO repeater task phins_hcorrstats starting 23.8 seconds late 2012-09-03 22:39:49,799 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:39:49,799 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:39:54,804 INFO repeater task nb150_lastensq starting 19.8 seconds late 2012-09-03 22:39:56,867 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:39:56,867 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:39:25 2012-09-03 22:44:27,201 INFO repeater task ashtech_hcorrstats starting 2.0 seconds late 2012-09-03 22:44:28,117 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:44:28,117 INFO repeater task phins_hcorrstats starting 2.9 seconds late 2012-09-03 22:44:28,947 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:44:28,947 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:44:38,960 INFO repeater task nb150_lastensq starting 4.0 seconds late 2012-09-03 22:44:41,057 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:44:41,058 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:44:25 2012-09-03 22:44:41,059 INFO repeater task os75nb_lastensq starting 5.1 seconds late 2012-09-03 22:44:42,079 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:44:42,079 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:44:26 2012-09-03 22:49:27,433 INFO repeater task ashtech_hcorrstats starting 2.2 seconds late 2012-09-03 22:49:28,344 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:49:28,344 INFO repeater task phins_hcorrstats starting 3.1 seconds late 2012-09-03 22:49:29,175 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:49:29,175 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:49:39,188 INFO repeater task nb150_lastensq starting 4.2 seconds late 2012-09-03 22:49:41,353 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-03 22:49:41,354 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:49:25 2012-09-03 22:49:41,354 INFO repeater task os75nb_lastensq starting 5.4 seconds late 2012-09-03 22:49:42,394 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:49:42,395 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:49:26 2012-09-03 22:54:27,772 INFO repeater task nb150_quick starting 2.6 seconds late 2012-09-03 22:54:32,028 INFO repeater task nb150_quick ended after 4.3 seconds 2012-09-03 22:54:32,028 INFO repeater task nb150_3dayplots starting 6.8 seconds late 2012-09-03 22:54:36,848 INFO repeater task nb150_3dayplots ended after 4.8 seconds 2012-09-03 22:54:36,848 INFO repeater task os75nb_lastensq starting 0.8 seconds late 2012-09-03 22:54:37,863 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:54:37,863 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:54:26 2012-09-03 22:54:37,864 INFO repeater task os75nb_quick starting 12.7 seconds late 2012-09-03 22:54:42,252 INFO repeater task os75nb_quick ended after 4.4 seconds 2012-09-03 22:54:42,252 INFO repeater task os75nb_3dayplots starting 17.0 seconds late 2012-09-03 22:54:47,597 INFO repeater task os75nb_3dayplots ended after 5.3 seconds 2012-09-03 22:54:47,598 INFO repeater task ashtech_hcorrstats starting 22.4 seconds late 2012-09-03 22:54:48,539 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:54:48,539 INFO repeater task phins_hcorrstats starting 23.3 seconds late 2012-09-03 22:54:49,373 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:54:49,373 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:54:54,374 INFO repeater task nb150_lastensq starting 19.4 seconds late 2012-09-03 22:54:56,439 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:54:56,439 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:54:25 2012-09-03 22:59:26,818 INFO repeater task ashtech_hcorrstats starting 1.6 seconds late 2012-09-03 22:59:27,718 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 22:59:27,719 INFO repeater task phins_hcorrstats starting 2.5 seconds late 2012-09-03 22:59:28,545 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 22:59:28,545 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 22:59:38,558 INFO repeater task nb150_lastensq starting 3.6 seconds late 2012-09-03 22:59:40,672 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 22:59:40,673 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 22:59:25 2012-09-03 22:59:40,674 INFO repeater task os75nb_lastensq starting 4.7 seconds late 2012-09-03 22:59:41,671 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 22:59:41,671 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 22:59:26 2012-09-03 23:04:27,033 INFO repeater task ashtech_hcorrstats starting 1.8 seconds late 2012-09-03 23:04:27,931 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:04:27,932 INFO repeater task phins_hcorrstats starting 2.7 seconds late 2012-09-03 23:04:28,753 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:04:28,754 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:04:38,764 INFO repeater task nb150_lastensq starting 3.8 seconds late 2012-09-03 23:04:40,899 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:04:40,900 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:04:25 2012-09-03 23:04:40,901 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2012-09-03 23:04:41,950 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:04:41,951 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:04:26 2012-09-03 23:09:27,293 INFO repeater task nb150_quick starting 2.1 seconds late 2012-09-03 23:09:31,542 INFO repeater task nb150_quick ended after 4.2 seconds 2012-09-03 23:09:31,543 INFO repeater task nb150_3dayplots starting 6.3 seconds late 2012-09-03 23:09:36,378 INFO repeater task nb150_3dayplots ended after 4.8 seconds 2012-09-03 23:09:36,379 INFO repeater task os75nb_lastensq starting 0.4 seconds late 2012-09-03 23:09:37,429 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-03 23:09:37,429 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:09:26 2012-09-03 23:09:37,430 INFO repeater task os75nb_quick starting 12.2 seconds late 2012-09-03 23:09:41,695 INFO repeater task os75nb_quick ended after 4.3 seconds 2012-09-03 23:09:41,695 INFO repeater task os75nb_3dayplots starting 16.5 seconds late 2012-09-03 23:09:47,031 INFO repeater task os75nb_3dayplots ended after 5.3 seconds 2012-09-03 23:09:47,031 INFO repeater task ashtech_hcorrstats starting 21.8 seconds late 2012-09-03 23:09:47,944 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:09:47,945 INFO repeater task phins_hcorrstats starting 22.7 seconds late 2012-09-03 23:09:48,781 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:09:48,781 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:09:53,784 INFO repeater task nb150_lastensq starting 18.8 seconds late 2012-09-03 23:09:55,915 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:09:55,915 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:09:25 2012-09-03 23:14:26,278 INFO repeater task ashtech_hcorrstats starting 1.1 seconds late 2012-09-03 23:14:27,164 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:14:27,165 INFO repeater task phins_hcorrstats starting 2.0 seconds late 2012-09-03 23:14:27,982 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:14:27,982 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:14:37,994 INFO repeater task nb150_lastensq starting 3.0 seconds late 2012-09-03 23:14:40,081 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:14:40,104 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:14:25 2012-09-03 23:14:40,105 INFO repeater task os75nb_lastensq starting 4.1 seconds late 2012-09-03 23:14:41,116 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:14:41,116 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:14:26 2012-09-03 23:19:26,496 INFO repeater task ashtech_hcorrstats starting 1.3 seconds late 2012-09-03 23:19:27,396 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:19:27,396 INFO repeater task phins_hcorrstats starting 2.2 seconds late 2012-09-03 23:19:28,217 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:19:28,217 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:19:38,230 INFO repeater task nb150_lastensq starting 3.2 seconds late 2012-09-03 23:19:40,330 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:19:40,330 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:19:25 2012-09-03 23:19:40,331 INFO repeater task os75nb_lastensq starting 4.3 seconds late 2012-09-03 23:19:41,337 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:19:41,338 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:19:26 2012-09-03 23:24:26,720 INFO repeater task nb150_quick starting 1.5 seconds late 2012-09-03 23:24:30,843 INFO repeater task nb150_quick ended after 4.1 seconds 2012-09-03 23:24:30,844 INFO repeater task nb150_3dayplots starting 5.6 seconds late 2012-09-03 23:24:35,577 INFO repeater task nb150_3dayplots ended after 4.7 seconds 2012-09-03 23:24:35,578 INFO repeater task os75nb_quick starting 10.4 seconds late 2012-09-03 23:24:39,861 INFO repeater task os75nb_quick ended after 4.3 seconds 2012-09-03 23:24:39,862 INFO repeater task os75nb_3dayplots starting 14.7 seconds late 2012-09-03 23:24:45,176 INFO repeater task os75nb_3dayplots ended after 5.3 seconds 2012-09-03 23:24:45,177 INFO repeater task ashtech_hcorrstats starting 20.0 seconds late 2012-09-03 23:24:46,079 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:24:46,080 INFO repeater task phins_hcorrstats starting 20.9 seconds late 2012-09-03 23:24:46,926 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:24:46,927 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:24:51,932 INFO repeater task nb150_lastensq starting 16.9 seconds late 2012-09-03 23:24:54,019 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:24:54,020 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:24:25 2012-09-03 23:24:54,021 INFO repeater task os75nb_lastensq starting 18.0 seconds late 2012-09-03 23:24:55,027 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:24:55,028 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:24:26 2012-09-03 23:29:25,366 INFO repeater task ashtech_hcorrstats starting 0.2 seconds late 2012-09-03 23:29:26,279 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:29:26,279 INFO repeater task phins_hcorrstats starting 1.1 seconds late 2012-09-03 23:29:27,110 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:29:27,110 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:29:37,122 INFO repeater task nb150_lastensq starting 2.1 seconds late 2012-09-03 23:29:39,244 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:29:39,244 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:29:25 2012-09-03 23:29:39,245 INFO repeater task os75nb_lastensq starting 3.2 seconds late 2012-09-03 23:29:40,255 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:29:40,256 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:29:26 2012-09-03 23:34:25,586 INFO repeater task ashtech_hcorrstats starting 0.4 seconds late 2012-09-03 23:34:26,486 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:34:26,486 INFO repeater task phins_hcorrstats starting 1.3 seconds late 2012-09-03 23:34:27,301 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:34:27,301 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:34:37,312 INFO repeater task nb150_lastensq starting 2.3 seconds late 2012-09-03 23:34:39,464 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-03 23:34:39,464 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:34:25 2012-09-03 23:34:39,465 INFO repeater task os75nb_lastensq starting 3.5 seconds late 2012-09-03 23:34:40,477 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:34:40,478 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:34:26 2012-09-03 23:39:25,854 INFO repeater task nb150_quick starting 0.7 seconds late 2012-09-03 23:39:30,096 INFO repeater task nb150_quick ended after 4.2 seconds 2012-09-03 23:39:30,096 INFO repeater task nb150_3dayplots starting 4.9 seconds late 2012-09-03 23:39:34,916 INFO repeater task nb150_3dayplots ended after 4.8 seconds 2012-09-03 23:39:34,917 INFO repeater task os75nb_quick starting 9.7 seconds late 2012-09-03 23:39:39,151 INFO repeater task os75nb_quick ended after 4.2 seconds 2012-09-03 23:39:39,152 INFO repeater task os75nb_3dayplots starting 13.9 seconds late 2012-09-03 23:39:44,380 INFO repeater task os75nb_3dayplots ended after 5.2 seconds 2012-09-03 23:39:44,381 INFO repeater task ashtech_hcorrstats starting 19.2 seconds late 2012-09-03 23:39:45,281 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:39:45,282 INFO repeater task phins_hcorrstats starting 20.1 seconds late 2012-09-03 23:39:46,111 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:39:46,111 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:39:51,117 INFO repeater task nb150_lastensq starting 16.1 seconds late 2012-09-03 23:39:53,284 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-03 23:39:53,285 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:39:25 2012-09-03 23:39:53,285 INFO repeater task os75nb_lastensq starting 17.3 seconds late 2012-09-03 23:39:54,342 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-03 23:39:54,342 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:39:26 2012-09-03 23:44:29,671 INFO repeater task ashtech_hcorrstats starting 4.5 seconds late 2012-09-03 23:44:30,566 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:44:30,567 INFO repeater task phins_hcorrstats starting 5.4 seconds late 2012-09-03 23:44:31,388 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:44:31,388 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:44:36,392 INFO repeater task nb150_lastensq starting 1.4 seconds late 2012-09-03 23:44:38,546 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-03 23:44:38,546 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:44:25 2012-09-03 23:44:38,547 INFO repeater task os75nb_lastensq starting 2.5 seconds late 2012-09-03 23:44:39,558 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:44:39,559 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:44:26 2012-09-03 23:49:29,946 INFO repeater task ashtech_hcorrstats starting 4.7 seconds late 2012-09-03 23:49:30,870 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:49:30,871 INFO repeater task phins_hcorrstats starting 5.7 seconds late 2012-09-03 23:49:31,716 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:49:31,716 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-03 23:49:36,722 INFO repeater task nb150_lastensq starting 1.7 seconds late 2012-09-03 23:49:38,891 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-03 23:49:38,892 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:49:25 2012-09-03 23:49:38,893 INFO repeater task os75nb_lastensq starting 2.9 seconds late 2012-09-03 23:49:39,908 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-03 23:49:39,908 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:49:26 2012-09-03 23:54:25,277 INFO repeater task nb150_quick starting 0.1 seconds late 2012-09-03 23:54:29,492 INFO repeater task nb150_quick ended after 4.2 seconds 2012-09-03 23:54:29,493 INFO repeater task nb150_3dayplots starting 4.3 seconds late 2012-09-03 23:54:34,343 INFO repeater task nb150_3dayplots ended after 4.9 seconds 2012-09-03 23:54:34,344 INFO repeater task os75nb_quick starting 9.1 seconds late 2012-09-03 23:54:38,623 INFO repeater task os75nb_quick ended after 4.3 seconds 2012-09-03 23:54:38,623 INFO repeater task os75nb_3dayplots starting 13.4 seconds late 2012-09-03 23:54:43,962 INFO repeater task os75nb_3dayplots ended after 5.3 seconds 2012-09-03 23:54:43,963 INFO repeater task ashtech_hcorrstats starting 18.8 seconds late 2012-09-03 23:54:44,902 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:54:44,902 INFO repeater task phins_hcorrstats starting 19.7 seconds late 2012-09-03 23:54:45,763 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:54:45,763 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-03 23:54:50,764 INFO repeater task nb150_lastensq starting 15.8 seconds late 2012-09-03 23:54:52,853 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:54:52,854 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:54:25 2012-09-03 23:54:52,854 INFO repeater task os75nb_lastensq starting 16.9 seconds late 2012-09-03 23:54:53,911 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-03 23:54:53,912 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:54:26 2012-09-03 23:59:29,251 INFO repeater task ashtech_hcorrstats starting 4.0 seconds late 2012-09-03 23:59:30,187 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-03 23:59:30,187 INFO repeater task phins_hcorrstats starting 5.0 seconds late 2012-09-03 23:59:31,046 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-03 23:59:31,046 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-03 23:59:36,052 INFO repeater task nb150_lastensq starting 1.1 seconds late 2012-09-03 23:59:38,166 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-03 23:59:38,166 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/03 23:59:25 2012-09-03 23:59:38,167 INFO repeater task os75nb_lastensq starting 2.2 seconds late 2012-09-03 23:59:39,227 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-03 23:59:39,228 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/03 23:59:26 2012-09-04 00:04:29,586 INFO repeater task ashtech_hcorrstats starting 4.4 seconds late 2012-09-04 00:04:30,529 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:04:30,529 INFO repeater task phins_hcorrstats starting 5.3 seconds late 2012-09-04 00:04:31,391 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:04:31,391 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:04:36,394 INFO repeater task nb150_lastensq starting 1.4 seconds late 2012-09-04 00:04:38,520 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:04:38,521 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:04:25 2012-09-04 00:04:38,522 INFO repeater task os75nb_lastensq starting 2.5 seconds late 2012-09-04 00:04:39,574 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-04 00:04:39,575 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:04:26 2012-09-04 00:09:29,957 INFO repeater task nb150_quick starting 4.8 seconds late 2012-09-04 00:09:34,450 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 00:09:34,451 INFO repeater task nb150_3dayplots starting 9.2 seconds late 2012-09-04 00:09:39,405 INFO repeater task nb150_3dayplots output: could not parse 247_nb150_ddaycont.png could not parse 247_nb150_latcont.png could not parse 247_nb150_loncont.png could not parse 247_nb150_ddaycont.png could not parse 247_nb150_latcont.png could not parse 247_nb150_loncont.png 2012-09-04 00:09:39,405 INFO repeater task nb150_3dayplots ended after 5.0 seconds 2012-09-04 00:09:39,405 INFO repeater task os75nb_lastensq starting 3.4 seconds late 2012-09-04 00:09:40,422 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:09:40,422 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:09:26 2012-09-04 00:09:40,422 INFO repeater task os75nb_quick starting 15.2 seconds late 2012-09-04 00:09:45,042 INFO repeater task os75nb_quick ended after 4.6 seconds 2012-09-04 00:09:45,043 INFO repeater task os75nb_3dayplots starting 19.8 seconds late 2012-09-04 00:09:50,539 INFO repeater task os75nb_3dayplots output: could not parse 247_os75nb_ddaycont.png could not parse 247_os75nb_latcont.png could not parse 247_os75nb_loncont.png could not parse 247_os75nb_ddaycont.png could not parse 247_os75nb_latcont.png could not parse 247_os75nb_loncont.png 2012-09-04 00:09:50,540 INFO repeater task os75nb_3dayplots ended after 5.5 seconds 2012-09-04 00:09:50,540 INFO repeater task ashtech_hcorrstats starting 25.3 seconds late 2012-09-04 00:09:51,467 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:09:51,467 INFO repeater task phins_hcorrstats starting 26.3 seconds late 2012-09-04 00:09:52,328 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:09:52,328 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:09:57,334 INFO repeater task nb150_lastensq starting 22.3 seconds late 2012-09-04 00:09:59,406 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:09:59,430 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:09:25 2012-09-04 00:14:29,773 INFO repeater task ashtech_hcorrstats starting 4.6 seconds late 2012-09-04 00:14:30,718 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:14:30,719 INFO repeater task phins_hcorrstats starting 5.5 seconds late 2012-09-04 00:14:31,575 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:14:31,575 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:14:36,577 INFO repeater task nb150_lastensq starting 1.6 seconds late 2012-09-04 00:14:38,625 INFO repeater task nb150_lastensq ended after 2.0 seconds 2012-09-04 00:14:38,625 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:14:25 2012-09-04 00:14:38,626 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2012-09-04 00:14:39,608 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:14:39,609 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:14:26 2012-09-04 00:19:29,991 INFO repeater task ashtech_hcorrstats starting 4.8 seconds late 2012-09-04 00:19:30,914 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:19:30,915 INFO repeater task phins_hcorrstats starting 5.7 seconds late 2012-09-04 00:19:31,771 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:19:31,772 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:19:36,777 INFO repeater task nb150_lastensq starting 1.8 seconds late 2012-09-04 00:19:38,882 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:19:38,882 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:19:25 2012-09-04 00:19:38,883 INFO repeater task os75nb_lastensq starting 2.9 seconds late 2012-09-04 00:19:39,904 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:19:39,905 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:19:26 2012-09-04 00:24:25,239 INFO repeater task nb150_quick starting 0.0 seconds late 2012-09-04 00:24:29,774 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 00:24:29,775 INFO repeater task nb150_3dayplots starting 4.6 seconds late 2012-09-04 00:24:35,088 INFO repeater task nb150_3dayplots ended after 5.3 seconds 2012-09-04 00:24:35,089 INFO repeater task os75nb_quick starting 9.9 seconds late 2012-09-04 00:24:39,616 INFO repeater task os75nb_quick ended after 4.5 seconds 2012-09-04 00:24:39,617 INFO repeater task os75nb_3dayplots starting 14.4 seconds late 2012-09-04 00:24:45,496 INFO repeater task os75nb_3dayplots ended after 5.9 seconds 2012-09-04 00:24:45,497 INFO repeater task ashtech_hcorrstats starting 20.3 seconds late 2012-09-04 00:24:46,405 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:24:46,405 INFO repeater task phins_hcorrstats starting 21.2 seconds late 2012-09-04 00:24:47,237 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:24:47,237 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-04 00:24:52,243 INFO repeater task nb150_lastensq starting 17.2 seconds late 2012-09-04 00:24:54,307 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:24:54,307 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:24:25 2012-09-04 00:24:54,308 INFO repeater task os75nb_lastensq starting 18.3 seconds late 2012-09-04 00:24:55,327 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:24:55,327 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:24:26 2012-09-04 00:29:25,673 INFO repeater task ashtech_hcorrstats starting 0.5 seconds late 2012-09-04 00:29:26,583 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:29:26,584 INFO repeater task phins_hcorrstats starting 1.4 seconds late 2012-09-04 00:29:27,414 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:29:27,414 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-04 00:29:37,424 INFO repeater task nb150_lastensq starting 2.4 seconds late 2012-09-04 00:29:39,488 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:29:39,489 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:29:25 2012-09-04 00:29:39,489 INFO repeater task os75nb_lastensq starting 3.5 seconds late 2012-09-04 00:29:40,486 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:29:40,486 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:29:26 2012-09-04 00:34:25,848 INFO repeater task ashtech_hcorrstats starting 0.6 seconds late 2012-09-04 00:34:26,773 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:34:26,774 INFO repeater task phins_hcorrstats starting 1.6 seconds late 2012-09-04 00:34:27,597 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:34:27,597 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-04 00:34:37,610 INFO repeater task nb150_lastensq starting 2.6 seconds late 2012-09-04 00:34:39,752 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:34:39,752 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:34:25 2012-09-04 00:34:39,753 INFO repeater task os75nb_lastensq starting 3.8 seconds late 2012-09-04 00:34:40,781 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:34:40,782 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:34:26 2012-09-04 00:39:26,127 INFO repeater task nb150_quick starting 0.9 seconds late 2012-09-04 00:39:30,567 INFO repeater task nb150_quick ended after 4.4 seconds 2012-09-04 00:39:30,568 INFO repeater task nb150_3dayplots starting 5.4 seconds late 2012-09-04 00:39:35,878 INFO repeater task nb150_3dayplots ended after 5.3 seconds 2012-09-04 00:39:35,879 INFO repeater task os75nb_quick starting 10.7 seconds late 2012-09-04 00:39:40,393 INFO repeater task os75nb_quick ended after 4.5 seconds 2012-09-04 00:39:40,393 INFO repeater task os75nb_3dayplots starting 15.2 seconds late 2012-09-04 00:39:46,157 INFO repeater task os75nb_3dayplots ended after 5.8 seconds 2012-09-04 00:39:46,158 INFO repeater task ashtech_hcorrstats starting 21.0 seconds late 2012-09-04 00:39:47,091 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:39:47,091 INFO repeater task phins_hcorrstats starting 21.9 seconds late 2012-09-04 00:39:47,972 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:39:47,973 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:39:52,978 INFO repeater task nb150_lastensq starting 18.0 seconds late 2012-09-04 00:39:55,064 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:39:55,064 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:39:25 2012-09-04 00:39:55,065 INFO repeater task os75nb_lastensq starting 19.1 seconds late 2012-09-04 00:39:56,052 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:39:56,052 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:39:26 2012-09-04 00:44:26,378 INFO repeater task ashtech_hcorrstats starting 1.2 seconds late 2012-09-04 00:44:27,301 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:44:27,302 INFO repeater task phins_hcorrstats starting 2.1 seconds late 2012-09-04 00:44:28,176 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:44:28,176 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:44:38,187 INFO repeater task nb150_lastensq starting 3.2 seconds late 2012-09-04 00:44:40,257 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:44:40,257 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:44:25 2012-09-04 00:44:40,258 INFO repeater task os75nb_lastensq starting 4.3 seconds late 2012-09-04 00:44:41,284 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:44:41,284 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:44:26 2012-09-04 00:49:26,651 INFO repeater task ashtech_hcorrstats starting 1.4 seconds late 2012-09-04 00:49:27,604 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 00:49:27,604 INFO repeater task phins_hcorrstats starting 2.4 seconds late 2012-09-04 00:49:28,454 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:49:28,454 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-04 00:49:38,464 INFO repeater task nb150_lastensq starting 3.5 seconds late 2012-09-04 00:49:40,602 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:49:40,603 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:49:25 2012-09-04 00:49:40,603 INFO repeater task os75nb_lastensq starting 4.6 seconds late 2012-09-04 00:49:41,595 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:49:41,596 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:49:26 2012-09-04 00:54:26,944 INFO repeater task nb150_quick starting 1.7 seconds late 2012-09-04 00:54:31,399 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 00:54:31,400 INFO repeater task nb150_3dayplots starting 6.2 seconds late 2012-09-04 00:54:36,726 INFO repeater task nb150_3dayplots ended after 5.3 seconds 2012-09-04 00:54:36,727 INFO repeater task os75nb_lastensq starting 0.7 seconds late 2012-09-04 00:54:37,724 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:54:37,724 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:54:26 2012-09-04 00:54:37,725 INFO repeater task os75nb_quick starting 12.5 seconds late 2012-09-04 00:54:42,207 INFO repeater task os75nb_quick ended after 4.5 seconds 2012-09-04 00:54:42,208 INFO repeater task os75nb_3dayplots starting 17.0 seconds late 2012-09-04 00:54:48,091 INFO repeater task os75nb_3dayplots ended after 5.9 seconds 2012-09-04 00:54:48,091 INFO repeater task ashtech_hcorrstats starting 22.9 seconds late 2012-09-04 00:54:49,037 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 00:54:49,038 INFO repeater task phins_hcorrstats starting 23.8 seconds late 2012-09-04 00:54:49,897 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:54:49,897 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:54:54,899 INFO repeater task nb150_lastensq starting 19.9 seconds late 2012-09-04 00:54:56,986 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:54:56,986 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:54:25 2012-09-04 00:59:27,342 INFO repeater task ashtech_hcorrstats starting 2.1 seconds late 2012-09-04 00:59:28,302 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 00:59:28,303 INFO repeater task phins_hcorrstats starting 3.1 seconds late 2012-09-04 00:59:29,168 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 00:59:29,169 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 00:59:39,179 INFO repeater task nb150_lastensq starting 4.2 seconds late 2012-09-04 00:59:41,303 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 00:59:41,304 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 00:59:25 2012-09-04 00:59:41,305 INFO repeater task os75nb_lastensq starting 5.3 seconds late 2012-09-04 00:59:42,340 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 00:59:42,341 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 00:59:26 2012-09-04 01:04:27,676 INFO repeater task ashtech_hcorrstats starting 2.5 seconds late 2012-09-04 01:04:28,635 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:04:28,636 INFO repeater task phins_hcorrstats starting 3.4 seconds late 2012-09-04 01:04:29,495 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:04:29,496 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:04:39,509 INFO repeater task nb150_lastensq starting 4.5 seconds late 2012-09-04 01:04:41,653 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 01:04:41,654 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:04:25 2012-09-04 01:04:41,654 INFO repeater task os75nb_lastensq starting 5.7 seconds late 2012-09-04 01:04:42,692 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:04:42,693 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:04:26 2012-09-04 01:09:28,061 INFO repeater task nb150_quick starting 2.9 seconds late 2012-09-04 01:09:32,532 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 01:09:32,533 INFO repeater task nb150_3dayplots starting 7.3 seconds late 2012-09-04 01:09:37,784 INFO repeater task nb150_3dayplots ended after 5.3 seconds 2012-09-04 01:09:37,785 INFO repeater task os75nb_lastensq starting 1.8 seconds late 2012-09-04 01:09:38,832 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:09:38,876 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:09:26 2012-09-04 01:09:38,877 INFO repeater task os75nb_quick starting 13.7 seconds late 2012-09-04 01:09:43,463 INFO repeater task os75nb_quick ended after 4.6 seconds 2012-09-04 01:09:43,464 INFO repeater task os75nb_3dayplots starting 18.3 seconds late 2012-09-04 01:09:49,218 INFO repeater task os75nb_3dayplots ended after 5.8 seconds 2012-09-04 01:09:49,219 INFO repeater task ashtech_hcorrstats starting 24.0 seconds late 2012-09-04 01:09:50,157 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 01:09:50,158 INFO repeater task phins_hcorrstats starting 25.0 seconds late 2012-09-04 01:09:51,022 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:09:51,023 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:09:56,027 INFO repeater task nb150_lastensq starting 21.0 seconds late 2012-09-04 01:09:58,172 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 01:09:58,173 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:09:25 2012-09-04 01:14:28,526 INFO repeater task ashtech_hcorrstats starting 3.3 seconds late 2012-09-04 01:14:29,491 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:14:29,492 INFO repeater task phins_hcorrstats starting 4.3 seconds late 2012-09-04 01:14:30,370 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:14:30,370 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:14:35,374 INFO repeater task nb150_lastensq starting 0.4 seconds late 2012-09-04 01:14:37,471 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 01:14:37,472 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:14:25 2012-09-04 01:14:37,473 INFO repeater task os75nb_lastensq starting 1.5 seconds late 2012-09-04 01:14:38,474 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:14:38,475 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:14:26 2012-09-04 01:19:28,850 INFO repeater task ashtech_hcorrstats starting 3.6 seconds late 2012-09-04 01:19:29,805 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:19:29,805 INFO repeater task phins_hcorrstats starting 4.6 seconds late 2012-09-04 01:19:30,674 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:19:30,674 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:19:35,680 INFO repeater task nb150_lastensq starting 0.7 seconds late 2012-09-04 01:19:37,858 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-04 01:19:37,858 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:19:25 2012-09-04 01:19:37,859 INFO repeater task os75nb_lastensq starting 1.9 seconds late 2012-09-04 01:19:38,908 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:19:38,909 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:19:26 2012-09-04 01:24:29,275 INFO repeater task nb150_quick starting 4.1 seconds late 2012-09-04 01:24:33,752 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 01:24:33,752 INFO repeater task nb150_3dayplots starting 8.5 seconds late 2012-09-04 01:24:38,994 INFO repeater task nb150_3dayplots ended after 5.2 seconds 2012-09-04 01:24:38,994 INFO repeater task os75nb_lastensq starting 3.0 seconds late 2012-09-04 01:24:40,060 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-04 01:24:40,063 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:24:26 2012-09-04 01:24:40,064 INFO repeater task os75nb_quick starting 14.9 seconds late 2012-09-04 01:24:44,622 INFO repeater task os75nb_quick ended after 4.6 seconds 2012-09-04 01:24:44,622 INFO repeater task os75nb_3dayplots starting 19.4 seconds late 2012-09-04 01:24:50,363 INFO repeater task os75nb_3dayplots ended after 5.7 seconds 2012-09-04 01:24:50,363 INFO repeater task ashtech_hcorrstats starting 25.2 seconds late 2012-09-04 01:24:51,295 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 01:24:51,296 INFO repeater task phins_hcorrstats starting 26.1 seconds late 2012-09-04 01:24:52,145 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:24:52,145 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-04 01:24:57,151 INFO repeater task nb150_lastensq starting 22.2 seconds late 2012-09-04 01:24:59,312 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-04 01:24:59,312 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:24:25 2012-09-04 01:29:29,663 INFO repeater task ashtech_hcorrstats starting 4.5 seconds late 2012-09-04 01:29:30,604 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 01:29:30,604 INFO repeater task phins_hcorrstats starting 5.4 seconds late 2012-09-04 01:29:31,465 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:29:31,466 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:29:36,467 INFO repeater task nb150_lastensq starting 1.5 seconds late 2012-09-04 01:29:38,617 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-04 01:29:38,617 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:29:25 2012-09-04 01:29:38,618 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2012-09-04 01:29:39,662 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:29:39,662 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:29:26 2012-09-04 01:34:30,049 INFO repeater task ashtech_hcorrstats starting 4.8 seconds late 2012-09-04 01:34:30,999 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 01:34:30,999 INFO repeater task phins_hcorrstats starting 5.8 seconds late 2012-09-04 01:34:31,855 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:34:31,856 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:34:36,861 INFO repeater task nb150_lastensq starting 1.9 seconds late 2012-09-04 01:34:38,962 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 01:34:38,963 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:34:25 2012-09-04 01:34:38,963 INFO repeater task os75nb_lastensq starting 3.0 seconds late 2012-09-04 01:34:39,976 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:34:39,976 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:34:26 2012-09-04 01:39:25,334 INFO repeater task nb150_quick starting 0.1 seconds late 2012-09-04 01:39:29,853 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 01:39:29,854 INFO repeater task nb150_3dayplots starting 4.7 seconds late 2012-09-04 01:39:35,042 INFO repeater task nb150_3dayplots ended after 5.2 seconds 2012-09-04 01:39:35,043 INFO repeater task os75nb_quick starting 9.8 seconds late 2012-09-04 01:39:39,553 INFO repeater task os75nb_quick ended after 4.5 seconds 2012-09-04 01:39:39,554 INFO repeater task os75nb_3dayplots starting 14.4 seconds late 2012-09-04 01:39:45,444 INFO repeater task os75nb_3dayplots ended after 5.9 seconds 2012-09-04 01:39:45,445 INFO repeater task ashtech_hcorrstats starting 20.2 seconds late 2012-09-04 01:39:46,404 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:39:46,405 INFO repeater task phins_hcorrstats starting 21.2 seconds late 2012-09-04 01:39:47,256 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:39:47,257 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:39:52,262 INFO repeater task nb150_lastensq starting 17.3 seconds late 2012-09-04 01:39:54,467 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-04 01:39:54,467 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:39:25 2012-09-04 01:39:54,468 INFO repeater task os75nb_lastensq starting 18.5 seconds late 2012-09-04 01:39:55,486 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:39:55,486 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:39:26 2012-09-04 01:44:25,826 INFO repeater task ashtech_hcorrstats starting 0.6 seconds late 2012-09-04 01:44:26,797 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:44:26,797 INFO repeater task phins_hcorrstats starting 1.6 seconds late 2012-09-04 01:44:27,659 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:44:27,659 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:44:37,672 INFO repeater task nb150_lastensq starting 2.7 seconds late 2012-09-04 01:44:39,782 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 01:44:39,783 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:44:25 2012-09-04 01:44:39,783 INFO repeater task os75nb_lastensq starting 3.8 seconds late 2012-09-04 01:44:40,812 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:44:40,813 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:44:26 2012-09-04 01:49:26,178 INFO repeater task ashtech_hcorrstats starting 1.0 seconds late 2012-09-04 01:49:27,146 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:49:27,147 INFO repeater task phins_hcorrstats starting 1.9 seconds late 2012-09-04 01:49:28,006 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:49:28,007 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:49:38,020 INFO repeater task nb150_lastensq starting 3.0 seconds late 2012-09-04 01:49:40,111 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 01:49:40,111 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:49:25 2012-09-04 01:49:40,112 INFO repeater task os75nb_lastensq starting 4.1 seconds late 2012-09-04 01:49:41,126 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:49:41,127 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:49:26 2012-09-04 01:54:26,477 INFO repeater task nb150_quick starting 1.3 seconds late 2012-09-04 01:54:30,976 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 01:54:30,977 INFO repeater task nb150_3dayplots starting 5.8 seconds late 2012-09-04 01:54:36,212 INFO repeater task nb150_3dayplots ended after 5.2 seconds 2012-09-04 01:54:36,213 INFO repeater task os75nb_lastensq starting 0.2 seconds late 2012-09-04 01:54:37,244 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 01:54:37,245 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:54:26 2012-09-04 01:54:37,245 INFO repeater task os75nb_quick starting 12.0 seconds late 2012-09-04 01:54:41,748 INFO repeater task os75nb_quick ended after 4.5 seconds 2012-09-04 01:54:41,749 INFO repeater task os75nb_3dayplots starting 16.5 seconds late 2012-09-04 01:54:47,635 INFO repeater task os75nb_3dayplots ended after 5.9 seconds 2012-09-04 01:54:47,636 INFO repeater task ashtech_hcorrstats starting 22.4 seconds late 2012-09-04 01:54:48,586 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:54:48,586 INFO repeater task phins_hcorrstats starting 23.4 seconds late 2012-09-04 01:54:49,434 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:54:49,435 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-04 01:54:54,437 INFO repeater task nb150_lastensq starting 19.4 seconds late 2012-09-04 01:54:56,629 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-04 01:54:56,630 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:54:25 2012-09-04 01:59:26,953 INFO repeater task ashtech_hcorrstats starting 1.7 seconds late 2012-09-04 01:59:27,921 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 01:59:27,922 INFO repeater task phins_hcorrstats starting 2.7 seconds late 2012-09-04 01:59:28,782 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 01:59:28,783 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 01:59:38,794 INFO repeater task nb150_lastensq starting 3.8 seconds late 2012-09-04 01:59:40,896 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 01:59:40,896 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 01:59:25 2012-09-04 01:59:40,897 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2012-09-04 01:59:41,954 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-04 01:59:41,954 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 01:59:26 2012-09-04 02:04:27,306 INFO repeater task ashtech_hcorrstats starting 2.1 seconds late 2012-09-04 02:04:28,284 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 02:04:28,284 INFO repeater task phins_hcorrstats starting 3.1 seconds late 2012-09-04 02:04:29,148 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:04:29,148 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 02:04:39,161 INFO repeater task nb150_lastensq starting 4.2 seconds late 2012-09-04 02:04:41,291 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 02:04:41,292 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:04:25 2012-09-04 02:04:41,293 INFO repeater task os75nb_lastensq starting 5.3 seconds late 2012-09-04 02:04:42,351 INFO repeater task os75nb_lastensq ended after 1.1 seconds 2012-09-04 02:04:42,352 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:04:26 2012-09-04 02:09:27,714 INFO repeater task nb150_quick starting 2.5 seconds late 2012-09-04 02:09:32,198 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 02:09:32,198 INFO repeater task nb150_3dayplots starting 7.0 seconds late 2012-09-04 02:09:37,394 INFO repeater task nb150_3dayplots ended after 5.2 seconds 2012-09-04 02:09:37,394 INFO repeater task os75nb_lastensq starting 1.4 seconds late 2012-09-04 02:09:38,384 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 02:09:38,385 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:09:26 2012-09-04 02:09:38,385 INFO repeater task os75nb_quick starting 13.2 seconds late 2012-09-04 02:09:42,858 INFO repeater task os75nb_quick ended after 4.5 seconds 2012-09-04 02:09:42,859 INFO repeater task os75nb_3dayplots starting 17.7 seconds late 2012-09-04 02:09:48,610 INFO repeater task os75nb_3dayplots ended after 5.8 seconds 2012-09-04 02:09:48,610 INFO repeater task ashtech_hcorrstats starting 23.4 seconds late 2012-09-04 02:09:49,554 INFO repeater task ashtech_hcorrstats ended after 0.9 seconds 2012-09-04 02:09:49,555 INFO repeater task phins_hcorrstats starting 24.4 seconds late 2012-09-04 02:09:50,401 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:09:50,401 INFO repeater task phins_hcorrstats ended after 0.8 seconds 2012-09-04 02:09:55,407 INFO repeater task nb150_lastensq starting 20.4 seconds late 2012-09-04 02:09:57,483 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 02:09:57,484 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:09:25 2012-09-04 02:14:27,828 INFO repeater task ashtech_hcorrstats starting 2.6 seconds late 2012-09-04 02:14:28,812 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 02:14:28,812 INFO repeater task phins_hcorrstats starting 3.6 seconds late 2012-09-04 02:14:29,667 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:14:29,668 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 02:14:39,681 INFO repeater task nb150_lastensq starting 4.7 seconds late 2012-09-04 02:14:41,742 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 02:14:41,742 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:14:25 2012-09-04 02:14:41,743 INFO repeater task os75nb_lastensq starting 5.7 seconds late 2012-09-04 02:14:42,763 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 02:14:42,764 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:14:26 2012-09-04 02:19:28,111 INFO repeater task ashtech_hcorrstats starting 2.9 seconds late 2012-09-04 02:19:29,070 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 02:19:29,070 INFO repeater task phins_hcorrstats starting 3.9 seconds late 2012-09-04 02:19:29,922 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:19:29,922 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 02:19:39,932 INFO repeater task nb150_lastensq starting 4.9 seconds late 2012-09-04 02:19:42,061 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 02:19:42,061 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:19:25 2012-09-04 02:19:42,062 INFO repeater task os75nb_lastensq starting 6.1 seconds late 2012-09-04 02:19:43,084 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 02:19:43,084 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:19:26 2012-09-04 02:24:28,434 INFO repeater task nb150_quick starting 3.2 seconds late 2012-09-04 02:24:32,908 INFO repeater task nb150_quick ended after 4.5 seconds 2012-09-04 02:24:32,909 INFO repeater task nb150_3dayplots starting 7.7 seconds late 2012-09-04 02:24:38,156 INFO repeater task nb150_3dayplots ended after 5.2 seconds 2012-09-04 02:24:38,157 INFO repeater task os75nb_lastensq starting 2.2 seconds late 2012-09-04 02:24:39,162 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 02:24:39,162 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:24:26 2012-09-04 02:24:39,162 INFO repeater task os75nb_quick starting 14.0 seconds late 2012-09-04 02:24:43,735 INFO repeater task os75nb_quick ended after 4.6 seconds 2012-09-04 02:24:43,735 INFO repeater task os75nb_3dayplots starting 18.5 seconds late 2012-09-04 02:24:49,489 INFO repeater task os75nb_3dayplots ended after 5.8 seconds 2012-09-04 02:24:49,489 INFO repeater task ashtech_hcorrstats starting 24.3 seconds late 2012-09-04 02:24:50,442 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 02:24:50,443 INFO repeater task phins_hcorrstats starting 25.2 seconds late 2012-09-04 02:24:51,296 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:24:51,296 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 02:24:56,301 INFO repeater task nb150_lastensq starting 21.3 seconds late 2012-09-04 02:24:58,475 INFO repeater task nb150_lastensq ended after 2.2 seconds 2012-09-04 02:24:58,475 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:24:25 2012-09-04 02:29:28,813 INFO repeater task ashtech_hcorrstats starting 3.6 seconds late 2012-09-04 02:29:29,785 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 02:29:29,785 INFO repeater task phins_hcorrstats starting 4.6 seconds late 2012-09-04 02:29:30,663 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:29:30,663 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 02:29:35,669 INFO repeater task nb150_lastensq starting 0.7 seconds late 2012-09-04 02:29:37,758 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 02:29:37,759 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:29:25 2012-09-04 02:29:37,759 INFO repeater task os75nb_lastensq starting 1.8 seconds late 2012-09-04 02:29:38,791 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 02:29:38,791 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:29:26 2012-09-04 02:34:29,173 INFO repeater task ashtech_hcorrstats starting 4.0 seconds late 2012-09-04 02:34:30,150 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 02:34:30,151 INFO repeater task phins_hcorrstats starting 4.9 seconds late 2012-09-04 02:34:31,010 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:34:31,010 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 02:34:36,016 INFO repeater task nb150_lastensq starting 1.0 seconds late 2012-09-04 02:34:38,147 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 02:34:38,148 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:34:25 2012-09-04 02:34:38,149 INFO repeater task os75nb_lastensq starting 2.1 seconds late 2012-09-04 02:34:39,142 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 02:34:39,142 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:34:26 2012-09-04 02:39:29,491 INFO repeater task nb150_quick starting 4.3 seconds late 2012-09-04 02:39:34,093 INFO repeater task nb150_quick ended after 4.6 seconds 2012-09-04 02:39:34,094 INFO repeater task nb150_3dayplots starting 8.9 seconds late 2012-09-04 02:39:39,390 INFO repeater task nb150_3dayplots ended after 5.3 seconds 2012-09-04 02:39:39,391 INFO repeater task os75nb_lastensq starting 3.4 seconds late 2012-09-04 02:39:40,385 INFO repeater task os75nb_lastensq ended after 1.0 seconds 2012-09-04 02:39:40,385 INFO repeater task os75nb_lastensq: Time from /home/data/RR1210/proc/os75nb/load/wrote_ens_time: 2012/09/04 02:39:26 2012-09-04 02:39:40,386 INFO repeater task os75nb_quick starting 15.2 seconds late 2012-09-04 02:39:44,878 INFO repeater task os75nb_quick ended after 4.5 seconds 2012-09-04 02:39:44,879 INFO repeater task os75nb_3dayplots starting 19.7 seconds late 2012-09-04 02:39:50,624 INFO repeater task os75nb_3dayplots ended after 5.7 seconds 2012-09-04 02:39:50,624 INFO repeater task ashtech_hcorrstats starting 25.4 seconds late 2012-09-04 02:39:51,617 INFO repeater task ashtech_hcorrstats ended after 1.0 seconds 2012-09-04 02:39:51,617 INFO repeater task phins_hcorrstats starting 26.4 seconds late 2012-09-04 02:39:52,484 INFO repeater task phins_hcorrstats output: /usr/local/lib/python2.6/dist-packages/numpy/ma/core.py:3808: UserWarning: Warning: converting a masked element to nan. warnings.warn("Warning: converting a masked element to nan.") could not get phins stats Traceback (most recent call last): File "/home/currents/programs/uhdas/scripts/run_hbinhcorrstats.py", line 148, in np.round(winsecs))] NameError: name 'winsecs' is not defined 2012-09-04 02:39:52,484 INFO repeater task phins_hcorrstats ended after 0.9 seconds 2012-09-04 02:39:57,490 INFO repeater task nb150_lastensq starting 22.5 seconds late 2012-09-04 02:39:59,576 INFO repeater task nb150_lastensq ended after 2.1 seconds 2012-09-04 02:39:59,577 INFO repeater task nb150_lastensq: Time from /home/data/RR1210/proc/nb150/load/wrote_ens_time: 2012/09/04 02:39:25