2012-06-16 10:10:18,508 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2012-06-16 10:10:18,561 INFO repeater task phins2_hcorrstats starting 37.7 seconds late 2012-06-16 10:10:22,757 INFO repeater task phins2_hcorrstats ended after 4.2 seconds 2012-06-16 10:10:27,761 INFO repeater task wh300_lastensq starting 10.8 seconds late 2012-06-16 10:10:31,632 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:10:31,633 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:10:07 2012-06-16 10:10:31,635 INFO repeater task os75bb_lastensq starting 6.6 seconds late 2012-06-16 10:10:38,516 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 10:10:38,517 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:10:15 2012-06-16 10:10:38,519 INFO repeater task os75nb_lastensq starting 14.5 seconds late 2012-06-16 10:10:42,238 INFO repeater task os75nb_lastensq ended after 3.7 seconds 2012-06-16 10:10:42,238 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:10:14 2012-06-16 10:12:17,516 INFO repeater task wh300_lastensq starting 0.5 seconds late 2012-06-16 10:12:20,938 INFO repeater task wh300_lastensq ended after 3.4 seconds 2012-06-16 10:12:20,939 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:12:07 2012-06-16 10:14:21,895 INFO repeater task wh300_lastensq starting 4.9 seconds late 2012-06-16 10:14:25,700 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 10:14:25,701 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:14:07 2012-06-16 10:14:45,756 INFO repeater task phins_hcorrstats starting 4.9 seconds late 2012-06-16 10:14:49,990 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 10:14:49,991 INFO repeater task phins2_hcorrstats starting 9.1 seconds late 2012-06-16 10:14:54,181 INFO repeater task phins2_hcorrstats ended after 4.2 seconds 2012-06-16 10:15:24,247 INFO repeater task os75nb_lastensq starting 0.2 seconds late 2012-06-16 10:15:27,326 INFO repeater task os75nb_lastensq ended after 3.1 seconds 2012-06-16 10:15:27,327 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:15:14 2012-06-16 10:15:32,349 INFO repeater task os75bb_lastensq starting 7.3 seconds late 2012-06-16 10:15:49,081 INFO repeater task os75bb_lastensq ended after 16.7 seconds 2012-06-16 10:15:49,081 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:15:15 2012-06-16 10:16:19,201 INFO repeater task wh300_lastensq starting 2.2 seconds late 2012-06-16 10:16:25,279 INFO repeater task wh300_lastensq ended after 6.1 seconds 2012-06-16 10:16:25,280 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:16:07 2012-06-16 10:18:20,764 INFO repeater task wh300_lastensq starting 3.8 seconds late 2012-06-16 10:18:24,290 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 10:18:24,291 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:18:07 2012-06-16 10:19:44,501 INFO repeater task wh300_quick starting 3.7 seconds late 2012-06-16 10:20:30,686 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 10:20:30,687 INFO repeater task wh300_quick ended after 46.2 seconds 2012-06-16 10:20:30,687 INFO repeater task wh300_3dayplots starting 49.9 seconds late 2012-06-16 10:20:50,239 INFO repeater task wh300_3dayplots ended after 19.6 seconds 2012-06-16 10:20:50,240 INFO repeater task os75bb_lastensq starting 25.2 seconds late 2012-06-16 10:20:57,328 INFO repeater task os75bb_lastensq ended after 7.1 seconds 2012-06-16 10:20:57,328 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:20:15 2012-06-16 10:20:57,332 INFO repeater task os75bb_quick starting 76.5 seconds late 2012-06-16 10:21:23,790 INFO repeater task os75bb_quick ended after 26.5 seconds 2012-06-16 10:21:23,792 INFO repeater task os75bb_3dayplots starting 103.0 seconds late 2012-06-16 10:21:44,018 INFO repeater task os75bb_3dayplots ended after 20.2 seconds 2012-06-16 10:21:44,019 INFO repeater task os75nb_lastensq starting 80.0 seconds late 2012-06-16 10:21:47,286 INFO repeater task os75nb_lastensq ended after 3.3 seconds 2012-06-16 10:21:47,287 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:20:14 2012-06-16 10:21:47,288 INFO repeater task os75nb_quick starting 126.5 seconds late 2012-06-16 10:22:19,739 INFO repeater task os75nb_quick ended after 32.5 seconds 2012-06-16 10:22:19,740 INFO repeater task os75nb_3dayplots starting 158.9 seconds late 2012-06-16 10:22:45,797 INFO repeater task os75nb_3dayplots ended after 26.1 seconds 2012-06-16 10:22:45,798 INFO repeater task wh300_beamplots starting 185.0 seconds late 2012-06-16 10:22:52,703 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:22:52,704 INFO repeater task wh300_beamplots ended after 6.9 seconds 2012-06-16 10:22:52,705 INFO repeater task wh300_beamplots starting 191.9 seconds late 2012-06-16 10:22:59,037 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:22:59,038 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 10:22:59,039 INFO repeater task os75bb_beamplots starting 198.2 seconds late 2012-06-16 10:23:03,470 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:23:03,470 INFO repeater task os75bb_beamplots ended after 4.4 seconds 2012-06-16 10:23:03,471 INFO repeater task os75bb_beamplots starting 202.6 seconds late 2012-06-16 10:23:07,753 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:23:07,753 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 10:23:07,754 INFO repeater task os75nb_beamplots starting 206.9 seconds late 2012-06-16 10:23:11,866 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:23:11,866 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 10:23:11,867 INFO repeater task os75nb_beamplots starting 211.0 seconds late 2012-06-16 10:23:15,783 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:23:15,783 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2012-06-16 10:23:15,784 INFO repeater task phins_hcorrstats starting 214.9 seconds late 2012-06-16 10:23:20,761 INFO repeater task phins_hcorrstats ended after 5.0 seconds 2012-06-16 10:23:20,768 INFO repeater task phins2_hcorrstats starting 219.9 seconds late 2012-06-16 10:23:24,524 INFO repeater task phins2_hcorrstats ended after 3.8 seconds 2012-06-16 10:23:29,529 INFO repeater task wh300_lastensq starting 192.5 seconds late 2012-06-16 10:23:33,704 INFO repeater task wh300_lastensq ended after 4.2 seconds 2012-06-16 10:23:33,704 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:22:07 2012-06-16 10:24:18,817 INFO repeater task wh300_lastensq starting 1.8 seconds late 2012-06-16 10:24:22,698 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:24:22,699 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:24:07 2012-06-16 10:24:42,751 INFO repeater task phins_hcorrstats starting 1.9 seconds late 2012-06-16 10:24:46,789 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2012-06-16 10:24:46,790 INFO repeater task phins2_hcorrstats starting 5.9 seconds late 2012-06-16 10:24:50,514 INFO repeater task phins2_hcorrstats ended after 3.7 seconds 2012-06-16 10:25:25,594 INFO repeater task os75bb_lastensq starting 0.6 seconds late 2012-06-16 10:25:32,885 INFO repeater task os75bb_lastensq ended after 7.3 seconds 2012-06-16 10:25:32,886 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:25:15 2012-06-16 10:25:32,888 INFO repeater task os75nb_lastensq starting 8.9 seconds late 2012-06-16 10:25:36,180 INFO repeater task os75nb_lastensq ended after 3.3 seconds 2012-06-16 10:25:36,181 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:25:14 2012-06-16 10:26:21,284 INFO repeater task wh300_lastensq starting 4.3 seconds late 2012-06-16 10:26:25,219 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:26:25,220 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:26:07 2012-06-16 10:28:20,516 INFO repeater task wh300_lastensq starting 3.5 seconds late 2012-06-16 10:28:24,271 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 10:28:24,272 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:28:07 2012-06-16 10:29:44,560 INFO repeater task wh300_beamplots starting 3.7 seconds late 2012-06-16 10:29:51,170 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:29:51,171 INFO repeater task wh300_beamplots ended after 6.6 seconds 2012-06-16 10:29:51,172 INFO repeater task wh300_beamplots starting 10.3 seconds late 2012-06-16 10:29:57,521 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:29:57,521 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 10:29:57,522 INFO repeater task os75bb_beamplots starting 16.7 seconds late 2012-06-16 10:30:01,823 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:30:01,824 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 10:30:01,825 INFO repeater task os75bb_beamplots starting 21.0 seconds late 2012-06-16 10:30:06,815 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:30:06,815 INFO repeater task os75bb_beamplots ended after 5.0 seconds 2012-06-16 10:30:06,816 INFO repeater task os75nb_beamplots starting 26.0 seconds late 2012-06-16 10:30:10,742 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:30:10,742 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2012-06-16 10:30:10,743 INFO repeater task os75nb_beamplots starting 29.9 seconds late 2012-06-16 10:30:14,403 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:30:14,404 INFO repeater task os75nb_beamplots ended after 3.7 seconds 2012-06-16 10:30:14,405 INFO repeater task phins_hcorrstats starting 33.6 seconds late 2012-06-16 10:30:18,641 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 10:30:18,642 INFO repeater task phins2_hcorrstats starting 37.8 seconds late 2012-06-16 10:30:22,776 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 10:30:27,782 INFO repeater task wh300_lastensq starting 10.8 seconds late 2012-06-16 10:30:31,538 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 10:30:31,539 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:30:07 2012-06-16 10:30:31,542 INFO repeater task os75bb_lastensq starting 6.5 seconds late 2012-06-16 10:30:38,496 INFO repeater task os75bb_lastensq ended after 7.0 seconds 2012-06-16 10:30:38,497 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:30:15 2012-06-16 10:30:38,498 INFO repeater task os75nb_lastensq starting 14.5 seconds late 2012-06-16 10:30:42,224 INFO repeater task os75nb_lastensq ended after 3.7 seconds 2012-06-16 10:30:42,225 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:30:14 2012-06-16 10:32:17,745 INFO repeater task wh300_lastensq starting 0.7 seconds late 2012-06-16 10:32:21,131 INFO repeater task wh300_lastensq ended after 3.4 seconds 2012-06-16 10:32:21,132 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:32:07 2012-06-16 10:34:21,521 INFO repeater task wh300_lastensq starting 4.5 seconds late 2012-06-16 10:34:25,386 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:34:25,387 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:34:07 2012-06-16 10:34:45,437 INFO repeater task wh300_quick starting 4.6 seconds late 2012-06-16 10:35:27,607 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 10:35:27,607 INFO repeater task wh300_quick ended after 42.2 seconds 2012-06-16 10:35:27,608 INFO repeater task wh300_3dayplots starting 46.8 seconds late 2012-06-16 10:35:46,648 INFO repeater task wh300_3dayplots ended after 19.0 seconds 2012-06-16 10:35:46,649 INFO repeater task os75bb_lastensq starting 21.6 seconds late 2012-06-16 10:35:53,520 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 10:35:53,521 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:35:15 2012-06-16 10:35:53,522 INFO repeater task os75bb_quick starting 72.7 seconds late 2012-06-16 10:36:28,770 INFO repeater task os75bb_quick ended after 35.2 seconds 2012-06-16 10:36:28,772 INFO repeater task os75bb_3dayplots starting 107.9 seconds late 2012-06-16 10:36:49,452 INFO repeater task os75bb_3dayplots ended after 20.7 seconds 2012-06-16 10:36:49,453 INFO repeater task os75nb_lastensq starting 85.5 seconds late 2012-06-16 10:36:53,227 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 10:36:53,228 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:35:14 2012-06-16 10:36:53,229 INFO repeater task os75nb_quick starting 132.4 seconds late 2012-06-16 10:37:19,320 INFO repeater task os75nb_quick ended after 26.1 seconds 2012-06-16 10:37:19,321 INFO repeater task os75nb_3dayplots starting 158.5 seconds late 2012-06-16 10:37:37,958 INFO repeater task os75nb_3dayplots ended after 18.6 seconds 2012-06-16 10:37:37,962 INFO repeater task phins_hcorrstats starting 177.1 seconds late 2012-06-16 10:37:42,067 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2012-06-16 10:37:42,068 INFO repeater task phins2_hcorrstats starting 181.2 seconds late 2012-06-16 10:37:45,794 INFO repeater task phins2_hcorrstats ended after 3.7 seconds 2012-06-16 10:37:50,796 INFO repeater task wh300_lastensq starting 93.8 seconds late 2012-06-16 10:37:54,697 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:37:54,698 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:36:07 2012-06-16 10:38:19,773 INFO repeater task wh300_lastensq starting 2.8 seconds late 2012-06-16 10:38:25,239 INFO repeater task wh300_lastensq ended after 5.5 seconds 2012-06-16 10:38:25,240 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:38:07 2012-06-16 10:39:45,445 INFO repeater task wh300_beamplots starting 4.6 seconds late 2012-06-16 10:39:51,785 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:39:51,785 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 10:39:51,786 INFO repeater task wh300_beamplots starting 10.9 seconds late 2012-06-16 10:39:58,547 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:39:58,547 INFO repeater task wh300_beamplots ended after 6.8 seconds 2012-06-16 10:39:58,552 INFO repeater task os75bb_beamplots starting 17.7 seconds late 2012-06-16 10:40:02,471 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:40:02,472 INFO repeater task os75bb_beamplots ended after 3.9 seconds 2012-06-16 10:40:02,474 INFO repeater task os75bb_beamplots starting 21.6 seconds late 2012-06-16 10:40:07,299 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:40:07,300 INFO repeater task os75bb_beamplots ended after 4.8 seconds 2012-06-16 10:40:07,301 INFO repeater task os75nb_beamplots starting 26.5 seconds late 2012-06-16 10:40:11,390 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:40:11,390 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 10:40:11,391 INFO repeater task os75nb_beamplots starting 30.6 seconds late 2012-06-16 10:40:15,495 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:40:15,495 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 10:40:15,496 INFO repeater task phins_hcorrstats starting 34.6 seconds late 2012-06-16 10:40:19,637 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2012-06-16 10:40:19,640 INFO repeater task phins2_hcorrstats starting 38.8 seconds late 2012-06-16 10:40:23,405 INFO repeater task phins2_hcorrstats ended after 3.8 seconds 2012-06-16 10:40:28,412 INFO repeater task wh300_lastensq starting 11.4 seconds late 2012-06-16 10:40:32,198 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 10:40:32,199 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:40:07 2012-06-16 10:40:32,201 INFO repeater task os75bb_lastensq starting 7.2 seconds late 2012-06-16 10:40:39,480 INFO repeater task os75bb_lastensq ended after 7.3 seconds 2012-06-16 10:40:39,481 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:40:15 2012-06-16 10:40:39,482 INFO repeater task os75nb_lastensq starting 15.5 seconds late 2012-06-16 10:40:42,808 INFO repeater task os75nb_lastensq ended after 3.3 seconds 2012-06-16 10:40:42,809 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:40:14 2012-06-16 10:42:18,028 INFO repeater task wh300_lastensq starting 1.0 seconds late 2012-06-16 10:42:21,915 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:42:21,915 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:42:07 2012-06-16 10:44:17,257 INFO repeater task wh300_lastensq starting 0.3 seconds late 2012-06-16 10:44:20,572 INFO repeater task wh300_lastensq ended after 3.3 seconds 2012-06-16 10:44:20,573 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:44:07 2012-06-16 10:44:45,643 INFO repeater task phins_hcorrstats starting 4.8 seconds late 2012-06-16 10:44:49,877 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 10:44:49,878 INFO repeater task phins2_hcorrstats starting 9.0 seconds late 2012-06-16 10:44:54,001 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 10:45:24,076 INFO repeater task os75nb_lastensq starting 0.1 seconds late 2012-06-16 10:45:27,664 INFO repeater task os75nb_lastensq ended after 3.6 seconds 2012-06-16 10:45:27,665 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:45:14 2012-06-16 10:45:32,674 INFO repeater task os75bb_lastensq starting 7.7 seconds late 2012-06-16 10:45:39,663 INFO repeater task os75bb_lastensq ended after 7.0 seconds 2012-06-16 10:45:39,663 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:45:15 2012-06-16 10:46:19,756 INFO repeater task wh300_lastensq starting 2.8 seconds late 2012-06-16 10:46:23,505 INFO repeater task wh300_lastensq ended after 3.7 seconds 2012-06-16 10:46:23,506 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:46:07 2012-06-16 10:48:18,949 INFO repeater task wh300_lastensq starting 1.9 seconds late 2012-06-16 10:48:22,497 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 10:48:22,498 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:48:07 2012-06-16 10:49:42,693 INFO repeater task wh300_quick starting 1.9 seconds late 2012-06-16 10:50:28,212 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 10:50:28,213 INFO repeater task wh300_quick ended after 45.5 seconds 2012-06-16 10:50:28,214 INFO repeater task wh300_3dayplots starting 47.4 seconds late 2012-06-16 10:50:47,131 INFO repeater task wh300_3dayplots ended after 18.9 seconds 2012-06-16 10:50:47,139 INFO repeater task os75bb_lastensq starting 22.1 seconds late 2012-06-16 10:50:54,034 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 10:50:54,035 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:50:15 2012-06-16 10:50:54,036 INFO repeater task os75bb_quick starting 73.2 seconds late 2012-06-16 10:51:20,759 INFO repeater task os75bb_quick ended after 26.7 seconds 2012-06-16 10:51:20,760 INFO repeater task os75bb_3dayplots starting 99.9 seconds late 2012-06-16 10:51:40,683 INFO repeater task os75bb_3dayplots ended after 19.9 seconds 2012-06-16 10:51:40,684 INFO repeater task os75nb_lastensq starting 76.7 seconds late 2012-06-16 10:51:44,439 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 10:51:44,440 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:50:14 2012-06-16 10:51:44,440 INFO repeater task os75nb_quick starting 123.6 seconds late 2012-06-16 10:52:14,532 INFO repeater task os75nb_quick ended after 30.1 seconds 2012-06-16 10:52:14,533 INFO repeater task os75nb_3dayplots starting 153.7 seconds late 2012-06-16 10:52:41,054 INFO repeater task os75nb_3dayplots ended after 26.5 seconds 2012-06-16 10:52:41,055 INFO repeater task wh300_beamplots starting 180.2 seconds late 2012-06-16 10:52:47,475 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:52:47,476 INFO repeater task wh300_beamplots ended after 6.4 seconds 2012-06-16 10:52:47,477 INFO repeater task wh300_beamplots starting 186.6 seconds late 2012-06-16 10:52:54,256 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:52:54,257 INFO repeater task wh300_beamplots ended after 6.8 seconds 2012-06-16 10:52:54,258 INFO repeater task os75bb_beamplots starting 193.4 seconds late 2012-06-16 10:52:58,063 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:52:58,063 INFO repeater task os75bb_beamplots ended after 3.8 seconds 2012-06-16 10:52:58,064 INFO repeater task os75bb_beamplots starting 197.2 seconds late 2012-06-16 10:53:02,340 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 10:53:02,340 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 10:53:02,344 INFO repeater task os75nb_beamplots starting 201.5 seconds late 2012-06-16 10:53:06,473 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:53:06,473 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 10:53:06,474 INFO repeater task os75nb_beamplots starting 205.6 seconds late 2012-06-16 10:53:10,587 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 10:53:10,588 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 10:53:10,589 INFO repeater task phins_hcorrstats starting 209.7 seconds late 2012-06-16 10:53:14,735 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2012-06-16 10:53:14,736 INFO repeater task phins2_hcorrstats starting 213.9 seconds late 2012-06-16 10:53:18,388 INFO repeater task phins2_hcorrstats ended after 3.7 seconds 2012-06-16 10:53:23,392 INFO repeater task wh300_lastensq starting 186.4 seconds late 2012-06-16 10:53:27,454 INFO repeater task wh300_lastensq ended after 4.1 seconds 2012-06-16 10:53:27,455 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:52:07 2012-06-16 10:54:17,588 INFO repeater task wh300_lastensq starting 0.6 seconds late 2012-06-16 10:54:21,513 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:54:21,514 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:54:07 2012-06-16 10:54:41,567 INFO repeater task phins_hcorrstats starting 0.7 seconds late 2012-06-16 10:54:45,624 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2012-06-16 10:54:45,625 INFO repeater task phins2_hcorrstats starting 4.8 seconds late 2012-06-16 10:54:49,345 INFO repeater task phins2_hcorrstats ended after 3.7 seconds 2012-06-16 10:55:24,423 INFO repeater task os75nb_lastensq starting 0.4 seconds late 2012-06-16 10:55:28,189 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 10:55:28,190 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 10:55:14 2012-06-16 10:55:33,198 INFO repeater task os75bb_lastensq starting 8.2 seconds late 2012-06-16 10:55:40,106 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 10:55:40,107 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 10:55:15 2012-06-16 10:56:20,228 INFO repeater task wh300_lastensq starting 3.2 seconds late 2012-06-16 10:56:24,111 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 10:56:24,112 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:56:07 2012-06-16 10:58:19,400 INFO repeater task wh300_lastensq starting 2.4 seconds late 2012-06-16 10:58:23,214 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 10:58:23,215 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 10:58:07 2012-06-16 10:59:43,473 INFO repeater task wh300_beamplots starting 2.6 seconds late 2012-06-16 10:59:49,955 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:59:49,956 INFO repeater task wh300_beamplots ended after 6.5 seconds 2012-06-16 10:59:49,957 INFO repeater task wh300_beamplots starting 9.1 seconds late 2012-06-16 10:59:56,266 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 10:59:56,266 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 10:59:56,267 INFO repeater task os75bb_beamplots starting 15.4 seconds late 2012-06-16 11:00:00,543 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:00:00,543 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 11:00:00,545 INFO repeater task os75bb_beamplots starting 19.7 seconds late 2012-06-16 11:00:05,396 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:00:05,397 INFO repeater task os75bb_beamplots ended after 4.9 seconds 2012-06-16 11:00:05,398 INFO repeater task os75nb_beamplots starting 24.6 seconds late 2012-06-16 11:00:09,843 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:00:09,843 INFO repeater task os75nb_beamplots ended after 4.4 seconds 2012-06-16 11:00:09,844 INFO repeater task os75nb_beamplots starting 29.0 seconds late 2012-06-16 11:00:13,440 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:00:13,441 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2012-06-16 11:00:13,444 INFO repeater task phins_hcorrstats starting 32.6 seconds late 2012-06-16 11:00:17,582 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2012-06-16 11:00:17,583 INFO repeater task phins2_hcorrstats starting 36.7 seconds late 2012-06-16 11:00:21,746 INFO repeater task phins2_hcorrstats ended after 4.2 seconds 2012-06-16 11:00:26,752 INFO repeater task wh300_lastensq starting 9.8 seconds late 2012-06-16 11:00:30,687 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 11:00:30,688 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:00:07 2012-06-16 11:00:30,690 INFO repeater task os75bb_lastensq starting 5.7 seconds late 2012-06-16 11:00:37,566 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 11:00:37,567 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:00:15 2012-06-16 11:00:37,569 INFO repeater task os75nb_lastensq starting 13.6 seconds late 2012-06-16 11:00:41,343 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 11:00:41,344 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:00:14 2012-06-16 11:02:21,601 INFO repeater task wh300_lastensq starting 4.6 seconds late 2012-06-16 11:02:25,127 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 11:02:25,127 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:02:07 2012-06-16 11:04:21,083 INFO repeater task wh300_lastensq starting 4.1 seconds late 2012-06-16 11:04:24,860 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 11:04:24,861 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:04:07 2012-06-16 11:04:44,909 INFO repeater task wh300_quick starting 4.1 seconds late 2012-06-16 11:05:27,363 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 11:05:27,364 INFO repeater task wh300_quick ended after 42.5 seconds 2012-06-16 11:05:27,368 INFO repeater task wh300_3dayplots starting 46.5 seconds late 2012-06-16 11:05:46,132 INFO repeater task wh300_3dayplots ended after 18.8 seconds 2012-06-16 11:05:46,133 INFO repeater task os75bb_lastensq starting 21.1 seconds late 2012-06-16 11:05:53,496 INFO repeater task os75bb_lastensq ended after 7.4 seconds 2012-06-16 11:05:53,497 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:05:15 2012-06-16 11:05:53,498 INFO repeater task os75bb_quick starting 72.7 seconds late 2012-06-16 11:06:29,013 INFO repeater task os75bb_quick ended after 35.5 seconds 2012-06-16 11:06:29,016 INFO repeater task os75bb_3dayplots starting 108.2 seconds late 2012-06-16 11:06:50,264 INFO repeater task os75bb_3dayplots ended after 21.2 seconds 2012-06-16 11:06:50,265 INFO repeater task os75nb_lastensq starting 86.3 seconds late 2012-06-16 11:06:53,456 INFO repeater task os75nb_lastensq ended after 3.2 seconds 2012-06-16 11:06:53,457 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:05:14 2012-06-16 11:06:53,457 INFO repeater task os75nb_quick starting 132.6 seconds late 2012-06-16 11:07:19,878 INFO repeater task os75nb_quick ended after 26.4 seconds 2012-06-16 11:07:19,884 INFO repeater task os75nb_3dayplots starting 159.0 seconds late 2012-06-16 11:07:38,114 INFO repeater task os75nb_3dayplots ended after 18.2 seconds 2012-06-16 11:07:38,118 INFO repeater task phins_hcorrstats starting 177.3 seconds late 2012-06-16 11:07:42,372 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 11:07:42,373 INFO repeater task phins2_hcorrstats starting 181.5 seconds late 2012-06-16 11:07:46,526 INFO repeater task phins2_hcorrstats ended after 4.2 seconds 2012-06-16 11:07:51,532 INFO repeater task wh300_lastensq starting 94.5 seconds late 2012-06-16 11:07:55,005 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 11:07:55,006 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:06:07 2012-06-16 11:08:20,232 INFO repeater task wh300_lastensq starting 3.2 seconds late 2012-06-16 11:08:26,335 INFO repeater task wh300_lastensq ended after 6.1 seconds 2012-06-16 11:08:26,336 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:08:07 2012-06-16 11:09:41,641 INFO repeater task wh300_beamplots starting 0.8 seconds late 2012-06-16 11:09:48,259 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:09:48,260 INFO repeater task wh300_beamplots ended after 6.6 seconds 2012-06-16 11:09:48,261 INFO repeater task wh300_beamplots starting 7.4 seconds late 2012-06-16 11:09:54,576 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:09:54,577 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 11:09:54,578 INFO repeater task os75bb_beamplots starting 13.7 seconds late 2012-06-16 11:09:58,843 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:09:58,843 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 11:09:58,844 INFO repeater task os75bb_beamplots starting 18.0 seconds late 2012-06-16 11:10:03,239 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:10:03,239 INFO repeater task os75bb_beamplots ended after 4.4 seconds 2012-06-16 11:10:03,240 INFO repeater task os75nb_beamplots starting 22.4 seconds late 2012-06-16 11:10:08,203 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:10:08,204 INFO repeater task os75nb_beamplots ended after 5.0 seconds 2012-06-16 11:10:08,205 INFO repeater task os75nb_beamplots starting 27.4 seconds late 2012-06-16 11:10:11,812 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:10:11,813 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2012-06-16 11:10:11,816 INFO repeater task phins_hcorrstats starting 31.0 seconds late 2012-06-16 11:10:16,021 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 11:10:16,022 INFO repeater task phins2_hcorrstats starting 35.2 seconds late 2012-06-16 11:10:20,183 INFO repeater task phins2_hcorrstats ended after 4.2 seconds 2012-06-16 11:10:25,189 INFO repeater task wh300_lastensq starting 8.2 seconds late 2012-06-16 11:10:29,141 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:10:29,141 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:10:07 2012-06-16 11:10:29,143 INFO repeater task os75bb_lastensq starting 4.1 seconds late 2012-06-16 11:10:36,082 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 11:10:36,083 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:10:15 2012-06-16 11:10:36,085 INFO repeater task os75nb_lastensq starting 12.1 seconds late 2012-06-16 11:10:39,898 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 11:10:39,898 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:10:14 2012-06-16 11:12:20,140 INFO repeater task wh300_lastensq starting 3.1 seconds late 2012-06-16 11:12:23,862 INFO repeater task wh300_lastensq ended after 3.7 seconds 2012-06-16 11:12:23,862 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:12:07 2012-06-16 11:14:19,455 INFO repeater task wh300_lastensq starting 2.5 seconds late 2012-06-16 11:14:23,206 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 11:14:23,206 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:14:07 2012-06-16 11:14:43,259 INFO repeater task phins_hcorrstats starting 2.4 seconds late 2012-06-16 11:14:47,492 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 11:14:47,493 INFO repeater task phins2_hcorrstats starting 6.6 seconds late 2012-06-16 11:14:51,633 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 11:15:26,722 INFO repeater task os75bb_lastensq starting 1.7 seconds late 2012-06-16 11:15:33,618 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 11:15:33,619 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:15:15 2012-06-16 11:15:33,620 INFO repeater task os75nb_lastensq starting 9.6 seconds late 2012-06-16 11:15:42,851 INFO repeater task os75nb_lastensq ended after 9.2 seconds 2012-06-16 11:15:42,852 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:15:14 2012-06-16 11:16:17,960 INFO repeater task wh300_lastensq starting 1.0 seconds late 2012-06-16 11:16:24,153 INFO repeater task wh300_lastensq ended after 6.2 seconds 2012-06-16 11:16:24,153 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:16:07 2012-06-16 11:18:19,441 INFO repeater task wh300_lastensq starting 2.4 seconds late 2012-06-16 11:18:23,055 INFO repeater task wh300_lastensq ended after 3.6 seconds 2012-06-16 11:18:23,056 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:18:07 2012-06-16 11:19:43,357 INFO repeater task wh300_quick starting 2.5 seconds late 2012-06-16 11:20:32,636 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 11:20:32,636 INFO repeater task wh300_quick ended after 49.3 seconds 2012-06-16 11:20:32,637 INFO repeater task wh300_3dayplots starting 51.8 seconds late 2012-06-16 11:20:52,274 INFO repeater task wh300_3dayplots ended after 19.6 seconds 2012-06-16 11:20:52,275 INFO repeater task os75bb_lastensq starting 27.3 seconds late 2012-06-16 11:20:59,292 INFO repeater task os75bb_lastensq ended after 7.0 seconds 2012-06-16 11:20:59,293 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:20:15 2012-06-16 11:20:59,294 INFO repeater task os75bb_quick starting 78.5 seconds late 2012-06-16 11:21:26,145 INFO repeater task os75bb_quick ended after 26.9 seconds 2012-06-16 11:21:26,146 INFO repeater task os75bb_3dayplots starting 105.3 seconds late 2012-06-16 11:21:46,256 INFO repeater task os75bb_3dayplots ended after 20.1 seconds 2012-06-16 11:21:46,260 INFO repeater task os75nb_lastensq starting 82.3 seconds late 2012-06-16 11:21:49,651 INFO repeater task os75nb_lastensq ended after 3.4 seconds 2012-06-16 11:21:49,652 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:20:14 2012-06-16 11:21:49,653 INFO repeater task os75nb_quick starting 128.8 seconds late 2012-06-16 11:22:24,092 INFO repeater task os75nb_quick ended after 34.4 seconds 2012-06-16 11:22:24,093 INFO repeater task os75nb_3dayplots starting 163.3 seconds late 2012-06-16 11:22:48,938 INFO repeater task os75nb_3dayplots ended after 24.8 seconds 2012-06-16 11:22:48,939 INFO repeater task wh300_beamplots starting 188.1 seconds late 2012-06-16 11:22:55,922 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:22:55,922 INFO repeater task wh300_beamplots ended after 7.0 seconds 2012-06-16 11:22:55,923 INFO repeater task wh300_beamplots starting 195.1 seconds late 2012-06-16 11:23:02,581 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:23:02,582 INFO repeater task wh300_beamplots ended after 6.7 seconds 2012-06-16 11:23:02,582 INFO repeater task os75bb_beamplots starting 201.7 seconds late 2012-06-16 11:23:06,586 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:23:06,586 INFO repeater task os75bb_beamplots ended after 4.0 seconds 2012-06-16 11:23:06,587 INFO repeater task os75bb_beamplots starting 205.7 seconds late 2012-06-16 11:23:10,841 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:23:10,841 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 11:23:10,842 INFO repeater task os75nb_beamplots starting 210.0 seconds late 2012-06-16 11:23:14,963 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:23:14,963 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 11:23:14,964 INFO repeater task os75nb_beamplots starting 214.1 seconds late 2012-06-16 11:23:19,051 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:23:19,051 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 11:23:19,052 INFO repeater task phins_hcorrstats starting 218.2 seconds late 2012-06-16 11:23:23,076 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2012-06-16 11:23:23,080 INFO repeater task phins2_hcorrstats starting 222.2 seconds late 2012-06-16 11:23:26,881 INFO repeater task phins2_hcorrstats ended after 3.8 seconds 2012-06-16 11:23:31,888 INFO repeater task wh300_lastensq starting 194.9 seconds late 2012-06-16 11:23:36,024 INFO repeater task wh300_lastensq ended after 4.1 seconds 2012-06-16 11:23:36,025 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:22:07 2012-06-16 11:24:21,145 INFO repeater task wh300_lastensq starting 4.1 seconds late 2012-06-16 11:24:25,101 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:24:25,102 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:24:07 2012-06-16 11:24:45,163 INFO repeater task phins_hcorrstats starting 4.3 seconds late 2012-06-16 11:24:49,177 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2012-06-16 11:24:49,179 INFO repeater task phins2_hcorrstats starting 8.3 seconds late 2012-06-16 11:24:52,937 INFO repeater task phins2_hcorrstats ended after 3.8 seconds 2012-06-16 11:25:28,018 INFO repeater task os75bb_lastensq starting 3.0 seconds late 2012-06-16 11:25:35,499 INFO repeater task os75bb_lastensq ended after 7.5 seconds 2012-06-16 11:25:35,500 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:25:15 2012-06-16 11:25:35,509 INFO repeater task os75nb_lastensq starting 11.5 seconds late 2012-06-16 11:25:38,776 INFO repeater task os75nb_lastensq ended after 3.3 seconds 2012-06-16 11:25:38,777 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:25:14 2012-06-16 11:26:18,870 INFO repeater task wh300_lastensq starting 1.9 seconds late 2012-06-16 11:26:22,817 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 11:26:22,818 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:26:07 2012-06-16 11:28:18,116 INFO repeater task wh300_lastensq starting 1.1 seconds late 2012-06-16 11:28:21,906 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 11:28:21,907 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:28:07 2012-06-16 11:29:42,181 INFO repeater task wh300_beamplots starting 1.3 seconds late 2012-06-16 11:29:48,799 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:29:48,799 INFO repeater task wh300_beamplots ended after 6.6 seconds 2012-06-16 11:29:48,800 INFO repeater task wh300_beamplots starting 8.0 seconds late 2012-06-16 11:29:55,149 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:29:55,150 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 11:29:55,150 INFO repeater task os75bb_beamplots starting 14.3 seconds late 2012-06-16 11:29:59,426 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:29:59,426 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 11:29:59,427 INFO repeater task os75bb_beamplots starting 18.6 seconds late 2012-06-16 11:30:03,990 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:30:03,990 INFO repeater task os75bb_beamplots ended after 4.6 seconds 2012-06-16 11:30:03,991 INFO repeater task os75nb_beamplots starting 23.2 seconds late 2012-06-16 11:30:08,957 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:30:08,958 INFO repeater task os75nb_beamplots ended after 5.0 seconds 2012-06-16 11:30:08,958 INFO repeater task os75nb_beamplots starting 28.1 seconds late 2012-06-16 11:30:12,878 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:30:12,879 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2012-06-16 11:30:12,884 INFO repeater task phins_hcorrstats starting 32.0 seconds late 2012-06-16 11:30:16,749 INFO repeater task phins_hcorrstats ended after 3.9 seconds 2012-06-16 11:30:16,750 INFO repeater task phins2_hcorrstats starting 35.9 seconds late 2012-06-16 11:30:20,885 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 11:30:25,889 INFO repeater task wh300_lastensq starting 8.9 seconds late 2012-06-16 11:30:29,882 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:30:29,883 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:30:07 2012-06-16 11:30:29,885 INFO repeater task os75bb_lastensq starting 4.9 seconds late 2012-06-16 11:30:36,825 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 11:30:36,826 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:30:15 2012-06-16 11:30:36,828 INFO repeater task os75nb_lastensq starting 12.8 seconds late 2012-06-16 11:30:40,675 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 11:30:40,676 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:30:14 2012-06-16 11:32:20,916 INFO repeater task wh300_lastensq starting 3.9 seconds late 2012-06-16 11:32:24,747 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 11:32:24,748 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:32:07 2012-06-16 11:34:20,228 INFO repeater task wh300_lastensq starting 3.2 seconds late 2012-06-16 11:34:23,915 INFO repeater task wh300_lastensq ended after 3.7 seconds 2012-06-16 11:34:23,916 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:34:07 2012-06-16 11:34:43,965 INFO repeater task wh300_quick starting 3.1 seconds late 2012-06-16 11:35:26,739 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 11:35:26,740 INFO repeater task wh300_quick ended after 42.8 seconds 2012-06-16 11:35:26,741 INFO repeater task wh300_3dayplots starting 45.9 seconds late 2012-06-16 11:35:45,222 INFO repeater task wh300_3dayplots ended after 18.5 seconds 2012-06-16 11:35:45,223 INFO repeater task os75bb_lastensq starting 20.2 seconds late 2012-06-16 11:35:52,727 INFO repeater task os75bb_lastensq ended after 7.5 seconds 2012-06-16 11:35:52,727 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:35:15 2012-06-16 11:35:52,728 INFO repeater task os75bb_quick starting 71.9 seconds late 2012-06-16 11:36:27,992 INFO repeater task os75bb_quick ended after 35.3 seconds 2012-06-16 11:36:27,995 INFO repeater task os75bb_3dayplots starting 107.2 seconds late 2012-06-16 11:36:49,566 INFO repeater task os75bb_3dayplots ended after 21.6 seconds 2012-06-16 11:36:49,567 INFO repeater task os75nb_lastensq starting 85.6 seconds late 2012-06-16 11:36:53,214 INFO repeater task os75nb_lastensq ended after 3.6 seconds 2012-06-16 11:36:53,215 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:35:14 2012-06-16 11:36:53,216 INFO repeater task os75nb_quick starting 132.4 seconds late 2012-06-16 11:37:19,743 INFO repeater task os75nb_quick ended after 26.5 seconds 2012-06-16 11:37:19,743 INFO repeater task os75nb_3dayplots starting 158.9 seconds late 2012-06-16 11:37:37,767 INFO repeater task os75nb_3dayplots ended after 18.0 seconds 2012-06-16 11:37:37,770 INFO repeater task phins_hcorrstats starting 176.9 seconds late 2012-06-16 11:37:42,040 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 11:37:42,041 INFO repeater task phins2_hcorrstats starting 181.2 seconds late 2012-06-16 11:37:46,186 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 11:37:51,188 INFO repeater task wh300_lastensq starting 94.2 seconds late 2012-06-16 11:37:55,063 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 11:37:55,064 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:36:07 2012-06-16 11:38:20,176 INFO repeater task wh300_lastensq starting 3.2 seconds late 2012-06-16 11:38:25,973 INFO repeater task wh300_lastensq ended after 5.8 seconds 2012-06-16 11:38:25,974 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:38:07 2012-06-16 11:39:41,430 INFO repeater task wh300_beamplots starting 0.6 seconds late 2012-06-16 11:39:47,884 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:39:47,884 INFO repeater task wh300_beamplots ended after 6.5 seconds 2012-06-16 11:39:47,885 INFO repeater task wh300_beamplots starting 7.0 seconds late 2012-06-16 11:39:54,237 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:39:54,238 INFO repeater task wh300_beamplots ended after 6.4 seconds 2012-06-16 11:39:54,239 INFO repeater task os75bb_beamplots starting 13.4 seconds late 2012-06-16 11:39:58,542 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:39:58,543 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 11:39:58,543 INFO repeater task os75bb_beamplots starting 17.7 seconds late 2012-06-16 11:40:02,891 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:40:02,892 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 11:40:02,893 INFO repeater task os75nb_beamplots starting 22.1 seconds late 2012-06-16 11:40:07,866 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:40:07,866 INFO repeater task os75nb_beamplots ended after 5.0 seconds 2012-06-16 11:40:07,867 INFO repeater task os75nb_beamplots starting 27.0 seconds late 2012-06-16 11:40:11,903 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:40:11,903 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2012-06-16 11:40:11,904 INFO repeater task phins_hcorrstats starting 31.1 seconds late 2012-06-16 11:40:15,805 INFO repeater task phins_hcorrstats ended after 3.9 seconds 2012-06-16 11:40:15,810 INFO repeater task phins2_hcorrstats starting 35.0 seconds late 2012-06-16 11:40:19,870 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 11:40:24,874 INFO repeater task wh300_lastensq starting 7.9 seconds late 2012-06-16 11:40:28,889 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:40:28,890 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:40:07 2012-06-16 11:40:28,891 INFO repeater task os75bb_lastensq starting 3.9 seconds late 2012-06-16 11:40:35,870 INFO repeater task os75bb_lastensq ended after 7.0 seconds 2012-06-16 11:40:35,871 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:40:15 2012-06-16 11:40:35,873 INFO repeater task os75nb_lastensq starting 11.9 seconds late 2012-06-16 11:40:39,730 INFO repeater task os75nb_lastensq ended after 3.9 seconds 2012-06-16 11:40:39,731 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:40:14 2012-06-16 11:42:19,976 INFO repeater task wh300_lastensq starting 3.0 seconds late 2012-06-16 11:42:23,978 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:42:23,979 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:42:07 2012-06-16 11:44:19,561 INFO repeater task wh300_lastensq starting 2.6 seconds late 2012-06-16 11:44:23,055 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 11:44:23,056 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:44:07 2012-06-16 11:44:43,120 INFO repeater task phins_hcorrstats starting 2.3 seconds late 2012-06-16 11:44:47,380 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 11:44:47,381 INFO repeater task phins2_hcorrstats starting 6.5 seconds late 2012-06-16 11:44:51,521 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 11:45:26,598 INFO repeater task os75bb_lastensq starting 1.6 seconds late 2012-06-16 11:45:33,567 INFO repeater task os75bb_lastensq ended after 7.0 seconds 2012-06-16 11:45:33,568 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:45:15 2012-06-16 11:45:33,570 INFO repeater task os75nb_lastensq starting 9.6 seconds late 2012-06-16 11:45:37,396 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 11:45:37,397 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:45:14 2012-06-16 11:46:17,497 INFO repeater task wh300_lastensq starting 0.5 seconds late 2012-06-16 11:46:21,513 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:46:21,514 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:46:07 2012-06-16 11:48:17,140 INFO repeater task wh300_lastensq starting 0.1 seconds late 2012-06-16 11:48:20,689 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 11:48:20,690 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:48:07 2012-06-16 11:49:40,873 INFO repeater task wh300_quick starting 0.0 seconds late 2012-06-16 11:50:26,683 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 11:50:26,684 INFO repeater task wh300_quick ended after 45.8 seconds 2012-06-16 11:50:26,684 INFO repeater task wh300_3dayplots starting 45.8 seconds late 2012-06-16 11:50:45,669 INFO repeater task wh300_3dayplots ended after 19.0 seconds 2012-06-16 11:50:45,669 INFO repeater task os75bb_lastensq starting 20.7 seconds late 2012-06-16 11:50:52,637 INFO repeater task os75bb_lastensq ended after 7.0 seconds 2012-06-16 11:50:52,638 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:50:15 2012-06-16 11:50:52,638 INFO repeater task os75bb_quick starting 71.8 seconds late 2012-06-16 11:51:19,345 INFO repeater task os75bb_quick ended after 26.7 seconds 2012-06-16 11:51:19,346 INFO repeater task os75bb_3dayplots starting 98.5 seconds late 2012-06-16 11:51:39,233 INFO repeater task os75bb_3dayplots ended after 19.9 seconds 2012-06-16 11:51:39,236 INFO repeater task os75nb_lastensq starting 75.2 seconds late 2012-06-16 11:51:42,926 INFO repeater task os75nb_lastensq ended after 3.7 seconds 2012-06-16 11:51:42,926 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:50:14 2012-06-16 11:51:42,927 INFO repeater task os75nb_quick starting 122.1 seconds late 2012-06-16 11:52:12,805 INFO repeater task os75nb_quick ended after 29.9 seconds 2012-06-16 11:52:12,806 INFO repeater task os75nb_3dayplots starting 152.0 seconds late 2012-06-16 11:52:39,100 INFO repeater task os75nb_3dayplots ended after 26.3 seconds 2012-06-16 11:52:39,101 INFO repeater task wh300_beamplots starting 178.3 seconds late 2012-06-16 11:52:45,607 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:52:45,608 INFO repeater task wh300_beamplots ended after 6.5 seconds 2012-06-16 11:52:45,612 INFO repeater task wh300_beamplots starting 184.8 seconds late 2012-06-16 11:52:52,516 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:52:52,516 INFO repeater task wh300_beamplots ended after 6.9 seconds 2012-06-16 11:52:52,517 INFO repeater task os75bb_beamplots starting 191.7 seconds late 2012-06-16 11:52:56,590 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:52:56,590 INFO repeater task os75bb_beamplots ended after 4.1 seconds 2012-06-16 11:52:56,596 INFO repeater task os75bb_beamplots starting 195.8 seconds late 2012-06-16 11:53:00,467 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:53:00,468 INFO repeater task os75bb_beamplots ended after 3.9 seconds 2012-06-16 11:53:00,469 INFO repeater task os75nb_beamplots starting 199.6 seconds late 2012-06-16 11:53:04,593 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:53:04,594 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 11:53:04,595 INFO repeater task os75nb_beamplots starting 203.8 seconds late 2012-06-16 11:53:08,694 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 11:53:08,695 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 11:53:08,696 INFO repeater task phins_hcorrstats starting 207.8 seconds late 2012-06-16 11:53:12,924 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 11:53:12,925 INFO repeater task phins2_hcorrstats starting 212.1 seconds late 2012-06-16 11:53:16,793 INFO repeater task phins2_hcorrstats ended after 3.9 seconds 2012-06-16 11:53:21,800 INFO repeater task wh300_lastensq starting 184.8 seconds late 2012-06-16 11:53:25,649 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 11:53:25,649 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:52:07 2012-06-16 11:54:20,793 INFO repeater task wh300_lastensq starting 3.8 seconds late 2012-06-16 11:54:24,796 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:54:24,797 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:54:07 2012-06-16 11:54:44,853 INFO repeater task phins_hcorrstats starting 4.0 seconds late 2012-06-16 11:54:49,079 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 11:54:49,088 INFO repeater task phins2_hcorrstats starting 8.2 seconds late 2012-06-16 11:54:53,032 INFO repeater task phins2_hcorrstats ended after 3.9 seconds 2012-06-16 11:55:28,226 INFO repeater task os75bb_lastensq starting 3.2 seconds late 2012-06-16 11:55:35,503 INFO repeater task os75bb_lastensq ended after 7.3 seconds 2012-06-16 11:55:35,504 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 11:55:15 2012-06-16 11:55:35,505 INFO repeater task os75nb_lastensq starting 11.5 seconds late 2012-06-16 11:55:39,372 INFO repeater task os75nb_lastensq ended after 3.9 seconds 2012-06-16 11:55:39,373 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 11:55:14 2012-06-16 11:56:19,632 INFO repeater task wh300_lastensq starting 2.6 seconds late 2012-06-16 11:56:23,075 INFO repeater task wh300_lastensq ended after 3.4 seconds 2012-06-16 11:56:23,076 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:56:07 2012-06-16 11:58:18,357 INFO repeater task wh300_lastensq starting 1.4 seconds late 2012-06-16 11:58:22,395 INFO repeater task wh300_lastensq ended after 4.0 seconds 2012-06-16 11:58:22,395 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 11:58:07 2012-06-16 11:59:42,617 INFO repeater task wh300_beamplots starting 1.8 seconds late 2012-06-16 11:59:48,925 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:59:48,925 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 11:59:48,926 INFO repeater task wh300_beamplots starting 8.1 seconds late 2012-06-16 11:59:55,244 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 11:59:55,245 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 11:59:55,245 INFO repeater task os75bb_beamplots starting 14.4 seconds late 2012-06-16 11:59:59,500 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 11:59:59,501 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 11:59:59,502 INFO repeater task os75bb_beamplots starting 18.7 seconds late 2012-06-16 12:00:04,038 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:00:04,039 INFO repeater task os75bb_beamplots ended after 4.5 seconds 2012-06-16 12:00:04,039 INFO repeater task os75nb_beamplots starting 23.2 seconds late 2012-06-16 12:00:09,287 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:00:09,287 INFO repeater task os75nb_beamplots ended after 5.2 seconds 2012-06-16 12:00:09,288 INFO repeater task os75nb_beamplots starting 28.4 seconds late 2012-06-16 12:00:13,414 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:00:13,415 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 12:00:13,415 INFO repeater task phins_hcorrstats starting 32.6 seconds late 2012-06-16 12:00:17,642 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 12:00:17,643 INFO repeater task phins2_hcorrstats starting 36.8 seconds late 2012-06-16 12:00:21,482 INFO repeater task phins2_hcorrstats ended after 3.8 seconds 2012-06-16 12:00:26,488 INFO repeater task wh300_lastensq starting 9.5 seconds late 2012-06-16 12:00:30,285 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 12:00:30,285 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:00:07 2012-06-16 12:00:30,287 INFO repeater task os75bb_lastensq starting 5.3 seconds late 2012-06-16 12:00:37,816 INFO repeater task os75bb_lastensq ended after 7.5 seconds 2012-06-16 12:00:37,817 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:00:15 2012-06-16 12:00:37,819 INFO repeater task os75nb_lastensq starting 13.8 seconds late 2012-06-16 12:00:40,912 INFO repeater task os75nb_lastensq ended after 3.1 seconds 2012-06-16 12:00:40,913 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:00:14 2012-06-16 12:02:21,156 INFO repeater task wh300_lastensq starting 4.2 seconds late 2012-06-16 12:02:24,984 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 12:02:24,985 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:02:07 2012-06-16 12:04:20,280 INFO repeater task wh300_lastensq starting 3.3 seconds late 2012-06-16 12:04:23,495 INFO repeater task wh300_lastensq ended after 3.2 seconds 2012-06-16 12:04:23,496 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:04:07 2012-06-16 12:04:43,545 INFO repeater task wh300_quick starting 2.7 seconds late 2012-06-16 12:05:26,169 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 12:05:26,169 INFO repeater task wh300_quick ended after 42.6 seconds 2012-06-16 12:05:26,171 INFO repeater task wh300_3dayplots starting 45.3 seconds late 2012-06-16 12:05:44,549 INFO repeater task wh300_3dayplots ended after 18.4 seconds 2012-06-16 12:05:44,550 INFO repeater task os75bb_lastensq starting 19.6 seconds late 2012-06-16 12:05:52,032 INFO repeater task os75bb_lastensq ended after 7.5 seconds 2012-06-16 12:05:52,033 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:05:15 2012-06-16 12:05:52,034 INFO repeater task os75bb_quick starting 71.2 seconds late 2012-06-16 12:06:26,805 INFO repeater task os75bb_quick ended after 34.8 seconds 2012-06-16 12:06:26,805 INFO repeater task os75bb_3dayplots starting 106.0 seconds late 2012-06-16 12:06:48,161 INFO repeater task os75bb_3dayplots ended after 21.4 seconds 2012-06-16 12:06:48,162 INFO repeater task os75nb_lastensq starting 84.2 seconds late 2012-06-16 12:06:51,329 INFO repeater task os75nb_lastensq ended after 3.2 seconds 2012-06-16 12:06:51,330 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:05:14 2012-06-16 12:06:51,331 INFO repeater task os75nb_quick starting 130.5 seconds late 2012-06-16 12:07:17,842 INFO repeater task os75nb_quick ended after 26.5 seconds 2012-06-16 12:07:17,843 INFO repeater task os75nb_3dayplots starting 157.0 seconds late 2012-06-16 12:07:36,023 INFO repeater task os75nb_3dayplots ended after 18.2 seconds 2012-06-16 12:07:36,027 INFO repeater task phins_hcorrstats starting 175.2 seconds late 2012-06-16 12:07:40,299 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 12:07:40,300 INFO repeater task phins2_hcorrstats starting 179.5 seconds late 2012-06-16 12:07:44,456 INFO repeater task phins2_hcorrstats ended after 4.2 seconds 2012-06-16 12:07:49,460 INFO repeater task wh300_lastensq starting 92.5 seconds late 2012-06-16 12:07:53,051 INFO repeater task wh300_lastensq ended after 3.6 seconds 2012-06-16 12:07:53,052 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:06:07 2012-06-16 12:08:18,148 INFO repeater task wh300_lastensq starting 1.1 seconds late 2012-06-16 12:08:24,031 INFO repeater task wh300_lastensq ended after 5.9 seconds 2012-06-16 12:08:24,031 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:08:07 2012-06-16 12:09:44,404 INFO repeater task wh300_beamplots starting 3.6 seconds late 2012-06-16 12:09:50,999 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:09:51,000 INFO repeater task wh300_beamplots ended after 6.6 seconds 2012-06-16 12:09:51,001 INFO repeater task wh300_beamplots starting 10.2 seconds late 2012-06-16 12:09:57,350 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:09:57,350 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 12:09:57,351 INFO repeater task os75bb_beamplots starting 16.5 seconds late 2012-06-16 12:10:01,601 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:10:01,602 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 12:10:01,602 INFO repeater task os75bb_beamplots starting 20.8 seconds late 2012-06-16 12:10:06,238 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:10:06,239 INFO repeater task os75bb_beamplots ended after 4.6 seconds 2012-06-16 12:10:06,239 INFO repeater task os75nb_beamplots starting 25.4 seconds late 2012-06-16 12:10:10,148 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:10:10,149 INFO repeater task os75nb_beamplots ended after 3.9 seconds 2012-06-16 12:10:10,149 INFO repeater task os75nb_beamplots starting 29.3 seconds late 2012-06-16 12:10:13,790 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:10:13,790 INFO repeater task os75nb_beamplots ended after 3.6 seconds 2012-06-16 12:10:13,791 INFO repeater task phins_hcorrstats starting 32.9 seconds late 2012-06-16 12:10:18,047 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 12:10:18,049 INFO repeater task phins2_hcorrstats starting 37.2 seconds late 2012-06-16 12:10:22,197 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 12:10:27,200 INFO repeater task wh300_lastensq starting 10.2 seconds late 2012-06-16 12:10:31,075 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 12:10:31,076 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:10:07 2012-06-16 12:10:31,079 INFO repeater task os75bb_lastensq starting 6.1 seconds late 2012-06-16 12:10:37,934 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 12:10:37,935 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:10:15 2012-06-16 12:10:37,937 INFO repeater task os75nb_lastensq starting 13.9 seconds late 2012-06-16 12:10:41,653 INFO repeater task os75nb_lastensq ended after 3.7 seconds 2012-06-16 12:10:41,654 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:10:14 2012-06-16 12:12:21,944 INFO repeater task wh300_lastensq starting 4.9 seconds late 2012-06-16 12:12:25,240 INFO repeater task wh300_lastensq ended after 3.3 seconds 2012-06-16 12:12:25,241 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:12:07 2012-06-16 12:14:20,537 INFO repeater task wh300_lastensq starting 3.5 seconds late 2012-06-16 12:14:24,407 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 12:14:24,408 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:14:07 2012-06-16 12:14:44,463 INFO repeater task phins_hcorrstats starting 3.6 seconds late 2012-06-16 12:14:48,694 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 12:14:48,695 INFO repeater task phins2_hcorrstats starting 7.8 seconds late 2012-06-16 12:14:52,248 INFO repeater task phins2_hcorrstats ended after 3.6 seconds 2012-06-16 12:15:27,330 INFO repeater task os75bb_lastensq starting 2.3 seconds late 2012-06-16 12:15:41,374 INFO repeater task os75bb_lastensq ended after 14.0 seconds 2012-06-16 12:15:41,375 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:15:15 2012-06-16 12:15:41,377 INFO repeater task os75nb_lastensq starting 17.4 seconds late 2012-06-16 12:15:51,321 INFO repeater task os75nb_lastensq ended after 9.9 seconds 2012-06-16 12:15:51,322 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:15:14 2012-06-16 12:16:21,399 INFO repeater task wh300_lastensq starting 4.4 seconds late 2012-06-16 12:16:25,868 INFO repeater task wh300_lastensq ended after 4.5 seconds 2012-06-16 12:16:25,869 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:16:07 2012-06-16 12:18:21,396 INFO repeater task wh300_lastensq starting 4.4 seconds late 2012-06-16 12:18:24,755 INFO repeater task wh300_lastensq ended after 3.4 seconds 2012-06-16 12:18:24,756 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:18:07 2012-06-16 12:19:44,949 INFO repeater task wh300_quick starting 4.1 seconds late 2012-06-16 12:20:33,215 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 12:20:33,216 INFO repeater task wh300_quick ended after 48.3 seconds 2012-06-16 12:20:33,217 INFO repeater task wh300_3dayplots starting 52.4 seconds late 2012-06-16 12:20:52,495 INFO repeater task wh300_3dayplots ended after 19.3 seconds 2012-06-16 12:20:52,498 INFO repeater task os75bb_lastensq starting 27.5 seconds late 2012-06-16 12:20:59,690 INFO repeater task os75bb_lastensq ended after 7.2 seconds 2012-06-16 12:20:59,691 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:20:15 2012-06-16 12:20:59,692 INFO repeater task os75bb_quick starting 78.9 seconds late 2012-06-16 12:21:26,061 INFO repeater task os75bb_quick ended after 26.4 seconds 2012-06-16 12:21:26,062 INFO repeater task os75bb_3dayplots starting 105.2 seconds late 2012-06-16 12:21:46,303 INFO repeater task os75bb_3dayplots ended after 20.2 seconds 2012-06-16 12:21:46,304 INFO repeater task os75nb_lastensq starting 82.3 seconds late 2012-06-16 12:21:50,013 INFO repeater task os75nb_lastensq ended after 3.7 seconds 2012-06-16 12:21:50,014 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:20:14 2012-06-16 12:21:50,015 INFO repeater task os75nb_quick starting 129.2 seconds late 2012-06-16 12:22:23,131 INFO repeater task os75nb_quick ended after 33.1 seconds 2012-06-16 12:22:23,132 INFO repeater task os75nb_3dayplots starting 162.3 seconds late 2012-06-16 12:22:48,315 INFO repeater task os75nb_3dayplots ended after 25.2 seconds 2012-06-16 12:22:48,316 INFO repeater task wh300_beamplots starting 187.5 seconds late 2012-06-16 12:22:55,360 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:22:55,361 INFO repeater task wh300_beamplots ended after 7.0 seconds 2012-06-16 12:22:55,362 INFO repeater task wh300_beamplots starting 194.5 seconds late 2012-06-16 12:23:01,951 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:23:01,951 INFO repeater task wh300_beamplots ended after 6.6 seconds 2012-06-16 12:23:01,952 INFO repeater task os75bb_beamplots starting 201.1 seconds late 2012-06-16 12:23:06,321 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:23:06,322 INFO repeater task os75bb_beamplots ended after 4.4 seconds 2012-06-16 12:23:06,323 INFO repeater task os75bb_beamplots starting 205.5 seconds late 2012-06-16 12:23:10,299 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:23:10,299 INFO repeater task os75bb_beamplots ended after 4.0 seconds 2012-06-16 12:23:10,302 INFO repeater task os75nb_beamplots starting 209.5 seconds late 2012-06-16 12:23:14,079 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:23:14,084 INFO repeater task os75nb_beamplots ended after 3.8 seconds 2012-06-16 12:23:14,088 INFO repeater task os75nb_beamplots starting 213.2 seconds late 2012-06-16 12:23:18,182 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:23:18,182 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 12:23:18,183 INFO repeater task phins_hcorrstats starting 217.3 seconds late 2012-06-16 12:23:22,492 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 12:23:22,493 INFO repeater task phins2_hcorrstats starting 221.6 seconds late 2012-06-16 12:23:26,528 INFO repeater task phins2_hcorrstats ended after 4.0 seconds 2012-06-16 12:23:31,533 INFO repeater task wh300_lastensq starting 194.5 seconds late 2012-06-16 12:23:35,040 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 12:23:35,041 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:22:07 2012-06-16 12:24:20,160 INFO repeater task wh300_lastensq starting 3.2 seconds late 2012-06-16 12:24:24,033 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 12:24:24,033 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:24:07 2012-06-16 12:24:44,095 INFO repeater task phins_hcorrstats starting 3.2 seconds late 2012-06-16 12:24:48,347 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 12:24:48,348 INFO repeater task phins2_hcorrstats starting 7.5 seconds late 2012-06-16 12:24:52,336 INFO repeater task phins2_hcorrstats ended after 4.0 seconds 2012-06-16 12:25:27,430 INFO repeater task os75bb_lastensq starting 2.4 seconds late 2012-06-16 12:25:34,512 INFO repeater task os75bb_lastensq ended after 7.1 seconds 2012-06-16 12:25:34,513 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:25:15 2012-06-16 12:25:34,515 INFO repeater task os75nb_lastensq starting 10.5 seconds late 2012-06-16 12:25:38,245 INFO repeater task os75nb_lastensq ended after 3.7 seconds 2012-06-16 12:25:38,245 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:25:14 2012-06-16 12:26:18,561 INFO repeater task wh300_lastensq starting 1.6 seconds late 2012-06-16 12:26:21,887 INFO repeater task wh300_lastensq ended after 3.3 seconds 2012-06-16 12:26:21,888 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:26:07 2012-06-16 12:28:17,173 INFO repeater task wh300_lastensq starting 0.2 seconds late 2012-06-16 12:28:21,048 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 12:28:21,049 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:28:07 2012-06-16 12:29:41,257 INFO repeater task wh300_beamplots starting 0.4 seconds late 2012-06-16 12:29:47,641 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:29:47,642 INFO repeater task wh300_beamplots ended after 6.4 seconds 2012-06-16 12:29:47,643 INFO repeater task wh300_beamplots starting 6.8 seconds late 2012-06-16 12:29:54,044 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:29:54,045 INFO repeater task wh300_beamplots ended after 6.4 seconds 2012-06-16 12:29:54,045 INFO repeater task os75bb_beamplots starting 13.2 seconds late 2012-06-16 12:29:58,312 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:29:58,312 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 12:29:58,313 INFO repeater task os75bb_beamplots starting 17.5 seconds late 2012-06-16 12:30:02,638 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:30:02,638 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 12:30:02,639 INFO repeater task os75nb_beamplots starting 21.8 seconds late 2012-06-16 12:30:07,445 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:30:07,446 INFO repeater task os75nb_beamplots ended after 4.8 seconds 2012-06-16 12:30:07,446 INFO repeater task os75nb_beamplots starting 26.6 seconds late 2012-06-16 12:30:11,594 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:30:11,594 INFO repeater task os75nb_beamplots ended after 4.1 seconds 2012-06-16 12:30:11,595 INFO repeater task phins_hcorrstats starting 30.7 seconds late 2012-06-16 12:30:15,673 INFO repeater task phins_hcorrstats ended after 4.1 seconds 2012-06-16 12:30:15,674 INFO repeater task phins2_hcorrstats starting 34.8 seconds late 2012-06-16 12:30:19,394 INFO repeater task phins2_hcorrstats ended after 3.7 seconds 2012-06-16 12:30:24,398 INFO repeater task wh300_lastensq starting 7.4 seconds late 2012-06-16 12:30:28,299 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 12:30:28,300 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:30:07 2012-06-16 12:30:28,303 INFO repeater task os75bb_lastensq starting 3.3 seconds late 2012-06-16 12:30:35,446 INFO repeater task os75bb_lastensq ended after 7.1 seconds 2012-06-16 12:30:35,447 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:30:15 2012-06-16 12:30:35,453 INFO repeater task os75nb_lastensq starting 11.5 seconds late 2012-06-16 12:30:38,942 INFO repeater task os75nb_lastensq ended after 3.5 seconds 2012-06-16 12:30:38,943 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:30:14 2012-06-16 12:32:19,197 INFO repeater task wh300_lastensq starting 2.2 seconds late 2012-06-16 12:32:23,061 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 12:32:23,062 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:32:07 2012-06-16 12:34:18,628 INFO repeater task wh300_lastensq starting 1.6 seconds late 2012-06-16 12:34:22,013 INFO repeater task wh300_lastensq ended after 3.4 seconds 2012-06-16 12:34:22,014 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:34:07 2012-06-16 12:34:42,061 INFO repeater task wh300_quick starting 1.2 seconds late 2012-06-16 12:35:24,973 INFO repeater task wh300_quick output: Failure in plot: btcal Traceback (most recent call last): File "/home/currents/programs/pycurrents/adcp/quick_mpl.py", line 40, in run_plotter Plotter() File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 847, in __call__ if not self.get_data(): File "/home/currents/programs/pycurrents/adcp/quick_mplplots.py", line 881, in get_data refi = rangeslice(refdat[:,0], self.ddrange) IndexError: invalid index 2012-06-16 12:35:24,973 INFO repeater task wh300_quick ended after 42.9 seconds 2012-06-16 12:35:24,974 INFO repeater task wh300_3dayplots starting 44.1 seconds late 2012-06-16 12:35:43,571 INFO repeater task wh300_3dayplots ended after 18.6 seconds 2012-06-16 12:35:43,573 INFO repeater task os75bb_lastensq starting 18.6 seconds late 2012-06-16 12:35:51,063 INFO repeater task os75bb_lastensq ended after 7.5 seconds 2012-06-16 12:35:51,064 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:35:15 2012-06-16 12:35:51,065 INFO repeater task os75bb_quick starting 70.2 seconds late 2012-06-16 12:36:24,571 INFO repeater task os75bb_quick ended after 33.5 seconds 2012-06-16 12:36:24,572 INFO repeater task os75bb_3dayplots starting 103.7 seconds late 2012-06-16 12:36:47,574 INFO repeater task os75bb_3dayplots ended after 23.0 seconds 2012-06-16 12:36:47,575 INFO repeater task os75nb_lastensq starting 83.6 seconds late 2012-06-16 12:36:51,129 INFO repeater task os75nb_lastensq ended after 3.6 seconds 2012-06-16 12:36:51,129 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:35:14 2012-06-16 12:36:51,130 INFO repeater task os75nb_quick starting 130.3 seconds late 2012-06-16 12:37:17,671 INFO repeater task os75nb_quick ended after 26.5 seconds 2012-06-16 12:37:17,673 INFO repeater task os75nb_3dayplots starting 156.8 seconds late 2012-06-16 12:37:35,811 INFO repeater task os75nb_3dayplots ended after 18.1 seconds 2012-06-16 12:37:35,815 INFO repeater task phins_hcorrstats starting 175.0 seconds late 2012-06-16 12:37:40,083 INFO repeater task phins_hcorrstats ended after 4.3 seconds 2012-06-16 12:37:40,084 INFO repeater task phins2_hcorrstats starting 179.2 seconds late 2012-06-16 12:37:44,241 INFO repeater task phins2_hcorrstats ended after 4.2 seconds 2012-06-16 12:37:49,244 INFO repeater task wh300_lastensq starting 92.2 seconds late 2012-06-16 12:37:53,051 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 12:37:53,052 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:36:07 2012-06-16 12:38:18,233 INFO repeater task wh300_lastensq starting 1.2 seconds late 2012-06-16 12:38:24,046 INFO repeater task wh300_lastensq ended after 5.8 seconds 2012-06-16 12:38:24,047 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:38:07 2012-06-16 12:39:44,396 INFO repeater task wh300_beamplots starting 3.6 seconds late 2012-06-16 12:39:50,928 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:39:50,929 INFO repeater task wh300_beamplots ended after 6.5 seconds 2012-06-16 12:39:50,930 INFO repeater task wh300_beamplots starting 10.1 seconds late 2012-06-16 12:39:57,269 INFO repeater task wh300_beamplots output: Starting procsetup 2012-06-16 12:39:57,270 INFO repeater task wh300_beamplots ended after 6.3 seconds 2012-06-16 12:39:57,271 INFO repeater task os75bb_beamplots starting 16.4 seconds late 2012-06-16 12:40:01,567 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:40:01,567 INFO repeater task os75bb_beamplots ended after 4.3 seconds 2012-06-16 12:40:01,568 INFO repeater task os75bb_beamplots starting 20.7 seconds late 2012-06-16 12:40:06,325 INFO repeater task os75bb_beamplots output: Starting procsetup 2012-06-16 12:40:06,325 INFO repeater task os75bb_beamplots ended after 4.8 seconds 2012-06-16 12:40:06,326 INFO repeater task os75nb_beamplots starting 25.5 seconds late 2012-06-16 12:40:10,563 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:40:10,563 INFO repeater task os75nb_beamplots ended after 4.2 seconds 2012-06-16 12:40:10,564 INFO repeater task os75nb_beamplots starting 29.7 seconds late 2012-06-16 12:40:14,532 INFO repeater task os75nb_beamplots output: Starting procsetup 2012-06-16 12:40:14,533 INFO repeater task os75nb_beamplots ended after 4.0 seconds 2012-06-16 12:40:14,534 INFO repeater task phins_hcorrstats starting 33.7 seconds late 2012-06-16 12:40:18,572 INFO repeater task phins_hcorrstats ended after 4.0 seconds 2012-06-16 12:40:18,576 INFO repeater task phins2_hcorrstats starting 37.7 seconds late 2012-06-16 12:40:22,488 INFO repeater task phins2_hcorrstats ended after 3.9 seconds 2012-06-16 12:40:27,493 INFO repeater task wh300_lastensq starting 10.5 seconds late 2012-06-16 12:40:31,377 INFO repeater task wh300_lastensq ended after 3.9 seconds 2012-06-16 12:40:31,378 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:40:07 2012-06-16 12:40:31,380 INFO repeater task os75bb_lastensq starting 6.4 seconds late 2012-06-16 12:40:38,270 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 12:40:38,271 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:40:15 2012-06-16 12:40:38,273 INFO repeater task os75nb_lastensq starting 14.3 seconds late 2012-06-16 12:40:42,054 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 12:40:42,055 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:40:14 2012-06-16 12:42:17,297 INFO repeater task wh300_lastensq starting 0.3 seconds late 2012-06-16 12:42:21,056 INFO repeater task wh300_lastensq ended after 3.8 seconds 2012-06-16 12:42:21,056 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:42:07 2012-06-16 12:44:21,416 INFO repeater task wh300_lastensq starting 4.4 seconds late 2012-06-16 12:44:24,933 INFO repeater task wh300_lastensq ended after 3.5 seconds 2012-06-16 12:44:24,934 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:44:07 2012-06-16 12:44:44,987 INFO repeater task phins_hcorrstats starting 4.1 seconds late 2012-06-16 12:44:49,216 INFO repeater task phins_hcorrstats ended after 4.2 seconds 2012-06-16 12:44:49,217 INFO repeater task phins2_hcorrstats starting 8.4 seconds late 2012-06-16 12:44:53,339 INFO repeater task phins2_hcorrstats ended after 4.1 seconds 2012-06-16 12:45:28,430 INFO repeater task os75bb_lastensq starting 3.4 seconds late 2012-06-16 12:45:35,326 INFO repeater task os75bb_lastensq ended after 6.9 seconds 2012-06-16 12:45:35,326 INFO repeater task os75bb_lastensq: Time from /home/data/at21_02/proc/os75bb/load/wrote_ens_time: 2012/06/16 12:45:15 2012-06-16 12:45:35,328 INFO repeater task os75nb_lastensq starting 11.3 seconds late 2012-06-16 12:45:39,091 INFO repeater task os75nb_lastensq ended after 3.8 seconds 2012-06-16 12:45:39,092 INFO repeater task os75nb_lastensq: Time from /home/data/at21_02/proc/os75nb/load/wrote_ens_time: 2012/06/16 12:45:14 2012-06-16 12:46:19,196 INFO repeater task wh300_lastensq starting 2.2 seconds late 2012-06-16 12:46:22,753 INFO repeater task wh300_lastensq ended after 3.6 seconds 2012-06-16 12:46:22,754 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:46:07 2012-06-16 12:48:18,580 INFO repeater task wh300_lastensq starting 1.6 seconds late 2012-06-16 12:48:22,320 INFO repeater task wh300_lastensq ended after 3.7 seconds 2012-06-16 12:48:22,321 INFO repeater task wh300_lastensq: Time from /home/data/at21_02/proc/wh300/load/wrote_ens_time: 2012/06/16 12:48:07 2012-06-16 12:49:42,529 INFO repeater task wh300_quick starting 1.7 seconds late