NOAA Logo National Centers for Environmental Information

formerly the National Oceanographic Data Center (NODC)...  more on NCEI

NOAA Satellite and Information Service
Top Banner Graphic
Sidebar Image For GHRSST LTSRF at NODC

On a daily basis, the LTSRF at NODC automatically acquires from the GDAC all data and metadata which are 30 days or more past the data of observation and organizes them into NODC Accessions based on the producing Regional Data Assembly Center (RDAC), Processing Level (L2P or L4), Sensor (AMSR-E, TMI, AVHRR-GAC, etc.) and Date. These data are moved into the formal NODC archive and quality controlled using a set of automated procedures with random human checks on the process. For detailed technical information on these automatation procedures, see the GHRSST LTSRF Automated Accessioning document. This document is a "living" document and subject to continual revision as the procedures evolve.

Operational Status Messages:

2014-06-04: 15th GHRSST Science Team Meeting in full swing now!
15th GHRSST Science Team Meeting in full swing now! NODC is a key partner as the GHRSST long term archive and stewardship facility. See www.ghrsst.org/ghrsst/Meetings-and-workshops/ghrsst-xv-science-meetingand ghrsst.nodc.noaa.gov

2014-06-04: NODC publishes first two GHRSST Data Specification Version 2 datasets
NODC publishes first two GHRSST Data Specification Version 2 datasets, building on the large collection of Version 1 datasets... ghrsst.nodc.noaa.gov. NAVO VIIRS L2P, and Canadian Meteorological Center (CMC) Level 4 global SST analysis product. More products to come soon!

2013-06-01: LTSRF nearly back to operational status
The issues with the old ingest filesystems have been diagnosed and understood, new ingest filesystems have been built, and ingest of GHRSST data is under way again. However, it may be a few more days before the NODC archives are back to full operational status. We all agree that a measure of paranoia is called for when dealing with issues with the long term NOAA archives. Thank you for your patience.

2013-05-24: LTSRF on temporary hold
A pair of disks underlying the ingest filesystem have failed. Ingest of GHRSST data into the LTSRF is on hold while the filesystems are being rebuilt.

2013-04-23: LTSRF Processing Upgrades Completed
In preparation for GDS 2.0 compliant data arriving at the LTSRF, the automatic acquisition and ingest processes have been upgraded to handle some non-compliant GDS 1.0 data. This will enable a backlog of such data to be cleaned up and ingested, freeing up resources for the GDS 2.0 data processing. Normal archive operations have resumed. Thank you for your patience.

2013-03-12: LTSRF Processing Being Upgraded
In preparation for GDS 2.0 compliant data arriving at the LTSRF, the automatic acquisition and ingest processes are being upgraded to handle these new data formats. A backlog of non-compliant GDS 1.0 data is being cleaned up and ingested. Some other past processing issues are also being handled. Normal archive operations will resume once these issues have been handled. Thank you for your patience.

2013-03-09: NODC Archives temporarily paused
Two different filesystems filled up while a backlog of data was being ingested into the NODC Archive system. All processing has been stopped while engineers address the issues. Thank you for your patience.

2011-02-05: NODC Archives operational
The NODC Archive system preventative maintenance has been completed. We hope this will result in improved archive performance. Thank you for your patience.

2011-02-05: NODC Archives undergoing preventative maintenance
The NODC Archive system is undergoing preventative maintenance. Diagnostics revealed a problem with a disk in the ingest processing filesystem. The disk has been replaced and the filesystem was rebuilt and revalidated. However, in order to reduce stress on that filesystem and the underlying disks, it was decided to move the ingest processing to a new filesystem. That move is underway. Thank you for your patience.

2009-12-28: NODC Archives fully operational
Scheduled maintenance on the NODC Archive system has been successfully completed. All GHRSST data which has been acquired during the maintenance period will be ingested over the next few days. Thank you for your patience.

2009-12-27: NODC Archives undergoing maintenance
The NODC Archive system is undergoing scheduled maintenance. Various database and software improvements are being rolled out over the next few days. In the meantime, the LTSRF continues to acquire GHRSST data which will be ingested once the Archive maintenance has been completed. Thank you for your patience.

2009-12-14: Network issues resolved, LTSRF resuming operations
Network issues that had been interfering with the acquisition of GHRSST data from JPL have been resolved. Additional issues with incomplete metadata for AVHRR17_L data sets are being investigated. All other GHRSST data sets are being ingested normally. Thank you for your patience.

2009-12-09: Network issues interfering with acquisition of GHRSST data
Network issues have been interfering with the acquisition of GHRSST data from JPL. The connection has been unexpectedly slow and thus we have been unable to keep up with the regular flow of data. Network engineers are looking into the trouble in hopes of determining the cause of the slowness. Thank you for your patience.

2009-01-06: NODC Archive fully operational
Maintenance on the NODC Archive Management System has been fully completed and automatic archiving of GHRSST data sets has resumed. Thank you for your patience during the maintenance period.

2008-12-31: NODC Archive undergoing maintenance
The NODC Archive Management System will be undergoing maintenance in order to enhance processing and to increase speed and capacity. The system will be unavailable beginning at 5pm EST, Wednesday, December 31. We expect the maintenance to be completed by Monday, January 5, 2009. Automatic archiving of GHRSST data will by necessity be suspended during the maintenance period. All GHRSST data will continue to be acquired from the NASA GDAC and automatic ingest and archiving of the data will resume once the maintenance has been completed. We apologize for any inconvenience this may cause.

2008-10-02: LTSRF Automated Accessioning Document Updated
The GHRSST LTSRF Automated Accession Document available on http://ghrsst.nodc.noaa.gov/documents.html was updated today to include a new RDAC (NEODAAS) and to reflect the name change of the international GHRSST project from "GODAE High Resolution SST Pilot Project" to the "Group for High Resolution SST".

2008-07-01: PO.DAAC Server Problems
Problems with the data server at the NASA PO.DAAC have prevented acquisition of the latest GHRSST data by the LTSRF. Once these problems have been resolved, the backlog of data will be acquired and ingested.

2008-03-17: LTSRF Archive Graphics Restored
After an approximately two week hiatus, the daily GHRSST LTSRF archive status graphics have been restored. These graphics are available at http://ghrsst.nodc.noaa.gov/opmessages.html.

2008-03-07: NODC Archive undergoing maintenance
The NODC Archive Management System will be undergoing maintenance in order to enhance processing and to increase speed and capacity. The system will be unavailable beginning at 5pm EST, Saturday, March 8. We expect the maintenance to be completed by Monday, March 10. Automatic archiving of GHRSST data will by necessity be suspended during the maintenance period. All GHRSST data will continue to be acquired from the NASA GDAC and automatic ingest and archiving of the data will resume once the maintenance has been completed. We apologize for any inconvenience this may cause.

2008-02-12: Problem with Acquisition Corrected
A problem with the data acquisition system at the LTSRF was discovered. A lock was left in place when the data acquisition system crashed last week and monitoring scripts failed to detect the errant lock. The monitoring scripts have been updated and the data acquisition system is back on line.

2007-12-10: NODC Archive fully operational
The maintenance and upgrade of the NODC Archive Management System has been completed. Additional processing capacity is now available. The LTSRF has resumed automatic ingest and archival of GHRSST data. Any backlog should be processed within the next few days.

2007-12-07: NODC Archive undergoing maintenance
The NODC Archive Management System is undergoing maintenance in order to provide additional processing capacity. We expect the maintenance to be completed by Monday, December 10. In the meantime, automatic archiving of GHRSST data has been suspended. All GHRSST data will continue to be acquired and automatic ingest and archiving of the data will resume once the maintenance has been completed. We apologize for any inconvenience this may cause.

2007-10-26: GDAC indexing system problem fixed
The 19 October NASA GDAC indexing system problem was resolved today and the LTSRF has resumed ingesting and archiving the backlogged data. Roughly 11,000 data files appear to have been backlogged, so it will be at least several days before they have all been archived.

2007-10-23: Problem with the indexing system at the NASA PO.DAAC's GDAC
Since 19 October, no new accessions have been brought into the LTSRF archive due to a problem with the indexing system at the NASA PO.DAAC's GDAC. No data are being lost, and the backlog will be ingested into the archive as soon as the GDAC resolves the issue. We apologize for any inconvenience this may cause.

2007-07-28: Daily ingest and automatic archiving of GHRSST data has resumed
Daily ingest and automatic archiving of GHRSST data has resumed. Within approximately one week the backlog of data will be processed.

2007-07-26: Problem with the indexing system at the NASA PO.DAAC's GDAC
Since 17 July, no new accessions have been brought into the LTSRF archive due to a problem with the index file generation system at the NASA PO.DAAC's GDAC. No data are being lost, and the backlog will be ingested into the archive as soon as the GDAC resolves the issue which should be within the next couple of days. We apologize for any inconveniences this may cause.

2006-11-21: Automated accessioning has been fully restored
Automated accessioning has been fully restored and all data held at the failover site have been transferred to the archive.

2006-11-14: Automated accessioning has been temporarily postponed
Automated accessioning has been temporarily postponed for newly arriving data due to a disk space issue, which arose when a large volume of MODIS Terra was acquired unexpectedly. The ingest of newly arriving data has switched over to our backup systems in Boulder, CO, at the National Geophysical Data Center. Automated accessioning of newly arriving data will be returned to normal operations the week of Monday, November 20, 2006. At that time, the backlog of data not yet formally archived will also be processed and moved into the archive system. We apologize for any inconvenience this may cause.

Archive Status Graphics (updated daily, click for full resolution):

Number of Accessions
Total Volume Total Number
Daily Volume Daily Number
Operational Messages Access GHRSST Data LTSRF News
GHRSST Documents LTSRF Home SST-SI Intercomparisons

 

Flag Bar
NODC NOAA CLASS AVHRR SST GODAE GAC RSMAS GHRSST GHRSST-PP MCSST NLSST SeaWiFS OAIS AIP SIP DIP
GOSTA NPOESS VIIRS OPeNDAP LAS HRPT LAC GAC HDF-SDS DMAC PO.DAAC LTSRF GDAC RDAC L2P L4 OSTIA

  Last modified:    Thu, 8-Oct-2015 18:15 UTC NCEI.info@noaa.gov
 
Dept. of Commerce - NOAA - NESDIS - NCEI
* Offsite Link Notification
USA.gov - The U.S. Government's Web Portal