1. INTRODUCTION
1.1 Purpose of the Document
The Global Temperature-Salinity Profile Programme (GTSPP) is a joint programme of the IOC Committee on International Oceanographic Data and Information Exchange (IODE) and the Joint IOC/WMO Committee on the Integrated Global Ocean Services System (IGOSS). IODE and IGOSS are technical committees of the Intergovernmental Oceanographic Commission (IOC) and the World Meteorological Organization (WMO).
Development of the GTSPP (then called the Global Temperature-Salinity Pilot Project) began in 1989. The short-term goal of the GTSPP was to respond to the needs of the Tropical Ocean and Global Atmosphere (TOGA) Experiment and the World Ocean Circulation Experiment (WOCE) for temperature and salinity data. The longer term goal was to develop and implement an end to end data management system for temperature and salinity data, which could serve as a model for future oceanographic data management systems.
GTSPP went into operation in November 1990. The first version of the GTSPP Project Plan was published the same year. Since that time there have been many developments and some changes in direction including a decision by IGOSS and IODE to end the pilot phase and implement GTSPP as a permanent programme. Member states of IOC and WMO decided it was time to publish an updated version of the programme plan.
In addition to presenting information on the further development of the GTSPP this document highlights the more important improvements to international data management practice. This new plan serves both as a guide to future development of the GTSPP and a concise source of information on progress to date.
1.2 Rationale for the Programme
GTSPP was developed as a response to changing needs in the ocean science and marine operational communities. Scientists conducting research into oceanic and atmospheric processes are addressing global issues and need multi-disciplinary data sets for their experiments. The operational community needs more data in operational time frames to conduct safe operations at sea. Both the scientific and operational communities are applying the knowledge of ocean processes gained in four decades of research. Data are being assimilated into models making predictions addressing sustainable development, climate change, and human and environmental safety.
As a result of these needs, data collection programmes are more complex and produce significantly larger volumes of data. The quality control problem is more difficult because of the increased volume and complexity of the data. Improved means of using high-speed data communications and the World Wide Web in international data management are being developed. Data and improved data and information products need to be available more quickly than in the past.
In short a new paradigm for international oceanographic data management is required. GTSPP has and will continue to address the development of that paradigm.
1.3 Overview of this Document
This document is directed to the scientific research community and users of operational ocean data. It is also intended to provide an example and be a source of information to programmes such as the Global Ocean Observing System (GOOS) for developing and implementing end to end data management systems. The document is also directed towards member states of IOC. It discusses how member states can make contributions and how they can benefit from the GTSPP.
Section 2 below presents the objectives of the GTSPP as a permanent programme of IGOSS and IODE. Many of the original objectives of the pilot project have to a great extent been achieved. The objectives given here are revised objectives established for the permanent . They are based on the original objectives, what has been accomplished, and the new priorities for GTSPP.
Section 3 describes the benefits that member states can expect from participation in the GTSPP. The section also contains a number of examples of the benefits that have already been realized by a number of member states.
Section 4 describes how member states can participate actively in the further implementation of the GTSPP. Participation in the GTSPP can lead to increased availability of temperature and salinity data for national needs. It can also provide access to improved data management technology for member states for capacity building.
Section 5 presents information on the present and potential future areas of cooperation of GTSPP with other IOC and WMO programmes. GTSPP has developed an example of a successful end to end data management system which can be applied to temperature and salinity data and to other variables that are or will be collected by these other programmes.
Section 6 discusses the very important subject of scientific cooperation and guidance to the data management activities of the GTSPP, why such cooperation is needed, and how it might develop in the future.
Section 7 provides an overview of the Programme Plan and details the more important initiatives that GTSPP is undertaking to improve the existing elements of the programme and to address the elements of the programme that have not yet been implemented. This section is a concise presentation of the plan for the way forward.
Section 8 describes how the programme is managed and identifies the parent bodies.
Annex A contains the terms of reference for and composition of the GTSPP Steering Group.
Annex B contains information on contacting the IOC and GTSPP participants for further information or for data and information products. World Wide Web and email addresses are included.
Annex C contains the list of acronyms.
Annex D is a history of the GTSPP. It contains information on the meetings that lead to the development of the GTSPP and its adoption as an IGOSS-IODE Programme. It should be noted that the reports of all these meetings are contained on the first edition of the GTSPP CD-ROM, which is available from the IOC Secretariat.
Annex E describes the more important improvements to international data management and exchange that have been achieved within the GTSPP. Several new concepts were incorporated into the first GTSPP Project Plan. While seemingly straight forward, their routine implementation in an organized and efficient manner in a high volume, time sensitive international data flow had not yet been achieved.
Annex F lists the objectives of the GTSPP. These objectives are reviewed and updated at meetings of the Steering Group.
Annex G presents details of the elements of the GTSPP. These elements include such items as near real time data acquisition, communications infrastructure, and delayed mode data acquisition. The annex describes the elements, how they have been implemented, responsibility for operations, etc.
2. OBJECTIVES OF THE GTSPP
When the pilot project for the GTSPP was established there were 6 objectives which appear in Annex F. The following objectives represent the way forward for the permanent programme and reflect the impact of the achievements of the pilot project; the latest activities of IOC and WMO including implementation of the GOOS, GCOS, and WCRP; the completion of WOCE; and the development of CLIVAR.
The pilot project had another objective to improve the completeness of the historical databases by digitizing historical data existing only in analogue or manuscript form and by including digital data not presently at a World Data Centre (WDC). However this responsibility has since been taken on by the IODE Global Data Archaeology and Rescue Project (GODAR).
3. BENEFITS OF GTSPP FOR MEMBER STATES
GTSPP has an obvious international objective, but it is also intended that member states benefit at the national and regional level. In particular, member states benefit from GTSPP because:
The following are some examples of benefits of participation in the GTSPP by some IOC and WMO member states.
It is expected that as GTSPP moves forward and member state participation increases, more and varied benefits of this nature will be realized.
4. MEMBER STATE PARTICIPATION IN THE GTSPP
As of 1997 there are 14 organizations in 8 member states of IOC and WMO participating actively in the GTSPP. Active participation means that the member state or organization is doing something for GTSPP on a regular basis.
It is a goal of GTSPP is to increase this participation. The types of contributions that are being made now are described below. Ideas on new contributions are also included. member states that do not yet do so are encouraged to examine their data related activities and where appropriate to actively support the GTSPP.
The existing contributions are varied. Some organizations are supplying data. Others are assembling the data and applying quality control. Others are providing information for monitoring the data flow on the GTS. Some are acquiring data from national sources that do not normally contribute to the international systems and providing the data to GTSPP centres. Scientific organizations are providing scientifically based quality control to data sets for their region of expertise. Other organizations are providing computer software for use in GTSPP data centres. There is a wide range of activities involved in establishing and operating this programme. There are many ways to participate in GTSPP.
The best progress will be realized in the future if contributions come from more member states so that a heavy workload is not imposed on a small number of active participants. If the workload is spread:
As indicated above there are many areas where member states can make valuable contributions. Within their own marine science communities Member states can:
For example one area that needs improvement is the submission of near real time salinity observations, surface and subsurface. Globally there are very little salinity data transmitted over the GTS. Member states should make every effort to encourage their research vessels to submit TESAC messages from CTD casts or TRACKOB messages from thermosalinographs.
All member states automatically play a part in GTSPP through their normal IGOSS/IODE activities. To participate more actively in the GTSPP, member states can write to the IOC Secretariat, the WMO Secretariat, or to the Chairman of the GTSPP Steering Group outlining the areas in which they wish to contribute.
5. GTSPP INTERFACE WITH EXISTING PROGRAMMES
When the Global Temperature-Salinity Pilot Project began, the first elements of the World Climate Research Programme (WCRP) and the Tropical Ocean and Global Atmosphere (TOGA) Experiment were being implemented. The World Ocean Circulation Experiment (WOCE) was being developed.
In fact GTSPP was developed to respond to the needs of TOGA and WOCE and had a very successful working relationship with those programmes. Since that time TOGA has been completed, and WOCE has moved from the data collection phase of the programme to synthesis and analysis activities. Two new programmes have been established and GTSPP is turning its attention to serving those programmes as well as continuing to work with WOCE. The new programmes are the Global Ocean Observing System (GOOS) and CLIVAR (the Climate Variability Programme).The GTSPP principle continues to be to work in cooperation with existing programmes that either require or collect and manage temperature and salinity data. Both GOOS and CLIVAR will require the use of T&S data and be involved in specifying requirements for its collection. GTSPP will work with its parent committees of IGOSS and IODE to implement mutually beneficial programmes with GOOS and CLIVAR.
The following sections outline the areas of potential additional services to WOCE and potential services to GOOS and CLIVAR.
5.1 World Ocean Circulation Experiment (WOCE)
The WOCE programme consists of a number of experiments. One of the experiments is the Upper Ocean Thermal Programme (UOT). The main data requirements of the UOT are for heat and salt distributions of the upper ocean. The development of accurate distributions of these variables requires the most complete and accurate temperature and salinity databases. GTSPP has helped with the management of these data during the data collection phase of the WOCE programme through participation in the WOCE UOT Data Assembly Centre (DAC).
The new requirement for GTSPP support to WOCE is to address the compilation of the databases in a form that will be useful in the synthesis and analysis phase of the Experiment. GTSPP will also seek additional temperature and salinity profile data collected during the WOCE period by other national and international programmes. GTSPP will provide copies of the databases as they exist at any given time to those conducting the synthesis and analysis phase of the Experiment.
Another important focus of the new GTSPP programme is in working with the WOCE Data Products Committee (DPC) to build the UOT part of the WOCE Data Resource. The WOCE Data Resource is an active distributed archive of the WOCE data which will continue to make the data available to users after the completion of WOCE. In many cases the Data Resource will continue to grow where observation systems are put in place to continue important WOCE measurements.
Another area of WOCE - GTSPP cooperation is related to the TOGA/WOCE Subsurface Data Centre that had been established in Brest, France. This centre operates a database with subsurface temperature and salinity data for a specific area of ocean and time frame of interest to TOGA and WOCE. There is a regular exchange of data between the Brest Centre and the GTSPP Centre in the US NODC in Washington DC. This exchange ensures that each centre has copies of all available data relevant to its mandate. GTSPP will continue to work with the Brest Centre to ensure that both Centres are working with the complete database.
5.2 CLIVAR
CLIVAR is a 15-year Climate Variability (CLIVAR) programme to study climate variability and predictability. It is the primary WCRP programme for the study of the role of the ocean in the coupled climate system. It can be regarded as a programme that builds on the knowledge gained through TOGA, WOCE, and the 1995 study of anthropogenic effects on climate change that was carried out by the Intergovernmental Panel on Climate Change.
CLIVAR anticipates that the IOC and WMO and their subsidiary bodies will work together to codify and monitor the standards for making, processing and archiving meteorological observations for operational needs in the terrestrial, marine, and cryospheric environments. This will lead to the maintenance and continued growth of a reliable global climate record. CLIVAR also anticipates that IOC and WMO will institute and maintain an international infrastructure for encouraging, assisting and coordinating individual nations contributing to the deployment and maintenance of operational observing systems.
To serve CLIVAR's needs these data must be provided in a timely fashion. It is also important to ensure that as much data as possible that are collected by observing systems deployed for research purposes are inserted expeditiously into the operational data processing and archiving streams.
GTSPP was designed with requirements for programmes such as CLIVAR in mind. GTSPP has been organized to provide data in the most timely manner possible and with early as possible examination and documentation of the data quality. GTSPP also has made significant progress in acquiring data collected by the oceanographic research organizations to make it available to national and international clients. GTSPP therefore expects to provide continuing support to climate research and prediction by supporting CLIVAR as it has supported TOGA and WOCE.
5.3 GOOS
The Global Ocean Observing System is responsible for the development of future ocean observing systems that will address issues including climate change and prediction, health of the oceans, marine living resources, the coastal zone, and ocean services. The Intergovernmental Committee for the Global Ocean Observing System (I-GOOS) coordinates member states efforts for establishing GOOS. The Joint Scientific and Technical Committee for GOOS (J-GOOS) is the body that supplies scientific and technical expertise to the development of the observing systems. The intention is that the data collection and management aspects of GOOS be built on the existing systems of IGOSS, IODE, GLOSS, DPCP, and others. Thus GOOS is a future client for GTSPP services.
As with CLIVAR, GTSPP was developed to meet the perceived needs of GOOS. The GTSPP model is regarded as a prototype for the data management systems that will be needed for many aspects of GOOS. In particular GTSPP has and will continue to put significant effort into the development of real time quality control systems, data flow monitoring, and the development of the continuously managed database concept. These developments have placed GTSPP is an excellent position to contribute significantly to the implementation of the data management aspects of GOOS.
One of the important initiatives of the new GTSPP programme is focused on the provision and distribution of useful data products and information to the client community. The initial approach to this aspect of the programme is to develop a distributed set of World Wide Web sites among the UOT DAC sites with data products and information for clients.
6. SCIENCE SUPPORT
Continued scientific acceptance and involvement continues to be crucial to the success of GTSPP. It has been demonstrated again and again within national and international programmes that close cooperation between the scientists and data managers is required for success, and increases efficiency significantly to the benefit of the scientific and data management programmes. GTSPP must continue to actively seek cooperative arrangements with the scientific community. This will occur through a number of mechanisms including:
The recommendation of the Fourth Session of the Steering Group on the GTSPP was to transfer scientific QC techniques to the data centres where possible. This decision was based on the practical realities of funding of such work in scientific laboratories. It does not lessen the need for scientific support to the QC process and to GTSPP in general. This support will still be needed to ensure a high quality database through continued scientific analysis and evaluation of the GTSPP data sets. It is essential that GTSPP continue to function as a combination of data management and scientific endeavour. This is the only way the programme will result in a timely and complete database of temperature and salinity data of known and agreed standards of quality.
7. PROGRAMME PRIORITIES AND PLANS
The priorities for the pilot project were as follows.
Priority was initially placed on the implementation of the real time data flow elements of the pilot project because of the needs of TOGA and the WOCE UOT Programme. As decided at the Fourth Session of the GTSPP Steering Group priorities for further development of GTSPP will now shift to delayed mode data acquisition, data from new sources, and data and information products. Another important new initiative is the development of activities supporting the synthesis and analysis phases of WOCE, the development and implementation of GOOS, and the development and implementation of CLIVAR.
GTSPP priorities and plans can be described in terms of improvements to the existing elements and major new initiatives focussing on the lesser developed aspects of the programme.
7.1 Improvements to Existing Elements
7.1.1 Transfer of scientific QC to the data centres
As discussed earlier in this plan an active programme for transferring the scientific quality control procedures developed in the WOCE UOT science centres is being implemented. The transfer includes the training of data centre staff through exchange visits and in some cases transfer of quality control software.
7.1.2 Continued comparison of the contents of the BREST and NODC data bases.
Comparisons of these two databases will continue on a regular basis to ensure the client communities of each centre will have the most complete database available for their use.
7.1.3 Resolution of differences in interpretation of data and meta data standards.
Over past few years various meta data codes have been assigned by the GTSPP and WOCE UOT centres. Because the system is operational there is not always time to debate the assignments with other GTSPP centres some differences in usage have resulted. Present usage will be agreed and documented, changed where necessary, and a process for assignment of codes and usage of fields will be implemented.
7.1.4 Continued support of GTSPP (NODC and MEDS) to the SOOPIP.
MEDS and NODC will continue to operate the GTSPP Real Time Assembly and QC Centre and the Continuously Managed Database respectively as a contribution to the permanent programme. This includes providing support as necessary to the Ship of Opportunity Implementation Panel (SOOPIP) in their efforts to maintain the real time sampling networks of the WOCE UOT Programme.
7.1.5 Cooperation with WMO GTS monitoring.
GTSPP will continue to work with the World Weather Watch in the annual monitoring of the GTS data flows to ensure a high level of performance in circulating ocean data in real time.
7.2 New Initiatives
7.2.1 Capture of new data sources including new instrumentation for both the real time and delayed mode data streams.
The profiling ALACE float is an instrument that has come into broader use in the 1990s. This instrument descends to a preprogrammed depth, drifts with the currents for a given time, and surfaces to transmit position and sensor data via satellite. While descending and ascending, temperature and salinity profile data are observed. GTSPP is seeking access to these data in both real time and delayed mode. GTSPP is also actively pursuing the acquisition of other types of data such as that from towed undulating instruments for inclusion in the databases.
7.2.2 Delayed mode data acquisition and monitoring of the data flows.
There are two initiatives in the GTSPP plan in relation to delayed mode data. The first is to further develop the delayed mode aspects of the system including data flow monitoring in order to improve the completeness and timeliness of the database. The second is to complete processing of the delayed mode WOCE data according to the schedule proposed by the GTSPP IV meeting. This second initiative is to ensure that all available temperature and salinity data are acquired for use in the synthesis, analysis, and modelling phase of WOCE.
7.2.3 Development of data product and information aspects of the GTSPP.
GTSPP at present produces a number of data and information products. Included are maps and inventories of temperature and salinity data acquired in real time and in the CMD. Data flow analyses from GTS centres in North America, Europe, and Asia are produced on a monthly basis. Analyses of errors occurring in data are produced monthly and fed back to operators for use in dealing with recurring problems. Maps of surface and subsurface temperatures from the databases are produced by the Science Centres. Several data sets for various areas of ocean are produced on a regular basis and forwarded to clients with operational needs on a several times per week or monthly basis.
Enhancements to these services are constantly under development. The Science Centres are developing additional products that prove useful in serving their national and international clients and making them available through their WWW sites. This method of development is considered the most effective as it ensures the development efforts are directed to products that are needed.
GTSPP can provide where needed other custom data sets on a regular basis for clients with operational needs. The Programme is also developing improved services through its network of national and international WWW sites.
7.2.4 Development of services for WOCE, GOOS, and CLIVAR.
Section 5 of this document describes in detail the relationship of GTSPP to WOCE, GOOS, and CLIVAR. To summarize, GTSPP will continue to provide services to WOCE through the final phases of the experiment. Specifically GTSPP will support the analysis phase of the experiment by making available at any time the most complete and timely data sets available; and will assist as possible in the development of the WOCE Data Resource by providing assistance to the WOCE DPC in the development of the Resource, and by operating the appropriate distributed databases in the resulting operational system.
For the development of GOOS and CLIVAR, GTSPP will provide assistance as appropriate in the development and implementation of new data flows from existing and new sources of temperature and salinity data; and the preparation of new data manipulation tools, data products and analyses for processing and analysis centres established by these programmes.
8. PROGRAMME MANAGEMENT
8.1 Parent Bodies
The parent bodies for GTSPP are the Intergovernmental Oceanographic Commission and the World Meteorological Organization (see Figure 1). At the Seventh Session of the Joint IOC-WMO Committee on IGOSS it was recommended that GTSPP become a permanent programme of IGOSS and IODE. The Fifteenth Session of the Committee on IODE concurred and GTSPP is now a permanent programme rather than a pilot project.
The permanent programme has been renamed the Global Temperature-Salinity Profile Programme which retains the acronym GTSPP.
8.2 Steering Group
The terms of reference and the composition of the Steering Group on the GTSPP were accepted the Thirteenth Session of the Committee on International Oceanographic Data and Information Exchange (New York USA, 17-24 January 1990).
The Steering Group has been responsible for the continuing development and implementation of the Programme. The Group oversees and directs the development of the Programme and promotes and encourages participation in the GTSPP. The Group includes members from the scientific community and provides scientific guidance to participants. The Group specifies, maintains, and distributes relevant documentation to IGOSS and IODE contacts and representatives of scientific programmes, and reports to the IODE and IGOSS Committees. It also invites scientific experts at the discretion of the Chair.
At the Fourth Session the future of the Steering Group was discussed. The conclusion was that GTSPP was sufficiently developed that it no longer needed the full attention of a steering group. The meeting noted that IGOSS and IODE had approved the development of end to end data management systems for the various data types common to the two bodies. It was noted that the GTSPP was in fact the first example of an IGOSS-IODE end to end data management system. The meeting therefore proposed that the Steering Group for the GTSPP be modified to become a Steering Group for IGOSS and IODE end-to-end data management systems with new terms of reference to guide GTSPP and other similar programmes for other data types.This new role for the Steering Group has been referred to IODE and IGOSS and will be discussed at the next IODE Officers meeting.
The complete terms of reference and composition for the existing Steering Group are contained in Annex A. These terms of reference will be reviewed and updated subsequent to the decision of the IODE Officers Meeting in consultation with the IGOSS Bureau in regard to conversion of the Steering Group to one dealing with IGOSS/IODE end to end data management systems.
ANNEX A
Terms of Reference and Composition for the Steering Group on the Global Temperature-Salinity Pilot Project
Terms of Reference
Composition
ANNEX B
Contacting the GTSPP
For more information on the GTSPP contact the following sources:
I. IOC Secretariat
Dr. I. Oliounine
Intergovernmental Oceanographic Commission
1, rue Miollis
75732 Paris Cedex 15
France
Phone: (33) (1) 45 68 39 63
Email: i.oliounine@unesco.org
Fax: (33)(1) 45 68 58 12
IOC Home Page: http://www.unesco.org/ioc/
II. WMO Secretariat
Dr. Peter Dexter
World Weather Watch
World Meteorological Organization
Case postal 2300
CH-1211
Geneva 2
Switzerland
Phone: 4122 730 8237
Email: dexter@www.wmo.ch
Fax: 4122 733 0242
III. Chairman of the Committee on International Oceanographic Data and Information Exchange
Ben Searle
Head, Australian Oceanographic Data Centre
Level 2, MHQ Annex
Wylde Street
Potts Point NSW 2011 Australia
Phone: +61 2 563 4801
Email: ben@AODC.gov.au
Fax: +61 2 563 4820
IV. Chairman of the Steering Group on the GTSPP
Dr. J. R. Wilson
5771 Rideau Valley Drive
Manotick, Ontario, Canada
K4M 1B3
Phone: 613-692-3009
Email: rwilson@fox.nstn.ca
Fax (613) 993-4058
Note 1. The GTSPP has published a CD-ROM, which contains extensive information about the GTSPP and the data available to the end of 1995. This CD-ROM is available from the IOC Secretariat. Information on the GTSPP is also available on the IOC Home Page.
Note 2. In cooperation with the WOCE UOT programme, GTSPP has published a second CD ROM containing all data to the end of 1998. This is available from the WOCE DIU, MEDS or NODC. A second version is planned for October, 2000.
ANNEX C
List of Acronyms
| CD-ROM | Compact Disk - Read Only Memory |
| CMD | Continuously Managed Database |
| CLIVAR | Climate Variability Programme |
| GODAR | Global Oceanographic Data Archaeology and Rescue Project |
| GTS | Global Telecommunications System |
| GTSPP | Global Temperature-Salinity Profile Programme |
| DAC | (WOCE) Data Assembly Centre |
| DMC | (WOCE) Data Management Committee |
| ICSU | International Council of Scientific Unions |
| IGOSS | Integrated Global Ocean Services System |
| IOC | Intergovernmental Oceanographic Commission |
| IODE | International Oceanographic Data and Information Exchange |
| JEDA | Joint Environmental Data Analysis (Center) |
| MEDS | Marine Environmental Data Service |
| NODC | National Oceanographic Data Centre |
| QC | Quality Control |
| RNODC | Responsible National Oceanographic Data Centre |
| SOOPIP | Ship of Opportunity Implementation Panel |
| TOGA | Tropical Ocean and Global Atmosphere (Experiment) |
| UOT | (WOCE) Upper Ocean Thermal (Programme) |
| WCRP | World Climate Research Programme |
| WDC | World Data Centre |
| WMO | World Meteorological Organization |
| WOCE | World Ocean Circulation Experiment |
ANNEX D
History of the GTSPP
The original concept for the Global Temperature/Salinity Pilot Project (GTSPP) was raised at the Second Joint IOC-WMO Meeting of Experts on IGOSS-IODE Data Flow ( Ottawa, Canada, 18-22 January, 1988). The meeting developed a draft proposal for a project to develop a very high quality, scientifically acceptable global ocean thermal data set.
The meeting of The Group of Experts on Responsible National Oceanographic Data Centres (RNODCs) and Climate Data Services (Wormley, UK, February, 1988), with participants from IODE, WOCE and TOGA, discussed the WCRP ocean data needs and the role of the IODE system in meeting those needs. A recommendation "...that a pilot project (global thermal database) be implemented to prove the value of the concept..." was supported by the meeting.
At the Fifth Session of the Joint IOC-WMO Working Committee for IGOSS (Paris, 14-23 November, 1988), a plan proposing a pilot project on global temperature and salinity data management was presented to the Committee by Canada and the USA. Inclusion of salinity data was a result of consultations with potential users prior to the IGOSS meeting.
The First Ad-Hoc Consultative Meeting on the GTSPP was held at the US National Oceanographic Data Center in Washington, DC (23-25 January, 1989). The Meeting developed goals and defined the Project's major elements. The Summary Report of this meeting, titled "Report of an Ad-Hoc Consultative Meeting on the Global Temperature/Salinity Pilot Project (An IGOSS-IODE Programme)" in available on the GTSPP CD-ROM, published in 1996 and available from the IOC Secretariat as indicated in Annex B.
The Second Ad-Hoc Consultative Meeting on the GTSPP was held at the Marine Environmental Data Service in Ottawa, Canada (25-28 July, 1989) and further advanced the Project. This meeting worked out the data flows and coordinated the activities of WOCE and TOGA, and the GTSPP in managing temperature and salinity data. The Summary Report of this meeting, titled "Second ad hoc Consultative Meeting on the Global Temperature/Salinity Pilot Project (A Proposed IGOSS-IODE Project)" is also available on the GTSPP CD-ROM.
A Workshop on the GTSPP was held prior to the Thirteenth Session of the Committee on IODE in New York (15-16 January, 1990). Many aspects of the project were discussed and clarified. The formation, terms of reference, and composition of the Steering Group on the GTSPP was also defined. The recommendations of the Workshop were discussed at IODE XIII and the results of the discussions can be found in the report of that meeting. With the approval of the IODE session, GTSPP became an official IODE/IGOSS pilot project.
The First Session of the Steering Group (Brest, France, 17-19 September, 1990) reviewed and finalized for publication the GTSPP Project Plan, the QC Manual, and the Brochure. The format for the exchange of data between GTSPP Centres was established, and the Implementation Plan was updated. The operational algorithms for the Continuously Managed Database and for duplicates identification and management were reviewed and documented. Procedures for the development of data flow monitoring for the GTS were established. A new potential product list was established.
Two centres volunteered and were accepted to become the main processing and data management centres for GTSPP data. The Marine Environmental Data Service (MEDS) in Canada manages the Real Time QC and Assembly Centre. This centre gathers and merges all available global temperature and salinity data, effects GTSPP QC on the data, resolves duplicates, and provides data sets to users on a 3 times per week schedule. The centre also monitors data quality and alerts data collectors to recurring problems.
The US National Oceanographic Data Centre (NODC) operates the Continuously Managed Database (CMD) for the real time and delayed mode data, carries out delayed mode QC and duplicates resolution, coordinates the scientific quality control activities, and handles distribution of the data to users, both national and international.
The Second Session of the Steering Group (Obninsk, Russia, 15-20 July, 1991) reviewed progress on implementation of the pilot project. In particular the meeting reviewed the real time data flows and formats, the results of quality control of the real time data, and the development of the continuously managed database. Some small adjustments and changes of procedures were indicated but on the whole, progress was considered very favourable. Continuation of the monitoring of the real time data flow on the GTS was judged as highly useful and was to be continued. Support to the WOCE Upper Ocean Thermal Data Assembly Centre (WOCE UOT DAC) was found to be adequate for the moment pending further discussion at WOCE meetings to be held in the fall in Washington. Plans for development of a GTSPP CD-ROM were initiated.
The Third Session of the Steering Group (Ottawa, Canada, 15-19 November 1993) discussed the potential for additional temperature and salinity profile data. Data from undulating instruments are sometimes treated as profiles and could be handled within GTSPP systems as such providing appropriate supporting meta data were included. Declassified data from the navies of various IOC countries were also noted as an additional data that is coming available. As a further service to WOCE the meeting recommended that computerized monitoring of the sampling of the WOCE/TOGA lines be implemented. The US NODC volunteered to provide that service. MEDS agreed to continue feedback of information to operators on commonly occurring errors in data reports from ships and buoys.
The meeting also discussed the standardization of the scientific QC procedures and of the languages and libraries to make sharing of software between GTSPP participants easier. The meeting reviewed and updated the GTSPP action plan for the next intersessional period.
The Fifteenth Session of the Committee on IODE (Athens, Greece, 23-31 January , 1996) concurred with the view of the Seventh Session of the Joint IOC/WMO Committee for IGOSS that the GTSPP should become a permanent IOC/WMO programme with the name Global Temperature-Salinity Profile Programme.
The Fourth Session of the Steering Group (Washington, DC, USA, 16-19 April 1996 dealt with cooperation with the GODAR Project, redefined the limits of the GTSPP responsibilities, and reviewed the roles of the science centres and the data centres in regard to quality control of the data. Decisions were made that GTSPP would deal only with profile data and that aspects of the GTSPP related to historical salinity data collected before 1990 would be left to the GODAR Project. In each case GTSPP had not yet developed the ability and systems to manage these other data. In each case another competent organization had offered to undertake the work as a contribution to international data management.
GTSPP IV also reviewed the manner in which the quality control tasks were distributed between the science centres and the data centres. Concerns were expressed that the science centres did not have sufficiently stable funding to guarantee that they could continue to apply their QC to the data into the indefinite future. It was therefore recommended that there should be a continuous process of transfer of scientific QC techniques and training to the data centres through exchange visits, training, etc. The science centres would still be involved at a lower level of effort providing guidance and advice.
The meeting also discussed sources of additional data from both new instrumentation and other data collectors. The delayed mode data flow was found to be behind schedule and goals were set to bring that element of the Programme back on schedule. ANNEX E
Improved Methodologies Implemented by the GTSPP
i) Enhanced Scientific Input to the Data Management Activity
The United States National Oceanographic Data Centre (NODC), in an effort to promote and improve data management activities in the USA, established a cooperative venture with the Scripps Institute of Oceanography. This project was called the Joint Environmental Data Analysis (JEDA) Center. It demonstrated the utility and feasibility of having a scientific node in data quality control. The benefits of JEDA were two fold. JEDA improved the quality and the usefulness of the data held nationally by NODC and distributed to other NODCs and RNODCs. Also the activities of JEDA resulted in the production of a number of very useful products. GTSPP was designed to include these kinds of interactions and cooperation between the scientific community and the data centres.
In developing its strategies for data management, the World Ocean Circulation Experiment Data Management Committee (DMC) adopted a similar model in defining the Data Assembly Centre or DAC. A DAC consisted of one or more scientific organizations working cooperatively with one or more data centres to handle the data from a WOCE experiment. The scientific organizations contributed knowledge of oceanography and data collection procedures. The data centres contributed data processing, archiving, and distribution expertise. The result of applying these models to the development of the GTSPP is higher quality reliable data that is properly documented for present and future users.
This closer cooperation between the scientific community and the data centres has showed real benefits both for GTSPP and WOCE data management. As the techniques for scientific quality control of the data are proven and standardized, they are being incorporated into data centre operations. This enhances the capabilities of the data centre and allows the scientific centres to concentrate on the science, the development of further QC techniques, or the development of more useful products.
ii) The Continuously Managed Database
The concept of the continuously managed database has been a significant advance in making data available to the user community sooner and in a form that is more convenient for them. Prior to the CMD concept, users had to contact three or more sources to obtain the most complete data set at any given time. The real time data would have to be obtained from one or more IGOSS SOCs. The historical data would be from a WDC or from one or more NODCs and RNODCs. The delayed mode data if available at all would probably have to be obtained from one or more oceanographic laboratories. The data would be in several formats, and there would be duplicates of observations in several of the files obtained. Meta data would be scarce and varied and the use of flags and indicators would be different between the files from different sources.
The CMD was designed to avoid these problems. Data would be available in one format. Duplicates would be removed. The QC flags and the meta data indicators would all be the same. The database would include the latest data available; as delayed mode data would have replaced the lower resolution data collected from the GTS.
Thus the user could be a user immediately he received the data rather than first being a data manager. It would not be necessary to convert formats to a common one or carry out individual QC evaluations and duplicates removal. Significant efficiencies are achieved by having data organized once in a data centre as to having a system whereby each user has to repeat a series of data management tasks before the data can be used.
The continuously managed database has been a very successful advance in data management within the GTSPP.
iii) Enhanced and Standardized Quality Control
In the development of the GTSPP there were several problems with the manner in which QC systems were implemented in data centres. The first problem was that most data centres had their own version and series of QC tests that could be applied. Checks against climatology were not applied routinely. Duplicates checking was rare. There were no meta data attached to data that had been through QC to detail what QC tests were applied and which ones failed. GTSPP attempted to address these and other problems.
The first step was to agree on the quality control tests that would be done. Draft lists of the tests were prepared and discussed at the Steering Group Meetings. Agreement was achieved and the GTSPP QC manual was published as a result. Variables were defined to hold the information on which tests were applied and which failed. The GTSPP format was developed to carry these variables with the data. Meta data and QC flags were standardized for real-time, delayed mode, and historical versions of the data. The meta data were designed to allow the user to differentiate between the various versions of the observation (e.g. between real time and delayed mode versions). A table of information called the history group was developed to be carried with each observation (station of data). The history group identified where the data had been and what each organization had done to it.
The duplicate management algorithms were developed and tested using the real time data flow. Similar versions of the algorithm for detection of duplicates and selection of the copy of the observation that would be retained were implemented in the real time data centre in the MEDS and in the CMD input preparation in the US NODC.
These improvements to documenting the management of the temperature-salinity data have not only allowed the users of the data to understand what has been done to the data, but also have proven very useful to the data centres in finding and solving problems with the processing of the data.
iv) Improved Data Flow Monitoring
The Global Telecommunications System is used to circulate meteorological weather and ocean reports around the world to meteorological and oceanographic centres. Various types of bulletins have different requirements for distribution. Some are for local or national distribution. Others are for international or global distribution. There is a mix of technologies in the various countries. Consequently the GTS is complex and routing problems can occur.
Two of the goals of the GTSPP are to improve the performance of IOC and WMO data exchange systems and to circulate monitoring reports on data flow and data availability. To accomplish this goal for the GTS, a monitoring system has been put in place for the flow of oceanographic reports on the GTS, in particular BATHY and TESAC reports.
To accomplish this monitoring Germany and Japan supply copies of the ocean data they receive from the GTS to the Real Time QC and Assembly Centre (MEDS) in Canada. The reports from these European and Asian centres are then compared to those received in the USA and Canada. The complete data set is assumed to be the combination of the data received in the four centres with the duplicates removed. Thus a comparison of the reports received versus the reports not received in each of the four centres can be prepared. This report is published on the World Wide Web in about the middle of each month for the previous month. For the first time users of real time ocean data can be aware of which data are available and what they missed. This allows any IGOSS or IODE centre to contact the appropriate GTS centre to correct routing tables to ensure they get the most complete data set possible in real time.
The result of this monitoring indicated that various centres were receiving of the order of 65% to 95% of the data from month to month. Not only has this monitoring allowed the centres to improve their capture of real time data, but it has ensured that the data centres capture 95% or more of the available data instead of losing up to 30% per month.
v) Feedback of Information on Data Problems to the Data Collectors
International ship of opportunity programmes have been operated on behalf of IGOSS and various international science programmes for many years. Until GTSPP there was no complete and comprehensive examination of the quality of the data in a single centre. This made it difficult to identify common types of errors and compare various sources of the data to identify specific ships or buoys that were repeatedly making the same types of errors.
The Real Time QC and Assembly Centre in MEDS has undertaken this task. Each month a statistical analysis is done for the ships and buoys reporting for that month. When the number of reports with errors for a ship or buoy exceeds 10% of its data for a month a message is sent to the operator with an explanation of the types of errors that are occurring. This provides the operator with the information necessary to address the problem.
After a two of years of providing this feedback it has been noticed that there has been a statistically significant decrease in the number of such errors.
ANNEX F
Objectives of the Pilot Project
The objectives at the beginning of the Pilot Project were as follows.
ANNEX G
Elements of the GTSPP
Figure 2 is an attempt to present the rather complex data flows of national and international programmes within which GTSPP must find its place. The boxes in the Figure represent generic centres. A given international IGOSS or IODE centre may fit within several boxes in carrying out its national and international responsibilities. The following sections discuss this Figure in terms of seven essential elements of the GTSPP.
These seven essential elements of the GTSPP are given below. All of these elements must function for the Programme to be fully operational.
The elements of GTSPP are:
G.1 Near Real Time and Operational Time Frame Data Acquisition
Near real time data acquisition within GTSPP depends on the GTS of the World Weather Watch of WMO and the telecommunications arrangements for BATHY and TESAC data established by IGOSS. Copies of other real time or operational time frame data sets are acquired from any other available sources via the Internet of other high-speed networks. The goal is to ensure that the most complete operational time frame data set is captured.
Figure 3 is a graphic representation of the GTSPP operational time frame data flow. The "data collectors" in the top boxes follow one of two procedures. In the first case the data are provided to GTS centres that place it on the GTS with minutes to a few hours of its collection. In the second case the data are supplied to a national organization that forwards it to the real time centre in MEDS within a few days to a month of its collection.
The real time data that are circulated on the GTS are copied by both MEDS and the IGOSS SOCs, and by users of real time data who have access to the GTS. These users would include meteorological and oceanographic centres that issue forecasts and warnings, centres that provide ship routing services, and centres that prepare real time guidance products for the fishing industry. Some of the IGOSS SOCs provide copies of the data they received to MEDS for a monthly analysis of GTS data flows.
MEDS compiles the global data set from the various sources, applies the documented GTSPP QC and duplicates removal procedures, and forwards the data to the US NODC three time per week. At NODC the data are added to the continuously managed database, also three times per week. There are also several clients that receive copies of the data sent from MEDS three times per week. These are clients who do not need the data within hours but rather within a few days. By getting the data from the GTSPP Centre in MEDS they save having to operate computer systems to do quality control and duplicate removal.
At the beginning of the pilot project the US NODC would accumulate a monthly set of near real time data and merge it with any delayed mode data received for the relevant period. The monthly data sets were forwarded to the agency responsible for the scientific evaluation and quality control. After the first year this process was discontinued for the real time data. It was found that the QC procedures in the data centres had improved so that the scientific QC did not add much value to the data set. It was decided that scientific QC would be reserved for a more final version of the data set after the delayed mode data had replaced much of the real time data.
Note that the regular route for real-time data to the box marked "Operational Clients" in Figures 2 and 3 is not affected by GTSPP. This route provides for uninterrupted flow of data for weather and operational forecasting through the national weather services of member states. These centres need the data in hours rather than days.
G.2 Delayed Mode Data Acquisition
GTSPP utilizes, to the extent possible, the existing IODE data network and processing system to acquire and process delayed mode data. The box entitled "Delayed Mode & Historical Data" in Figure 4 shows the delayed mode data flow in graphic form. The data flow into the continuously managed database in the US NODC is through a "Delayed Mode QC" process. This process is analogous to the QC carried out on the real time data and is to conform to the specifications of the GTSPP QC Manual. In some cases, where appropriate arrangements can be made this box and the QC it implies could actually exist and be performed in another national oceanographic data centre on behalf of NODC.
Having proceeded through the delayed mode QC process, the data then follow the same route as the real time data through the rest of the CMD process; however, on a different time schedule because of the more irregular times of arrival. During the merging of the data into the CMD, any duplicates occurring between near real time and delayed mode data sources will be identified with the highest resolution duplicate being retained as the active CMD copy.
Acquisition of delayed mode data from the Principal Investigators is a priority for the GTSPP. It is necessary for GTSPP participants to work diligently in a pro-active manner with both the Principle Investigators and the data managers of the global programmes that collect the temperature and salinity data. The goal is to get the delayed mode data into the CMD within one year or less of its collection. An excellent way for any national oceanographic data centre to support GTSPP actively is to obtain national data sets of temperature and salinity data, apply GTSPP QC procedures, and submit them to the US NODC for inclusion in the CMD.
Delayed mode data are usually exchanged on magnetic media or CD-ROMs. However, in many instances where high-speed networks are available, data are now being telecommunicated.
Member states without the ability to exchange data in GF3 are encouraged to submit data in any form they can. GTSPP will attempt to provide assistance to overcome any data exchange difficulties.
G.3 Communications Infrastructure
The ability to acquire data and to ensure that it is provided to the GTSPP Continuously Managed Database in a timely manner is dependent on the communications infrastructure. Operation of GTSPP involves a range of communication mechanisms, which include:
Over a period of time, the objective is to move to faster and more automated means of communications for data acquisition and dissemination, and for the dissemination of data products and information.
Internet and the World Wide Web have become very important in the dissemination of data, information products, and information concerning the programme. Some of the products have near real time uses, the applicability of which can be greatly enhanced by their timely distribution. Publication of such products on the World Wide Web has become the option of choice to provide the data quickly to clients that have access to the Internet. For users in member states that do not have access to the Internet, other options for telecommunicated products have to be implemented. For example GTS data flow products have been circulated to some member states by fax. Member states that can not receive products and data available from GTSPP on the Internet should contact the IOC Secretariat with a request that some other arrangements be made.
Figure 2 does not contain any specific information on communications infrastructure. However, the characteristics of the communications infrastructure are implied to a certain extent by the connections between the boxes.
G.4 Quality Control Procedures
The quality control element continues to be crucial to the successful operation of GTSPP. It is essential that all data maintained in the GTSPP Continuously Managed Database (CMD) is of a known quality and that the scientific community, including the major global research programmes, accept the validity of the quality control flags attached to the GTSPP data.
The philosophy of GTSPP is to create a complete database. This is achieved partly by retaining all data that meet the minimum level of quality. Once an observation has successfully passed the first level of checks (which consist of relatively simple data structure, format and range related tests), it will not be removed or deleted from the CMD except in the case of exact duplicates.
The GTSPP Quality Control Manual covers the checks that are undertaken by participating data centres. It describes the approach of using a small number of quality control flags by using a series of data quality levels to identify data validity.
The quality control levels range from a minimum series of checks up to the more sophisticated numerical assessments. All the data that have been checked and have passed the lowest quality level criteria are included in the CMD with the appropriate flag and it will then be available to the user.
A significant feature of the GTSPP quality control procedures is that they form the basis for a global quality control standard. The scientific community can accept this standard because that community has been heavily involved in its development. Gaining this acceptance has been a major achievement for GTSPP. It is very important that the scientific community continue to be involved in suggesting, reviewing and agreeing to GTSPP quality control procedures.
It was decided at the Fourth Session of the Steering Group on the GTSPP that it is desirable and necessary to transfer the scientific QC procedures being done by the WOCE UOT Science Centres to the data centres. Economic considerations in the 1990s have made it clear that continued support of GTSPP data management by the science centres can not be guaranteed at the level of the past few years. Although apparently initiated for negative reasons, this "transfer of technology" to the data centres is a positive step in its own right. Upgrading data centres skills has been a goal of IODE for the past several years and can only lead to better data centre performance and services.
On the other hand involvement of the scientific community in the development and maintenance of GTSPP QC procedures and the skills of the data centre persons performing the QC must be maintained at a significant level to ensure continued success. GTSPP through its participating centres must work to maintain effective working arrangements with the science programmes to ensure the adequacy of its QC activities. Only in this way can the continued validity and acceptability of the GTSPP data set be guaranteed.
G.5 Continuously Managed Database
All the activities of GTSPP, including data acquisition, communications, data flow analysis, data quality control, and scientific analysis, result in the creation of the global temperature and salinity data set. To manage this data set, a Continuously Managed Database (CMD) was implemented.
As data are acquired in both near real time and delayed mode, they are added to the database. Delayed mode data have a higher resolution and are calibrated and quality controlled by the originator. Thus the delayed mode data represent a "better" version of the data for all purposes. This "better" version replaces the data obtained in near real time. This "better" version of the data arrives later than the real time version. The Continuously Managed Database therefore holds the most current and highest quality data set available at any given time. It will be continuously refined as additional quality checks are undertaken. The term replace here means replace as the active copy of the observation in the database. As stated earlier, observations that have passed quality control and entered the database are not removed. They are flagged to indicate that a higher quality version of the observation exists in the database.
The system supporting the CMD provides a number of functions including:
Subsets of GTSPP data covering areas of national interest or global data sets are provided to member states on request.
G.6 GTSPP Data and Information Products
GTSPP has a role in the production of two types of data and information products. The first role is a direct one whereby GTSPP actually produces the product as part of the operation of the programme. The second role is in providing a higher quality and more complete data set to others who are producing products and information about ocean temperatures and salinities. Examples of the first type of product are:
At the present time, various other research and operational agencies produce data analysis products in response to national and international needs. If these analyses are produced using a more complete and higher quality in-situ data set from GTSPP, then the product will be of higher quality. This is the second type of role for GTSPP in products and information.
It is important that GTSPP compliments rather than competes with other national and international organizations in producing products. The GTSPP role is to provide a high quality data set that will assist these organizations in producing higher quality products. An example would be GTSPP providing the most complete and best quality in situ data set available for a numerical modelling study.
By supporting the work of the scientific experts in other organizations GTSPP can expand its expertise in uses of the temperature and salinity data as well as assisting the work of the experts. These experts are in many cases in a better position to produce scientific analyses and products because of special expertise and local knowledge.
The development and distribution of data and information products helps to promote and advertise the GTSPP. The products demonstrate additional uses for the data and show the effectiveness of GTSPP as a data management model and as an important contributor to the global research programmes.
GTSPP data and information products are disseminated as widely as possible via a number of means including mail, electronic mail, publishing on the World Wide Web, and on CD-ROM.
G.7 Data Flow Monitoring
The implementation and operation of GTSPP involves the use of considerable resources, including manpower, computer systems, and communications networks. In order to maximize the effectiveness and the data returns for the investment, it is essential that the data flow of the system be carefully monitored.
The monitoring programme is intended to assist all participants, including data contributors and user groups, to have knowledge of the effectiveness of the programme and to modify aspects that are not performing efficiently. It will also provide an indication of improvements in the system as the programme develops.
In particular, GTSPP exercises the monitoring procedures developed in IGOSS and IODE and assist with the further development and improvement of these procedures.
GTSPP data flow monitoring will aim to meet the following objectives: