NOAA / POES Space Environment Monitor

NOAA's Polar Orbiting Environmental Satellites (POES) carry a suite of instruments that measure the flux of energetic ions and electrons at the altitude of the satellite. This environment varies as a result of solar and geomagnetic activity. Beginning with the NOAA-15 satellite, an upgraded version of the Space Environment Monitor (SEM-2) has been flown.

Because the SEM-2 instruments differ significantly from the earlier SEM-1, there has been a complete revision to the data processing and archiving process. A number of improvements have also been included. Among these are incorporating up-to-date satellite orbit information and magnetic field models in the calculation of various magnetic coordinates, and improved data quality control.

The Total Energy Detector (TED) is designed to measure the energy flux carried by auroral particles, both positively charged ions (assumed here to be protons) and electrons, into the polar atmosphere. The magnitude and spatial extent of this energy flux are good measures of both the level of auroral activity and the atmospheric response to that energy input.

The Medium Energy Proton and Electron Detector (MEPED) includes a set of solid-state energetic particle detectors that monitor the intensities of protons and electrons over a range extending from 30 keV to more than 200 MeV. Particles having those energies include the radiation belt populations, solar particle events, and the lower energy galactic cosmic rays. Enhanced fluxes of these particles entering the atmosphere can produce significant and widespread degradation in short-wave radio propagation; in extreme cases even radio blackouts. The energetic particles also contribute to astronaut radiation exposure, especially on high inclination orbit missions during energetic solar particle events.

• General time coverage by satellite:
  • TIROS-N 1978 - 1981 (Introduction of SEM-1)
  • NOAA-6 1979 - 1986
  • NOAA-7 1981 - 1985
  • NOAA-8 1983 - 1985
  • NOAA-10 1986 - 1991
  • NOAA-12 1991 - 2002
  • NOAA-14 1994 - 2004
  • NOAA-15 1998 - present (Introduction of SEM-2)
  • NOAA-16 2001 - present
  • NOAA-17 2002 - present
  • NOAA-18 2005 - present
  • METOP-02 2006 - present (aka METOP-A)

  A detailed archive catalog is updated automatically whenever data are received

• Direct Access to POES SEM data (poes.ngdc.noaa.gov/data): This link will take you to the access point for all POES SEM data which are updated daily.
  
  

  ./data	./avg	./cdf	./YYYY (i.e., ./2008)	./SATID (i.e., ./metop02)		16s averages, CDF format, SEM-2 only.
  		./txt	./YYYY	./SATID		16s averages, ASCII table, SEM-2 only.
  	./full	./YYMM	./SATID			full resolution, 2s values, native binary format.
  		./netcdf	./YYYY	./SATID		full resolution, 2s values, NetCDF format, under development.
  	./raw	./YYMM	./SATID			full resolution, 2s values, native binary format, Level-0, internal use.
  	./plots	./qc	./YYYY	./SATID		Daily plot of all data in time series used for quality control, pdf format.
  		./lshell	./YYYY	./SATID		L-shell plots by orbit, png images in tar file, under development.
  		./maps	./YYYY	./MM	./cylindrical	Flux distribution maps, under development.
  					./orthogonal_west
  ./docs						Documentation and software, see details below.

• Documentation files for Polar Orbiting Environmental Satellite (POES) SEM data, prepared by the Space Weather Prediction Center:
  • SEM-1 Documentation for TIROS-N through NOAA-14, (version 1.0 January 1985, 2.0 MB pdf ).
  • SEM-2 Documentation for NOAA-15 and later satellites:SEM2v2.0.doc, rev 2006
    Appendix A : Archive record description.
    Appendix B : Conversion table for MEPED and TED counts.
    Appendix C : TED Sensor Data Grouped by Unit Serial Number, rev 2006.
    Appendix D : C Language Program to Read an Archive Record.
    Appendix E : FORTRAN Language Program To Read an Archive Record.
    Appendix F : Procedures to recover energetic proton number fluxes from the Omnidirectional detector responses, rev 2006.
    Appendix G: Processing Problems, Instrument Problems, Updated Information, rev 2007.
    Errata for SEM2 Documentation : rev 2006.
  • NOAA-KLM User's Guide with N' Supplement.
  • January 7, 2002 -- Status report for NOAA-12, NOAA-14, NOAA-15, & NOAA-16
  • February 11, 2003 -- Status report for NOAA-12, NOAA-14, NOAA-15, NOAA-16, & NOAA-17
  • January 8, 2004 -- Status report for NOAA-12, NOAA-14, NOAA-15, NOAA-16, & NOAA-17
  • January 5, 2005 -- Status report for NOAA-12, NOAA-14, NOAA-15, NOAA-16, & NOAA-17
  • July 17, 2006 -- NOAA-18 reprocessing.
  • January 10, 2008 -- Status report for NOAA-15, NOAA-16, NOAA-17, NOAA-18 & MetOp-02
• The NORAD ortital elements for NOAA and TIROS- N satellites are available from CelestraK.

2008-04-22 MepOp Orbital Maneuvers

It has come to our attention that during instances when the MetOp satellite exercises orbital maneuvers the entire SEM-2 instrument is turned off.  Unfortunately the data processing software does not recognize when the SEM-2 data processing unit (DPU) has been turned off and so assumes that the data received from the TED and MEPED detectors, that had been turned off, are valid in spite of the fact those data are zero-fill during these periods.  The TED and MEPED instrument ON-OFF flags in the daily archive files are not properly set to OFF at these times.

Those periods of time during which the SEM-2 instrument on MetOp were turned off are:

April 19, 2007 between 0819:58 and 1616:14 UTC
April 24, 2007 between 0000:00 and 1359:27 UTC
July  12, 2007 between 0922:22 and 1538:22 UTC
Sept. 18, 2007 between 1454:10 and 2400:00 UTC
Sept. 19, 2007 between 0000:00 and 1402:58 UTC
Jan.  31, 2008 between 0921:30 and 1538:33 UTC
April  8, 2008 between 0732:23 and 2400:00 UTC
April  9, 2008 between 0000:00 and 0437:58 UTC

The TED and MEPED ON-OFF flags in the MetOp archive files for these days have been corrected and the corrected files are available.

2008-01-07 Revised NOAA-16 file for day 2007-07-09

It was discovered that orbital data contained in the NOAA-16 archive file for July 9, 2007 (day 190) was incorrect for times after 2035:11 UT. A revised NOAA-16 archive file for that day has been produced that eliminated records with incorrect orbital information.

2007-03-23 Revised NOAA-18 archive files

Revisions to NOAA-18 archive data files for July 23-24, 2005 and for the entire period July 11, 2006 through December 26, 2006 were necessary because incorrect calibration data for the TED instrument were used.  These revisions impacted only the TED auroral particle energy flux values and many of the data quality flags.  All of the MEPED data in the original archive data files were correct.

Users of TED data for these periods are advised to download the revised archive data files for NOAA-18.

2005-08-16 ERRATA: Software errors in unpackSem2.c since year 2000.

It has been brought to our attention by a user of POES SEM-2 data that the C language archive unpacking routine returns anomalous sensor values during periods where there are data missing as flagged by 999. We have examined that code and uncovered two significant errors in the C version of the code that have existed since 2000.

Both errors involve the way the C unpacker implements missing data flags. The first error centered around the fact that missing data flags associated with sensor data from the second half of the 32-second archive record were being improperly unpacked from the binary archive record. The consequences of that error were that TED and MEPED sensor values during periods when data were missing were often improperly flagged with valid data being set to -999. indicating missing data, while entries that should have been flagged as missing data were given count values of 19988488, the highest count value possible.

The second error also involved the implementation of missing data flags and impacted P8 and P9 omni-directional detector data throughout an entire 32-second archive record. The P8 and P9 data share the same data word in the TIROS data format and readouts alternate between the two. In the archive record the data listing for P8 alternates between valid data readouts and values set to 0 in the archive format while the P9 data alternates in the same fashion but with valid readouts when the P8 value is zero. The existing documentation explains this and a user is expected to extract only the appropriate entries when using P8 and P9 data. During instances when data were missing, the C unpacker assigned the missing data flag (-999.), in both the P8 and P9 data, to the entry appropriate to 'no data' while the entries appropriate to valid data were given count values of 19988488. This count value is unphysical for P8 and P9 data.

Both these errors would have impact upon any analysis that had not recognized these unphysical sensor count.

The FORTRAN version of the archive record unpacker did not have either of these problems.

David S Evans <David.S.Evans@noaa.gov>

Corrected sofware (unpackSem2_v2.c) is now available for distribution.

• The Space Weather Prediction Center has a variety of displays available of these data:
  • Recent auroral activity.
  • Recent energetic particle maps.
  • University of Bergen also has plots of recent, and historic data

• Static displays of NOAA data created for various projects:
  • NOAA-11 anomalies plotted on a background of NOAA-10 electron fluxes. (GIF)
  • Stack plots showing the NOAA-12 > .3 MeV electrons at L4.5 - L4.8 and GOES-8 > 2 MeV electrons at L6.6. These plots show the affect of smoothing on the NOAA-12 data, an algorithm for detecting NOAA-12 event start and peak times, and an exponential decay model for those events. (PDF, 12/23/98)
    • Jan 1997
    • Jan - Mar 1997
    • Jan - Jun 1997
    • Jul - Dec 1997