GOES data in SolarSoft Database

GOES/XRS data in SolarSoft

11-Jan-2011, Aki Takeda.
7-Feb-2011, revised.

about GOES satellite

mainly from NGDC website ( http://ngdc.noaa.gov/stp/satellite/goes/index.html)

GOES : Geostationary Operational Environmental Satellites (No.1 -- 15)
SMS : Synchronous Meteorological Satellites (preceding mission of GOES)
SEM : Space Environment Monitor (instrument subsystem on board all GOES and SMS).

Magnetometer : magnetic field measurements (HP, HE and HN).
Energetic Particle Sensor(EPS) : energetic particle.
X-Ray Sensor(XRS) : soft X-ray flux (0.5-3A, 1-8A).
Soft X-ray Imager : (GOES12)

*** GOES coverage ***
    * SMS-1: 1974-07 to 1974-10
    * SMS-2:: 1975-02 to 1976-04
    * GOES-1 1976-01 to 1978-05
    * GOES-2 1977-08 to 1983-05
    * GOES-3 1978-07 to 1980-08
    * GOES-4 no data
    * GOES-5 1983-01 to 1987-02
    * GOES-6 1983-05 to 1994-11  ### XRS: ?-may-1983 to 30-may-1994
    * GOES-7 1987-03 to 1996-08  ### XRS: 6-mar-1987 to 13-aug-1996
    * GOES-8 1995-03 to 2003-06  ### XRS: 1-mar-1995 to 10-apr-2003  
    * GOES-9 1996-04 to 1998-08  ### XRS: 1-apr-1996 to 27-jul-1998
    * GOES-10 1998-07 to 2009-12 ### XRS: 1-jul-1998 to 30-nov-2009
    * GOES-11 2000-07 to present ### XRS: 1-jun-2006 to 9-feb-2008
    * GOES-12 2003-01 to 2010-09 ### XRS: 10-jan-2003 to 12-apr-2007 
    * GOES-13 2010-04 to present; EUV, XRS, SXI not operational. 
                                 ### launched in apr-2006.
    * GOES-14 2009-12 to present, XRS only, other systems in storage mode.
                                 ### XRS: 26-nov-2009 to 26-oct-2010 
    * GOES-15 2010-09 to present, XRS only, other systems in test mode.
                                 ### XRS: 27-oct-2010 to present 

### : added by AkT

GOES data available in the SolarSoft

Two original data source at NOAA

(1) Recent 90 days : http://www.swpc.noaa.gov/ftpmenu/lists/xray.html
daily text files for 1m and 5m average.
(2) NGDC archive :
http://goes.ngdc.noaa.gov/data
monthly text files, 1m- 5m- average (to present) and 3-sec full (-1996, FITS).

### problem ###
Both (1) and (2) sometimes have missing records, which often compensate with each other.
Recent files not available in (2). i.e., GOES15 data N/A in (2).

Two archives under $SSWDB

$SSWDB/ydb/g** series
- week files since 1991_w01.
- maintained by YLA.
  - 1991-2001 regenerated based on the source (2) and replaced in 2008.
  - 2002-2008 regenerated based on the source (2) in 2009, replaced in 2011.
  - 2009-2010 regenerated based on the source (1) and (2) and replaced in 2011.
- coverage after 2009.
- read with RD_GXD.
$SSWDB/goes/xray/yyyymmdd_G*xr_?m.txt series
- daily files since 19-sep-2002, same files as in the source (1).
- 1 minute or 5 minute avarage text files for GOES 8-15.
- coverage since 2002.
- read with RD_GOESX_ASCII

Coverage of the GOES week files under $SSWDB/ydb (official) and $SSWDB/ydb_beta (YLA contribution) as of 11-Jan-2011.

1991 ydb	1992 ydb	1993 ydb	1994 ydb	1995 ydb

1996 ydb	1997 ydb	1998 ydb	1999 ydb	2000 ydb	2001 ydb

2002 ydb	2003 ydb	2004 ydb	2005 ydb

2002 ydb_beta	2003 ydb_beta	2004 ydb_beta	2005 ydb_beta

2006 ydb	2007 ydb	2008 ydb	2009 ydb	2010 ydb

2006 ydb_beta	2007 ydb_beta	2008 ydb_beta	2009 ydb_beta	2010 ydb_beta

### Movie of GOES week data from 1991 - 2010.

### PLOT_GOES workout ###

IDL> plot_goes,'7-feb-2010','8-feb-2010'     ;  same as /one
IDL> plot_goes,'7-feb-2010','8-feb-2010',/one
IDL> plot_goes,'7-feb-2010','8-feb-2010',/five
IDL> plot_goes,'7-feb-2010','8-feb-2010',/ascii,/goes14    ; ascii defaults to GOES 10.
IDL> plot_goes,'10-nov-2009','10-dec-2009'     ; data chosen from GOES 14
IDL> rd_gxd,'1-feb-2004','28-feb-2004',gxd,/goes12,/one  ; read from $SSWDB/ydb/g21
IDL> rd_gxd,'1-feb-2004','28-feb-2004',gxd2,/goes12,/one,indir='$SSWDB/ydb_beta/g21'

Selection of the default GOES satellite is made by GET_GOES_DEFSAT.PRO

;***** setting in the get_goes_defsat (YLA version) *****
; before def8t                   ; GOES 7
def8t= '1-aug-1996'              ; GOES 8 start
def10t='20-oct-1998'             ; GOES 8  --> GEOS 10
def12t='1-jun-2006'              ; switch to GOES 12
def10t2='1-apr-2007'             ; GOES12 --> GOES 10
def14t='1-dec-2009'              ; switch to GOES 14
def15t='1-jan-2011'              ; switch to GOES 15

### consideration ###
Remake weekly files for 2009 and onward, or switch to use ascii files (by default).
Week files remade unitl the end of 2010. Asking Sam Freeland his view on switching PLOT_GOES default to ascii (waiting for response).