Download and reformat magnetic carrington maps from fetch type NSOZ_DATE. More...

Detailed Description

Download and reformat magnetic carrington maps from fetch type NSOZ_DATE.

Only files newer than a minimum date (default today - 15 days) AND file corresponding to 12 AM/PM or 1 AM/PM are downloaded.
Download remote files if not already present locally.
From the downloaded file (Fetch level 0), gunzip the file (Fetch level 1 with data format FITS_NSO_V0) and create a user-friendly symbolic link (Fetch level 2 with the same data format).
Do it if not already present locally or if not the most recent.
Add in SW Database the new downloaded or formatted files.
Important: After running this script, one must call update_database routine. Indeed, if this program fails before updating the database then the folder will have files not followed by the database.

Author: M. Indurain

Date: 01 Jan 2019

2. Filter files

Only 0h,6h,12h,18h and > date_begin are looked (remote_files_fm1 list).

3. Fetch level 0: Download files

interface_fetch_map2D.vn2vnp1 return remote files that need to be downloaded (to_be_downloaded list).
module_toolbox_file.download_files downloads this list and return what it has downloaded (downloaded_files list).

4. Fetch level 1: format in V0

Gunzip .fts.gz into .fts (FITS_NSO_V0).

interface_fetch_map2D.vn2vnp1 return local 0th fetch level files that need to create their equivalent in the 1st fetch level (to_be_f1_fetched list).
module_toolbox_file.gunzip_files gunzip this list and return what it has formatted (f1_fetched_files list).

5. Fetch level 2: Rename through a symbolic link

Convert original_name.fts (Data format FITS_NSO_V0) into friendly_name.fts (same data format) with a symbolic link.

interface_fetch_map2D.vn2vnp1 return local 1th fetch level files that need to create their equivalent in the 2st fetch level (to_be_f2_fetched list).
build the symbolic link and return what it has created (f2_fetched_files list).

6. Update database

Add or update the map2D database with recently created files (files from downloaded_files, f1_fetched_files, f2_fetched_files).