Download and reformat euv171 maps from fetch type SDO_AIA_171_CR. More...

Detailed Description

Download and reformat euv171 maps from fetch type SDO_AIA_171_CR.

Only files newer than a minimum date (default -Infinity) are downloaded.
Download remote files if not already present locally.
From the downloaded file (Fetch level 0 with data format FITS_SDOAIA_V0) and create a user-friendly symbolic link (Fetch level 1 with the same data format).
Do it if not already present locally or if not the most recent.
Add in SW Database the new downloaded or formatted files.
Important: After running this script, one must call update_database routine. Indeed, if this program fails before updating the database then the folder will have files not followed by the database.

Author: M. Indurain

Date: 01 Jan 2019

1. Server connection

Connect to the server and list all available files on the server (all_remote_files list) without taking into account date_begin and date_end.

2. Filter files

Only > date_begin and < date_end are looked (remote_files_fm1 list).

3. Fetch level 0: Download files

interface_fetch_map2D.vn2vnp1 return remote files that need to be downloaded (to_be_downloaded list).
module_toolbox_file.download_files downloads this list and return what it has downloaded (downloaded_files list).

4. Fetch level 1: Rename through a symbolic link

Convert original_name.fts (Data format FITS_SDOAIA_V0) into friendly_name.fts (same data format) with a symbolic link.

interface_fetch_map2D.vn2vnp1 return local 0th fetch level files that need to create their equivalent in the 1st fetch level (to_be_f1_fetched list).
build the symbolic link and return what it has created (f1_fetched_files list).

5. Update database

Add or update the map2D database with recently created files (files from downloaded_files, f1_fetched_files).