Download and reformat magnetic carrington maps from fetch type WSO_FILLED_CR. More...

Detailed Description

Download and reformat magnetic carrington maps from fetch type WSO_FILLED_CR.

Only files newer than a minimum date (default -Infinity) are downloaded.
From the downloaded file (Fetch level 0 with data format ASCII_WSO_V0), reformat it as V1 format (Fetch level 1 with data format ASCII_WSO_V1) and create a user-friendly symbolic link (Fetch level 2 with the same data format).
Do it if not already present locally or if not the most recent.
Add in SW Database the new downloaded or formatted files.
Important: After running this script, one must call update_database routine. Indeed, if this program fails before updating the database then the folder will have files not followed by the database.

Author: M. Indurain

Date: 01 Jan 2019

1. Server connection

Connect to the server and list all available files on the server (all_remote_files list) without taking into account date_begin and date_end.

2. Filter files

Only > date_begin and < date_end are looked (remote_files_fm1 list).

3. Fetch level 0: Download files

interface_fetch_map2D.vn2vnp1 return remote files that need to be downloaded (to_be_downloaded list).
module_toolbox_file.download_files downloads this list and return what it has downloaded (downloaded_files list).

4. Fetch level 1: Format in V1

Reformat file with data format ASCII_WSO_V0 into data format ASCII_WSO_V1.

interface_fetch_map2D.vn2vnp1 return local 0th fetch level files that need to create their equivalent in the 1st fetch level (to_be_f1_fetched list).
module_wso_wso_map2D.read_v0/module_wso_wso_map2D.write_ascii_v1 reformat this list and return what it has formatted (f1_fetched_files list).

5. Fetch level 2: rename through a symbolic link

Convert original_name.txt (Data format ASCII_WSO_V1) into friendly_name.txt (same data format) with a symbolic link.

interface_fetch_map2D.vn2vnp1 return local 1th fetch level files that need to create their equivalent in the 2st fetch level (to_be_f2_fetched list).
build the symbolic link and return what it has created (f2_fetched_files list).

6. Update database

Add or update the map2D database with recently created files (files from downloaded_files, f1_fetched_files, f2_fetched_files).