Hello,
I can’t download any products at all.
Log’s errors:
“Jan 16 13:57:18 localhost sen2agri-orchestrator[13675]: Executing S4C_L4B scheduled job. No S1 products were found 15 days before scheduled time for site ID 17 within interval [ Thu Jan 17 00:00:00 2019 and Fri Feb 1 00:00:00 2019]! The schedule for this date will wait …
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: Scheduled job execution: ERROR Agric Practices: No LPIS product found for site firooz.
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: Executing S4C_L4B scheduled job. No NDVI products were found 60 days before scheduled time for site ID 16 within interval [ Tue Mar 3 00:00:00 2020 and Sat May 2 00:00:00 2020]! The schedule for this date will wait …
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: Executing S4C_L4B scheduled job. No S1 products were found 15 days before scheduled time for site ID 16 within interval [ Fri Apr 17 00:00:00 2020 and Sat May 2 00:00:00 2020]! The schedule for this date will wait …
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: Scheduled job execution: ERROR Agric Practices: No LPIS product found for site ned_2019.
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: Executing S4C_L4B scheduled job. No S1 products were found 15 days before scheduled time for site ID 17 within interval [ Thu Jan 17 00:00:00 2019 and Fri Feb 1 00:00:00 2019]! The schedule for this date will wait …
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: IsInSeason: Date not in season (start = Tue Jan 1 2019, end = Tue Dec 31 2019, current=Sat Feb 29 2020)
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: IsInSeason: Date not in season (start = Tue Jan 1 2019, end = Tue Dec 31 2019, current=Sat Feb 29 2020)
Jan 16 13:58:18 localhost sen2agri-orchestrator[13675]: Scheduler CropType: Error getting season start dates for site 17 for scheduled date Sat Feb 29 00:00:00 2020!”
These messages are on a higher level of processing.
Do you have any products in the “products” tab from the web interface?
There might be several reasons you obtain these messages:
the products are not downloaded. To investigate this, please check the messages in the sen4cap services using the following command (you can tune the “5 days ago” according to your situation):
sudo journalctl -fu sen2agri-services --since “5 days ago”
Please also check the downloader_history table to see if the products were actually downloaded or not:
psql -U admin sen4cap -c “select * from downloader_history”
If you find nothing in downloader_history, you should check if the datasources are correctly configured.
The products might not have been pre-processed due to something wrong in the MAJA or S1 pre-processing. You can check this for S2 preprocessing with:
sudo journalctl -fu sen2agri-demmaccs --since “5 days ago”
and for S1 pre-processing you should also check the logs from sen4cap services with the command above.
If you don’t have S2 pre-processed into L2A, you should check if the correct version of MAJA is installed, if the gipp_maja and srtm and swbd are correctly copied in the /mnt/archive
I checked the log and every time it shows the same error!
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: ARCHIVES DIRECTORY = /mnt/archive/demmaccs_tmp/archives/tmpXQ91L_
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: is_tarfile: The object (directory or file) /mnt/archive/dwn_def/s2/default/mygeodata/S2A_MSIL1C_20200603T070631_N0209_R106_T39SXV_20200603T105159.SAFE is not an archive: [Errno 2] No such file or directory: ‘/mnt/archive/dwn_def/s2/default/mygeodata/S2A_MSIL1C_20200603T070631_N0209_R106_T39SXV_20200603T105159.SAFE’ !
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: This wasn’t an archive, so continue as is. Deleting /mnt/archive/demmaccs_tmp/archives/tmpXQ91L_
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: 2021-01-24 08:42:07.429752:[12479]:dmworker_0: Ended extract_from_archive_if_needed for tile 39SXV
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: dmworker_0: site_id = 14
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: dmworker_0: satellite_id = 1
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: dmworker_0: orbit_id = 106
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: dmworker_0: tile_id = 39SXV
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: dmworker_0: dh_id = 1898
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: dmworker_0: path = /mnt/archive/dwn_def/s2/default/mygeodata/S2A_MSIL1C_20200603T070631_N0209_R106_T39SXV_20200603T105159.SAFE
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: dmworker_0: prev_path = None
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: Found key s2.enabled for all sites with value true
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: ###################################
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: Cannot check if product root dir path /mnt/archive/dwn_def/s2/default/mygeodata/S2A_MSIL1C_20200603T070631_N0209_R106_T39SXV_20200603T105159.SAFE exists or it is a valid symlink. Error was: 2
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: ###################################
Jan 24 08:42:07 localhost demmaccs_launcher.py[12479]: 2021-01-24 08:42:07.468666:[12479]:dmworker_0: The product /mnt/archive/dwn_def/s2/default/mygeodata/S2A_MSIL1C_20200603T070631_N0209_R106_T39SXV_20200603T105159.SAFE is not valid or temporary unavailable…
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: Waiting for queue to join…
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: dmworker_1 will consume: None | l2a | /mnt/archive/maccs_def/{site}/l2a/
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: 2021-01-24 08:42:08.457319:[12479]:dmworker_1: No tile to process. Gracefully closing…
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: dmworker_0 will consume: None | l2a | /mnt/archive/maccs_def/{site}/l2a/
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: 2021-01-24 08:42:08.457646:[12479]:dmworker_0: No tile to process. Gracefully closing…
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: 2021-01-24 08:42:08.458301:[12479]:dmworker_0: Exit thread
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: All the workers finished their job. Exiting…
Jan 24 08:42:08 localhost demmaccs_launcher.py[12479]: 2021-01-24 08:42:08.458936:[12479]:dmworker_1: Exit thread
From what I see in these messages, the input L1C products are no longer available on disk.
For example, the product /mnt/archive/dwn_def/s2/default/mygeodata/S2A_MSIL1C_20200603T070631_N0209_R106_T39SXV_20200603T105159.SAFE does not exists anymore.
Did you deleted the L1C products (the directory /mnt/archive/dwn_def/s2/default/mygeodata)?
Or maybe you used for downloading the products a mounted external drive that is no longer available?