Error in preprocessing S2 product on CREODIAS

Atmospheric Corrections Processor
1

Hello Sen4CAP team,

I have an error concerning the S2 preprocessing on CREODIAS. It does not start after all the products were found in the EO archive of CREODIAS (all in status_id=2 in the DB).

The error in the journaclt is the following :

Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: Demmaccs main thread: feeding the queue for workers with: [[(1, 1, 8, '31UFR', 1424, '/eodata/Sentinel-2/MSI/L1C/2019/11/09/S2A_MSIL1C_20191109T104251_N0208_R008_T31UFR_20191109T111651.SAFE', None)]]
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: dmworker_1 will consume: [[(1, 1, 8, '31UFR', 1424, '/eodata/Sentinel-2/MSI/L1C/2019/11/09/S2A_MSIL1C_20191109T104251_N0208_R008_T31UFR_20191109T111651.SAFE', None)]] | l2a | /mnt/archive/maccs_def/{site}/l2a/
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: 2020-10-30 14:54:46.908221:[18085]:dmworker_1: Starting extract_from_archive_if_needed for tile 31UFR
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: Exception in thread dmworker_1:
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: Traceback (most recent call last):
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: self.run()
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: File "/usr/lib64/python2.7/threading.py", line 765, in run
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: self.__target(*self.__args, **self.__kwargs)
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: File "/usr/share/sen2agri/sen2agri-demmaccs/demmaccs_launcher.py", line 585, in new_launch_demmaccs
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: l1c_was_archived, full_path = extract_from_archive_if_needed(l1c[0][5])
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: File "/usr/share/sen2agri/sen2agri-demmaccs/demmaccs_launcher.py", line 422, in extract_from_archive_if_needed
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: extracted_archive_dir = tempfile.mkdtemp(dir = os.path.join(demmaccs_config.working_dir, ARCHIVES))
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: File "/usr/lib64/python2.7/tempfile.py", line 329, in mkdtemp
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: _os.mkdir(file, 0700)
Oct 30 14:54:46 leo4cap.novalocal demmaccs_launcher.py[18085]: OSError: [Errno 2] No such file or directory: '/mnt/archive/demmaccs_tmp/archives/tmpMTEEBc'

Thanks for your help !

Diane H.

2

Dear Diane,

Seems that the user sen2agri-service does not have the rights to write into the directory /mnt/archive/demmaccs_tmp, being created with another user (and not having write permissions for user sen2agri-service).
The solution would be to set the write rights for other users on folder /mnt/archive/demmaccs_tmp :

sudo chmod -R 777 /mnt/archive/demmaccs_tmp

Or, you can simply remove the directory /mnt/archive/demmaccs_tmp and then restart sen2agri-demmaccs service:

sudo systemctl restart sen2agri-demmaccs

Best regards,
Cosmin

1 Like
3

Thank you for this quick answer !
It is working now