L3B Error

engineer_farmer · July 6, 2021, 11:41am

I read the technical documentation of Sen4Cap and watched the videos on the youtube channel. Then, about 10 days ago, I created 3 sites. Although it downloaded some Sentinel-2 data, I could not extract any product. One of them site I created is “Lutfen” and I am sending you screenshots about this site to show the situation. Why am I not getting any product and there are many errors? I would be grateful if you help, thanks.

cudroiu · July 6, 2021, 11:59am

Hello,

From what I see, there are several issues:

Your site is defined from April to June. Unfortunately, ESA limited recently access to the online repository to only the last month (see this post Images appear as retriable but nothing happens - #2 by cudroiu)
Some L1C products were downloaded, probably from end of may and june. Nevertheless, the L3B processor needs some L2A products as input. You could check if there are any issues with the L2A pre-processing by investigating:

the messages in the demmaccs (sudo journalctl -fu sen2agri-demmaccs --since “10 days ago”)
in the database, tables downloader_history and l1_tile_history

psql -U admin sen4cap -c "select * from downloader_history "
psql -U admin sen4cap -c "select * from l1_tile_history "

Once you have the L2A products, you can try relaunching the L3B processor by adding a scheduled job in the “dashboard” tab → L3B Vegetation status, similar or identical with the existing one. The existing one was already executed as it was a season in the past but it gave errors (as you mentioned) as there were no L2A products available when it executed.

Hope this helps.

Best regards,
Cosmin

engineer_farmer · July 7, 2021, 7:45am

Sir @cudroiu thanks for your reply.

There seems to be a problem with the sen2agri-demmaccs service and I don’t know how to solve it. I am sharing the log file.

[root@localhost ~]# sudo journalctl -fu sen2agri-demmaccs --since 2021-06-27
-- Logs begin at Wed 2021-07-07 10:02:45 +03. --
Jul 07 10:03:34 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:03:42 localhost.localdomain python2[2515]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:03:42 localhost.localdomain l2a_launcher.py[2515]: Traceback (most recent call last):
Jul 07 10:03:42 localhost.localdomain l2a_launcher.py[2515]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:03:42 localhost.localdomain l2a_launcher.py[2515]: with open(majalog_path, "w") as log_file:
Jul 07 10:03:42 localhost.localdomain l2a_launcher.py[2515]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:03:42 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:03:42 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:03:42 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:04:00 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:04:00 localhost.localdomain python2[2800]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:04:00 localhost.localdomain l2a_launcher.py[2800]: Traceback (most recent call last):
Jul 07 10:04:00 localhost.localdomain l2a_launcher.py[2800]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:04:00 localhost.localdomain l2a_launcher.py[2800]: with open(majalog_path, "w") as log_file:
Jul 07 10:04:00 localhost.localdomain l2a_launcher.py[2800]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:04:00 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:04:00 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:04:00 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:05:03 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:05:03 localhost.localdomain python2[3917]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:05:04 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:05:04 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:05:04 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:06:03 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:06:03 localhost.localdomain python2[4018]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:06:03 localhost.localdomain l2a_launcher.py[4018]: Traceback (most recent call last):
Jul 07 10:06:03 localhost.localdomain l2a_launcher.py[4018]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:06:03 localhost.localdomain l2a_launcher.py[4018]: with open(majalog_path, "w") as log_file:
Jul 07 10:06:03 localhost.localdomain l2a_launcher.py[4018]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:06:03 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:06:03 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:06:03 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:07:02 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:07:03 localhost.localdomain python2[4148]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:07:03 localhost.localdomain l2a_launcher.py[4148]: Traceback (most recent call last):
Jul 07 10:07:03 localhost.localdomain l2a_launcher.py[4148]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:07:03 localhost.localdomain l2a_launcher.py[4148]: with open(majalog_path, "w") as log_file:
Jul 07 10:07:03 localhost.localdomain l2a_launcher.py[4148]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:07:03 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:07:03 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:07:03 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:08:04 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:08:04 localhost.localdomain python2[4195]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:08:04 localhost.localdomain l2a_launcher.py[4195]: Traceback (most recent call last):
Jul 07 10:08:04 localhost.localdomain l2a_launcher.py[4195]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:08:04 localhost.localdomain l2a_launcher.py[4195]: with open(majalog_path, "w") as log_file:
Jul 07 10:08:04 localhost.localdomain l2a_launcher.py[4195]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:08:04 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:08:04 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:08:04 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:09:04 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:09:04 localhost.localdomain python2[4231]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:09:04 localhost.localdomain l2a_launcher.py[4231]: Traceback (most recent call last):
Jul 07 10:09:04 localhost.localdomain l2a_launcher.py[4231]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:09:04 localhost.localdomain l2a_launcher.py[4231]: with open(majalog_path, "w") as log_file:
Jul 07 10:09:04 localhost.localdomain l2a_launcher.py[4231]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:09:04 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:09:04 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:09:04 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:10:01 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:10:01 localhost.localdomain python2[4281]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:10:01 localhost.localdomain l2a_launcher.py[4281]: Traceback (most recent call last):
Jul 07 10:10:01 localhost.localdomain l2a_launcher.py[4281]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:10:01 localhost.localdomain l2a_launcher.py[4281]: with open(majalog_path, "w") as log_file:
Jul 07 10:10:01 localhost.localdomain l2a_launcher.py[4281]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:10:01 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:10:02 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:10:02 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 07 10:11:05 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 07 10:11:05 localhost.localdomain python2[4415]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 07 10:11:05 localhost.localdomain l2a_launcher.py[4415]: Traceback (most recent call last):
Jul 07 10:11:05 localhost.localdomain l2a_launcher.py[4415]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 07 10:11:05 localhost.localdomain l2a_launcher.py[4415]: with open(majalog_path, "w") as log_file:
Jul 07 10:11:05 localhost.localdomain l2a_launcher.py[4415]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 07 10:11:05 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 07 10:11:05 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 07 10:11:05 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.

The other two commands you wrote for database do not work either.

Screenshot_10

cudroiu · July 7, 2021, 8:31am

Hello,
Please try to :

remove /tmp/maja.log:

sudo rm -fR /tmp/maja.log

Check again the demmaccs logs and see if is OK now.
I assume that you copied and pasted the commands from the post above but seems that the " were replaced with some other quotes format. Please run again the commands but edit the quotes by typing them.

Cosmin

engineer_farmer · July 8, 2021, 3:54pm

@cudroiu
I copied it directly as you said, sorry.
And as you said there is only L1C data, I can’t get L2A data with MAJA.
I rewrote the commands you said and I’m sending the results.

sudo journalctl -fu sen2agri-demmaccs --since …

[root@localhost ~]# sudo rm -fR /tmp/maja.log
[root@localhost ~]# 
[root@localhost ~]# sudo journalctl -fu sen2agri-demmaccs --since 2021-06-27
-- Logs begin at Thu 2021-07-08 18:10:36 +03. --
Jul 08 18:11:17 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 08 18:11:25 localhost.localdomain python2[2541]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2541]: Traceback (most recent call last):
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2541]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2541]: with open(majalog_path, "w") as log_file:
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2541]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 08 18:11:26 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 08 18:11:26 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 08 18:11:26 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 08 18:11:26 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 08 18:11:26 localhost.localdomain python2[2625]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2625]: Traceback (most recent call last):
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2625]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2625]: with open(majalog_path, "w") as log_file:
Jul 08 18:11:26 localhost.localdomain l2a_launcher.py[2625]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 08 18:11:26 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 08 18:11:26 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 08 18:11:26 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 08 18:12:00 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 08 18:12:01 localhost.localdomain python2[3146]: detected unhandled Python exception in '/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py'
Jul 08 18:12:01 localhost.localdomain l2a_launcher.py[3146]: Traceback (most recent call last):
Jul 08 18:12:01 localhost.localdomain l2a_launcher.py[3146]: File "/usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher.py", line 2572, in <module>
Jul 08 18:12:01 localhost.localdomain l2a_launcher.py[3146]: with open(majalog_path, "w") as log_file:
Jul 08 18:12:01 localhost.localdomain l2a_launcher.py[3146]: IOError: [Errno 21] Is a directory: '/tmp/maja.log'
Jul 08 18:12:01 localhost.localdomain systemd[1]: sen2agri-demmaccs.service: main process exited, code=exited, status=1/FAILURE
Jul 08 18:12:01 localhost.localdomain systemd[1]: Unit sen2agri-demmaccs.service entered failed state.
Jul 08 18:12:01 localhost.localdomain systemd[1]: sen2agri-demmaccs.service failed.
Jul 08 18:13:07 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.071979:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.138669:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.424795:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.443587:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.453602:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <master>: product 335 assigned to <worker 0>
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: #################### Tile & Site Info ####################
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: site_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: satellite_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: orbit_id = 35
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: tile_id = 37SEA
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: downloader_history_id = 335
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: path = /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: previous_l2a_path = None
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: site_short_name = lutfen
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: site_output_path = /mnt/archive/maccs_def/lutfen/l2a/
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.455363:[4442]:<worker 0>: 0: Starting extract_from_archive_if_needed for tile 37SEA
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.508089:[4442]:<worker 0>: This wasn't an archive, so continue as is.
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.508392:[4442]:<worker 0>: 0: Ended extract_from_archive_if_needed for tile 37SEA
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.536102:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.544568:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.549579:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <master>: product 334 assigned to <worker 1>
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: #################### Tile & Site Info ####################
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: site_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: satellite_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: orbit_id = 35
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: tile_id = 37SFA
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: downloader_history_id = 334
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: path = /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: previous_l2a_path = None
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: site_short_name = lutfen
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: site_output_path = /mnt/archive/maccs_def/lutfen/l2a/
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.550028:[4442]:<worker 1>: 1: Starting extract_from_archive_if_needed for tile 37SFA
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.572483:[4442]:<worker 1>: This wasn't an archive, so continue as is.
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.572904:[4442]:<worker 1>: 1: Ended extract_from_archive_if_needed for tile 37SFA
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.599047:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.607268:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.611969:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <master>: product 337 assigned to <worker 2>
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: #################### Tile & Site Info ####################
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: site_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: satellite_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: orbit_id = 35
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: tile_id = 37SEB
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: downloader_history_id = 337
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: path = /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: previous_l2a_path = None
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: site_short_name = lutfen
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: site_output_path = /mnt/archive/maccs_def/lutfen/l2a/
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.612969:[4442]:<worker 2>: 2: Starting extract_from_archive_if_needed for tile 37SEB
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.613174:[4442]:<worker 2>: This wasn't an archive, so continue as is.
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.613248:[4442]:<worker 2>: 2: Ended extract_from_archive_if_needed for tile 37SEB
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 0>: Successful pre-processing = True
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.629784:[4442]:<worker 0>: Successful pre-processing = True
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 1>: Successful pre-processing = True
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.663744:[4442]:<worker 1>: Successful pre-processing = True
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.681199:[4442]:<worker 0>: Running command:  docker run -v /var/run/docker.sock:/var/run/docker.sock --rm -u 1001:1001 --group-add 980 -v /tmp/maja.log:/tmp/maja.log -v /mnt/archive/srtm:/mnt/archive/srtm -v /mnt/archive/swbd:/mnt/archive/swbd -v /mnt/archive/gipp/maja/UserConfiguration:/mnt/archive/gipp/maja/UserConfiguration -v /mnt/archive/gipp/maja:/mnt/archive/gipp/maja -v /mnt/archive/demmaccs_tmp/:/mnt/archive/demmaccs_tmp/ -v /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE:/mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE -v /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE:/mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE --name l2a_processors_335 lnicola/sen2agri-l2a-processors /usr/share/l2a_processors/maja.py --dem /mnt/archive/srtm --swbd /mnt/archive/swbd --conf /mnt/archive/gipp/maja/UserConfiguration --processes-number-dem 1 --processes-number-maccs 1 --gipp-dir /mnt/archive/gipp/maja --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maja/3.2.2/bin/maja --delete-temp --product-id 335 /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE --tiles-to-process 37SEA --removeSreFiles --docker-image-l8align lnicola/sen2agri-l8-alignment --docker-image-dem lnicola/sen2agri-dem --docker-image-maja3 lnicola/maja:3.2.2-centos-7 --docker-image-maja4 lnicola/maja:4.2.1-centos-7 --docker-image-gdal osgeo/gdal:ubuntu-full-3.2.0
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.681619:[4442]:<worker 1>: Running command:  docker run -v /var/run/docker.sock:/var/run/docker.sock --rm -u 1001:1001 --group-add 980 -v /tmp/maja.log:/tmp/maja.log -v /mnt/archive/srtm:/mnt/archive/srtm -v /mnt/archive/swbd:/mnt/archive/swbd -v /mnt/archive/gipp/maja/UserConfiguration:/mnt/archive/gipp/maja/UserConfiguration -v /mnt/archive/gipp/maja:/mnt/archive/gipp/maja -v /mnt/archive/demmaccs_tmp/:/mnt/archive/demmaccs_tmp/ -v /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE:/mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE -v /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE:/mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE --name l2a_processors_334 lnicola/sen2agri-l2a-processors /usr/share/l2a_processors/maja.py --dem /mnt/archive/srtm --swbd /mnt/archive/swbd --conf /mnt/archive/gipp/maja/UserConfiguration --processes-number-dem 1 --processes-number-maccs 1 --gipp-dir /mnt/archive/gipp/maja --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maja/3.2.2/bin/maja --delete-temp --product-id 334 /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE --tiles-to-process 37SFA --removeSreFiles --docker-image-l8align lnicola/sen2agri-l8-alignment --docker-image-dem lnicola/sen2agri-dem --docker-image-maja3 lnicola/maja:3.2.2-centos-7 --docker-image-maja4 lnicola/maja:4.2.1-centos-7 --docker-image-gdal osgeo/gdal:ubuntu-full-3.2.0
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: Running Maja, console output can be found at /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEA_20210524T091706.SAFE/maja.log
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: Running Maja, console output can be found at /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SFA_20210524T091706.SAFE/maja.log
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.841521:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 2>: Successful pre-processing = True
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.843307:[4442]:<worker 2>: Successful pre-processing = True
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.854149:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.860463:[4442]:MainThread: Successful db fetch
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <master>: product 339 assigned to <worker 3>
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: #################### Tile & Site Info ####################
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: site_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: satellite_id = 1
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: orbit_id = 35
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: tile_id = 37SEV
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: downloader_history_id = 339
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: path = /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: previous_l2a_path = None
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: site_short_name = lutfen
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: site_output_path = /mnt/archive/maccs_def/lutfen/l2a/
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.861375:[4442]:<worker 3>: 3: Starting extract_from_archive_if_needed for tile 37SEV
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.861641:[4442]:<worker 3>: This wasn't an archive, so continue as is.
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.861769:[4442]:<worker 3>: 3: Ended extract_from_archive_if_needed for tile 37SEV
Jul 08 18:13:08 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:08.885408:[4442]:<worker 2>: Running command:  docker run -v /var/run/docker.sock:/var/run/docker.sock --rm -u 1001:1001 --group-add 980 -v /tmp/maja.log:/tmp/maja.log -v /mnt/archive/srtm:/mnt/archive/srtm -v /mnt/archive/swbd:/mnt/archive/swbd -v /mnt/archive/gipp/maja/UserConfiguration:/mnt/archive/gipp/maja/UserConfiguration -v /mnt/archive/gipp/maja:/mnt/archive/gipp/maja -v /mnt/archive/demmaccs_tmp/:/mnt/archive/demmaccs_tmp/ -v /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE:/mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE -v /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE:/mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE --name l2a_processors_337 lnicola/sen2agri-l2a-processors /usr/share/l2a_processors/maja.py --dem /mnt/archive/srtm --swbd /mnt/archive/swbd --conf /mnt/archive/gipp/maja/UserConfiguration --processes-number-dem 1 --processes-number-maccs 1 --gipp-dir /mnt/archive/gipp/maja --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maja/3.2.2/bin/maja --delete-temp --product-id 337 /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE --tiles-to-process 37SEB --removeSreFiles --docker-image-l8align lnicola/sen2agri-l8-alignment --docker-image-dem lnicola/sen2agri-dem --docker-image-maja3 lnicola/maja:3.2.2-centos-7 --docker-image-maja4 lnicola/maja:4.2.1-centos-7 --docker-image-gdal osgeo/gdal:ubuntu-full-3.2.0
Jul 08 18:13:09 localhost.localdomain l2a_launcher.py[4442]: Running Maja, console output can be found at /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE/maja.log
Jul 08 18:13:09 localhost.localdomain l2a_launcher.py[4442]: (launcher info) <worker 3>: Successful pre-processing = True
Jul 08 18:13:09 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:09.088812:[4442]:<worker 3>: Successful pre-processing = True
Jul 08 18:13:09 localhost.localdomain l2a_launcher.py[4442]: 2021-07-08 18:13:09.108820:[4442]:<worker 3>: Running command:  docker run -v /var/run/docker.sock:/var/run/docker.sock --rm -u 1001:1001 --group-add 980 -v /tmp/maja.log:/tmp/maja.log -v /mnt/archive/srtm:/mnt/archive/srtm -v /mnt/archive/swbd:/mnt/archive/swbd -v /mnt/archive/gipp/maja/UserConfiguration:/mnt/archive/gipp/maja/UserConfiguration -v /mnt/archive/gipp/maja:/mnt/archive/gipp/maja -v /mnt/archive/demmaccs_tmp/:/mnt/archive/demmaccs_tmp/ -v /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE:/mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE -v /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE:/mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE --name l2a_processors_339 lnicola/sen2agri-l2a-processors /usr/share/l2a_processors/maja.py --dem /mnt/archive/srtm --swbd /mnt/archive/swbd --conf /mnt/archive/gipp/maja/UserConfiguration --processes-number-dem 1 --processes-number-maccs 1 --gipp-dir /mnt/archive/gipp/maja --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maja/3.2.2/bin/maja --delete-temp --product-id 339 /mnt/archive/dwn_def/s2/default/lutfen/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE --tiles-to-process 37SEV --removeSreFiles --docker-image-l8align lnicola/sen2agri-l8-alignment --docker-image-dem lnicola/sen2agri-dem --docker-image-maja3 lnicola/maja:3.2.2-centos-7 --docker-image-maja4 lnicola/maja:4.2.1-centos-7 --docker-image-gdal osgeo/gdal:ubuntu-full-3.2.0

psql -U admin sen4cap -c "select * from downloader_history"

psql -U admin sen4cap -c "select * from l1_tile_history "

cudroiu · July 9, 2021, 4:42am

Hello,

As I assumed, you have some products that cannot be downloaded from SciHub as they are not online.
But on the other hand you have some products from the last month that were successfully downloaded.
Also, MAJA seems be be launched OK now by the system.
Nevertheless, you should further check now the logs that MAJA generates, in order to see if there is any issue with each individual MAJA execution:

sudo cat /mnt/archive/maccs_def/lutfen/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEB_20210524T091706.SAFE/maja.log

Best regards,
Cosmin

engineer_farmer · July 9, 2021, 7:28am

Could it be a problem with CentOS?
@cudroiu

cudroiu · July 9, 2021, 8:35am

Hello,

It seems that you did not provided in the installer the MAJA gipp files and these are missing from your machine.
Could you make sure that you have the gipp files in /mnt/archive/gipp_maja (if you upgraded an older version) or in /mnt/archive/gipp/maja (and that this directory contains the UserConfiguration directory too)?

Best regards,
Cosmin

engineer_farmer · July 9, 2021, 8:53am

@cudroiu
My setup file was as in the Screenshot 1. I did it as stated in the user guide.

Screenshot 1:

Inside of “maja” file:
Screenshot_12

The file path you mentioned is exist:

lnicola · July 9, 2021, 12:27pm

Hi!

Can you please post the contents of /mnt/archive/gipp and /mnt/archive/gipp/maja (ls -lr /mnt/archive/gipp is enough) and the output of psql -U admin sen4cap -c "select * from config where value like '%gipp%'"?

Thanks!

engineer_farmer · July 9, 2021, 1:00pm

Hi! @lnicola

gipp foolder:

maja folder:
Screenshot_26

The result of command you said:

engineer_farmer · July 9, 2021, 1:10pm

@lnicola
Also, if you want to look inside of files that are in maja folder:

LANDSAT8

SENTINEL2

UserConfiguration

lnicola · July 9, 2021, 2:48pm

The permissions are all wrong. Can you try

$ sudo find /mnt/archive/gipp -type d -print0 | xargs -0 chmod 755
$ sudo find /mnt/archive/gipp -type f -print0 | xargs -0 chmod 644

engineer_farmer · July 9, 2021, 3:00pm

@lnicola
I wrote these commands now. But I don’t know if it works or not.

The current sen2agri-demmaccs status:

cudroiu · July 9, 2021, 3:19pm

Could you provide :

sudo journalctl -fu sen2agri-demmaccs

Cosmin

engineer_farmer · July 9, 2021, 3:26pm

@cudroiu

Shall I re-execute the commands you wrote in the previous days?

Edit: I re-executed the previous commands. Now, sen2agri-demmaccs is active.

[root@localhost ~]# sudo rm -fR /tmp/maja.log
[root@localhost ~]# psql -U admin sen4cap -c "delete  from l1_tile_history "
DELETE 72
[root@localhost ~]# psql -U admin sen4cap -c "update downloader_history set status_id = 2 where status_id = 6"
UPDATE 77
[root@localhost ~]# systemctl status sen2agri-demmaccs
● sen2agri-demmaccs.service - Runs MACCS on L1C products
   Loaded: loaded (/usr/lib/systemd/system/sen2agri-demmaccs.service; static; vendor preset: disabled)
   Active: active (running) since Fri 2021-07-09 19:41:02 +03; 26s ago
 Main PID: 8999 (python2)
    Tasks: 40
   Memory: 38.9M
   CGroup: /system.slice/sen2agri-demmaccs.service
           ├─8999 python2 /usr/share/sen2agri/sen2agri-demmaccs/l2a_launcher....
           ├─9011 /usr/bin/docker-current run -v /var/run/docker.sock:/var/ru...
           ├─9022 /usr/bin/docker-current run -v /var/run/docker.sock:/var/ru...
           ├─9036 /usr/bin/docker-current run -v /var/run/docker.sock:/var/ru...
           └─9044 /usr/bin/docker-current run -v /var/run/docker.sock:/var/ru...

Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: (launcher info) ...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: Running Maja, co...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: (launcher info) ...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41...
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41...
Hint: Some lines were ellipsized, use -l to show in full.

The command you want me to retype:
sudo journalctl -fu sen2agri-demmaccs

[root@localhost ~]# sudo journalctl -fu sen2agri-demmaccs
-- Logs begin at Fri 2021-07-09 17:52:59 +03. --
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41:02.752712:[8999]:<worker 3>: 3: Starting extract_from_archive_if_needed for tile 37SFA
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41:02.752800:[8999]:<worker 3>: This wasn't an archive, so continue as is.
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41:02.752847:[8999]:<worker 3>: 3: Ended extract_from_archive_if_needed for tile 37SFA
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: (launcher info) <worker 3>: Successful pre-processing = True
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41:02.809177:[8999]:<worker 3>: Successful pre-processing = True
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41:02.809470:[8999]:<worker 3>: Running command:  docker run -v /var/run/docker.sock:/var/run/docker.sock --rm -u 1001:1001 --group-add 980 -v /tmp/maja.log:/tmp/maja.log -v /mnt/archive/srtm:/mnt/archive/srtm -v /mnt/archive/swbd:/mnt/archive/swbd -v /mnt/archive/gipp/maja/UserConfiguration:/mnt/archive/gipp/maja/UserConfiguration -v /mnt/archive/gipp/maja:/mnt/archive/gipp/maja -v /mnt/archive/demmaccs_tmp/:/mnt/archive/demmaccs_tmp/ -v /mnt/archive/dwn_def/s2/default/seb37/S2A_MSIL1C_20210514T075611_N0300_R035_T37SFA_20210514T093302.SAFE:/mnt/archive/dwn_def/s2/default/seb37/S2A_MSIL1C_20210514T075611_N0300_R035_T37SFA_20210514T093302.SAFE -v /mnt/archive/maccs_def/seb37/l2a/output/S2A_MSIL2A_20210514T075611_N0300_R035_T37SFA_20210514T093302.SAFE:/mnt/archive/maccs_def/seb37/l2a/output/S2A_MSIL2A_20210514T075611_N0300_R035_T37SFA_20210514T093302.SAFE --name l2a_processors_2207 lnicola/sen2agri-l2a-processors /usr/share/l2a_processors/maja.py --dem /mnt/archive/srtm --swbd /mnt/archive/swbd --conf /mnt/archive/gipp/maja/UserConfiguration --processes-number-dem 1 --processes-number-maccs 1 --gipp-dir /mnt/archive/gipp/maja --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maja/3.2.2/bin/maja --delete-temp --product-id 2207 /mnt/archive/dwn_def/s2/default/seb37/S2A_MSIL1C_20210514T075611_N0300_R035_T37SFA_20210514T093302.SAFE /mnt/archive/maccs_def/seb37/l2a/output/S2A_MSIL2A_20210514T075611_N0300_R035_T37SFA_20210514T093302.SAFE --tiles-to-process 37SFA --removeSreFiles --docker-image-l8align lnicola/sen2agri-l8-alignment --docker-image-dem lnicola/sen2agri-dem --docker-image-maja3 lnicola/maja:3.2.2-centos-7 --docker-image-maja4 lnicola/maja:4.2.1-centos-7 --docker-image-gdal osgeo/gdal:ubuntu-full-3.2.0
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: Running Maja, console output can be found at /mnt/archive/maccs_def/seb37/l2a/output/S2A_MSIL2A_20210514T075611_N0300_R035_T37SFA_20210514T093302.SAFE/maja.log
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: (launcher info) <worker 2>: Successful pre-processing = True
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41:02.906144:[8999]:<worker 2>: Successful pre-processing = True
Jul 09 19:41:02 localhost.localdomain l2a_launcher.py[8999]: 2021-07-09 19:41:02.906436:[8999]:<worker 2>: Running command:  docker run -v /var/run/docker.sock:/var/run/docker.sock --rm -u 1001:1001 --group-add 980 -v /tmp/maja.log:/tmp/maja.log -v /mnt/archive/srtm:/mnt/archive/srtm -v /mnt/archive/swbd:/mnt/archive/swbd -v /mnt/archive/gipp/maja/UserConfiguration:/mnt/archive/gipp/maja/UserConfiguration -v /mnt/archive/gipp/maja:/mnt/archive/gipp/maja -v /mnt/archive/demmaccs_tmp/:/mnt/archive/demmaccs_tmp/ -v /mnt/archive/dwn_def/s2/default/sea/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE:/mnt/archive/dwn_def/s2/default/sea/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE -v /mnt/archive/maccs_def/sea/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE:/mnt/archive/maccs_def/sea/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE --name l2a_processors_672 lnicola/sen2agri-l2a-processors /usr/share/l2a_processors/maja.py --dem /mnt/archive/srtm --swbd /mnt/archive/swbd --conf /mnt/archive/gipp/maja/UserConfiguration --processes-number-dem 1 --processes-number-maccs 1 --gipp-dir /mnt/archive/gipp/maja --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maja/3.2.2/bin/maja --delete-temp --product-id 672 /mnt/archive/dwn_def/s2/default/sea/S2A_MSIL1C_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE /mnt/archive/maccs_def/sea/l2a/output/S2A_MSIL2A_20210524T075611_N0300_R035_T37SEV_20210524T091706.SAFE --tiles-to-process 37SEV --removeSreFiles --docker-image-l8align lnicola/sen2agri-l8-alignment --docker-image-dem lnicola/sen2agri-dem --docker-image-maja3 lnicola/maja:3.2.2-centos-7 --docker-image-maja4 lnicola/maja:4.2.1-centos-7 --docker-image-gdal osgeo/gdal:ubuntu-full-3.2.0

jab_lp · November 30, 2021, 12:19pm

Hello to all,

Thanks for the good documentation in this thread!

I was stuck at exactly the same place. Already under SEN4CAP version 2 I did not get further here. I think the update to version 3 did the rest. Things seemed to be messed up, but with the help of this thread I was able to clean up my system and get the sen2agri-demmaccs service to run successfully again.

Let me perhaps emphasize for the next help seeker the importance of the commands

psql -U admin sen4cap -c "delete  from l1_tile_history "
psql -U admin sen4cap -c "update downloader_history set status_id = 2 where status_id = 6"

to finally re-trigger the maja processing (at least if I understood correctly ). These only showed up in @engineer_farmer’s log, but were not mentioned (publicly visible) here by @cudroiu or @lnicola as far as I can tell.