Dear Sen4Cap team,
There is an issue with the: S4C L4A Crop Type
It is always in error status.
The Job Output is the following for the 4 different step names:
Step Name1:
export-product-launcher
Command:
/usr/bin/export-product-launcher.py -f /mnt/archive/orchestrator_temp/s4c_l4a/91/294-product-formatter/prd_infos.txt -o CropType.gpkg
Output:
null
Errors:
null
Step Name2:
ProductFormatter
Command:
docker run --rm -u 1000:1000 --group-add 994 -v /mnt/archive/orchestrator_temp/s4c_l4a:/mnt/archive/orchestrator_temp/s4c_l4a -v /mnt/archive:/mnt/archive -v /etc/sen2agri:/etc/sen2agri sen4cap/processors:3.0.0 otbcli ProductFormatter -destroot /mnt/archive/sample/s4c_l4a/ -fileclass OPER -level S4C_L4A -vectprd 1 -baseline 01.00 -siteid 6 -timeperiod 20190501T000000_20190801T000000 -processor generic -outprops /mnt/archive/orchestrator_temp/s4c_l4a/91/294-product-formatter/product_properties.txt -gipp /mnt/archive/orchestrator_temp/s4c_l4a/91/294-product-formatter/executionInfos.txt -processor.generic.files /mnt/archive/orchestrator_temp/s4c_l4a/91/294-product-formatter/
Output:
null
Errors:
null
Step Name3:
S4CCropType
Command:
crop-type-wrapper.py docker run --rm -u 1000:1000 --group-add 994 -v /mnt/archive/orchestrator_temp/s4c_l4a:/mnt/archive/orchestrator_temp/s4c_l4a -v /mnt/archive:/mnt/archive -v /etc/sen2agri:/etc/sen2agri sen4cap/processors:3.0.0 crop-type-wrapper.py -s 6 --season-start 2019-05-01 --season-end 2019-08-01 --working-path /mnt/archive/orchestrator_temp/s4c_l4a/91/293-s4c-crop-type/ --out-path /mnt/archive/orchestrator_temp/s4c_l4a/91/294-product-formatter/ --parcels /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/parcels.csv --lut /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/lut.csv --tile-footprints /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/tiles.csv --optical-products /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/optical.csv --radar-products /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/radar.csv --lpis /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/lpis.txt --target-path /mnt/archive/sample/s4c_l4a/ --outputs /mnt/archive/orchestrator_temp/s4c_l4a/91/293-s4c-crop-type/markers_product_infos.csv --lc 1234 --min-s2-pix 3 --min-s1-pix 1 --best-s2-pix 10 --pa-min 30 --pa-train-h 4000 --pa-train-l 1333 --sample-ratio-h 0.25 --sample-ratio-l 0.75 --smote-target 1000 --smote-k 5 --num-trees 300 --min-node-size 10 --mode both
Output:
0
merge-statistics sar-merged/mean-sar.csv sar-merged/dev-sar.csv
Exit code: 1
sh -c ‘cut -d, -f1-1 sar-merged/mean-sar.csv > sar-merged/mean-simple-sar.csv’
Exit code: 1
sh -c ‘cut -d, -f1,2- sar-merged/mean-sar.csv > sar-merged/mean-temporal-sar.csv’
Exit code: 1
sh -c ‘cut -d, -f1-1 sar-merged/dev-sar.csv > sar-merged/dev-simple-sar.csv’
Exit code: 1
sh -c ‘cut -d, -f1,2- sar-merged/dev-sar.csv > sar-merged/dev-temporal-sar.csv’
Exit code: 1
sh -c ‘cut -d, -f2- sar-merged/dev-simple-sar.csv > /tmp/tmpLnP1VX.csv’
sh -c ‘paste -d, sar-merged/mean-simple-sar.csv /tmp/tmpLnP1VX.csv >> sar-merged/sar-features.csv’
sh -c ‘cut -d, -f2- sar-merged/dev-temporal-sar.csv > /tmp/tmp3GMR5y.csv’
sh -c ‘paste -d, sar-merged/mean-temporal-sar.csv /tmp/tmp3GMR5y.csv >> sar-merged/sar-temporal.csv’
crop-type-parcels.py -m optical -s 6 --lpis-path /mnt/archive/lpis/sample/2019 --optical-products /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/optical.csv
crop-type-parcels.py -m sar -s 6 --lpis-path /mnt/archive/lpis/sample/2019 --tile-footprints /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/tiles.csv --radar-products /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/radar.csv
merge-sar.py sar sar-merged
Errors:
Usage: merge-statistics mean.csv dev.csv mean-1.csv dev-1.csv count-1.csv […]
cut: sar-merged/mean-sar.csv: No such file or directory
cut: sar-merged/mean-sar.csv: No such file or directory
cut: sar-merged/dev-sar.csv: No such file or directory
cut: sar-merged/dev-sar.csv: No such file or directory
Traceback (most recent call last):
File “/usr/bin/crop-type-wrapper.py”, line 365, in
main()
File “/usr/bin/crop-type-wrapper.py”, line 252, in main
os.rename(“optical/optical-features.csv”, “features/optical-features.csv”)
OSError: [Errno 2] No such file or directory
Step Name4:
S4CCropTypeExtractParcels
Command:
extract-parcels.py -s 6 --season-start 2019-05-01 --season-end 2019-08-01 – /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/parcels.csv /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/lut.csv /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/tiles.csv /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/optical.csv /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/radar.csv /mnt/archive/orchestrator_temp/s4c_l4a/91/292-s4c-l4a-extract-parcels/lpis.txt
Output:
select short_name
from site
where id = 6
select shape_tiles_s2.tile_id,
shape_tiles_s2.epsg_code,
ST_AsText(shape_tiles_s2.geog) as geog
from shape_tiles_s2
where shape_tiles_s2.tile_id in (
select tile_id
from sp_get_site_tiles(6 :: smallint, 1 :: smallint)
);
select site_id,
name,
full_path,
unnest(tiles) as tile,
created_timestamp
from product
where satellite_id = 1
and product_type_id = 1
and created_timestamp between '2019-05-01'::date and '2019-08-01'::date + interval '1 day'
and site_id = 6
order by site_id, created_timestamp;
select *
from (
select
greatest(substr(split_part(product.name, '_', 4), 2), split_part(product.name, '_', 5)) :: date as date,
site_tiles.tile_id,
product.orbit_type_id,
split_part(product.name, '_', 6) as polarization,
product.product_type_id,
product.full_path
from sp_get_site_tiles(6 :: smallint, 1 :: smallint) as site_tiles
inner join shape_tiles_s2 on shape_tiles_s2.tile_id = site_tiles.tile_id
inner join product on ST_Intersects(product.geog, shape_tiles_s2.geog)
where product.satellite_id = 3
and product.site_id = 6
) products
where date between '2019-05-01'::date and '2019-08-01'::date + interval '1 day'
order by date;
select full_path
from product
where site_id = 6
and product_type_id = 14
and created_timestamp <= '2019-08-01T00:00:00'::timestamp
order by created_timestamp desc
limit 1;
select lpis."NewID",
lpis."Area_meters",
lpis."S1Pix",
lpis."S2Pix",
lut.ctnuml4a as "CTnumL4A",
lut.ctl4a as "CTL4A",
lut.lc
from "decl_sample_2019" lpis
natural join "lut_sample_2019" lut
where "GeomValid"
and not "Duplic"
and not "Overlap"
and not is_deleted
order by "NewID"
select distinct ctnuml4a as “CTnumL4A”, ctl4a as “CTL4A” from “lut_sample_2019”
Errors:
empty err log
Do you have any idea why we have this error?
Thank you,
Sofia