L4A custom job errors

Hello SEN4CAP team,

I am trying to run an L4A custom job using only S1 data.

  1. After running extract-parcels.py I get among others a “radar.csv”, file containing the name of same fields, but no data.
    dt,tile_id,orbit_type_id,polarization,radar_product_type,full_path

Is this OK?

  1. At the S4CCropType step I get the following error:

Error in subset(X, target == names(which.min(n_target)))[sample(min(n_target)), :
incorrect number of dimensions
Calls: SMOTE
Execution halted
Traceback (most recent call last):
File “/usr/bin/crop-type-wrapper.py”, line 364, in
main()
File “/usr/bin/crop-type-wrapper.py”, line 328, in main
run_command(command)
File “/usr/bin/crop-type-wrapper.py”, line 24, in run_command
raise RuntimeError(“Command {} failed with exit code {}”.format(cmd_line, result))
RuntimeError: Command crop_type.R /mnt/archive/orchestrator_temp/s4c_l4a/2623/21525-product-formatter// 0 0 0 0 /mnt/archive/orchestrator_temp/s4c_l4a/2623/21523-s4c-l4a-extract-parcels/parcels.csv CTnumL4A 123 Area_meters 0 1 30 10 4000 1333 0.25 0.75 Smote 1000 5 300 10 /mnt/archive/orchestrator_temp/s4c_l4a/2623/21523-s4c-l4a-extract-parcels/lut.csv failed with exit code 1

Before this I get another error message:
Usage: merge-statistics mean.csv dev.csv mean-1.csv dev-1.csv count-1.csv […]
cut: sar-merged/mean-sar.csv: No such file or directory
cut: sar-merged/mean-sar.csv: No such file or directory
cut: sar-merged/dev-sar.csv: No such file or directory
cut: sar-merged/dev-sar.csv: No such file or directory

Thank you!
Stefan

Is this OK?

No, it should contain a list of products that intersect your site and were acquired in the season you’ve defined. extract-parcels.py prints a SQL query for debugging, that might provide some clues.

At the S4CCropType step I get the following error

That’s because there’s no input for the script to use.

Thank you!

Apparently the processor crashes when computing the footprint of the L2A_S1 products. Can you help with this error?

All 2 intersections failed (All 2 intersections failed ([2021-02-19 02:42:04] Intersecting product: S1A_IW_SLC__1SDV_20200419T162551_20200419T162618_032199_03B948_D053.SAFE, polarisation: VH, error: 2021-02-19 02:41:59[WARNING] Cannot determine footprint for product SEN4CAP_L2A_S1_V20200425T162445_20200419T162551_VH_102_COHE. Reason: java.io.IOException: org.opengis.referencing.FactoryException: Type “PROJCRS” is unknow in this context.
at ro.cs.tao.eodata.GdalInfoWrapper.getMetadata(GdalInfoWrapper.java:302)
at org.esa.sen4cap.preprocessing.Sentinel1Level2Worker.createProductMetadata(Sentinel1Level2Worker.java:853)
at org.esa.sen4cap.preprocessing.Sentinel1Level2Worker.createProducts(Sentinel1Level2Worker.java:422)
at org.esa.sen4cap.preprocessing.Sentinel1L2ProcessorV1.processProductPair(Sentinel1L2ProcessorV1.java:249)
at org.esa.sen4cap.preprocessing.Sentinel1L2ProcessorV1.processAcquisition(Sentinel1L2ProcessorV1.java:160)
at org.esa.sen4cap.scheduling.Sentinel1Level2Job.processSite(Sentinel1Level2Job.java:192)
at org.esa.sen4cap.scheduling.Sentinel1Level2Job.executeImpl(Sentinel1Level2Job.java:248)
at org.esa.sen2agri.scheduling.AbstractJob.execute(AbstractJob.java:67)
at org.esa.sen4cap.scheduling.Sentinel1Level2Job.execute(Sentinel1Level2Job.java:103)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
Caused by: org.opengis.referencing.FactoryException: Type “PROJCRS” is unknow in this context.
at org.geotools.referencing.factory.ReferencingObjectFactory.createFromWKT(ReferencingObjectFactory.java:1075)
at org.geotools.referencing.CRS.parseWKT(CRS.java:536)
at ro.cs.tao.eodata.GdalInfoWrapper.getMetadata(GdalInfoWrapper.java:214)
… 10 more
Caused by: java.text.ParseException: Type “PROJCRS” is unknow in this context.
at org.geotools.referencing.wkt.Parser.parseCoordinateReferenceSystem(Parser.java:244)
at org.geotools.referencing.wkt.Parser.parseCoordinateReferenceSystem(Parser.java:213)
at org.geotools.referencing.factory.ReferencingObjectFactory.createFromWKT(ReferencingObjectFactory.java:1069)
… 12 more
;)[2021-02-20 03:05:35] Intersecting product: S1A_IW_SLC__1SDV_20200419T162551_20200419T162618_032199_03B948_D053.SAFE, polarisation: VV, error: 2021-02-20 03:05:30[WARNING] Cannot determine footprint for product SEN4CAP_L2A_S1_V20200425T162445_20200419T162551_VV_102_COHE. Reason: java.io.IOException: org.opengis.referencing.FactoryException: Type “PROJCRS” is unknow in this context.
at ro.cs.tao.eodata.GdalInfoWrapper.getMetadata(GdalInfoWrapper.java:302)
at org.esa.sen4cap.preprocessing.Sentinel1Level2Worker.createProductMetadata(Sentinel1Level2Worker.java:853)
at org.esa.sen4cap.preprocessing.Sentinel1Level2Worker.createProducts(Sentinel1Level2Worker.java:422)
at org.esa.sen4cap.preprocessing.Sentinel1L2ProcessorV1.processProductPair(Sentinel1L2ProcessorV1.java:249)
at org.esa.sen4cap.preprocessing.Sentinel1L2ProcessorV1.processAcquisition(Sentinel1L2ProcessorV1.java:160)
at org.esa.sen4cap.scheduling.Sentinel1Level2Job.processSite(Sentinel1Level2Job.java:192)
at org.esa.sen4cap.scheduling.Sentinel1Level2Job.executeImpl(Sentinel1Level2Job.java:248)
at org.esa.sen2agri.scheduling.AbstractJob.execute(AbstractJob.java:67)
at org.esa.sen4cap.scheduling.Sentinel1Level2Job.execute(Sentinel1Level2Job.java:103)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
Caused by: org.opengis.referencing.FactoryException: Type “PROJCRS” is unknow in this context.
at org.geotools.referencing.factory.ReferencingObjectFactory.createFromWKT(ReferencingObjectFactory.java:1075)
at org.geotools.referencing.CRS.parseWKT(CRS.java:536)
at ro.cs.tao.eodata.GdalInfoWrapper.getMetadata(GdalInfoWrapper.java:214)
… 10 more
Caused by: java.text.ParseException: Type “PROJCRS” is unknow in this context.
at org.geotools.referencing.wkt.Parser.parseCoordinateReferenceSystem(Parser.java:244)
at org.geotools.referencing.wkt.Parser.parseCoordinateReferenceSystem(Parser.java:213)
at org.geotools.referencing.factory.ReferencingObjectFactory.createFromWKT(ReferencingObjectFactory.java:1069)
… 12 more