Error: "Cannot Process Dataset" Only On Multispectral Images

[TC_RS]

Hello all,

Today is my first day using ODM, and while many aspects have been successful, I have not been able to create a stitched image for my multispectral datasets.

I have imagery from a Sentera Double 4k 5-band multispectral camera. When I try to upload the multispec imagery, the upload goes well for a while, then I get the “Cannot Process Dataset” error. I only get this when trying to do multispectral work-- the RGB images work great, and even using the multispec images to do a standard ortho gives me a normal image.

I will include the finer details below. Does anyone have any idea what the issue may be? I see that there are other “Cannot Process Dataset” posts, but to the best of my ability, none of them have solved my issue. I did not see any posts covering these issues in the github issues page. I am very new to image processing, so please let me know if I am overlooking something simple.

Thanks so much in advance for any help, and please let me know if I can provide any more information or if there are any edits that I should make to this post.

My system specs:
Windows 10 Home
i7
16gb ram
nvidia 2060

I am running webODM on Google Chrome and installed the program using Docker.

My current settings are:
Processing Node: Auto
Options: Multispectral
Resize Images: No (I have also tried this with Yes)

Here is a link to the images:
https://drive.google.com/drive/folders/1IwHnj7BAxAtLDUQf69PBvO9laKfv_zzd?usp=sharing

Here is the log for this event:

node-odm_1 | info: About to run: /var/www/scripts/postprocess.sh data/6a917fab-9ab8-49f1-b063-e623f663b8f9
node-odm_1 | info: About to run: 7z a -mx=0 -y -r -bd /var/www/data/6a917fab-9ab8-49f1-b063-e623f663b8f9/all.zip odm_orthophoto/odm_orthophoto.tif odm_georeferencing odm_texturing odm_dem/dsm.tif entwine_pointcloud images.json cameras.json task_output.txt log.json odm_report
node-odm_1 | info: About to run: /code/run.sh --radiometric-calibration camera --auto-boundary --pc-ept --cog --project-path /var/www/data 466cb47b-5872-4afe-bbc8-b4e9ce856ba4
worker | INFO Processing status: 40 for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | [2022-07-05 20:36:22,360: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Processing status: 40 for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | INFO Downloading all.zip for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | [2022-07-05 20:36:22,367: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Downloading all.zip for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | INFO Extracting all.zip for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | [2022-07-05 20:36:25,602: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Extracting all.zip for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | INFO Extracted all.zip for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | [2022-07-05 20:36:28,312: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Extracted all.zip for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | INFO Populated extent field with /webodm/app/media/project/5/task/8935ec6c-0ce4-4302-8c97-1fc345fa36a1/assets/odm_orthophoto/odm_orthophoto.tif for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | [2022-07-05 20:36:30,458: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Populated extent field with /webodm/app/media/project/5/task/8935ec6c-0ce4-4302-8c97-1fc345fa36a1/assets/odm_orthophoto/odm_orthophoto.tif for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | INFO Populated extent field with /webodm/app/media/project/5/task/8935ec6c-0ce4-4302-8c97-1fc345fa36a1/assets/odm_dem/dsm.tif for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | [2022-07-05 20:36:30,700: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Populated extent field with /webodm/app/media/project/5/task/8935ec6c-0ce4-4302-8c97-1fc345fa36a1/assets/odm_dem/dsm.tif for Task [RGB] (8935ec6c-0ce4-4302-8c97-1fc345fa36a1)
worker | INFO Cleaning up OAM datastore for task 8935ec6c-0ce4-4302-8c97-1fc345fa36a1
worker | [2022-07-05 20:36:34,514: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Cleaning up OAM datastore for task 8935ec6c-0ce4-4302-8c97-1fc345fa36a1
worker | INFO Cleaning up DroneDB datastore for task 8935ec6c-0ce4-4302-8c97-1fc345fa36a1
worker | [2022-07-05 20:36:34,542: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Cleaning up DroneDB datastore for task 8935ec6c-0ce4-4302-8c97-1fc345fa36a1
worker | INFO Info task 8935ec6c-0ce4-4302-8c97-1fc345fa36a1 (8935ec6c-0ce4-4302-8c97-1fc345fa36a1_ddb)
worker | [2022-07-05 20:36:34,764: INFO/ForkPoolWorker-38] worker.tasks.process_task[e4c5df18-263b-4910-a8d6-8ed0b7964363]: Info task 8935ec6c-0ce4-4302-8c97-1fc345fa36a1 (8935ec6c-0ce4-4302-8c97-1fc345fa36a1_ddb)
webapp | /usr/local/lib/python3.9/dist-packages/rio_tiler/reader.py:385: AlphaBandWarning: Alpha band was removed from the output data array
webapp | warnings.warn(
webapp | WARNING Not Found: /api/projects/5/tasks/8935ec6c-0ce4-4302-8c97-1fc345fa36a1/orthophoto/tiles/1/0/0.png

[Saijin_Naib]

Make sure you are not mixing the multispectral data (one band per image) with the RGB/visible data (3-band, usually JPEG) in the same Task. This is not currently supported.

[TC_RS]

Hello, thanks for the reply! Do you mind elaborating a bit on this? I have a folder of images from the “NDRE” folder that my multispectral camera outputs. Is this what I should be uploading? You can see the images in the Google Drive folder that I linked. If I am uploading the wrong thing, do you have an idea of what the files that I upload should look like? Thanks for the help.

[Saijin_Naib]

These look like a standard false-color 3-band image, so they should not be processed with the multispectral preset. Have you processed this set of images on Default settings to see what you get?

[TC_RS]

I just processed them with the Default settings like you mentioned- it looks like that was much better! I now have a mosaic of the image. I’m not at the point in my workflow where I can extract data from this, do you know if this mosaic will retain the 5-band multispectral properties? I’m hoping to extract the data from each band from this mosaic as the next step in my process and am now a little worried this may not work out as I expected.

I mentioned this earlier, but I am very new here and am in a little over my head for the moment Very sorry if I am asking any dumb questions here, thanks again for offering so much help.

[Saijin_Naib]

No dumb questions! Everyone’s here to learn.

That particular set of imagery is a 3-band image, so it will not be able to provide more data than the three bands it contains. They seem to be implying it is a false-color composite NDRE, which should be something like Red, Red-Edge, and Near-Infrared bands. You’ll need to go through the product documentation for your particular sensor variant to confirm what their NDRE JPEG product bands are.

To get your truly multispectral data, you would need to process the imagery in individual bands, likely as one TIFF per band. Again, you’ll need to refer to the documentation for your particular sensor for how to enable this mode (if not enabled by default).

[TC_RS]

Thanks again, that all makes clear sense. If I remember correctly, the sensor is 5 bands, containing RGB as well RE and NIR. Along with the “NDRE” imagery sets, I also get “nRGB” imagery sets when I do flights with my camera. I’m thinking that I might be able to get all 5 bands by doing pixel extraction from each image- RGB from the RGB image, and R, RE, and NIR from the NDRE. I’ll poke around throughout the week and see what’s going on. Really appreciate all the help Saijin!

[Saijin_Naib]

Let us know what you find! Also check for the latest firmware for your camera to see if maybe they enable a mode for individual images per band.