Newbie, processing multispectral data

Hi I started using WEBODM Ligtning for processing multispectral data.
I imported different datasets of 50-500 images, but the process is stopped all the time. I thought editing task options could be a solution. I wanted to start with the camera file.
How can I check whether the camera.json file I added is being used? When I select import to a json file in Edit Task options I cannot see any response.

The pocess terminates with:
Running global seam leveling:
Create matrices for optimization…
*** stack smashing detected ***: terminated
Aborted (core dumped)
Traceback (most recent call last):
File β€œ/code/run.py”, line 69, in
app.execute()
File β€œ/code/stages/odm_app.py”, line 83, in execute
self.first_stage.run()
File β€œ/code/opendm/types.py”, line 360, in run
self.next_stage.run(outputs)
File β€œ/code/opendm/types.py”, line 360, in run
self.next_stage.run(outputs)
File β€œ/code/opendm/types.py”, line 360, in run
self.next_stage.run(outputs)
[Previous line repeated 3 more times]
File β€œ/code/opendm/types.py”, line 341, in run
self.process(self.args, outputs)
File β€œ/code/stages/mvstex.py”, line 104, in process
system.run(’{bin} {nvm_file} {model} {out_dir} ’
File β€œ/code/opendm/system.py”, line 79, in run
raise Exception(β€œChild returned {}”.format(retcode))
Exception: Child returned 134

The task output will usually have a line telling you whether the file you provide is being used. But I would first worry about the other error. Are you able to process one of the sample datasets (e.g. GitHub - pierotofy/drone_dataset_mica: 5 bands 16bit TIFF images )?

1 Like

I tried with the option multispectral. This doesn’t work either. But different message:
It looks like there might be one of the following problems:

** Not enough images*
** Not enough overlap between images*
** Images might be too blurry (common with phone cameras)*
** The min-num-features task option is set too low, try increasing it by 25%*

Ah, yes, for that dataset you might need to increase min-num-features (24000), matcher-neighbors (12) and matcher-type (bow)

2 Likes

Hi I managed to process the demo-images from the micasense set and the Brighton Park. So the installation is OK and the settings for these data sets too. But applying these settings to my own data set (not a micasense), still end in an error.
Below the log.
The camera is a Laquinta camera with different bands combined in one tif. Do I need diiferent settings for such a camera?
[INFO] build_overviews: False
[INFO] camera_lens: auto
[INFO] cameras: {}
[INFO] crop: 3
[INFO] debug: False
[INFO] dem_decimation: 1
[INFO] dem_euclidean_map: False
[INFO] dem_gapfill_steps: 3
[INFO] dem_resolution: 2.0
[INFO] depthmap_resolution: 640
[INFO] dsm: False
[INFO] dtm: False
[INFO] end_with: odm_report
[INFO] fast_orthophoto: False
[INFO] feature_quality: high
[INFO] feature_type: sift
[INFO] force_gps: False
[INFO] gcp: None
[INFO] geo: None
[INFO] gps_accuracy: 10
[INFO] ignore_gsd: False
[INFO] matcher_distance: 0
[INFO] matcher_neighbors: 12
[INFO] matcher_type: bow
[INFO] max_concurrency: 8
[INFO] merge: all
[INFO] mesh_octree_depth: 11
[INFO] mesh_size: 200000
[INFO] min_num_features: 10000
[INFO] name: f303576d-f9ba-47c8-8a21-b3cba93377d7
[INFO] optimize_disk_space: True
[INFO] orthophoto_compression: DEFLATE
[INFO] orthophoto_cutline: False
[INFO] orthophoto_no_tiled: False
[INFO] orthophoto_png: False
[INFO] orthophoto_resolution: 2.0
[INFO] pc_classify: False
[INFO] pc_csv: False
[INFO] pc_ept: False
[INFO] pc_filter: 2.5
[INFO] pc_las: False
[INFO] pc_quality: medium
[INFO] pc_rectify: False
[INFO] pc_sample: 0.01
[INFO] primary_band: auto
[INFO] project_path: /var/www/data
[INFO] radiometric_calibration: none
[INFO] rerun: None
[INFO] rerun_all: False
[INFO] rerun_from: None
[INFO] resize_to: 2048
[INFO] skip_3dmodel: False
[INFO] skip_band_alignment: False
[INFO] skip_report: False
[INFO] sm_cluster: None
[INFO] smrf_scalar: 1.25
[INFO] smrf_slope: 0.15
[INFO] smrf_threshold: 0.5
[INFO] smrf_window: 18.0
[INFO] split: 999999
[INFO] split_image_groups: None
[INFO] split_overlap: 150
[INFO] texturing_data_term: area
[INFO] texturing_outlier_removal_type: gauss_clamping
[INFO] texturing_skip_global_seam_leveling: True
[INFO] texturing_skip_local_seam_leveling: False
[INFO] texturing_tone_mapping: none
[INFO] tiles: False
[INFO] time: False
[INFO] use_3dmesh: False
[INFO] use_exif: False
[INFO] use_fixed_camera_params: False
[INFO] use_hybrid_bundle_adjustment: False
[INFO] verbose: False
[INFO] ==============
[INFO] Running dataset stage
[INFO] Loading dataset from: /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images
[INFO] Loading 457 images
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14200600.TIF: could not convert string to float: β€˜22.50 23.78 8.75 8.50’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14251000.TIF: could not convert string to float: β€˜27.60 29.18 10.67 10.14’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14232300.TIF: could not convert string to float: β€˜26.20 27.60 10.11 9.70’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14211300.TIF: could not convert string to float: β€˜24.15 25.53 9.37 8.98’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14190000.TIF: could not convert string to float: β€˜20.43 21.62 8.02 7.73’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14221900.TIF: could not convert string to float: β€˜25.94 27.43 9.98 9.64’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14180100.TIF: could not convert string to float: β€˜19.61 20.81 7.72 7.46’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14231200.TIF: could not convert string to float: β€˜26.33 27.71 10.15 9.77’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14180200.TIF: could not convert string to float: β€˜19.57 20.79 7.71 7.45’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14242100.TIF: could not convert string to float: β€˜25.78 27.28 9.99 9.54’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14174801.TIF: could not convert string to float: β€˜19.59 20.79 7.71 7.47’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14184100.TIF: could not convert string to float: β€˜20.12 21.33 7.91 7.63’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14214000.TIF: could not convert string to float: β€˜25.37 26.88 9.83 9.37’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14181800.TIF: could not convert string to float: β€˜19.67 20.90 7.75 7.47’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14250100.TIF: could not convert string to float: β€˜27.86 29.49 10.78 10.22’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14222900.TIF: could not convert string to float: β€˜26.14 27.49 10.05 9.69’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14194800.TIF: could not convert string to float: β€˜21.60 22.86 8.45 8.18’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14223500.TIF: could not convert string to float: β€˜26.29 27.72 10.14 9.75’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14204100.TIF: could not convert string to float: β€˜23.31 24.68 9.04 8.75’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14204600.TIF: could not convert string to float: β€˜23.03 24.40 8.96 8.63’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14193700.TIF: could not convert string to float: β€˜21.16 22.42 8.28 7.99’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14251500.TIF: could not convert string to float: β€˜27.85 29.40 10.75 10.22’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14191100.TIF: could not convert string to float: β€˜20.60 21.88 8.10 7.82’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14240800.TIF: could not convert string to float: β€˜25.46 26.94 9.89 9.45’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14232500.TIF: could not convert string to float: β€˜26.40 27.78 10.18 9.80’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14195200.TIF: could not convert string to float: β€˜21.77 23.01 8.48 8.23’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14204300.TIF: could not convert string to float: β€˜23.03 24.40 8.96 8.63’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14182300.TIF: could not convert string to float: β€˜19.72 20.95 7.75 7.49’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14243900.TIF: could not convert string to float: β€˜26.39 27.86 10.23 9.71’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14221200.TIF: could not convert string to float: β€˜26.32 27.66 10.13 9.73’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14191000.TIF: could not convert string to float: β€˜20.51 21.71 8.04 7.74’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14251700.TIF: could not convert string to float: β€˜27.54 29.11 10.66 10.12’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14210700.TIF: could not convert string to float: β€˜24.00 25.33 9.30 8.93’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14234500.TIF: could not convert string to float: β€˜26.53 28.15 10.21 9.79’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14212300.TIF: could not convert string to float: β€˜24.30 25.71 9.44 9.02’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14220100.TIF: could not convert string to float: β€˜27.53 29.07 10.56 10.19’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14242400.TIF: could not convert string to float: β€˜25.76 27.26 9.99 9.53’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14250700.TIF: could not convert string to float: β€˜27.77 29.36 10.73 10.21’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14252400.TIF: could not convert string to float: β€˜28.51 30.18 10.99 10.46’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14185100.TIF: could not convert string to float: β€˜20.27 21.49 7.96 7.68’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14180500.TIF: could not convert string to float: β€˜19.60 20.82 7.72 7.46’
[WARNING] Cannot read XMP tags for /var/www/data/f303576d-f9ba-47c8-8a21-b3cba93377d7/images/14252800.TIF: could not convert string to float: β€˜28.78 30.50 11.08 10.54’
Traceback (most recent call last):
File β€œ/code/run.py”, line 69, in
app.execute()
File β€œ/code/stages/odm_app.py”, line 83, in execute
self.first_stage.run()
File β€œ/code/opendm/types.py”, line 341, in run
self.process(self.args, outputs)
File β€œ/code/stages/dataset.py”, line 110, in process
p = types.ODM_Photo(f)
File β€œ/code/opendm/photo.py”, line 79, in init
self.parse_exif_values(path_file)
File β€œ/code/opendm/photo.py”, line 178, in parse_exif_values
xmp = self.get_xmp(f)
File β€œ/code/opendm/photo.py”, line 297, in get_xmp
xmp_str = img_bytes[xmp_start:xmp_end + 12].decode(β€˜utf8’)
UnicodeDecodeError: β€˜utf-8’ codec can’t decode byte 0xb0 in position 1008: invalid start byte

Some information in your images seems to be invalid/corrupted based on the log (see the warning messages). What sensor are you using?

1 Like

Laquinta from DB2-vision

With the stacked multilayered-tif

Thanks. Did you do any post-processing to them or are the images straight from the sensor?

Could you also share your images (upload them somewhere like Google Drive or Dropbox)?

I didn’t do any post-processing. The link to the images is
https://www.jottacloud.com/s/1670d4b2fb6d06d4cb1ac75b0177438aaf7

1 Like

A few notes:

This error is unrelated to the rest, due to a corrupted image (likely); pass the --debug option to find out which image is corrupted and discard it.

These errors are due to the β€œsun_sensor” attribute. ODM expects .TIF to be single layer TIFFs. These images are RGBNir (4 layer TIFFs). I suspect you will need to capture your images with the β€œStacked Multilayer TIFF” option, not the β€œSingle Layer”), or manually extract the individual bands into individual files.

3 Likes

Thanks a lot for explaining these errors. I know now in which direction I can solve the issues.

2 Likes

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.