Unable to process data : issue with opensfm reconstruction

iskander · 26 September 2019 16:41

Hi all,
We are trying to process 15 images that have 80% forward overlap. All the images had GPS exif. We used the docker to test odm on our images. The process run smoothly till we encountered this issue (see log below)
…
2019-09-26 16:25:09,776 DEBUG: Robust matching time : 0.000370025634766s
2019-09-26 16:25:09,776 DEBUG: Full matching 1535 / 1561, time: 1.84735012054s
[INFO] running /code/SuperBuild/src/opensfm/bin/opensfm create_tracks “/code/opensfm”
2019-09-26 16:25:10,547 INFO: reading features
2019-09-26 16:25:10,793 DEBUG: Merging features onto tracks
2019-09-26 16:25:11,752 DEBUG: Good tracks: 20409
[INFO] running /code/SuperBuild/src/opensfm/bin/opensfm reconstruct “/code/opensfm”
2019-09-26 16:25:14,246 INFO: Starting incremental reconstruction
2019-09-26 16:25:18,022 INFO: 0 partial reconstructions in total.
Traceback (most recent call last):
File “/code/run.py”, line 56, in
app.execute()
File “/code/stages/odm_app.py”, line 92, in execute
self.first_stage.run()
File “/code/opendm/types.py”, line 373, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 373, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 373, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 354, in run
self.process(self.args, outputs)
File “/code/stages/run_opensfm.py”, line 48, in process
octx.update_config({‘undistorted_image_max_size’: gsd.image_max_size(photos, args.orthophoto_resolution, tree.opensfm_reconstruction, ignore_gsd=args.ignore_gsd)})
File “/code/opendm/gsd.py”, line 39, in image_max_size
isf = image_scale_factor(target_resolution, reconstruction_json, gsd_error_estimate)
File “/code/opendm/gsd.py”, line 55, in image_scale_factor
gsd = opensfm_reconstruction_average_gsd(reconstruction_json)
File “/usr/local/lib/python2.7/dist-packages/repoze/lru/init.py”, line 348, in cached_wrapper
val = func(*args, **kwargs)
File “/code/opendm/gsd.py”, line 105, in opensfm_reconstruction_average_gsd
reconstruction = data[0]
IndexError: list index out of range

we checked the reconstruction.json file under opensfm and it was empty.
Do you have any idea what went wrong?

Best Regards,
Iskander

mcnis003 · 4 December 2019 16:34

I have the same issue. Was a solution ever found?

mcnis003 · 5 December 2019 20:04

ran without GCPs and still get same error

iskander · 5 December 2019 22:01

Hi
I did not yet get any answer to my question since the time i post it.
Best,

mcnis003 · 17 December 2019 00:23

Looks like the error is related to this:

github.com/OpenDroneMap/WebODM

Help users understand "0 partial reconstructions in total."

opened 02:04PM - 03 Nov 18 UTC

closed 04:28PM - 04 Nov 18 UTC

RuikangSun

improvements help wanted

### How did you install WebODM? (Docker, natively, ...)? sudo apt-get -y upda…te sudo apt-get -y upgrade sudo apt-get -y install docker-compose sudo apt-get -y install python-pip sudo curl -L https://github.com/docker/compose/releases/download/1.21.0/docker-compose-$(uname -s)-$(uname -m) -o /usr/bin/docker-compose git clone https://github.com/OpenDroneMap/WebODM --config core.autocrlf=input --depth 1 cd WebODM sudo ./webodm.sh start ### What's your browser and operating system? (Copy/paste the output of https://www.whatismybrowser.com/) Firefox 63 on Windows 7 ### What is the problem? [INFO] Running ODM Load Dataset Cell [DEBUG] Loading dataset from: /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/images [DEBUG] /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/images [WARNING] Could not find ccd_width in file. Use --force-ccd or edit the sensor_data.json file to manually input ccd width [DEBUG] Loaded DJI_4369.JPG | camera: dji fc1102 | dimensions: 3968 x 2976 | focal: 4.49 | ccd: None | lat: 37.0577777778 | lon: 118.094444444 | alt: 50.6 [WARNING] Could not find ccd_width in file. Use --force-ccd or edit the sensor_data.json file to manually input ccd width [DEBUG] Loaded DJI_4369_sFYkQdR.JPG | camera: dji fc1102 | dimensions: 3968 x 2976 | focal: 4.49 | ccd: None | lat: 37.0577777778 | lon: 118.094444444 | alt: 50.6 [INFO] Found 2 usable images [DEBUG] running /code/build/bin/odm_extract_utm -imagesPath /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/images/ -imageListFile /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/img_list.txt -outputCoordFile /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/odm_georeferencing/coords.txt -logFile /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/odm_georeferencing/odm_georeferencing_utm_log.txt [DEBUG] Line: WGS84 UTM 50N [INFO] Running ODM Load Dataset Cell - Finished [INFO] Running ODM OpenSfM Cell [DEBUG] Altitude data detected, enabling it for GPS alignment [DEBUG] ['use_exif_size: no', 'feature_process_size: 2048', 'feature_min_frames: 8000', 'processes: 4', 'matching_gps_neighbors: 8', 'depthmap_method: PATCH_MATCH', 'depthmap_resolution: 640', 'depthmap_min_patch_sd: 1', 'depthmap_min_consistent_views: 3', 'optimize_camera_parameters: yes', 'use_altitude_tag: True', 'align_method: naive'] [DEBUG] running PYTHONPATH=/code/SuperBuild/install/lib/python2.7/dist-packages /code/SuperBuild/src/opensfm/bin/opensfm extract_metadata /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/opensfm 2018-11-03 14:00:17,008 INFO: Extracting EXIF for DJI_4369.JPG 2018-11-03 14:00:17,189 INFO: Extracting EXIF for DJI_4369_sFYkQdR.JPG [DEBUG] running PYTHONPATH=/code/SuperBuild/install/lib/python2.7/dist-packages /code/SuperBuild/src/opensfm/bin/opensfm detect_features /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/opensfm 2018-11-03 14:00:18,197 INFO: Extracting ROOT_HAHOG features for image DJI_4369.JPG 2018-11-03 14:00:18,472 INFO: Extracting ROOT_HAHOG features for image DJI_4369_sFYkQdR.JPG 2018-11-03 14:00:21,503 DEBUG: Found 10204 points in 2.95629000664s 2018-11-03 14:00:22,155 DEBUG: Found 10204 points in 3.33254504204s [DEBUG] running PYTHONPATH=/code/SuperBuild/install/lib/python2.7/dist-packages /code/SuperBuild/src/opensfm/bin/opensfm match_features /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/opensfm 2018-11-03 14:00:23,544 INFO: Matching 1 image pairs 2018-11-03 14:00:23,929 INFO: Matching DJI_4369_sFYkQdR.JPG - 1 / 2 2018-11-03 14:00:24,209 INFO: Matching DJI_4369.JPG - 2 / 2 2018-11-03 14:00:26,473 DEBUG: DJI_4369.JPG - DJI_4369_sFYkQdR.JPG has 10202 candidate matches 2018-11-03 14:00:26,475 DEBUG: Robust matching time : 0.00150108337402s 2018-11-03 14:00:26,475 DEBUG: Full matching 10202 / 10202, time: 2.26585412025s [DEBUG] running PYTHONPATH=/code/SuperBuild/install/lib/python2.7/dist-packages /code/SuperBuild/src/opensfm/bin/opensfm create_tracks /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/opensfm 2018-11-03 14:00:27,101 INFO: reading features 2018-11-03 14:00:27,197 DEBUG: Merging features onto tracks 2018-11-03 14:00:27,326 DEBUG: Good tracks: 10202 [DEBUG] running PYTHONPATH=/code/SuperBuild/install/lib/python2.7/dist-packages /code/SuperBuild/src/opensfm/bin/opensfm reconstruct /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/opensfm 2018-11-03 14:00:28,231 INFO: Starting incremental reconstruction 2018-11-03 14:00:28,403 INFO: 0 partial reconstructions in total. Traceback (most recent call last): File "/code/run.py", line 47, in <module> plasm.execute(niter=1) File "/code/scripts/run_opensfm.py", line 141, in process image_scale = gsd.image_scale_factor(args.orthophoto_resolution, tree.opensfm_reconstruction) File "/code/opendm/gsd.py", line 31, in image_scale_factor gsd = opensfm_reconstruction_average_gsd(reconstruction_json) File "/usr/local/lib/python2.7/dist-packages/repoze/lru/__init__.py", line 348, in cached_wrapper val = func(*args, **kwargs) File "/code/opendm/gsd.py", line 75, in opensfm_reconstruction_average_gsd raise IOError(reconstruction_json + " does not exist.") IOError: /var/www/data/d581819e-a16e-46a4-9262-f932537e62ee/opensfm/reconstruction.json does not exist. ### What should be the expected behavior? Not sure ### How can we reproduce this? (What steps did you do to trigger the problem? What parameters are you using for processing? If possible please include a copy of your dataset uploaded on Google Drive or Dropbox. Be detailed) Not sure

the key part of the error message is this:

I guess this indicates that you have poor overlap or blurred images.

This is frustrating for me because ODM was working well for me until some point in 2018 when the matching process started giving this type of output:

Matcher: FLANN T-desc: 2.772 T-robust: 0.003 T-total: 2.775 Matches: 854 Robust: 844 Success: True

My photos are relative low resolution agricultural photos.

I would appreciate any suggestions for how to produce orthophotos again.

mcnis003 · 17 December 2019 19:57

Does anyone have suggested parameters? I only need an orthophoto. This is what I am using:

–fast-orthophoto
–min-num-features 30000
–ignore-gsd
–matcher-neighbors 16
–matcher-distance 30
–texturing-nadir-weight 8

pierotofy · 17 December 2019 20:20

Perhaps try to increase --matcher-distance, 30 meters seems a bit low. The other parameters are good. Double --min-num-features if you really want to push it (although 30,000 is already pretty high).

mcnis003 · 17 December 2019 20:56

Thanks for replying. No change. I have attempted these parameters:

docker run -i -v /home/ianmcnish/rgb_gcp_list.txt:/code/images/rgb_gcp_list.txt -v /home/ianmcnish/:/code/images -v /home/ianmcnish/:/code/odm_orthophoto -v /home/ianmcnish/:/code/odm_texturing opendronemap/odm --gcp /code/images/rgb_gcp_list.txt --fast-orthophoto --min-num-features 60000 --ignore-gsd --matcher-neighbors 16 --matcher-distance 60 --texturing-nadir-weight 8

Here is the output. I trimmed it to fit in the forum.

[INFO] Fast orthophoto is turned on, automatically setting --skip-3dmodel

[INFO] Initializing OpenDroneMap app - Tue Dec 17 20:41:54 2019

[INFO] ==============

[INFO] build_overviews: False

[INFO] camera_lens: auto

[INFO] cameras: {}

[INFO] crop: 3

[INFO] debug: False

[INFO] dem_decimation: 1

[INFO] dem_euclidean_map: False

[INFO] dem_gapfill_steps: 3

[INFO] dem_resolution: 5

[INFO] depthmap_resolution: 640

[INFO] dsm: False

[INFO] dtm: False

[INFO] end_with: odm_orthophoto

[INFO] fast_orthophoto: True

[INFO] force_gps: False

[INFO] gcp: /code/images/rgb_gcp_list.txt

[INFO] ignore_gsd: True

[INFO] matcher_distance: 60

[INFO] matcher_neighbors: 16

[INFO] max_concurrency: 10

[INFO] merge: all

[INFO] mesh_octree_depth: 9

[INFO] mesh_point_weight: 4

[INFO] mesh_samples: 1.0

[INFO] mesh_size: 100000

[INFO] min_num_features: 60000

[INFO] mve_confidence: 0.6

[INFO] name: code

[INFO] opensfm_depthmap_method: PATCH_MATCH

[INFO] opensfm_depthmap_min_consistent_views: 3

[INFO] opensfm_depthmap_min_patch_sd: 1

[INFO] orthophoto_compression: DEFLATE

[INFO] orthophoto_cutline: False

[INFO] orthophoto_no_tiled: False

[INFO] orthophoto_resolution: 5

[INFO] pc_classify: False

[INFO] pc_csv: False

[INFO] pc_ept: False

[INFO] pc_filter: 2.5

[INFO] pc_las: False

[INFO] pc_sample: 0

[INFO] project_path: /

[INFO] rerun: None

[INFO] rerun_all: False

[INFO] rerun_from: None

[INFO] resize_to: 2048

[INFO] skip_3dmodel: True

[INFO] sm_cluster: None

[INFO] smrf_scalar: 1.25

[INFO] smrf_slope: 0.15

[INFO] smrf_threshold: 0.5

[INFO] smrf_window: 18.0

[INFO] split: 999999

[INFO] split_overlap: 150

[INFO] texturing_data_term: gmi

[INFO] texturing_keep_unseen_faces: False

[INFO] texturing_nadir_weight: 8

[INFO] texturing_outlier_removal_type: gauss_clamping

[INFO] texturing_skip_global_seam_leveling: False

[INFO] texturing_skip_hole_filling: False

[INFO] texturing_skip_local_seam_leveling: False

[INFO] texturing_skip_visibility_test: False

[INFO] texturing_tone_mapping: none

[INFO] time: False

[INFO] use_3dmesh: False

[INFO] use_exif: False

[INFO] use_fixed_camera_params: False

[INFO] use_hybrid_bundle_adjustment: False

[INFO] use_opensfm_dense: False

[INFO] verbose: False

[INFO] ==============

[INFO] Running dataset stage

[INFO] Loading dataset from: /code/images

[INFO] Loading 54 images

[INFO] Wrote images database: /code/images.json

[INFO] Found 54 usable images

[INFO] Parsing SRS header: EPSG:32615

[INFO] Generated coords file from GCP: WGS84 UTM 15N

[INFO] Parsing SRS header: WGS84 UTM 15N

[INFO] Parsing SRS header: WGS84 UTM 15N

[INFO] 20 GCP points will be used for georeferencing

[INFO] Parsing SRS header: WGS84 UTM 15N

[INFO] Finished dataset stage

[INFO] Running split stage

[INFO] Normal dataset, will process all at once.

[INFO] Finished split stage

[INFO] Running merge stage

[INFO] Normal dataset, nothing to merge.

[INFO] Finished merge stage

[INFO] Running opensfm stage

[INFO] Altitude data detected, enabling it for GPS alignment

[INFO] ['use_exif_size: no', 'feature_process_size: 2048', 'feature_min_frames: 60000', 'processes: 10', 'matching_gps_neighbors: 16', 'matching_gps_distance: 60', 'depthmap_method: PATCH_MATCH', 'depthmap_resolution: 640', 'depthmap_min_patch_sd: 1', 'depthmap_min_consistent_views: 3', 'optimize_camera_parameters: yes', 'undistorted_image_format: png', 'bundle_outlier_filtering_type: AUTO', 'align_orientation_prior: vertical', 'use_altitude_tag: yes', 'align_method: auto', 'local_bundle_radius: 0', 'bundle_use_gcp: yes', 'bundle_use_gps: no']

[INFO] running /code/SuperBuild/src/opensfm/bin/opensfm extract_metadata "/code/opensfm"

2019-12-17 20:41:56,039 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00110.jpg

2019-12-17 20:41:56,063 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00116.jpg

2019-12-17 20:41:56,066 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00076.jpg

2019-12-17 20:41:56,069 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00107.jpg

2019-12-17 20:41:56,071 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00087.jpg

2019-12-17 20:41:56,074 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00011.jpg

2019-12-17 20:41:56,077 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00074.jpg

2019-12-17 20:41:56,080 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00005.jpg

2019-12-17 20:41:56,082 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00120.jpg

2019-12-17 20:41:56,085 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00084.jpg

2019-12-17 20:41:56,088 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00072.jpg

2019-12-17 20:41:56,090 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00152.jpg

2019-12-17 20:41:56,093 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00097.jpg

2019-12-17 20:41:56,096 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00131.jpg

2019-12-17 20:41:56,099 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00004.jpg

2019-12-17 20:41:56,101 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00128.jpg

2019-12-17 20:41:56,104 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00006.jpg

2019-12-17 20:41:56,107 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00088.jpg

2019-12-17 20:41:56,110 INFO: Extracting EXIF for calibrated_0cae8e93088d_FW00154.jpg

2019-12-17 20:41:57,640 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00110.jpg

2019-12-17 20:41:57,970 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00116.jpg

2019-12-17 20:41:58,292 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00076.jpg

2019-12-17 20:41:58,625 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00107.jpg

2019-12-17 20:41:59,143 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00087.jpg

2019-12-17 20:41:59,469 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00011.jpg

2019-12-17 20:41:59,810 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00074.jpg

2019-12-17 20:42:00,276 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00005.jpg

2019-12-17 20:42:00,779 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00120.jpg

2019-12-17 20:42:01,294 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00084.jpg

2019-12-17 20:42:05,762 DEBUG: Found 27470 points in 8.09183502197s

2019-12-17 20:42:05,769 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00110.jpg, no features masked.

2019-12-17 20:42:06,046 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00072.jpg

2019-12-17 20:42:06,629 DEBUG: Found 26867 points in 8.62837004662s

2019-12-17 20:42:06,634 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00116.jpg, no features masked.

2019-12-17 20:42:06,910 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00152.jpg

2019-12-17 20:42:07,090 DEBUG: Found 27574 points in 8.76607203484s

2019-12-17 20:42:07,096 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00076.jpg, no features masked.

2019-12-17 20:42:07,425 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00097.jpg

2019-12-17 20:42:07,931 DEBUG: Found 28703 points in 9.27611589432s

2019-12-17 20:42:07,937 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00107.jpg, no features masked.

2019-12-17 20:42:08,222 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00131.jpg

2019-12-17 20:42:08,434 DEBUG: Found 25776 points in 8.92405080795s

2019-12-17 20:42:08,440 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00011.jpg, no features masked.

2019-12-17 20:42:08,714 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00004.jpg

2019-12-17 20:42:08,807 DEBUG: Found 27609 points in 9.61218214035s

2019-12-17 20:42:08,813 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00087.jpg, no features masked.

2019-12-17 20:42:08,961 DEBUG: Found 26844 points in 9.10031795502s

2019-12-17 20:42:08,968 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00074.jpg, no features masked.

2019-12-17 20:42:09,118 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00128.jpg

2019-12-17 20:42:09,279 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00006.jpg

2019-12-17 20:42:09,805 DEBUG: Found 26790 points in 9.47175383568s

2019-12-17 20:42:09,811 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00005.jpg, no features masked.

2019-12-17 20:42:10,098 INFO: Extracting ROOT_HAHOG features for image calibrated_0cae8e93088d_FW00088.jpg

2019-12-17 20:42:10,216 DEBUG: Found 27368 points in 9.38525605202s

2019-12-17 20:42:10,222 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00120.jpg, no features masked.

2019-12-17 20:44:25,962 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00006.jpg, no features masked.

2019-12-17 20:44:26,242 DEBUG: Matching calibrated_0cae8e93088d_FW00095.jpg and calibrated_0cae8e93088d_FW00109.jpg. Matcher: FLANN T-desc: 8.185 T-robust: 0.005 T-total: 8.190 Matches: 1502 Robust: 1484 Success: True

2019-12-17 20:44:26,439 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00006.jpg, no features masked.

2019-12-17 20:44:28,609 DEBUG: Matching calibrated_0cae8e93088d_FW00141.jpg and calibrated_0cae8e93088d_FW00129.jpg. Matcher: FLANN T-desc: 10.412 T-robust: 0.010 T-total: 10.422 Matches: 1482 Robust: 1457 Success: True

2019-12-17 20:44:28,714 DEBUG: Matching calibrated_0cae8e93088d_FW00008.jpg and calibrated_0cae8e93088d_FW00010.jpg. Matcher: FLANN T-desc: 8.422 T-robust: 0.013 T-total: 8.435 Matches: 2483 Robust: 2465 Success: True

2019-12-17 20:44:28,784 DEBUG: Matching calibrated_0cae8e93088d_FW00064.jpg and calibrated_0cae8e93088d_FW00073.jpg. Matcher: FLANN T-desc: 8.591 T-robust: 0.001 T-total: 8.593 Matches: 220 Robust: 201 Success: True

2019-12-17 20:44:28,806 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00154.jpg, no features masked.

2019-12-17 20:44:28,881 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00010.jpg, no features masked.

2019-12-17 20:44:28,934 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00006.jpg, no features masked.

2019-12-17 20:44:30,234 DEBUG: Matching calibrated_0cae8e93088d_FW00006.jpg and calibrated_0cae8e93088d_FW00076.jpg. Matcher: FLANN T-desc: 9.680 T-robust: 0.007 T-total: 9.687 Matches: 449 Robust: 425 Success: True

2019-12-17 20:44:30,388 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00073.jpg, no features masked.

2019-12-17 20:44:30,725 DEBUG: Matching calibrated_0cae8e93088d_FW00119.jpg and calibrated_0cae8e93088d_FW00129.jpg. Matcher: FLANN T-desc: 9.514 T-robust: 0.004 T-total: 9.518 Matches: 1080 Robust: 1060 Success: True

2019-12-17 20:44:30,797 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00141.jpg, no features masked.

2019-12-17 20:44:32,152 DEBUG: Matching calibrated_0cae8e93088d_FW00085.jpg and calibrated_0cae8e93088d_FW00107.jpg. Matcher: FLANN T-desc: 9.692 T-robust: 0.001 T-total: 9.693 Matches: 267 Robust: 245 Success: True

2019-12-17 20:44:32,290 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00075.jpg, no features masked.

2019-12-17 20:44:34,257 DEBUG: Matching calibrated_0cae8e93088d_FW00074.jpg and calibrated_0cae8e93088d_FW00006.jpg. Matcher: FLANN T-desc: 8.300 T-robust: 0.012 T-total: 8.312 Matches: 3246 Robust: 3211 Success: True

2019-12-17 20:44:34,377 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00005.jpg, no features masked.

2019-12-17 20:44:34,496 DEBUG: Matching calibrated_0cae8e93088d_FW00086.jpg and calibrated_0cae8e93088d_FW00009.jpg. Matcher: FLANN T-desc: 8.547 T-robust: 0.003 T-total: 8.550 Matches: 763 Robust: 744 Success: True

2019-12-17 20:44:34,561 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00088.jpg, no features masked.

2019-12-17 20:44:34,564 DEBUG: Matching calibrated_0cae8e93088d_FW00128.jpg and calibrated_0cae8e93088d_FW00131.jpg. Matcher: FLANN T-desc: 10.814 T-robust: 0.023 T-total: 10.837 Matches: 454 Robust: 432 Success: True

2019-12-17 20:44:34,719 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00140.jpg, no features masked.

2019-12-17 20:44:35,344 DEBUG: Matching calibrated_0cae8e93088d_FW00095.jpg and calibrated_0cae8e93088d_FW00006.jpg. Matcher: FLANN T-desc: 8.923 T-robust: 0.006 T-total: 8.929 Matches: 1240 Robust: 1174 Success: True

2019-12-17 20:44:35,476 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00004.jpg, no features masked.

2019-12-17 20:44:37,099 DEBUG: Matching calibrated_0cae8e93088d_FW00064.jpg and calibrated_0cae8e93088d_FW00010.jpg. Matcher: FLANN T-desc: 8.149 T-robust: 0.055 T-total: 8.204 Matches: 4226 Robust: 4162 Success: True

2019-12-17 20:44:37,268 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00066.jpg, no features masked.

2019-12-17 20:44:37,493 DEBUG: Matching calibrated_0cae8e93088d_FW00008.jpg and calibrated_0cae8e93088d_FW00006.jpg. Matcher: FLANN T-desc: 8.575 T-robust: 0.077 T-total: 8.652 Matches: 2179 Robust: 2159 Success: True

2019-12-17 20:44:37,791 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00066.jpg, no features masked.

2019-12-17 20:44:39,440 DEBUG: Matching calibrated_0cae8e93088d_FW00006.jpg and calibrated_0cae8e93088d_FW00073.jpg. Matcher: FLANN T-desc: 9.043 T-robust: 0.023 T-total: 9.066 Matches: 4858 Robust: 4848 Success: True

2019-12-17 20:44:39,498 DEBUG: Matching calibrated_0cae8e93088d_FW00141.jpg and calibrated_0cae8e93088d_FW00154.jpg. Matcher: FLANN T-desc: 10.701 T-robust: 0.012 T-total: 10.713 Matches: 568 Robust: 536 Success: True

2019-12-17 20:44:39,512 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00011.jpg, no features masked.

2019-12-17 20:44:39,652 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00155.jpg, no features masked.

2019-12-17 20:44:40,407 DEBUG: Matching calibrated_0cae8e93088d_FW00119.jpg and calibrated_0cae8e93088d_FW00141.jpg. Matcher: FLANN T-desc: 9.613 T-robust: 0.001 T-total: 9.615 Matches: 121 Robust: 97 Success: True

2019-12-17 20:44:40,552 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00131.jpg, no features masked.

2019-12-17 20:44:42,004 DEBUG: Matching calibrated_0cae8e93088d_FW00085.jpg and calibrated_0cae8e93088d_FW00075.jpg. Matcher: FLANN T-desc: 9.733 T-robust: 0.005 T-total: 9.738 Matches: 1535 Robust: 1516 Success: True

2019-12-17 20:44:42,149 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00084.jpg, no features masked.

2019-12-17 20:44:43,598 DEBUG: Matching calibrated_0cae8e93088d_FW00074.jpg and calibrated_0cae8e93088d_FW00005.jpg. Matcher: FLANN T-desc: 9.233 T-robust: 0.005 T-total: 9.237 Matches: 1302 Robust: 1279 Success: True

2019-12-17 20:44:43,697 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00010.jpg, no features masked.

2019-12-17 20:44:43,748 DEBUG: Matching calibrated_0cae8e93088d_FW00086.jpg and calibrated_0cae8e93088d_FW00088.jpg. Matcher: FLANN T-desc: 9.174 T-robust: 0.015 T-total: 9.190 Matches: 2735 Robust: 2660 Success: True

2019-12-17 20:44:43,844 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00007.jpg, no features masked.

2019-12-17 20:44:44,512 DEBUG: Matching calibrated_0cae8e93088d_FW00128.jpg and calibrated_0cae8e93088d_FW00140.jpg. Matcher: FLANN T-desc: 9.824 T-robust: 0.001 T-total: 9.825 Matches: 75 Robust: 62 Success: True

2019-12-17 20:44:44,516 DEBUG: Matching calibrated_0cae8e93088d_FW00095.jpg and calibrated_0cae8e93088d_FW00004.jpg. Matcher: FLANN T-desc: 9.013 T-robust: 0.035 T-total: 9.048 Matches: 2869 Robust: 2846 Success: True

2019-12-17 20:44:44,686 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00151.jpg, no features masked.

2019-12-17 20:44:44,717 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00094.jpg, no features masked.

2019-12-17 20:44:45,917 DEBUG: Matching calibrated_0cae8e93088d_FW00008.jpg and calibrated_0cae8e93088d_FW00066.jpg. Matcher: FLANN T-desc: 8.094 T-robust: 0.026 T-total: 8.120 Matches: 2005 Robust: 1982 Success: True

2019-12-17 20:44:46,060 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00072.jpg, no features masked.

2019-12-17 20:44:46,366 DEBUG: Matching calibrated_0cae8e93088d_FW00064.jpg and calibrated_0cae8e93088d_FW00066.jpg. Matcher: FLANN T-desc: 9.055 T-robust: 0.026 T-total: 9.081 Matches: 2176 Robust: 2132 Success: True

2019-12-17 20:44:46,615 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00065.jpg, no features masked.

2019-12-17 20:48:59,586 DEBUG: Matching calibrated_0cae8e93088d_FW00076.jpg and calibrated_0cae8e93088d_FW00011.jpg. Matcher: FLANN T-desc: 1.931 T-robust: 0.002 T-total: 1.933 Matches: 814 Robust: 766 Success: True

2019-12-17 20:48:59,593 DEBUG: No segmentation for calibrated_0cae8e93088d_FW00142.jpg, no features masked.

2019-12-17 20:49:01,137 DEBUG: Matching calibrated_0cae8e93088d_FW00076.jpg and calibrated_0cae8e93088d_FW00098.jpg. Matcher: FLANN T-desc: 1.549 T-robust: 0.001 T-total: 1.550 Matches: 353 Robust: 331 Success: True

2019-12-17 20:49:01,137 DEBUG: Image calibrated_0cae8e93088d_FW00076.jpg matches: 3 out of 3

2019-12-17 20:49:01,693 DEBUG: Matching calibrated_0cae8e93088d_FW00120.jpg and calibrated_0cae8e93088d_FW00142.jpg. Matcher: FLANN T-desc: 2.106 T-robust: 0.001 T-total: 2.107 Matches: 250 Robust: 231 Success: True

2019-12-17 20:49:01,693 DEBUG: Image calibrated_0cae8e93088d_FW00120.jpg matches: 3 out of 3

2019-12-17 20:49:01,753 DEBUG: Matched 496 pairs in 366.49555397 seconds.

[INFO] running /code/SuperBuild/src/opensfm/bin/opensfm create_tracks "/code/opensfm"

2019-12-17 20:49:02,502 INFO: reading features

2019-12-17 20:49:04,925 DEBUG: Merging features onto tracks

2019-12-17 20:49:10,776 DEBUG: Good tracks: 194612

[INFO] running /code/SuperBuild/src/opensfm/bin/opensfm reconstruct "/code/opensfm"

2019-12-17 20:49:44,614 INFO: Starting incremental reconstruction

2019-12-17 20:49:57,173 INFO: 0 partial reconstructions in total.

[INFO] Updating /code/opensfm/config.yaml

[INFO] undistorted_image_max_size: 1248

[INFO] running /code/SuperBuild/src/opensfm/bin/opensfm undistort "/code/opensfm"

[INFO] running /code/SuperBuild/src/opensfm/bin/opensfm export_visualsfm --undistorted --points "/code/opensfm"

Traceback (most recent call last):

File "/code/SuperBuild/src/opensfm/bin/opensfm", line 34, in <module>

command.run(args)

File "/code/SuperBuild/src/opensfm/opensfm/commands/export_visualsfm.py", line 30, in run

reconstructions = data.load_undistorted_reconstruction()

File "/code/SuperBuild/src/opensfm/opensfm/dataset.py", line 585, in load_undistorted_reconstruction

filename='undistorted_reconstruction.json')

File "/code/SuperBuild/src/opensfm/opensfm/dataset.py", line 575, in load_reconstruction

with io.open_rt(self._reconstruction_file(filename)) as fin:

File "/code/SuperBuild/src/opensfm/opensfm/io.py", line 555, in open_rt

return io.open(path, 'r', encoding='utf-8')

IOError: [Errno 2] No such file or directory: '/code/opensfm/undistorted_reconstruction.json'

Traceback (most recent call last):

File "/code/run.py", line 57, in <module>

app.execute()

File "/code/stages/odm_app.py", line 92, in execute

self.first_stage.run()

File "/code/opendm/types.py", line 370, in run

self.next_stage.run(outputs)

File "/code/opendm/types.py", line 370, in run

self.next_stage.run(outputs)

File "/code/opendm/types.py", line 370, in run

self.next_stage.run(outputs)

File "/code/opendm/types.py", line 351, in run

self.process(self.args, outputs)

File "/code/stages/run_opensfm.py", line 70, in process

octx.run('export_visualsfm --undistorted --points')

File "/code/opendm/osfm.py", line 21, in run

(context.opensfm_path, command, self.opensfm_project_path))

File "/code/opendm/system.py", line 76, in run

raise Exception("Child returned {}".format(retcode))

Exception: Child returned 1

pierotofy · 17 December 2019 22:29

Mm, I really don’t know in this case. Perhaps it’s the images, but you mentioned it worked in the past, so perhaps the problem is something else. If anybody finds the cause please post it here.

Ivan · 16 April 2021 15:54

Good day to everyone. Please help me with one problem. In the beginning, I need to tell you my PC specifications for a better understanding of the problem, so here are the specifications:

RAM: 64 GB RAM,
Processor: AMD Ryzen 9 3900X, 12 Core, 24 Thread Processor, 4.6 GHz Max Boost, 3.8 GHz Base,
Graphics card: AMD Raden RX 5700 XT, 8 GB GDDR6.

So let’s start. I have recently installed ODM (version: 2.4.10) natively on Ubuntu 20.04.2 LTS by your description steps declared on the web page (GitHub - OpenDroneMap/ODM: A command line toolkit to generate maps, point clouds, 3D models and DEMs from drone, balloon or kite images. 📷). Installation was done great, without any problem during it. After installation, I downloaded the attached sample image dataset (Aukerman) to test if everything is ok with the ODM installation. When I ran ODM natively, all steps were successfully accomplished before step OpenSfM reconstruction. I used all default settings set by default ODM installation during ODM execution, except project path (for project path, I was using a new created folder (project) in the main ODM-master folder). After running and finish the step OpenSfM reconstruction, ODM tells me that “The program could not process this dataset using the current settings. Check that the images have enough overlap, that there are enough recognizable features, and that the images are in focus. You could also try to increase the --min-num-features parameter. The program will now exit.”. I will paste you all report from the terminal of ODM.

I thought that everything would be going great with the attached sample images. But as you can see, it does not. So I had tried to change the setting -min-num-features parameter (-min-num-features parameter: 20000) of the project, but the error still exists. I think that the problem is in OpenSfM because it can’t create file reconstruction.json. But I don’t know.

I am pleased you to help me to fix this problem. Greetings.

Terminal report of ODM:
[INFO] Initializing ODM - pet tra 16 17:03:28 2021
[INFO] ==============
[INFO] build_overviews: False
[INFO] camera_lens: auto
[INFO] cameras: {}
[INFO] crop: 3
[INFO] debug: False
[INFO] dem_decimation: 1
[INFO] dem_euclidean_map: False
[INFO] dem_gapfill_steps: 3
[INFO] dem_resolution: 5
[INFO] depthmap_resolution: 640
[INFO] dsm: False
[INFO] dtm: False
[INFO] end_with: odm_report
[INFO] fast_orthophoto: False
[INFO] feature_quality: high
[INFO] feature_type: sift
[INFO] force_gps: False
[INFO] gcp: None
[INFO] geo: None
[INFO] gps_accuracy: 10
[INFO] ignore_gsd: False
[INFO] matcher_distance: 0
[INFO] matcher_neighbors: 8
[INFO] matcher_type: flann
[INFO] max_concurrency: 24
[INFO] merge: all
[INFO] mesh_octree_depth: 11
[INFO] mesh_size: 200000
[INFO] min_num_features: 8000
[INFO] name: aukerman
[INFO] optimize_disk_space: False
[INFO] orthophoto_compression: DEFLATE
[INFO] orthophoto_cutline: False
[INFO] orthophoto_kmz: False
[INFO] orthophoto_no_tiled: False
[INFO] orthophoto_png: False
[INFO] orthophoto_resolution: 5
[INFO] pc_classify: False
[INFO] pc_csv: False
[INFO] pc_ept: False
[INFO] pc_filter: 2.5
[INFO] pc_las: False
[INFO] pc_quality: medium
[INFO] pc_rectify: False
[INFO] pc_sample: 0
[INFO] pc_tile: False
[INFO] primary_band: auto
[INFO] project_path: /home/pc/Programs/ODM-master/projects
[INFO] radiometric_calibration: none
[INFO] rerun: None
[INFO] rerun_all: False
[INFO] rerun_from: None
[INFO] resize_to: 2048
[INFO] skip_3dmodel: False
[INFO] skip_band_alignment: False
[INFO] skip_report: False
[INFO] sm_cluster: None
[INFO] smrf_scalar: 1.25
[INFO] smrf_slope: 0.15
[INFO] smrf_threshold: 0.5
[INFO] smrf_window: 18.0
[INFO] split: 999999
[INFO] split_image_groups: None
[INFO] split_overlap: 150
[INFO] texturing_data_term: gmi
[INFO] texturing_keep_unseen_faces: False
[INFO] texturing_outlier_removal_type: gauss_clamping
[INFO] texturing_skip_global_seam_leveling: False
[INFO] texturing_skip_local_seam_leveling: False
[INFO] texturing_tone_mapping: none
[INFO] tiles: False
[INFO] time: False
[INFO] use_3dmesh: False
[INFO] use_exif: False
[INFO] use_fixed_camera_params: False
[INFO] use_hybrid_bundle_adjustment: False
[INFO] verbose: False
[INFO] ==============
[INFO] Running dataset stage
[INFO] Loading dataset from: /home/pc/Programs/ODM-master/projects/aukerman/images
[INFO] Loading 77 images
[INFO] Wrote images database: /home/pc/Programs/ODM-master/projects/aukerman/images.json
[INFO] Found 77 usable images
[INFO] Parsing SRS header: WGS84 UTM 17N
[INFO] Finished dataset stage
[INFO] Running split stage
[INFO] Normal dataset, will process all at once.
[INFO] Finished split stage
[INFO] Running merge stage
[INFO] Normal dataset, nothing to merge.
[INFO] Finished merge stage
[INFO] Running opensfm stage
[INFO] Writing exif overrides
[INFO] Maximum photo dimensions: 4896px
[INFO] PyOpenCL is missing (not a GPU build)
[INFO] Altitude data detected, enabling it for GPS alignment
[INFO] [‘use_exif_size: no’, ‘flann_algorithm: KDTREE’, ‘feature_process_size: 2448’, ‘feature_min_frames: 8000’, ‘processes: 24’, ‘matching_gps_neighbors: 8’, ‘matching_gps_distance: 0’, ‘optimize_camera_parameters: yes’, ‘undistorted_image_format: tif’, ‘bundle_outlier_filtering_type: AUTO’, ‘align_orientation_prior: vertical’, ‘triangulation_type: ROBUST’, ‘retriangulation_ratio: 2’, ‘feature_type: SIFT’, ‘use_altitude_tag: yes’, ‘align_method: auto’, ‘local_bundle_radius: 0’]
[INFO] running /home/pc/Programs/ODM-master/SuperBuild/src/opensfm/bin/opensfm extract_metadata “/home/pc/Programs/ODM-master/projects/aukerman/opensfm”
[INFO] running /home/pc/Programs/ODM-master/SuperBuild/src/opensfm/bin/opensfm detect_features “/home/pc/Programs/ODM-master/projects/aukerman/opensfm”
[INFO] running /home/pc/Programs/ODM-master/SuperBuild/src/opensfm/bin/opensfm match_features “/home/pc/Programs/ODM-master/projects/aukerman/opensfm”
[INFO] running /home/pc/Programs/ODM-master/SuperBuild/src/opensfm/bin/opensfm create_tracks “/home/pc/Programs/ODM-master/projects/aukerman/opensfm”
[INFO] running /home/pc/Programs/ODM-master/SuperBuild/src/opensfm/bin/opensfm reconstruct “/home/pc/Programs/ODM-master/projects/aukerman/opensfm”
[ERROR] The program could not process this dataset using the current settings. Check that the images have enough overlap, that there are enough recognizable features and that the images are in focus. You could also try to increase the --min-num-features parameter.The program will now exit.

lacie-life · 6 July 2021 14:34

I have the same issue. Anyone have solution ?