TypeError: unsupported operand type(s) for *: 'NoneType' and 'int'

Nicolas_Cadieux · 4 January 2022 02:21

Hi,
Adding GCPs to a project end with a error. Works without GCP but as a result, the files is not georeferenced. I am open to all suggestions. I am working with 1950’s aerial photographs… I am currently using 2 points per file as a test. Thanks for your help!
This is the log:
“”"
[INFO] Fast orthophoto is turned on, automatically setting --skip-3dmodel
[INFO] Initializing ODM 2.7.0 - Tue Jan 04 00:22:19 2022
[INFO] ==============
[INFO] auto_boundary: True
[INFO] boundary: {}
[INFO] build_overviews: False
[INFO] camera_lens: auto
[INFO] cameras: {}
[INFO] cog: True
[INFO] copy_to: None
[INFO] crop: 0.0
[INFO] debug: False
[INFO] dem_decimation: 1
[INFO] dem_euclidean_map: False
[INFO] dem_gapfill_steps: 3
[INFO] dem_resolution: 5
[INFO] depthmap_resolution: 640
[INFO] dsm: False
[INFO] dtm: False
[INFO] end_with: odm_postprocess
[INFO] fast_orthophoto: True
[INFO] feature_quality: high
[INFO] feature_type: sift
[INFO] force_gps: False
[INFO] gcp: /var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/gcp/gcp_list__jgp.txt
[INFO] geo: None
[INFO] gps_accuracy: 10
[INFO] ignore_gsd: False
[INFO] matcher_neighbors: 8
[INFO] matcher_type: bruteforce
[INFO] max_concurrency: 6
[INFO] merge: all
[INFO] mesh_octree_depth: 11
[INFO] mesh_size: 200000
[INFO] min_num_features: 20000
[INFO] name: 22bd99a0-f87c-4ca5-a8d3-1bd489161fdc
[INFO] optimize_disk_space: False
[INFO] orthophoto_compression: DEFLATE
[INFO] orthophoto_cutline: False
[INFO] orthophoto_kmz: False
[INFO] orthophoto_no_tiled: False
[INFO] orthophoto_png: False
[INFO] orthophoto_resolution: 5
[INFO] pc_classify: False
[INFO] pc_csv: False
[INFO] pc_ept: True
[INFO] pc_filter: 2.5
[INFO] pc_geometric: False
[INFO] pc_las: False
[INFO] pc_quality: medium
[INFO] pc_rectify: False
[INFO] pc_sample: 0
[INFO] pc_tile: False
[INFO] primary_band: auto
[INFO] project_path: /var/www/data
[INFO] radiometric_calibration: none
[INFO] rerun: None
[INFO] rerun_all: False
[INFO] rerun_from: None
[INFO] resize_to: 2048
[INFO] sfm_algorithm: incremental
[INFO] skip_3dmodel: True
[INFO] skip_band_alignment: False
[INFO] skip_orthophoto: False
[INFO] skip_report: False
[INFO] sm_cluster: None
[INFO] smrf_scalar: 1.25
[INFO] smrf_slope: 0.15
[INFO] smrf_threshold: 0.5
[INFO] smrf_window: 18.0
[INFO] split: 999999
[INFO] split_image_groups: None
[INFO] split_overlap: 150
[INFO] texturing_data_term: gmi
[INFO] texturing_keep_unseen_faces: False
[INFO] texturing_outlier_removal_type: gauss_clamping
[INFO] texturing_skip_global_seam_leveling: False
[INFO] texturing_skip_local_seam_leveling: False
[INFO] texturing_tone_mapping: none
[INFO] tiles: False
[INFO] time: False
[INFO] use_3dmesh: False
[INFO] use_exif: False
[INFO] use_fixed_camera_params: False
[INFO] use_hybrid_bundle_adjustment: False
[INFO] verbose: False
[INFO] ==============
[INFO] Running dataset stage
[INFO] Loading dataset from: /var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/images
[INFO] Loading 6 images
[INFO] Found 6 usable images
[INFO] Parsing SRS header: +proj=utm +zone=19 +ellps=GRS80 +units=m +no_defs
[INFO] Parsing SRS header: WGS84 UTM 19N
[INFO] Parsing SRS header: WGS84 UTM 19N
[INFO] 12 GCP points will be used for georeferencing
[INFO] Generated coords file from GCP: WGS84 UTM 19N
[INFO] Wrote /var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/odm_georeferencing/odm_georeferencing_model_geo.txt
[INFO] Parsing SRS header: WGS84 UTM 19N
[INFO] Finished dataset stage
[INFO] Running split stage
[INFO] Normal dataset, will process all at once.
[INFO] Finished split stage
[INFO] Running merge stage
[INFO] Normal dataset, nothing to merge.
[INFO] Finished merge stage
[INFO] Running opensfm stage
[INFO] Maximum photo dimensions: 10725px
[INFO] Photo dimensions for feature extraction: 5362px
[INFO] nvidia-smi not found in PATH, using CPU
[INFO] [‘use_exif_size: no’, ‘flann_algorithm: KDTREE’, ‘feature_process_size: 5362’, ‘feature_min_frames: 20000’, ‘processes: 6’, ‘matching_gps_neighbors: 8’, ‘matching_gps_distance: 0’, ‘matching_graph_rounds: 50’, ‘optimize_camera_parameters: yes’, ‘reconstruction_algorithm: incremental’, ‘undistorted_image_format: tif’, ‘bundle_outlier_filtering_type: AUTO’, ‘sift_peak_threshold: 0.066’, ‘align_orientation_prior: vertical’, ‘triangulation_type: ROBUST’, ‘retriangulation_ratio: 2’, ‘matcher_type: BRUTEFORCE’, ‘feature_type: SIFT’, ‘align_method: auto’, ‘local_bundle_radius: 0’, ‘bundle_use_gcp: yes’, ‘bundle_use_gps: no’]
[INFO] Wrote reference_lla.json
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” detect_features “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
2022-01-04 00:22:21,255 INFO: Capping memory usage to ~ 56665.841796875 MB
2022-01-04 00:22:21,255 INFO: Expecting to process 129 images.
2022-01-04 00:22:21,259 INFO: Reading data for image A12486_060.jpg (queue-size=0
2022-01-04 00:22:21,259 INFO: Reading data for image A12486_061.jpg (queue-size=0
2022-01-04 00:22:21,259 INFO: Reading data for image A12486_063.jpg (queue-size=0
2022-01-04 00:22:23,483 INFO: Reading data for image A12486_062.jpg (queue-size=1
2022-01-04 00:22:23,484 INFO: Extracting ROOT_SIFT features for image A12486_063.jpg
2022-01-04 00:22:23,715 INFO: Reading data for image A12486_065.jpg (queue-size=1
2022-01-04 00:22:23,715 INFO: Extracting ROOT_SIFT features for image A12486_060.jpg
2022-01-04 00:22:23,715 INFO: Reading data for image A12486_064.jpg (queue-size=2
2022-01-04 00:22:23,715 INFO: Extracting ROOT_SIFT features for image A12486_061.jpg
2022-01-04 00:22:24,604 DEBUG: Computing sift with threshold 0.066
2022-01-04 00:22:24,817 DEBUG: Computing sift with threshold 0.066
2022-01-04 00:22:24,861 DEBUG: Computing sift with threshold 0.066
2022-01-04 00:22:26,064 INFO: Extracting ROOT_SIFT features for image A12486_062.jpg
2022-01-04 00:22:26,503 INFO: Finished reading images
2022-01-04 00:22:26,503 INFO: Extracting ROOT_SIFT features for image A12486_065.jpg
2022-01-04 00:22:26,503 INFO: Extracting ROOT_SIFT features for image A12486_064.jpg
2022-01-04 00:22:27,181 DEBUG: Computing sift with threshold 0.066
2022-01-04 00:22:27,619 DEBUG: Computing sift with threshold 0.066
2022-01-04 00:22:27,635 DEBUG: Computing sift with threshold 0.066
2022-01-04 00:22:36,370 DEBUG: Found 5903 points in 11.765353918075562s
2022-01-04 00:22:36,370 DEBUG: reducing threshold
2022-01-04 00:22:36,370 DEBUG: Computing sift with threshold 0.044000000000000004
2022-01-04 00:22:36,950 DEBUG: Found 19752 points in 12.132671594619751s
2022-01-04 00:22:36,951 DEBUG: reducing threshold
2022-01-04 00:22:36,951 DEBUG: Computing sift with threshold 0.044000000000000004
2022-01-04 00:22:38,704 DEBUG: Found 98483 points in 13.842873334884644s
2022-01-04 00:22:38,704 DEBUG: done
2022-01-04 00:22:41,432 DEBUG: Found 11276 points in 13.797051191329956s
2022-01-04 00:22:41,433 DEBUG: reducing threshold
2022-01-04 00:22:41,433 DEBUG: Computing sift with threshold 0.044000000000000004
2022-01-04 00:22:42,394 DEBUG: Found 50716 points in 15.21232795715332s
2022-01-04 00:22:42,394 DEBUG: done
2022-01-04 00:22:42,655 DEBUG: Found 37891 points in 15.035759687423706s
2022-01-04 00:22:42,655 DEBUG: done
2022-01-04 00:22:51,707 DEBUG: Found 46954 points in 15.337414264678955s
2022-01-04 00:22:51,707 DEBUG: done
2022-01-04 00:22:52,744 DEBUG: No segmentation for A12486_065.jpg, no features masked.
2022-01-04 00:22:53,344 DEBUG: No segmentation for A12486_062.jpg, no features masked.
2022-01-04 00:22:53,517 DEBUG: No segmentation for A12486_061.jpg, no features masked.
2022-01-04 00:22:55,277 DEBUG: Found 112712 points in 18.326563119888306s
2022-01-04 00:22:55,277 DEBUG: done
2022-01-04 00:22:57,357 DEBUG: Found 68319 points in 15.924525499343872s
2022-01-04 00:22:57,357 DEBUG: done
2022-01-04 00:23:02,778 DEBUG: No segmentation for A12486_063.jpg, no features masked.
2022-01-04 00:23:07,480 DEBUG: No segmentation for A12486_064.jpg, no features masked.
2022-01-04 00:23:07,494 DEBUG: No segmentation for A12486_060.jpg, no features masked.
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” match_features “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
2022-01-04 00:23:11,572 WARNING: Not all images have GPS info. Disabling matching_gps_neighbors.
2022-01-04 00:23:11,573 INFO: Matching 15 image pairs
2022-01-04 00:23:11,586 INFO: Computing pair matching with 6 processes
2022-01-04 00:23:11,930 DEBUG: No segmentation for A12486_063.jpg, no features masked.
2022-01-04 00:23:12,073 DEBUG: No segmentation for A12486_064.jpg, no features masked.
2022-01-04 00:23:12,205 DEBUG: No segmentation for A12486_065.jpg, no features masked.
2022-01-04 00:23:12,254 DEBUG: No segmentation for A12486_061.jpg, no features masked.
2022-01-04 00:23:12,332 DEBUG: No segmentation for A12486_060.jpg, no features masked.
2022-01-04 00:23:12,395 DEBUG: No segmentation for A12486_062.jpg, no features masked.
2022-01-04 00:27:44,106 DEBUG: Matching A12486_063.jpg and A12486_065.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 272.535 T-robust: 0.021 T-total: 272.556 Matches: 46 Robust: 17 Success: False
2022-01-04 00:31:19,543 DEBUG: Matching A12486_063.jpg and A12486_064.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 487.993 T-robust: 0.001 T-total: 487.995 Matches: 292 Robust: 247 Success: True
2022-01-04 00:31:59,355 DEBUG: Matching A12486_064.jpg and A12486_062.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 527.787 T-robust: 0.018 T-total: 527.806 Matches: 51 Robust: 15 Success: False
2022-01-04 00:32:35,757 DEBUG: Matching A12486_061.jpg and A12486_065.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 564.192 T-robust: 0.014 T-total: 564.207 Matches: 50 Robust: 14 Success: False
2022-01-04 00:33:42,359 DEBUG: Matching A12486_063.jpg and A12486_062.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 358.252 T-robust: 0.001 T-total: 358.253 Matches: 168 Robust: 135 Success: True
2022-01-04 00:34:56,035 DEBUG: Matching A12486_063.jpg and A12486_061.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 704.463 T-robust: 0.022 T-total: 704.486 Matches: 46 Robust: 10 Success: False
2022-01-04 00:36:32,979 DEBUG: Matching A12486_060.jpg and A12486_063.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 801.413 T-robust: 0.016 T-total: 801.429 Matches: 36 Robust: 9 Success: False
2022-01-04 00:37:47,034 DEBUG: Matching A12486_064.jpg and A12486_065.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 387.489 T-robust: 0.001 T-total: 387.491 Matches: 239 Robust: 198 Success: True
2022-01-04 00:38:31,565 DEBUG: Matching A12486_065.jpg and A12486_062.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 289.190 T-robust: 0.015 T-total: 289.205 Matches: 35 Robust: 15 Success: False
2022-01-04 00:47:08,087 DEBUG: Matching A12486_060.jpg and A12486_065.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 635.094 T-robust: 0.014 T-total: 635.107 Matches: 34 Robust: 14 Success: False
2022-01-04 00:47:20,529 DEBUG: Matching A12486_061.jpg and A12486_062.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 744.491 T-robust: 0.002 T-total: 744.493 Matches: 114 Robust: 78 Success: True
2022-01-04 00:50:54,819 DEBUG: Matching A12486_060.jpg and A12486_064.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 1099.047 T-robust: 0.014 T-total: 1099.061 Matches: 43 Robust: 13 Success: False
2022-01-04 00:51:03,566 DEBUG: Matching A12486_060.jpg and A12486_062.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 796.517 T-robust: 0.013 T-total: 796.531 Matches: 46 Robust: 12 Success: False
2022-01-04 00:53:12,357 DEBUG: Matching A12486_064.jpg and A12486_061.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 880.779 T-robust: 0.012 T-total: 880.792 Matches: 40 Robust: 16 Success: False
2022-01-04 00:55:38,769 DEBUG: Matching A12486_060.jpg and A12486_061.jpg. Matcher: BRUTEFORCE (symmetric) T-desc: 1419.411 T-robust: 0.001 T-total: 1419.413 Matches: 426 Robust: 377 Success: True
2022-01-04 00:55:38,771 INFO: Matched 15 pairs (brown-brown: 15) in 1947.2422195000017 seconds (129.816148 seconds/pair).
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” create_tracks “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
2022-01-04 00:55:39,784 INFO: reading features
2022-01-04 00:55:41,009 DEBUG: Merging features onto tracks
2022-01-04 00:55:41,014 DEBUG: Good tracks: 1011
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” reconstruct “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
2022-01-04 00:55:41,952 INFO: Starting incremental reconstruction
2022-01-04 00:55:41,968 INFO: Starting reconstruction with A12486_060.jpg and A12486_061.jpg
2022-01-04 00:55:41,980 INFO: Two-view 5-points reconstruction inliers (transposed=False): 375 / 377
2022-01-04 00:55:42,006 INFO: Triangulated: 375
2022-01-04 00:55:42,082 DEBUG: Ceres Solver Report: Iterations: 21, Initial cost: 6.608108e+01, Final cost: 2.089331e+01, Termination: CONVERGENCE
2022-01-04 00:55:42,086 INFO: Removed outliers: 0
2022-01-04 00:55:42,089 INFO: -------------------------------------------------------
2022-01-04 00:55:42,091 INFO: Some images can not be added
2022-01-04 00:55:42,091 INFO: -------------------------------------------------------
trust_region_minimizer.cc:733 Step failed to evaluate. Treating it as a step with infinite cost
trust_region_minimizer.cc:733 Step failed to evaluate. Treating it as a step with infinite cost
trust_region_minimizer.cc:733 Step failed to evaluate. Treating it as a step with infinite cost
2022-01-04 00:55:42,199 DEBUG: Ceres Solver Report: Iterations: 101, Initial cost: 5.621135e+17, Final cost: 1.853582e+06, Termination: NO_CONVERGENCE
2022-01-04 00:55:42,203 INFO: Removed outliers: 23
2022-01-04 00:55:42,206 INFO: Starting reconstruction with A12486_064.jpg and A12486_065.jpg
2022-01-04 00:55:42,210 INFO: Two-view 5-points reconstruction inliers (transposed=False): 196 / 198
2022-01-04 00:55:42,229 INFO: Triangulated: 196
2022-01-04 00:55:42,267 DEBUG: Ceres Solver Report: Iterations: 15, Initial cost: 2.612376e+01, Final cost: 1.727630e+01, Termination: CONVERGENCE
2022-01-04 00:55:42,270 INFO: Removed outliers: 4
2022-01-04 00:55:42,271 INFO: -------------------------------------------------------
2022-01-04 00:55:42,278 INFO: A12486_063.jpg resection inliers: 10 / 10
2022-01-04 00:55:42,279 INFO: Adding A12486_063.jpg to the reconstruction
2022-01-04 00:55:42,292 INFO: Re-triangulating
2022-01-04 00:55:42,303 DEBUG: Ceres Solver Report: Iterations: 5, Initial cost: 3.451843e+01, Final cost: 2.611642e+01, Termination: CONVERGENCE
2022-01-04 00:55:42,360 DEBUG: Ceres Solver Report: Iterations: 4, Initial cost: 2.733238e+01, Final cost: 2.614523e+01, Termination: CONVERGENCE
2022-01-04 00:55:42,364 INFO: Removed outliers: 12
2022-01-04 00:55:42,365 INFO: -------------------------------------------------------
2022-01-04 00:55:42,365 INFO: Some images can not be added
2022-01-04 00:55:42,365 INFO: -------------------------------------------------------
trust_region_minimizer.cc:733 Step failed to evaluate. Treating it as a step with infinite cost
trust_region_minimizer.cc:733 Step failed to evaluate. Treating it as a step with infinite cost
trust_region_minimizer.cc:733 Step failed to evaluate. Treating it as a step with infinite cost
2022-01-04 00:55:42,454 DEBUG: Ceres Solver Report: Iterations: 76, Initial cost: 4.374889e+24, Final cost: 1.182319e+10, Termination: CONVERGENCE
2022-01-04 00:55:42,459 INFO: Removed outliers: 13
2022-01-04 00:55:42,462 INFO: Reconstruction 0: 3 images, 409 points
2022-01-04 00:55:42,462 INFO: Reconstruction 1: 2 images, 362 points
2022-01-04 00:55:42,462 INFO: 2 partial reconstructions in total.
[INFO] Export reconstruction stats
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” compute_statistics --diagram_max_points 100000 “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
/code/SuperBuild/install/bin/opensfm/opensfm/stats.py:1117: RuntimeWarning: invalid value encountered in true_divide
res_colors /= highest - lowest
2022-01-04 00:55:45,029 DEBUG: locator: <matplotlib.colorbar._ColorbarAutoLocator object at 0x7f9cb662e8b0>
2022-01-04 00:55:45,029 DEBUG: Using auto colorbar locator <matplotlib.colorbar._ColorbarAutoLocator object at 0x7f9cb662e8b0> on colorbar
2022-01-04 00:55:45,029 DEBUG: Setting pcolormesh
<array_function internals>:5: UserWarning: Warning: converting a masked element to nan.
/usr/local/lib/python3.9/dist-packages/matplotlib/colors.py:1019: UserWarning: Warning: converting a masked element to nan.
data = np.asarray(value)
2022-01-04 00:55:45,557 DEBUG: locator: <matplotlib.colorbar._ColorbarAutoLocator object at 0x7f9cb66b9ca0>
2022-01-04 00:55:45,558 DEBUG: Using auto colorbar locator <matplotlib.colorbar._ColorbarAutoLocator object at 0x7f9cb66b9ca0> on colorbar
2022-01-04 00:55:45,558 DEBUG: Setting pcolormesh
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” export_geocoords --reconstruction --proj “+proj=utm +zone=19 +datum=WGS84 +units=m +no_defs +type=crs” --offset-x 480445.0 --offset-y 5447584.0 “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
[INFO] Updating /var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm/config.yaml
[INFO] undistorted_image_max_size: 10725
[INFO] Undistorting /var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm …
2022-01-04 00:55:49,241 DEBUG: Undistorting image A12486_063.jpg
2022-01-04 00:55:49,241 DEBUG: Undistorting image A12486_065.jpg
2022-01-04 00:55:49,242 DEBUG: Undistorting image A12486_064.jpg
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” export_visualsfm --points “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
/usr/local/lib/python3.9/dist-packages/PIL/Image.py:2834: DecompressionBombWarning: Image size (114489375 pixels) exceeds limit of 89478485 pixels, could be decompression bomb DOS attack.
warnings.warn(
[INFO] running “/code/SuperBuild/install/bin/opensfm/bin/opensfm” export_ply --no-cameras --point-num-views “/var/www/data/22bd99a0-f87c-4ca5-a8d3-1bd489161fdc/opensfm”
[INFO] Finished opensfm stage
[INFO] Running odm_filterpoints stage
Traceback (most recent call last):
File “/code/run.py”, line 60, in
retcode = app.execute()
File “/code/stages/odm_app.py”, line 130, in execute
raise e
File “/code/stages/odm_app.py”, line 94, in execute
self.first_stage.run()
File “/code/opendm/types.py”, line 346, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 346, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 346, in run
self.next_stage.run(outputs)
[Previous line repeated 1 more time]
File “/code/opendm/types.py”, line 327, in run
self.process(self.args, outputs)
File “/code/stages/odm_filterpoints.py”, line 31, in process
outputs[‘boundary’] = compute_boundary_from_shots(tree.opensfm_reconstruction, avg_gsd * 20, reconstruction.get_proj_offset()) # 20 is arbitrary
TypeError: unsupported operand type(s) for *: ‘NoneType’ and ‘int’

Saijin_Naib · 4 January 2022 03:54

I think it might be failing to make a valid boundary. Could you try re-running without --auto-boundary for now?

Nicolas_Cadieux · 7 January 2022 15:28

Hi,
This seems to help with some of the data sets.
Thanks!
Nicolas

system · 6 February 2022 15:29

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.