Hello community,
unfortunately my calculation via Lightning does not work even after the third attempt. I’m no longer able to help myself. Are there any currently known issues?
The following error was delivered this time:
Output could not be retrieved: HTTPSConnectionPool(host=‘spark1.webodm.net’, port=443): Read timed out. (read timeout=5)
Best regards
The error before:
[ERROR] Whoops! You ran out of memory! Add more RAM to your computer, if you’re using docker configure it to use more memory, for WSL2 make use of .wslconfig (Configure Linux distributions | Microsoft Docs), resize your images, lower the quality settings or process the images using a cloud provider (e.g. https://webodm.net).
Welcome!
Sorry you’re having trouble.
Are you able to share the dataset and your processing parameters so that we can help troubleshoot what’s going on?
Launching… please wait! This can take up to 5 minutes.
[INFO] ==============
[INFO] auto_boundary: False
[INFO] boundary: {}
[INFO] build_overviews: False
[INFO] camera_lens: auto
[INFO] cameras: {}
[INFO] cog: True
[INFO] copy_to: None
[INFO] crop: 3
[INFO] debug: False
[INFO] dem_decimation: 1
[INFO] dem_euclidean_map: False
[INFO] dem_gapfill_steps: 3
[INFO] dem_resolution: 2.0
[INFO] depthmap_resolution: 640
[INFO] dsm: True
[INFO] dtm: True
[INFO] end_with: odm_postprocess
[INFO] fast_orthophoto: False
[INFO] feature_quality: high
[INFO] feature_type: sift
[INFO] force_gps: True
[INFO] gcp: /var/www/data/4101cf7c-0b07-484a-a882-166a32e5fcf2/gcp/GCP_Tonfeld_Ost.txt
[INFO] geo: None
[INFO] gps_accuracy: 10
[INFO] ignore_gsd: False
[INFO] matcher_distance: 0
[INFO] matcher_neighbors: 8
[INFO] matcher_type: flann
[INFO] max_concurrency: 16
[INFO] merge: all
[INFO] mesh_octree_depth: 11
[INFO] mesh_size: 300000
[INFO] min_num_features: 8000
[INFO] name: 4101cf7c-0b07-484a-a882-166a32e5fcf2
[INFO] optimize_disk_space: True
[INFO] orthophoto_compression: NONE
[INFO] orthophoto_cutline: False
[INFO] orthophoto_kmz: False
[INFO] orthophoto_no_tiled: False
[INFO] orthophoto_png: False
[INFO] orthophoto_resolution: 2.0
[INFO] pc_classify: True
[INFO] pc_csv: False
[INFO] pc_ept: True
[INFO] pc_filter: 2.5
[INFO] pc_geometric: True
[INFO] pc_las: False
[INFO] pc_quality: high
[INFO] pc_rectify: False
[INFO] pc_sample: 0.01
[INFO] pc_tile: False
[INFO] primary_band: auto
[INFO] project_path: /var/www/data
[INFO] radiometric_calibration: none
[INFO] rerun: None
[INFO] rerun_all: False
[INFO] rerun_from: None
[INFO] resize_to: 2048
[INFO] skip_3dmodel: False
[INFO] skip_band_alignment: False
[INFO] skip_report: False
[INFO] sm_cluster: None
[INFO] smrf_scalar: 1.25
[INFO] smrf_slope: 0.15
[INFO] smrf_threshold: 0.5
[INFO] smrf_window: 18.0
[INFO] split: 999999
[INFO] split_image_groups: None
[INFO] split_overlap: 150
[INFO] texturing_data_term: gmi
[INFO] texturing_keep_unseen_faces: False
[INFO] texturing_outlier_removal_type: gauss_clamping
[INFO] texturing_skip_global_seam_leveling: False
[INFO] texturing_skip_local_seam_leveling: False
[INFO] texturing_tone_mapping: none
[INFO] tiles: False
[INFO] time: False
[INFO] use_3dmesh: False
[INFO] use_exif: False
[INFO] use_fixed_camera_params: False
[INFO] use_hybrid_bundle_adjustment: False
[INFO] verbose: False
[INFO] ==============
[INFO] Running dataset stage
[INFO] Loading dataset from: /var/www/data/4101cf7c-0b07-484a-a882-166a32e5fcf2/images
[INFO] Loading 836 images
[INFO] Wrote images database: /var/www/data/4101cf7c-0b07-484a-a882-166a32e5fcf2/images.json
[INFO] Found 836 usable images
[INFO] Parsing SRS header: EPSG:4326
[INFO] Parsing SRS header: WGS84 UTM 33N
[INFO] Parsing SRS header: WGS84 UTM 33N
[INFO] 31 GCP points will be used for georeferencing
[INFO] Generated coords file from GCP: WGS84 UTM 33N
[INFO] Wrote /var/www/data/4101cf7c-0b07-484a-a882-166a32e5fcf2/odm_georeferencing/odm_georeferencing_model_geo.txt
[INFO] Parsing SRS header: WGS84 UTM 33N
[INFO] Finished dataset stage
[INFO] Running split stage
[INFO] Normal dataset, will process all at once.
[INFO] Finished split stage
[INFO] Running merge stage
[INFO] Normal dataset, nothing to merge.
[INFO] Finished merge stage
[INFO] Running opensfm stage
[INFO] Writing exif overrides
[INFO] Maximum photo dimensions: 5184px
[INFO] Photo dimensions for feature extraction: 2592px
[INFO] Altitude data detected, enabling it for GPS alignment
[INFO] [‘use_exif_size: no’, ‘flann_algorithm: KDTREE’, ‘feature_process_size: 2592’, ‘feature_min_frames: 8000’, ‘processes: 16’, ‘matching_gps_neighbors: 8’, ‘matching_gps_distance: 0’, ‘optimize_camera_parameters: yes’, ‘undistorted_image_format: tif’, ‘bundle_outlier_filtering_type: AUTO’, ‘sift_peak_threshold: 0.066’, ‘align_orientation_prior: vertical’, ‘triangulation_type: ROBUST’, ‘retriangulation_ratio: 2’, ‘feature_type: SIFT’, ‘use_altitude_tag: yes’, ‘align_method: auto’, ‘local_bundle_radius: 0’, ‘bundle_use_gcp: yes’]
Mm, try passing pc-tile; it will reduce memory usage. Strange that it’s failing though. I will investigate.
–auto-boundary to true has helped some datasets that have failed in similar manners on Lightning to process, so that might also be worth passing.
Hello community, I’ve done my calculation (auto boundary and pc tile true). Unfortunately I now have huge black tiles in my point cloud. how can that be? My pictures flew in with 80 80.
These problems with Webodm are very annoying as each recalculation costs me money.
I’m sorry you’re not getting the results you need.
Can you attach a screenshot?
If you’re worried about wasting credits, consider an unlimited plan. I’ve refunded you the credits for the task in the meanwhile.
Sometimes, the --pc-tile can introduce a bit of a seam into the point cloud, but it in general tends to not be terribly noticeable (if at all) in final products like the DSM.
Thank you for the refund. Below you will find the screenshots and parameters.
Launching… please wait! This can take up to 5 minutes.
[INFO] ==============
[INFO] auto_boundary: True
[INFO] boundary: {}
[INFO] build_overviews: False
[INFO] camera_lens: auto
[INFO] cameras: {}
[INFO] cog: True
[INFO] copy_to: None
[INFO] crop: 3
[INFO] debug: False
[INFO] dem_decimation: 1
[INFO] dem_euclidean_map: False
[INFO] dem_gapfill_steps: 3
[INFO] dem_resolution: 2.0
[INFO] depthmap_resolution: 640
[INFO] dsm: True
[INFO] dtm: True
[INFO] end_with: odm_postprocess
[INFO] fast_orthophoto: False
[INFO] feature_quality: high
[INFO] feature_type: sift
[INFO] force_gps: True
[INFO] gcp: /var/www/data/997ee1b6-7118-4f9b-8a30-496bb2b76c09/gcp/GCP_Tonfeld_Ost.txt
[INFO] geo: None
[INFO] gps_accuracy: 10
[INFO] ignore_gsd: False
[INFO] matcher_distance: 0
[INFO] matcher_neighbors: 8
[INFO] matcher_type: flann
[INFO] max_concurrency: 16
[INFO] merge: all
[INFO] mesh_octree_depth: 11
[INFO] mesh_size: 300000
[INFO] min_num_features: 8000
[INFO] name: 997ee1b6-7118-4f9b-8a30-496bb2b76c09
[INFO] optimize_disk_space: True
[INFO] orthophoto_compression: DEFLATE
[INFO] orthophoto_cutline: False
[INFO] orthophoto_kmz: False
[INFO] orthophoto_no_tiled: False
[INFO] orthophoto_png: False
[INFO] orthophoto_resolution: 2.0
[INFO] pc_classify: True
[INFO] pc_csv: False
[INFO] pc_ept: True
[INFO] pc_filter: 2.5
[INFO] pc_geometric: False
[INFO] pc_las: False
[INFO] pc_quality: high
[INFO] pc_rectify: False
[INFO] pc_sample: 0.01
[INFO] pc_tile: True
[INFO] primary_band: auto
[INFO] project_path: /var/www/data
[INFO] radiometric_calibration: none
[INFO] rerun: None
[INFO] rerun_all: False
[INFO] rerun_from: None
[INFO] resize_to: 2048
[INFO] skip_3dmodel: False
[INFO] skip_band_alignment: False
[INFO] skip_report: False
[INFO] sm_cluster: None
[INFO] smrf_scalar: 1.25
[INFO] smrf_slope: 0.15
[INFO] smrf_threshold: 0.5
[INFO] smrf_window: 18.0
[INFO] split: 999999
[INFO] split_image_groups: None
[INFO] split_overlap: 150
[INFO] texturing_data_term: gmi
[INFO] texturing_keep_unseen_faces: False
[INFO] texturing_outlier_removal_type: gauss_clamping
[INFO] texturing_skip_global_seam_leveling: False
[INFO] texturing_skip_local_seam_leveling: False
[INFO] texturing_tone_mapping: none
[INFO] tiles: False
[INFO] time: False
[INFO] use_3dmesh: False
[INFO] use_exif: False
[INFO] use_fixed_camera_params: False
[INFO] use_hybrid_bundle_adjustment: False
[INFO] verbose: False
[INFO] ==============
[INFO] Running dataset stage
[INFO] Loading dataset from: /var/www/data/997ee1b6-7118-4f9b-8a30-496bb2b76c09/images
[INFO] Loading 874 images
[INFO] Wrote images database: /var/www/data/997ee1b6-7118-4f9b-8a30-496bb2b76c09/images.json
[INFO] Found 874 usable images
[INFO] Parsing SRS header: EPSG:4326
[INFO] Parsing SRS header: WGS84 UTM 33N
[INFO] Parsing SRS header: WGS84 UTM 33N
[INFO] 31 GCP points will be used for georeferencing
[INFO] Generated coords file from GCP: WGS84 UTM 33N
[INFO] Wrote /var/www/data/997ee1b6-7118-4f9b-8a30-496bb2b76c09/odm_georeferencing/odm_georeferencing_model_geo.txt
[INFO] Parsing SRS header: WGS84 UTM 33N
[INFO] Finished dataset stage
[INFO] Running split stage
[INFO] Normal dataset, will process all at once.
[INFO] Finished split stage
[INFO] Running merge stage
[INFO] Normal dataset, nothing to merge.
[INFO] Finished merge stage
[INFO] Running opensfm stage
[INFO] Writing exif overrides
[INFO] Maximum photo dimensions: 5184px
[INFO] Photo dimensions for feature extraction: 2592px
[INFO] Altitude data detected, enabling it for GPS alignment
[INFO] [‘use_exif_size: no’, ‘flann_algorithm: KDTREE’, ‘feature_process_size: 2592’, ‘feature_min_frames: 8000’, ‘processes: 16’, ‘matching_gps_neighbors: 8’, ‘matching_gps_distance: 0’, ‘optimize_camera_parameters: yes’, ‘undistorted_image_format: tif’, ‘bundle_outlier_filtering_type: AUTO’, ‘sift_peak_threshold: 0.066’, ‘align_orientation_prior: vertical’, ‘triangulation_type: ROBUST’, ‘retriangulation_ratio: 2’, ‘feature_type: SIFT’, ‘use_altitude_tag: yes’, ‘align_method: auto’, ‘local_bundle_radius: 0’, ‘bundle_use_gcp: yes’]
[INFO] Wrote reference_lla.json
Thanks for the parameters. Maybe try raising --min-num-features a bit, --crop 0, and maybe remove --pc-tile?
You can also send me the dataset and I can try processing for you to determine if I can help solve the gaps in the middle of the stockpile there.
okay, where should i upload the pictures and gcp files?
Can you open this link and download the data?
