I attempted to process a large dataset and it failed on two occasions, exiting with “cannot process dataset”. The last few lines of the log are:
2021-10-02 05:05:40,927 DEBUG: Matching LPBMuangGowBlk06M2P0933.jpg and LPBMuangGowPousiS1M2P0283.jpg. Matcher: FLANN (symmetric) T-desc: 2.485 T-robust: 0.004 T-total: 2.489 Matches: 93 Robust: 70 Success: True
2021-10-02 05:05:40,929 DEBUG: Matching LPBMuangGowPousiS1M2P0198.jpg and LPBMuangGowBlk08M2P0779.jpg. Matcher: FLANN (symmetric) T-desc: 2.367 T-robust: 0.003 T-total: 2.371 Matches: 978 Robust: 945 Success: True
2021-10-02 05:05:40,988 INFO: Matched 43172 pairs (brown-brown: 43172) in 6759.5914055 seconds (0.1565735061150746 seconds/pair).
[INFO] running D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\bin\opensfm create_tracks “D:\WebODM\resources\app\apps\NodeODM\data\563f5abe-8230-4550-b71f-b0d9f45096fe\opensfm”
2021-10-02 05:07:07,903 INFO: reading features
2021-10-02 05:09:03,178 DEBUG: Merging features onto tracks
2021-10-02 05:14:16,743 DEBUG: Good tracks: 9529735
[INFO] running D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\bin\opensfm reconstruct “D:\WebODM\resources\app\apps\NodeODM\data\563f5abe-8230-4550-b71f-b0d9f45096fe\opensfm”
Traceback (most recent call last):
File “D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\bin\opensfm_main.py”, line 15, in
File “D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\opensfm\commands\command_runner.py”, line 38, in command_runner
File “D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\opensfm\commands\command.py”, line 12, in run
File “D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\opensfm\commands\reconstruct.py”, line 11, in run_impl
File “D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\opensfm\actions\reconstruct.py”, line 8, in run_dataset
tracks_manager = data.load_tracks_manager()
File “D:\WebODM\resources\app\apps\ODM\SuperBuild\install\bin\opensfm\opensfm\dataset.py”, line 719, in load_tracks_manager
ValueError: invalid stoi argument
[ERROR] The program could not process this dataset using the current settings. Check that the images have enough overlap, that there are enough recognizable features and that the images are in focus. You could also try to increase the --min-num-features parameter.The program will now exit.
The first failed run used sift detector and exited at ~53 hours. After looking at the log I changed the detector to hahog and it exited after only 02:39.
All the images in this large 10000+ dataset have been run successfully as subsets 2500, 3000+ with the same parameters or quite similar, so the suggestion that there is something wrong with the images is puzzling. Images are nadir / 85% front and side overlap / elev 60m. I am running winwebodm on an amd 5950x / 128gb ram / 2tb ssd / windows 10.
Options: build-overviews: true, camera-lens: brown, crop: 0, debug: true, dsm: true, dtm: true, feature-quality: ultra, mesh-size: 250000, min-num-features: 10000, orthophoto-kmz: true, orthophoto-png: true, pc-classify: true, pc-csv: true, pc-ept: true, pc-geometric: true, pc-las: true, pc-quality: ultra, pc-rectify: true, use-hybrid-bundle-adjustment: true, verbose: true
I have uploaded the full log and a few images - “No segmentation for LPBMuangGow~.jpg, no features masked.” as well as a couple of orthophotos from successful runs of subsets.
Please let me know your suggestions and what other information you would like to see.