OOM problems when processing very large dataset

Hi,

I have had so many issues with WebODM and am very much hoping to actually have it work reliably so I can trust it to do the job.

Last year the problem was the antivirus real-time scan which was resolved, but this time I have no idea what the issue is. If the node-odm-1 node isn’t somehow randomly going offline, it’s the program not beginning processing (for DAYS) or some other bug. I uninstalled and deleted the program and folder and downloaded a fresh setup file from my purchase receipt email and re-installed it.

Now, all I get is it only getting through about 10% of processing and getting stuck, again, for DAYS with the spinning cog just doing its thing on the progress bar but nothing else happening. The only parameters I have changed are the instruction to split the dataset for ease of processing.

I’ve been at this for weeks now and time is running out for a government presentation I’m making (no I’m not currently a professional drone pilot or data analyst) so I can’t waste yet more time on it.

There are 32GB of images which is way more than I can fit in Dropbox or on an online folder I have access to.

Please can someone help? I have included a heap of information below if it helps.

Cheers

The entire task output:

… output truncated at undefined lines …
2022-06-26 13:39:02,464 DEBUG: No segmentation for Narlu_2022_ortho_1566.JPG, no features masked.
2022-06-26 13:40:41,216 DEBUG: Matching Narlu_2022_ortho_1382.JPG and Narlu_2022_ortho_1383.JPG. Matcher: FLANN (symmetric) T-desc: 329.473 T-robust: 0.274 T-total: 329.749 Matches: 1337 Robust: 1124 Success: True
2022-06-26 16:32:24,846 DEBUG: Matching Narlu_2022_ortho_498.JPG and Narlu_2022_ortho_459.JPG. Matcher: FLANN (symmetric) T-desc: 191.011 T-robust: 3.021 T-total: 194.034 Matches: 1005 Robust: 803 Success: True
2022-06-26 16:32:55,018 DEBUG: No segmentation for Narlu_2022_ortho_203.JPG, no features masked.
2022-06-26 16:33:04,470 DEBUG: Matching Narlu_2022_ortho_181.JPG and Narlu_2022_ortho_182.JPG. Matcher: FLANN (symmetric) T-desc: 235.245 T-robust: 0.239 T-total: 235.500 Matches: 14761 Robust: 14607 Success: True
2022-06-26 16:33:13,356 DEBUG: No segmentation for Narlu_2022_ortho_778.JPG, no features masked.
2022-06-26 16:33:13,742 DEBUG: Matching Narlu_2022_ortho_171.JPG and Narlu_2022_ortho_1245.JPG. Matcher: FLANN (symmetric) T-desc: 3996.840 T-robust: 18.891 T-total: 4015.845 Matches: 220 Robust: 13 Success: False
2022-06-26 16:34:27,343 DEBUG: No segmentation for Narlu_2022_ortho_1237.JPG, no features masked.
2022-06-26 16:34:45,208 DEBUG: No segmentation for Narlu_2022_ortho_438.JPG, no features masked.
2022-06-26 16:34:59,399 DEBUG: No segmentation for Narlu_2022_ortho_037.JPG, no features masked.
2022-06-26 16:36:58,527 DEBUG: Matching Narlu_2022_ortho_445.JPG and Narlu_2022_ortho_037.JPG. Matcher: FLANN (symmetric) T-desc: 273.093 T-robust: 0.043 T-total: 273.222 Matches: 582 Robust: 368 Success: True
2022-06-26 16:36:58,766 DEBUG: Matching Narlu_2022_ortho_203.JPG and Narlu_2022_ortho_1237.JPG. Matcher: FLANN (symmetric) T-desc: 312.425 T-robust: 0.153 T-total: 312.877 Matches: 199 Robust: 17 Success: False
2022-06-26 16:37:20,206 DEBUG: Matching Narlu_2022_ortho_002.JPG and Narlu_2022_ortho_438.JPG. Matcher: FLANN (symmetric) T-desc: 168.583 T-robust: 14.075 T-total: 182.865 Matches: 264 Robust: 14 Success: False
2022-06-26 16:37:20,207 DEBUG: Matching Narlu_2022_ortho_894.JPG and Narlu_2022_ortho_1541.JPG. Matcher: FLANN (symmetric) T-desc: 332.809 T-robust: 0.446 T-total: 333.257 Matches: 196 Robust: 12 Success: False
2022-06-26 16:37:20,358 DEBUG: Matching Narlu_2022_ortho_328.JPG and Narlu_2022_ortho_778.JPG. Matcher: FLANN (symmetric) T-desc: 347.796 T-robust: 0.419 T-total: 348.217 Matches: 970 Robust: 741 Success: True
2022-06-26 16:37:37,992 DEBUG: No segmentation for Narlu_2022_ortho_1098.JPG, no features masked.
2022-06-26 16:38:13,962 DEBUG: No segmentation for Narlu_2022_ortho_333.JPG, no features masked.
2022-06-26 16:38:18,819 DEBUG: Matching Narlu_2022_ortho_278.JPG and Narlu_2022_ortho_123.JPG. Matcher: FLANN (symmetric) T-desc: 313.738 T-robust: 0.321 T-total: 314.060 Matches: 241 Robust: 14 Success: False
2022-06-26 16:38:26,802 DEBUG: No segmentation for Narlu_2022_ortho_501.JPG, no features masked.
2022-06-26 16:38:34,590 DEBUG: No segmentation for Narlu_2022_ortho_335.JPG, no features masked.
2022-06-26 16:38:43,390 DEBUG: No segmentation for Narlu_2022_ortho_1414.JPG, no features masked.
2022-06-26 16:40:16,652 DEBUG: Matching Narlu_2022_ortho_1620.JPG and Narlu_2022_ortho_1666.JPG. Matcher: FLANN (symmetric) T-desc: 198.048 T-robust: 0.022 T-total: 198.070 Matches: 277 Robust: 71 Success: True
2022-06-26 16:41:56,849 DEBUG: Matching Narlu_2022_ortho_1673.JPG and Narlu_2022_ortho_1672.JPG. Matcher: FLANN (symmetric) T-desc: 276.465 T-robust: 0.014 T-total: 276.486 Matches: 3970 Robust: 3814 Success: True
2022-06-26 16:41:57,891 DEBUG: Matching Narlu_2022_ortho_1728.JPG and Narlu_2022_ortho_1693.JPG. Matcher: FLANN (symmetric) T-desc: 995.265 T-robust: 1.056 T-total: 996.323 Matches: 1095 Robust: 935 Success: True
2022-06-26 16:41:58,121 DEBUG: Matching Narlu_2022_ortho_1279.JPG and Narlu_2022_ortho_138.JPG. Matcher: FLANN (symmetric) T-desc: 610.036 T-robust: 1.283 T-total: 611.633 Matches: 211 Robust: 38 Success: True
2022-06-26 16:42:02,514 DEBUG: No segmentation for Narlu_2022_ortho_400.JPG, no features masked.
2022-06-26 16:42:06,478 DEBUG: Matching Narlu_2022_ortho_333.JPG and Narlu_2022_ortho_335.JPG. Matcher: FLANN (symmetric) T-desc: 286.118 T-robust: 0.003 T-total: 286.124 Matches: 1401 Robust: 1200 Success: True
2022-06-26 16:42:11,111 DEBUG: Matching Narlu_2022_ortho_501.JPG and Narlu_2022_ortho_499.JPG. Matcher: FLANN (symmetric) T-desc: 290.751 T-robust: 0.003 T-total: 290.756 Matches: 1175 Robust: 961 Success: True
2022-06-26 16:42:14,367 DEBUG: Matching Narlu_2022_ortho_1414.JPG and Narlu_2022_ortho_1319.JPG. Matcher: FLANN (symmetric) T-desc: 234.624 T-robust: 0.315 T-total: 234.942 Matches: 3075 Robust: 2886 Success: True
2022-06-26 16:42:36,736 DEBUG: No segmentation for Narlu_2022_ortho_1344.JPG, no features masked.
2022-06-26 16:44:34,706 DEBUG: No segmentation for Narlu_2022_ortho_130.JPG, no features masked.
2022-06-26 16:45:01,351 DEBUG: No segmentation for Narlu_2022_ortho_923.JPG, no features masked.
2022-06-26 16:48:03,005 DEBUG: Matching Narlu_2022_ortho_1271.JPG and Narlu_2022_ortho_1275.JPG. Matcher: FLANN (symmetric) T-desc: 364.551 T-robust: 0.149 T-total: 364.700 Matches: 154 Robust: 12 Success: False
2022-06-26 16:48:03,278 DEBUG: Matching Narlu_2022_ortho_898.JPG and Narlu_2022_ortho_080.JPG. Matcher: FLANN (symmetric) T-desc: 365.200 T-robust: 0.025 T-total: 365.227 Matches: 324 Robust: 128 Success: True
2022-06-26 16:48:16,736 DEBUG: Matching Narlu_2022_ortho_1344.JPG and Narlu_2022_ortho_130.JPG. Matcher: FLANN (symmetric) T-desc: 378.862 T-robust: 0.773 T-total: 379.831 Matches: 189 Robust: 14 Success: False
2022-06-26 16:48:17,648 DEBUG: Matching Narlu_2022_ortho_269.JPG and Narlu_2022_ortho_068.JPG. Matcher: FLANN (symmetric) T-desc: 364.816 T-robust: 0.510 T-total: 365.729 Matches: 534 Robust: 325 Success: True
2022-06-26 16:48:20,020 DEBUG: Matching Narlu_2022_ortho_841.JPG and Narlu_2022_ortho_881.JPG. Matcher: FLANN (symmetric) T-desc: 364.371 T-robust: 0.003 T-total: 364.377 Matches: 1373 Robust: 1174 Success: True
2022-06-26 16:48:22,605 DEBUG: Matching Narlu_2022_ortho_924.JPG and Narlu_2022_ortho_923.JPG. Matcher: FLANN (symmetric) T-desc: 375.063 T-robust: 0.004 T-total: 375.068 Matches: 364 Robust: 240 Success: True
2022-06-26 16:48:52,106 DEBUG: No segmentation for Narlu_2022_ortho_223.JPG, no features masked.
2022-06-26 16:48:54,644 DEBUG: No segmentation for Narlu_2022_ortho_716.JPG, no features masked.
2022-06-26 16:50:24,768 DEBUG: No segmentation for Narlu_2022_ortho_1827.JPG, no features masked.
2022-06-26 16:50:29,135 DEBUG: Matching Narlu_2022_ortho_1341.JPG and Narlu_2022_ortho_130.JPG. Matcher: FLANN (symmetric) T-desc: 126.432 T-robust: 0.019 T-total: 126.452 Matches: 201 Robust: 13 Success: False
2022-06-26 16:51:17,468 DEBUG: No segmentation for Narlu_2022_ortho_127.JPG, no features masked.
2022-06-26 16:51:19,760 DEBUG: No segmentation for Narlu_2022_ortho_657.JPG, no features masked.
2022-06-26 16:51:23,242 DEBUG: Matching Narlu_2022_ortho_561.JPG and Narlu_2022_ortho_223.JPG. Matcher: FLANN (symmetric) T-desc: 200.021 T-robust: 0.015 T-total: 200.140 Matches: 377 Robust: 210 Success: True
2022-06-26 16:51:29,288 DEBUG: No segmentation for Narlu_2022_ortho_932.JPG, no features masked.
2022-06-26 16:51:29,800 DEBUG: Matching Narlu_2022_ortho_1096.JPG and Narlu_2022_ortho_1098.JPG. Matcher: FLANN (symmetric) T-desc: 867.042 T-robust: 3.383 T-total: 870.936 Matches: 445 Robust: 280 Success: True
2022-06-26 16:52:59,178 DEBUG: No segmentation for Narlu_2022_ortho_737.JPG, no features masked.
2022-06-26 16:53:06,553 DEBUG: No segmentation for Narlu_2022_ortho_861.JPG, no features masked.
2022-06-26 16:53:07,488 DEBUG: Matching Narlu_2022_ortho_1827.JPG and Narlu_2022_ortho_127.JPG. Matcher: FLANN (symmetric) T-desc: 286.634 T-robust: 0.025 T-total: 286.661 Matches: 208 Robust: 13 Success: False
2022-06-26 16:53:10,811 DEBUG: Matching Narlu_2022_ortho_905.JPG and Narlu_2022_ortho_888.JPG. Matcher: FLANN (symmetric) T-desc: 293.558 T-robust: 0.005 T-total: 293.566 Matches: 2844 Robust: 2692 Success: True
2022-06-26 16:53:55,367 DEBUG: Matching Narlu_2022_ortho_716.JPG and Narlu_2022_ortho_657.JPG. Matcher: FLANN (symmetric) T-desc: 337.684 T-robust: 0.003 T-total: 337.689 Matches: 1262 Robust: 1032 Success: True
2022-06-26 16:54:23,043 DEBUG: No segmentation for Narlu_2022_ortho_765.JPG, no features masked.
2022-06-26 16:54:28,661 DEBUG: No segmentation for Narlu_2022_ortho_793.JPG, no features masked.
2022-06-26 16:54:30,573 DEBUG: Matching Narlu_2022_ortho_932.JPG and Narlu_2022_ortho_861.JPG. Matcher: FLANN (symmetric) T-desc: 241.395 T-robust: 0.042 T-total: 241.437 Matches: 229 Robust: 25 Success: True
2022-06-26 16:54:39,050 DEBUG: No segmentation for Narlu_2022_ortho_755.JPG, no features masked.
2022-06-26 16:55:21,447 DEBUG: No segmentation for Narlu_2022_ortho_598.JPG, no features masked.
2022-06-26 16:55:30,705 DEBUG: Matching Narlu_2022_ortho_023.JPG and Narlu_2022_ortho_065.JPG. Matcher: FLANN (symmetric) T-desc: 436.962 T-robust: 10.335 T-total: 447.302 Matches: 2538 Robust: 2348 Success: True
2022-06-26 16:55:32,672 DEBUG: Matching Narlu_2022_ortho_1237.JPG and Narlu_2022_ortho_765.JPG. Matcher: FLANN (symmetric) T-desc: 140.487 T-robust: 0.572 T-total: 141.060 Matches: 180 Robust: 18 Success: False
2022-06-26 16:56:13,505 DEBUG: Matching Narlu_2022_ortho_737.JPG and Narlu_2022_ortho_793.JPG. Matcher: FLANN (symmetric) T-desc: 289.982 T-robust: 0.032 T-total: 290.016 Matches: 649 Robust: 450 Success: True
2022-06-26 16:56:54,003 DEBUG: No segmentation for Narlu_2022_ortho_050.JPG, no features masked.
2022-06-26 16:59:01,943 DEBUG: Matching Narlu_2022_ortho_736.JPG and Narlu_2022_ortho_319.JPG. Matcher: FLANN (symmetric) T-desc: 210.583 T-robust: 0.580 T-total: 211.166 Matches: 320 Robust: 119 Success: True
2022-06-26 16:59:01,944 DEBUG: Matching Narlu_2022_ortho_598.JPG and Narlu_2022_ortho_597.JPG. Matcher: FLANN (symmetric) T-desc: 305.497 T-robust: 0.233 T-total: 305.733 Matches: 502 Robust: 355 Success: True
2022-06-26 16:59:55,434 DEBUG: Matching Narlu_2022_ortho_1332.JPG and Narlu_2022_ortho_1758.JPG. Matcher: FLANN (symmetric) T-desc: 407.718 T-robust: 0.009 T-total: 407.728 Matches: 538 Robust: 347 Success: True
2022-06-26 16:59:56,167 DEBUG: No segmentation for Narlu_2022_ortho_030.JPG, no features masked.
2022-06-26 16:59:56,822 DEBUG: No segmentation for Narlu_2022_ortho_114.JPG, no features masked.
2022-06-26 17:00:01,910 DEBUG: Matching Narlu_2022_ortho_1079.JPG and Narlu_2022_ortho_697.JPG. Matcher: FLANN (symmetric) T-desc: 267.690 T-robust: 0.018 T-total: 267.710 Matches: 700 Robust: 489 Success: True
2022-06-26 17:00:02,589 DEBUG: Matching Narlu_2022_ortho_1125.JPG and Narlu_2022_ortho_1644.JPG. Matcher: FLANN (symmetric) T-desc: 329.626 T-robust: 1.059 T-total: 330.822 Matches: 222 Robust: 46 Success: True
2022-06-26 17:01:24,431 DEBUG: No segmentation for Narlu_2022_ortho_1511.JPG, no features masked.
2022-06-26 17:01:25,903 DEBUG: Matching Narlu_2022_ortho_050.JPG and Narlu_2022_ortho_1378.JPG. Matcher: FLANN (symmetric) T-desc: 311.556 T-robust: 0.791 T-total: 312.348 Matches: 188 Robust: 13 Success: False
2022-06-26 17:01:34,852 DEBUG: Matching Narlu_2022_ortho_755.JPG and Narlu_2022_ortho_164.JPG. Matcher: FLANN (symmetric) T-desc: 586.904 T-robust: 17.979 T-total: 604.885 Matches: 513 Robust: 290 Success: True
2022-06-26 17:01:38,681 DEBUG: No segmentation for Narlu_2022_ortho_833.JPG, no features masked.
2022-06-26 17:01:58,675 DEBUG: No segmentation for Narlu_2022_ortho_1480.JPG, no features masked.
2022-06-26 17:04:12,742 DEBUG: No segmentation for Narlu_2022_ortho_1292.JPG, no features masked.
2022-06-26 17:04:20,322 DEBUG: No segmentation for Narlu_2022_ortho_1537.JPG, no features masked.
2022-06-26 17:04:22,663 DEBUG: Matching Narlu_2022_ortho_344.JPG and Narlu_2022_ortho_351.JPG. Matcher: FLANN (symmetric) T-desc: 259.989 T-robust: 0.020 T-total: 260.013 Matches: 251 Robust: 14 Success: False
2022-06-26 17:05:49,029 DEBUG: Matching Narlu_2022_ortho_476.JPG and Narlu_2022_ortho_400.JPG. Matcher: FLANN (symmetric) T-desc: 1443.378 T-robust: 88.637 T-total: 1532.258 Matches: 667 Robust: 457 Success: True
2022-06-26 17:06:01,044 DEBUG: Matching Narlu_2022_ortho_009.JPG and Narlu_2022_ortho_510.JPG. Matcher: FLANN (symmetric) T-desc: 365.207 T-robust: 0.004 T-total: 365.218 Matches: 927 Robust: 723 Success: True
2022-06-26 17:06:04,895 DEBUG: Matching Narlu_2022_ortho_114.JPG and Narlu_2022_ortho_833.JPG. Matcher: FLANN (symmetric) T-desc: 422.597 T-robust: 0.097 T-total: 422.697 Matches: 533 Robust: 364 Success: True
2022-06-26 17:06:13,581 DEBUG: No segmentation for Narlu_2022_ortho_1493.JPG, no features masked.
2022-06-26 17:06:20,317 DEBUG: No segmentation for Narlu_2022_ortho_1556.JPG, no features masked.
2022-06-26 17:07:36,629 DEBUG: No segmentation for Narlu_2022_ortho_1494.JPG, no features masked.
2022-06-26 17:07:43,815 DEBUG: Matching Narlu_2022_ortho_1480.JPG and Narlu_2022_ortho_1537.JPG. Matcher: FLANN (symmetric) T-desc: 368.196 T-robust: 0.007 T-total: 368.206 Matches: 1560 Robust: 1409 Success: True
2022-06-26 17:07:44,331 DEBUG: Matching Narlu_2022_ortho_1206.JPG and Narlu_2022_ortho_1292.JPG. Matcher: FLANN (symmetric) T-desc: 377.055 T-robust: 0.067 T-total: 377.141 Matches: 242 Robust: 26 Success: True
2022-06-26 17:09:35,557 DEBUG: Matching Narlu_2022_ortho_030.JPG and Narlu_2022_ortho_029.JPG. Matcher: FLANN (symmetric) T-desc: 506.007 T-robust: 126.239 T-total: 633.035 Matches: 3831 Robust: 3575 Success: True
2022-06-26 17:10:26,991 DEBUG: Matching Narlu_2022_ortho_1556.JPG and Narlu_2022_ortho_1817.JPG. Matcher: FLANN (symmetric) T-desc: 261.912 T-robust: 15.399 T-total: 277.430 Matches: 431 Robust: 238 Success: True
2022-06-26 17:10:27,151 DEBUG: Matching Narlu_2022_ortho_1493.JPG and Narlu_2022_ortho_1494.JPG. Matcher: FLANN (symmetric) T-desc: 249.907 T-robust: 15.711 T-total: 265.813 Matches: 966 Robust: 775 Success: True
2022-06-26 17:10:27,595 DEBUG: Matching Narlu_2022_ortho_1511.JPG and Narlu_2022_ortho_1401.JPG. Matcher: FLANN (symmetric) T-desc: 609.184 T-robust: 15.321 T-total: 625.144 Matches: 360 Robust: 181 Success: True
2022-06-26 17:10:27,595 DEBUG: Matching Narlu_2022_ortho_1499.JPG and Narlu_2022_ortho_1510.JPG. Matcher: FLANN (symmetric) T-desc: 347.460 T-robust: 15.972 T-total: 364.156 Matches: 257 Robust: 88 Success: True
2022-06-26 17:10:36,499 DEBUG: Matching Narlu_2022_ortho_1588.JPG and Narlu_2022_ortho_1603.JPG. Matcher: FLANN (symmetric) T-desc: 270.912 T-robust: 0.007 T-total: 270.921 Matches: 495 Robust: 335 Success: True
2022-06-26 17:11:42,721 DEBUG: No segmentation for Narlu_2022_ortho_250.JPG, no features masked.
2022-06-26 17:11:52,391 DEBUG: No segmentation for Narlu_2022_ortho_869.JPG, no features masked.
2022-06-26 17:12:01,618 DEBUG: No segmentation for Narlu_2022_ortho_1701.JPG, no features masked.
2022-06-26 17:12:34,168 DEBUG: No segmentation for Narlu_2022_ortho_1718.JPG, no features masked.
2022-06-26 17:12:34,588 DEBUG: No segmentation for Narlu_2022_ortho_1447.JPG, no features masked.
2022-06-26 17:14:48,191 DEBUG: No segmentation for Narlu_2022_ortho_309.JPG, no features masked.
2022-06-26 17:15:05,769 DEBUG: Matching Narlu_2022_ortho_1701.JPG and Narlu_2022_ortho_1718.JPG. Matcher: FLANN (symmetric) T-desc: 315.284 T-robust: 9.884 T-total: 325.585 Matches: 458 Robust: 290 Success: True
2022-06-26 17:15:05,814 DEBUG: Matching Narlu_2022_ortho_865.JPG and Narlu_2022_ortho_250.JPG. Matcher: FLANN (symmetric) T-desc: 430.288 T-robust: 8.880 T-total: 441.488 Matches: 373 Robust: 206 Success: True
2022-06-26 17:16:30,837 DEBUG: No segmentation for Narlu_2022_ortho_1834.JPG, no features masked.
2022-06-26 17:20:33,051 DEBUG: No segmentation for Narlu_2022_ortho_1427.JPG, no features masked.
2022-06-26 17:20:45,775 DEBUG: No segmentation for Narlu_2022_ortho_1210.JPG, no features masked.
2022-06-26 17:21:22,835 DEBUG: Matching Narlu_2022_ortho_1522.JPG and Narlu_2022_ortho_1560.JPG. Matcher: FLANN (symmetric) T-desc: 627.518 T-robust: 16.709 T-total: 645.074 Matches: 526 Robust: 372 Success: True
2022-06-26 17:22:56,110 DEBUG: Matching Narlu_2022_ortho_728.JPG and Narlu_2022_ortho_309.JPG. Matcher: FLANN (symmetric) T-desc: 736.835 T-robust: 8.986 T-total: 746.312 Matches: 451 Robust: 200 Success: True
2022-06-26 17:24:09,551 DEBUG: Matching Narlu_2022_ortho_1447.JPG and Narlu_2022_ortho_1834.JPG. Matcher: FLANN (symmetric) T-desc: 821.062 T-robust: 0.023 T-total: 821.086 Matches: 253 Robust: 55 Success: True
2022-06-26 17:24:14,664 DEBUG: Matching Narlu_2022_ortho_1402.JPG and Narlu_2022_ortho_1427.JPG. Matcher: FLANN (symmetric) T-desc: 542.993 T-robust: 0.015 T-total: 543.397 Matches: 449 Robust: 256 Success: True
2022-06-26 17:24:17,022 DEBUG: No segmentation for Narlu_2022_ortho_256.JPG, no features masked.
2022-06-26 17:24:49,946 DEBUG: No segmentation for Narlu_2022_ortho_417.JPG, no features masked.
2022-06-26 17:26:13,506 DEBUG: No segmentation for Narlu_2022_ortho_261.JPG, no features masked.
2022-06-26 17:27:17,231 DEBUG: No segmentation for Narlu_2022_ortho_211.JPG, no features masked.
2022-06-26 17:31:06,540 DEBUG: Matching Narlu_2022_ortho_525.JPG and Narlu_2022_ortho_603.JPG. Matcher: FLANN (symmetric) T-desc: 571.137 T-robust: 7.011 T-total: 582.943 Matches: 201 Robust: 12 Success: False
2022-06-26 17:31:06,139 DEBUG: Matching Narlu_2022_ortho_777.JPG and Narlu_2022_ortho_211.JPG. Matcher: FLANN (symmetric) T-desc: 411.607 T-robust: 0.440 T-total: 415.478 Matches: 675 Robust: 447 Success: True
2022-06-26 17:31:06,206 DEBUG: Matching Narlu_2022_ortho_256.JPG and Narlu_2022_ortho_261.JPG. Matcher: FLANN (symmetric) T-desc: 476.879 T-robust: 3.321 T-total: 481.176 Matches: 3214 Robust: 3001 Success: True
2022-06-26 17:32:36,718 DEBUG: No segmentation for Narlu_2022_ortho_625.JPG, no features masked.
2022-06-26 17:38:52,166 DEBUG: Matching Narlu_2022_ortho_1199.JPG and Narlu_2022_ortho_1210.JPG. Matcher: FLANN (symmetric) T-desc: 1163.694 T-robust: 253.642 T-total: 1420.197 Matches: 3891 Robust: 3723 Success: True
2022-06-26 17:39:33,705 DEBUG: Matching Narlu_2022_ortho_1598.JPG and Narlu_2022_ortho_1480.JPG. Matcher: FLANN (symmetric) T-desc: 459.668 T-robust: 43.713 T-total: 503.414 Matches: 896 Robust: 704 Success: True
2022-06-26 17:39:42,406 DEBUG: Matching Narlu_2022_ortho_1431.JPG and Narlu_2022_ortho_1430.JPG. Matcher: FLANN (symmetric) T-desc: 509.660 T-robust: 0.130 T-total: 510.015 Matches: 1676 Robust: 1491 Success: True
2022-06-26 17:42:25,450 DEBUG: Matching Narlu_2022_ortho_627.JPG and Narlu_2022_ortho_625.JPG. Matcher: FLANN (symmetric) T-desc: 672.681 T-robust: 0.339 T-total: 673.108 Matches: 4241 Robust: 4062 Success: True
2022-06-26 17:42:40,007 DEBUG: Matching Narlu_2022_ortho_1264.JPG and Narlu_2022_ortho_198.JPG. Matcher: FLANN (symmetric) T-desc: 189.003 T-robust: 0.134 T-total: 189.185 Matches: 361 Robust: 160 Success: True
2022-06-26 17:42:52,824 DEBUG: No segmentation for Narlu_2022_ortho_1734.JPG, no features masked.
2022-06-26 17:44:52,590 DEBUG: Matching Narlu_2022_ortho_776.JPG and Narlu_2022_ortho_755.JPG. Matcher: FLANN (symmetric) T-desc: 318.473 T-robust: 0.405 T-total: 318.884 Matches: 4238 Robust: 4014 Success: True
2022-06-26 17:45:38,802 DEBUG: Matching Narlu_2022_ortho_1370.JPG and Narlu_2022_ortho_1313.JPG. Matcher: FLANN (symmetric) T-desc: 193.278 T-robust: 0.073 T-total: 193.351 Matches: 178 Robust: 12 Success: False
2022-06-26 17:45:49,070 DEBUG: Matching Narlu_2022_ortho_1734.JPG and Narlu_2022_ortho_1350.JPG. Matcher: FLANN (symmetric) T-desc: 189.038 T-robust: 0.024 T-total: 189.062 Matches: 448 Robust: 228 Success: True
2022-06-26 17:46:07,480 DEBUG: No segmentation for Narlu_2022_ortho_1145.JPG, no features masked.
2022-06-26 17:46:08,228 DEBUG: No segmentation for Narlu_2022_ortho_225.JPG, no features masked.
2022-06-26 17:49:37,207 DEBUG: Matching Narlu_2022_ortho_1166.JPG and Narlu_2022_ortho_1241.JPG. Matcher: FLANN (symmetric) T-desc: 284.258 T-robust: 0.064 T-total: 284.323 Matches: 297 Robust: 63 Success: True
2022-06-26 17:49:37,512 DEBUG: Matching Narlu_2022_ortho_225.JPG and Narlu_2022_ortho_873.JPG. Matcher: FLANN (symmetric) T-desc: 228.300 T-robust: 0.024 T-total: 228.325 Matches: 349 Robust: 166 Success: True
2022-06-26 17:49:56,436 DEBUG: No segmentation for Narlu_2022_ortho_792.JPG, no features masked.
2022-06-26 17:50:08,401 DEBUG: No segmentation for Narlu_2022_ortho_718.JPG, no features masked.
2022-06-26 17:51:31,120 DEBUG: Matching Narlu_2022_ortho_457.JPG and Narlu_2022_ortho_417.JPG. Matcher: FLANN (symmetric) T-desc: 1634.412 T-robust: 1.463 T-total: 1635.897 Matches: 271 Robust: 13 Success: False
2022-06-26 17:52:09,998 DEBUG: Matching Narlu_2022_ortho_792.JPG and Narlu_2022_ortho_718.JPG. Matcher: FLANN (symmetric) T-desc: 152.175 T-robust: 0.025 T-total: 152.383 Matches: 257 Robust: 48 Success: True
2022-06-26 17:52:30,566 DEBUG: No segmentation for Narlu_2022_ortho_1455.JPG, no features masked.
2022-06-26 17:52:58,308 DEBUG: No segmentation for Narlu_2022_ortho_1137.JPG, no features masked.
2022-06-26 17:53:12,386 DEBUG: Matching Narlu_2022_ortho_003.JPG and Narlu_2022_ortho_438.JPG. Matcher: FLANN (symmetric) T-desc: 214.822 T-robust: 0.087 T-total: 215.057 Matches: 240 Robust: 14 Success: False
2022-06-26 17:54:37,038 DEBUG: Matching Narlu_2022_ortho_1109.JPG and Narlu_2022_ortho_1137.JPG. Matcher: FLANN (symmetric) T-desc: 146.425 T-robust: 0.461 T-total: 146.887 Matches: 642 Robust: 485 Success: True
2022-06-26 17:54:37,951 DEBUG: No segmentation for Narlu_2022_ortho_631.JPG, no features masked.
2022-06-26 17:54:38,291 DEBUG: Matching Narlu_2022_ortho_924.JPG and Narlu_2022_ortho_869.JPG. Matcher: FLANN (symmetric) T-desc: 2645.052 T-robust: 5.295 T-total: 2650.370 Matches: 216 Robust: 77 Success: True
2022-06-26 17:54:40,375 DEBUG: Matching Narlu_2022_ortho_1455.JPG and Narlu_2022_ortho_1643.JPG. Matcher: FLANN (symmetric) T-desc: 188.579 T-robust: 0.674 T-total: 189.255 Matches: 1590 Robust: 1392 Success: True
2022-06-26 17:55:03,510 DEBUG: No segmentation for Narlu_2022_ortho_630.JPG, no features masked.
2022-06-26 17:55:04,225 DEBUG: No segmentation for Narlu_2022_ortho_704.JPG, no features masked.
2022-06-26 17:55:06,360 DEBUG: No segmentation for Narlu_2022_ortho_588.JPG, no features masked.
2022-06-26 17:55:09,750 DEBUG: No segmentation for Narlu_2022_ortho_564.JPG, no features masked.
2022-06-26 17:58:22,284 DEBUG: Matching Narlu_2022_ortho_1268.JPG and Narlu_2022_ortho_192.JPG. Matcher: FLANN (symmetric) T-desc: 2865.559 T-robust: 8.221 T-total: 2873.819 Matches: 182 Robust: 13 Success: False
2022-06-26 17:58:23,038 DEBUG: Matching Narlu_2022_ortho_198.JPG and Narlu_2022_ortho_1260.JPG. Matcher: FLANN (symmetric) T-desc: 3033.023 T-robust: 5.463 T-total: 3038.563 Matches: 307 Robust: 129 Success: True

System information:

OS Name Microsoft Windows 10 Home
Version 10.0.19044 Build 19044
Other OS Description Not Available
OS Manufacturer Microsoft Corporation
System Name MSI
System Manufacturer Micro-Star International Co., Ltd.
System Model GS63VR 7RF
System Type x64-based PC
System SKU 16K2.3
Processor Intel(R) Core™ i7-7700HQ CPU @ 2.80GHz, 2801 Mhz, 4 Core(s), 8 Logical Processor(s)
BIOS Version/Date American Megatrends Inc. E16K2IMS.30E, 8/03/2017
SMBIOS Version 3.0
Embedded Controller Version 255.255
BIOS Mode UEFI
BaseBoard Manufacturer Micro-Star International Co., Ltd.
BaseBoard Product MS-16K2
BaseBoard Version REV:1.0
Platform Role Mobile
Secure Boot State Off
PCR7 Configuration Elevation Required to View
Windows Directory C:\WINDOWS
System Directory C:\WINDOWS\system32
Boot Device \Device\HarddiskVolume1
Locale Australia
Hardware Abstraction Layer Version = 10.0.19041.1741
User Name MSI\Nathan
Time Zone E. Australia Standard Time
Installed Physical Memory (RAM) 16.0 GB
Total Physical Memory 15.9 GB
Available Physical Memory 11.6 GB
Total Virtual Memory 38.9 GB
Available Virtual Memory 29.4 GB
Page File Space 23.0 GB
Page File D:\pagefile.sys
Kernel DMA Protection Off
Virtualization-based security Not enabled
Device Encryption Support Elevation Required to View
Hyper-V - VM Monitor Mode Extensions Yes
Hyper-V - Second Level Address Translation Extensions Yes
Hyper-V - Virtualization Enabled in Firmware Yes
Hyper-V - Data Execution Protection Yes
1 Like

How many images is that? I’m pretty sure it is far too many for 16GB of RAM.

As an example of time and memory requirements, I’ve just processed 279 images, totalling 3.14GB, ie 1 10th of your dataset, and that took the best part of a day with 96GB RAM +256GB Virtual memory, and 16 logical processors.

The spinning cog you are seeing is probably virtual memory usage, which is much slower than RAM, particularly if you are not using a SSD.

1 Like

Yes, almost certainly going way beyond the capabilities of your machine, unfortunately.

Are you able to expand the physical memory of that machine up to 64GB or beyond?

1 Like

Maybe, money is tight right now. I’m trying the WebODM Lighting network which is also causing me problems. I’ll search for answers on that and see if I can solve them.

Cheers

2 Likes

Based on my own testing I’d estimate 16GB RAM will allow WebODM to process about 250 photos (@20MPx) with default settings.

3 Likes

We haven’t been told, but I suspect there could be about 10 times that number of photos involved.

1 Like

Yes I think in another thread Nathan said he has 1800 photos to process, so way more than you could do with 16GB RAM

1 Like

Hi again,

I bought a subscription and ran the dataset again. Unfortunately I had to go into the field again and came back - almost out of time and the resulting orthomosaic is only half there- the lower half is completely missing.

I don’t have time for this, presentation is only 3 days away, I’ve been working at this for a month now to try and get an output.

One last try today…

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.