Cannot process more than 100 images in a single NodeODM instance, that is connected to WebODM

Hey everyone,
I am not able to process more than 100 images in NodeODM instance. Here is my issue:

No. of images: 653
Setup:

  1. WebODM running on docker, in a linux machine (ubuntu).
    System Specification:
    CPU: Ryzen 7 3600
    RAM: 16gb DDR4 2133Mhz
    Storage: 500GB SSD and 1TB HDD

  2. NodeODM running on docker, in a windows server machine
    Resources allocated to docker:
    CPU: Intel Xeon Silver 4208 2.10 Ghz (16 cores)
    RAM: 502GB
    HDD: 198GB

My machine running nodeODM instance is connected to the machine running webODM.
But it is not able to process the images, and I get this error in the webODM UI:

Process exited with code 1

It looks like your processing node ran out of memory. If you are using docker, make sure that your docker environment has enough RAM allocated. Alternatively, make sure you have enough physical RAM, reduce the number of images, make your images smaller, or reduce the max-concurrency parameter from the task’s [options](javascript:void(0);). You can also try to use a cloud processing node.

Is 50gb RAM not enough for ODM? If no, then what is the ideal system requirement to run ODM?

Also, these are the settings used in WebODM,

Options: mesh-octree-depth: 11, orthophoto-resolution: 2.0, orthophoto-no-tiled: true, dem-resolution: 2.0, mesh-size: 300000, ignore-gsd: true, pc-las: true, dsm: true, skip-3dmodel: true, verbose: true

And here is the log:

… output truncated at 500 lines …
-maxTileLength 4000
-verbose
Raster Size is 11398x7785
Extent is (-440.609619, 471.230381), (-314.215442, 308.584558)
NoData value: -9999
Description:
Reading raster…
Total vertices before simplification: 88733430
Blocks depth: 2
Splitting area in 16
Block size is 2849, 1946
Processing block (0,0)
Sampled 11078720 faces, target is 56250
Simplifying…
iteration 0 - triangles 11078720 threshold 2.43e-07
iteration 5 - triangles 7355522 threshold 3.2768e-05
iteration 10 - triangles 5411368 threshold 0.000371293
iteration 15 - triangles 3903146 threshold 0.00188957
iteration 20 - triangles 2805714 threshold 0.00643634
iteration 25 - triangles 2062188 threshold 0.0172104
iteration 30 - triangles 1562430 threshold 0.0391354
iteration 35 - triangles 1217288 threshold 0.0792352
iteration 40 - triangles 972044 threshold 0.147008
iteration 45 - triangles 790002 threshold 0.254804
iteration 50 - triangles 652724 threshold 0.418195
iteration 55 - triangles 546052 threshold 0.656357
iteration 60 - triangles 462632 threshold 0.992437
iteration 65 - triangles 397228 threshold 1.45393
iteration 70 - triangles 344118 threshold 2.07307
iteration 75 - triangles 301100 threshold 2.88717
iteration 80 - triangles 266144 threshold 3.93904
iteration 85 - triangles 237070 threshold 5.27732
iteration 90 - triangles 212308 threshold 6.95688
iteration 95 - triangles 191260 threshold 9.03921
Writing to binary file… done!
Processing block (0,1)
Sampled 11084416 faces, target is 56250
Simplifying…
iteration 0 - triangles 11084416 threshold 2.43e-07
iteration 5 - triangles 8587118 threshold 3.2768e-05
iteration 10 - triangles 6750082 threshold 0.000371293
iteration 15 - triangles 4989346 threshold 0.00188957
iteration 20 - triangles 3636364 threshold 0.00643634
iteration 25 - triangles 2692138 threshold 0.0172104
iteration 30 - triangles 2045754 threshold 0.0391354
iteration 35 - triangles 1595792 threshold 0.0792352
iteration 40 - triangles 1273914 threshold 0.147008
iteration 45 - triangles 1036006 threshold 0.254804
iteration 50 - triangles 853230 threshold 0.418195
iteration 55 - triangles 712744 threshold 0.656357
iteration 60 - triangles 602634 threshold 0.992437
iteration 65 - triangles 515246 threshold 1.45393
iteration 70 - triangles 445022 threshold 2.07307
iteration 75 - triangles 387646 threshold 2.88717
iteration 80 - triangles 340350 threshold 3.93904
iteration 85 - triangles 301240 threshold 5.27732
iteration 90 - triangles 268954 threshold 6.95688
iteration 95 - triangles 241424 threshold 9.03921
Writing to binary file… done!
Processing block (0,2)
Sampled 10934980 faces, target is 56250
Simplifying…
iteration 0 - triangles 10934980 threshold 2.43e-07
iteration 5 - triangles 5594191 threshold 3.2768e-05
iteration 10 - triangles 3868826 threshold 0.000371293
iteration 15 - triangles 2707906 threshold 0.00188957
iteration 20 - triangles 1921611 threshold 0.00643634
iteration 25 - triangles 1402118 threshold 0.0172104
iteration 30 - triangles 1056162 threshold 0.0391354
iteration 35 - triangles 818592 threshold 0.0792352
iteration 40 - triangles 651069 threshold 0.147008
iteration 45 - triangles 528587 threshold 0.254804
iteration 50 - triangles 435119 threshold 0.418195
iteration 55 - triangles 364393 threshold 0.656357
iteration 60 - triangles 308511 threshold 0.992437
iteration 65 - triangles 264217 threshold 1.45393
iteration 70 - triangles 229010 threshold 2.07307
iteration 75 - triangles 200175 threshold 2.88717
iteration 80 - triangles 176578 threshold 3.93904
iteration 85 - triangles 157180 threshold 5.27732
iteration 90 - triangles 140822 threshold 6.95688
iteration 95 - triangles 127258 threshold 9.03921
Writing to binary file… done!
Processing block (0,3)
Sampled 2201342 faces, target is 56250
Simplifying…
iteration 0 - triangles 2201342 threshold 2.43e-07
iteration 5 - triangl
es 351294 threshold 3.2768e-05
iteration 10 - triangles 71629 threshold 0.000371293
Writing to binary file… done!
Processing block (1,0)
Sampled 10917876 faces, target is 56250
Simplifying…
iteration 0 - triangles 10917876 threshold 2.43e-07
iteration 5 - triangles 5660917 threshold 3.2768e-05
iteration 10 - triangles 4003494 threshold 0.000371293
iteration 15 - triangles 2897631 threshold 0.00188957
iteration 20 - triangles 2096697 threshold 0.00643634
iteration 25 - triangles 1546439 threshold 0.0172104
iteration 30 - triangles 1173495 threshold 0.0391354
iteration 35 - triangles 915860 threshold 0.0792352
iteration 40 - triangles 731201 threshold 0.147008
iteration 45 - triangles 594418 threshold 0.254804
iteration 50 - triangles 490905 threshold 0.418195
iteration 55 - triangles 411360 threshold 0.656357
iteration 60 - triangles 349474 threshold 0.992437
iteration 65 - triangles 300321 threshold 1.45393
iteration 70 - triangles 260816 threshold 2.07307
iteration 75 - triangles 228278 threshold 2.88717
iteration 80 - triangles 201670 threshold 3.93904
iteration 85 - triangles 179927 threshold 5.27732
iteration 90 - triangles 161790 threshold 6.95688
iteration 95 - triangles 146460 threshold 9.03921
Writing to binary file… done!
Processing block (1,1)
Sampled 11088308 faces, target is 56250
Simplifying…
iteration 0 - triangles 11088308 threshold 2.43e-07
iteration 5 - triangles 9626306 threshold 3.2768e-05
iteration 10 - triangles 7955858 threshold 0.000371293
iteration 15 - triangles 5922646 threshold 0.00188957
iteration 20 - triangles 4322230 threshold 0.00643634
iteration 25 - triangles 3203798 threshold 0.0172104
iteration 30 - triangles 2439614 threshold 0.0391354
iteration 35 - triangles 1905412 threshold 0.0792352
iteration 40 - triangles 1522226 threshold 0.147008
iteration 45 - triangles 1239348 threshold 0.254804
iteration 50 - triangles 1021742 threshold 0.418195
iteration 55 - triangles 852904 threshold 0.656357
iteration 60 - triangles 720516 threshold 0.992437
iteration 65 - triangles 615580 threshold 1.45393
iteration 70 - triangles 530974 threshold 2.07307
iteration 75 - triangles 461166 threshold 2.88717
iteration 80 - triangles 404490 threshold 3.93904
iteration 85 - triangles 357850 threshold 5.27732
iteration 90 - triangles 318524 threshold 6.95688
iteration 95 - triangles 285370 threshold 9.03921
Writing to binary file… done!
Processing block (1,2)
Sampled 11088308 faces, target is 56250
Simplifying…
iteration 0 - triangles 11088308 threshold 2.43e-07
iteration 5 - triangles 9395480 threshold 3.2768e-05
iteration 10 - triangles 7704682 threshold 0.000371293
iteration 15 - triangles 5669980 threshold 0.00188957
iteration 20 - triangles 4088022 threshold 0.00643634
iteration 25 - triangles 3004758 threshold 0.0172104
iteration 30 - triangles 2270256 threshold 0.0391354
iteration 35 - triangles 1762534 threshold 0.0792352
iteration 40 - triangles 1399340 threshold 0.147008
iteration 45 - triangles 1132684 threshold 0.254804
iteration 50 - triangles 930468 threshold 0.418195
iteration 55 - triangles 773906 threshold 0.656357
iteration 60 - triangles 651964 threshold 0.992437
iteration 65 - triangles 555506 threshold 1.45393
iteration 70 - triangles 477834 threshold 2.07307
iteration 75 - triangles 414774 threshold 2.88717
iteration 80 - triangles 362938 threshold 3.93904
iteration 85 - triangles 320372 threshold 5.27732
iteration 90 - triangles 284906 threshold 6.95688
iteration 95 - triangles 255238 threshold 9.03921
Writing to binary file… done!
Processing block (1,3)
Sampled 8541768 faces, target is 56250
Simplifying…
iteration 0 - triangles 8541768 threshold 2.43e-07
iteration 5 - triangles 2646002 threshold 3.2768e-05
iteration 10 - triangles 1384729 threshold 0.000371293
iteration 15 - triangles 868553 threshold 0.00188957
iteration 20 - triangles 584360 threshold 0.00643634
iteration 25 - triangles 415170 threshold 0.0172104
iteration 30 - triangles 308153 threshold 0.0391354
iteration 35 - triangles 237579 threshold 0.0792352
iteration 40 - triangles 187995 threshold 0.147008
i
teration 45 - triangles 152546 threshold 0.254804
iteration 50 - triangles 125965 threshold 0.418195
iteration 55 - triangles 105624 threshold 0.656357
iteration 60 - triangles 90169 threshold 0.992437
iteration 65 - triangles 77888 threshold 1.45393
iteration 70 - triangles 68170 threshold 2.07307
iteration 75 - triangles 60225 threshold 2.88717
Writing to binary file… done!
Processing block (2,0)
Sampled 8211381 faces, target is 56250
Simplifying…
iteration 0 - triangles 8211381 threshold 2.43e-07
iteration 5 - triangles 2506800 threshold 3.2768e-05
iteration 10 - triangles 1274636 threshold 0.000371293
iteration 15 - triangles 841596 threshold 0.00188957
iteration 20 - triangles 594220 threshold 0.00643634
iteration 25 - triangles 435803 threshold 0.0172104
iteration 30 - triangles 330363 threshold 0.0391354
iteration 35 - triangles 258382 threshold 0.0792352
iteration 40 - triangles 207748 threshold 0.147008
iteration 45 - triangles 170438 threshold 0.254804
iteration 50 - triangles 142326 threshold 0.418195
iteration 55 - triangles 120801 threshold 0.656357
iteration 60 - triangles 104099 threshold 0.992437
iteration 65 - triangles 90847 threshold 1.45393
iteration 70 - triangles 79784 threshold 2.07307
iteration 75 - triangles 70979 threshold 2.88717
iteration 80 - triangles 63838 threshold 3.93904
iteration 85 - triangles 57750 threshold 5.27732
Writing to binary file… done!
Processing block (2,1)
Sampled 11088308 faces, target is 56250
Simplifying…
iteration 0 - triangles 11088308 threshold 2.43e-07
iteration 5 - triangles 8961610 threshold 3.2768e-05
iteration 10 - triangles 7083028 threshold 0.000371293
iteration 15 - triangles 5129082 threshold 0.00188957
iteration 20 - triangles 3668804 threshold 0.00643634
iteration 25 - triangles 2679484 threshold 0.0172104
iteration 30 - triangles 2011812 threshold 0.0391354
iteration 35 - triangles 1553678 threshold 0.0792352
iteration 40 - triangles 1227440 threshold 0.147008
iteration 45 - triangles 988976 threshold 0.254804
iteration 50 - triangles 809728 threshold 0.418195
iteration 55 - triangles 673004 threshold 0.656357
iteration 60 - triangles 566148 threshold 0.992437
iteration 65 - triangles 482126 threshold 1.45393
iteration 70 - triangles 414238 threshold 2.07307
iteration 75 - triangles 359254 threshold 2.88717
iteration 80 - triangles 314180 threshold 3.93904
iteration 85 - triangles 277152 threshold 5.27732
iteration 90 - triangles 246288 threshold 6.95688
iteration 95 - triangles 220330 threshold 9.03921
Writing to binary file… done!
Processing block (2,2)
Sampled 11088308 faces, target is 56250
Simplifying…
iteration 0 - triangles 11088308 threshold 2.43e-07
iteration 5 - triangles 9538310 threshold 3.2768e-05
iteration 10 - triangles 7926244 threshold 0.000371293
iteration 15 - triangles 5938430 threshold 0.00188957
iteration 20 - triangles 4338456 threshold 0.00643634
iteration 25 - triangles 3207286 threshold 0.0172104
iteration 30 - triangles 2431714 threshold 0.0391354
iteration 35 - triangles 1891220 threshold 0.0792352
iteration 40 - triangles 1503776 threshold 0.147008
iteration 45 - triangles 1218272 threshold 0.254804
iteration 50 - triangles 1002024 threshold 0.418195
iteration 55 - triangles 835044 threshold 0.656357
iteration 60 - triangles 703462 threshold 0.992437
iteration 65 - triangles 599304 threshold 1.45393
iteration 70 - triangles 516054 threshold 2.07307
iteration 75 - triangles 447546 threshold 2.88717
iteration 80 - triangles 391920 threshold 3.93904
iteration 85 - triangles 345392 threshold 5.27732
iteration 90 - triangles 307246 threshold 6.95688
iteration 95 - triangles 275322 threshold 9.03921
Writing to binary file… done!
Processing block (2,3)
Sampled 11088308 faces, target is 56250
Simplifying…
iteration 0 - triangles 11088308 threshold 2.43e-07
iteration 5 - triangles 7306322 threshold 3.2768e-05
iteration 10 - triangles 5583118 threshold 0.000371293
iteration 15 - triangles 4003936 threshold 0.00188957
iteration 20 - triangles 2826730 threshold 0.00643634
iteration 25 - triangles 2048360 threshold 0.017210
4
iteration 30 - triangles 1531620 threshold 0.0391354
iteration 35 - triangles 1177858 threshold 0.0792352
iteration 40 - triangles 928192 threshold 0.147008
iteration 45 - triangles 746632 threshold 0.254804
iteration 50 - triangles 610476 threshold 0.418195
iteration 55 - triangles 506402 threshold 0.656357
iteration 60 - triangles 426202 threshold 0.992437
iteration 65 - triangles 363452 threshold 1.45393
iteration 70 - triangles 312562 threshold 2.07307
iteration 75 - triangles 271596 threshold 2.88717
iteration 80 - triangles 238362 threshold 3.93904
iteration 85 - triangles 210642 threshold 5.27732
iteration 90 - triangles 187564 threshold 6.95688
iteration 95 - triangles 168032 threshold 9.03921
Writing to binary file… done!
Processing block (3,0)
Sampled 3537392 faces, target is 56250
Simplifying…
iteration 0 - triangles 3537392 threshold 2.43e-07
iteration 5 - triangles 608680 threshold 3.2768e-05
iteration 10 - triangles 142473 threshold 0.000371293
iteration 15 - triangles 71535 threshold 0.00188957
Writing to binary file… done!
Processing block (3,1)
Sampled 11088308 faces, target is 56250
Simplifying…
iteration 0 - triangles 11088308 threshold 2.43e-07
iteration 5 - triangles 6870408 threshold 3.2768e-05
iteration 10 - triangles 5011796 threshold 0.000371293
iteration 15 - triangles 3566616 threshold 0.00188957
iteration 20 - triangles 2542446 threshold 0.00643634
iteration 25 - triangles 1858150 threshold 0.0172104
iteration 30 - triangles 1400862 threshold 0.0391354
iteration 35 - triangles 1085870 threshold 0.0792352
iteration 40 - triangles 861586 threshold 0.147008
iteration 45 - triangles 697808 threshold 0.254804
iteration 50 - triangles 573722 threshold 0.418195
iteration 55 - triangles 478958 threshold 0.656357
iteration 60 - triangles 405186 threshold 0.992437
iteration 65 - triangles 346472 threshold 1.45393
iteration 70 - triangles 299504 threshold 2.07307
iteration 75 - triangles 261200 threshold 2.88717
iteration 80 - triangles 230130 threshold 3.93904
iteration 85 - triangles 204302 threshold 5.27732
iteration 90 - triangles 182706 threshold 6.95688
iteration 95 - triangles 164802 threshold 9.03921
Writing to binary file… done!
Processing block (3,2)
Sampled 11088308 faces, target is 56250
Simplifying…
iteration 0 - triangles 11088308 threshold 2.43e-07
iteration 5 - triangles 7857864 threshold 3.2768e-05
iteration 10 - triangles 6055832 threshold 0.000371293
iteration 15 - triangles 4421162 threshold 0.00188957
iteration 20 - triangles 3198550 threshold 0.00643634
iteration 25 - triangles 2355430 threshold 0.0172104
iteration 30 - triangles 1780808 threshold 0.0391354
iteration 35 - triangles 1384766 threshold 0.0792352
iteration 40 - triangles 1101254 threshold 0.147008
iteration 45 - triangles 892558 threshold 0.254804
iteration 50 - triangles 734550 threshold 0.418195
iteration 55 - triangles 612244 threshold 0.656357
iteration 60 - triangles 517886 threshold 0.992437
iteration 65 - triangles 443086 threshold 1.45393
iteration 70 - triangles 382556 threshold 2.07307
iteration 75 - triangles 333802 threshold 2.88717
iteration 80 - triangles 293152 threshold 3.93904
iteration 85 - triangles 259858 threshold 5.27732
iteration 90 - triangles 231722 threshold 6.95688
iteration 95 - triangles 208070 threshold 9.03921
Writing to binary file… done!
Processing block (3,3)
Sampled 9282689 faces, target is 56250
Simplifying…
iteration 0 - triangles 9282689 threshold 2.43e-07
iteration 5 - triangles 4351258 threshold 3.2768e-05
iteration 10 - triangles 2857233 threshold 0.000371293
iteration 15 - triangles 1923342 threshold 0.00188957
iteration 20 - triangles 1324075 threshold 0.00643634
iteration 25 - triangles 948022 threshold 0.0172104
iteration 30 - triangles 704750 threshold 0.0391354
iteration 35 - triangles 540674 threshold 0.0792352
iteration 40 - triangles 425708 threshold 0.147008
iteration 45 - triangles 342549 threshold 0.254804
iteration 50 - triangles 280919 threshold 0.418195
iteration 55 - triangles 233703 threshold 0.656357
iteration 60 - triangles 197033 threshold 0.
992437
iteration 65 - triangles 168843 threshold 1.45393
iteration 70 - triangles 145746 threshold 2.07307
iteration 75 - triangles 127548 threshold 2.88717
iteration 80 - triangles 112054 threshold 3.93904
iteration 85 - triangles 99863 threshold 5.27732
iteration 90 - triangles 89421 threshold 6.95688
iteration 95 - triangles 80569 threshold 9.03921
Writing to binary file… done!
Merge step…
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.0-0.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.0-1.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.0-2.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.0-3.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.1-0.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.1-1.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.1-2.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.1-3.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.2-0.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.2-1.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.2-2.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.2-3.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.3-0.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.3-1.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.3-2.bin
Reading /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply.3-3.bin
Simplifying final mesh…
iteration 0 - triangles 2359521 threshold 2.43e-07
iteration 5 - triangles 2277631 threshold 3.2768e-05
iteration 10 - triangles 2245402 threshold 0.000371293
iteration 15 - triangles 2188142 threshold 0.00188957
iteration 20 - triangles 2087955 threshold 0.00643634
iteration 25 - triangles 1936697 threshold 0.0172104
iteration 30 - triangles 1752010 threshold 0.0391354
iteration 35 - triangles 1554953 threshold 0.0792352
iteration 40 - triangles 1363271 threshold 0.147008
iteration 45 - triangles 1186232 threshold 0.254804
iteration 50 - triangles 1030390 threshold 0.418195
iteration 55 - triangles 895631 threshold 0.656357
iteration 60 - triangles 782612 threshold 0.992437
iteration 65 - triangles 686921 threshold 1.45393
iteration 70 - triangles 606385 threshold 2.07307
Writing to file… done!
[INFO] running /code/build/bin/odm_cleanmesh -inputFile /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply -outputFile /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.ply -removeIslands -decimateMesh 300000 -verbose
Running with parameters:
–inputFile /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.dirty.ply
–outputFile /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.ply
–decimateMesh 300000
–removeIslands
–verbose
Removing islands
Decimating mesh
Current vertex count: 300310
Wanted vertex count: 300000
Target reduction set to 0.001032
Saving cleaned mesh to file…
OK
[INFO] Finished odm_meshing stage
[INFO] Running mvs_texturing stage
[INFO] Writing MVS Textured file in: /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_texturing_25d/odm_textured_model.obj
[INFO] running /code/SuperBuild/install/bin/texrecon /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/opensfm/undistorted/reconstruction.nvm /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_meshing/odm_25dmesh.ply /var/www/data/8907b4d5-0e57-457c-89c4-aac22c7d4838/odm_texturing_25d/odm_textured_model -d gmi -o gauss_clamping -t none --nadir_mode -n 65535
/code/SuperBuild/install/bin/texrecon (built on Feb 25 2020, 17:23:47)
Load and prepare mesh:
PLY Loader: comment VTK generated PLY File
Reading PLY: 300003 verts…
599380 faces…
done.
Removed 1 redundant faces.
Warning: Zero-length normals detected: 29 face normals, 1 vertex normals
Generating texture views:
NVM: Loading file…
NVM: Number of views: 650
NVM: Number of features: 642354
Loading 100%… done. (Took 70.627s)
Building adjacency graph:
Adding edges 100%… done. (Took 1.647s)
898758 total edges.
View selection:
Building BVH from 599379 faces…
done. (Took: 648 ms)
Calculating face qualities 100%… done. (Took 119.562s)
Postprocessing face infos 100%… done. (Took 0.978s)
Maximum quality of a face within an image: 58606.7
Clamping qualities to 4448.69 within normalization.
Writing data cost file…
done.
Optimizing:
Time[s] Energy
1 618110
3 612022
4 600923
5 594548
6 591660
7 590036
8 589073
9 588292
10 587734
11 587240
12 586997
13 586788
13 586621
14 586487
15 586373
32859 faces have not been seen
Took: 140.311s
Generating texture patches:
Running…
done. (Took 56.383s)
3900 texture patches.
Running global seam leveling:
Create matrices for optimization…
done.
Lhs dimensionality: 322891 x 322891
Calculating adjustments:
Color channel 0: CG took 81 iterations. Residual is 9.56256e-05
Color channel 1: CG took 81 iterations. Residual is 9.74334e-05
Color channel 2: CG took 81 iterations. Residual is 9.38959e-05
Took 0.921 seconds
Adjusting texture patches 100%… done. (Took 14.41s)
Running local seam leveling:
Killed
Traceback (most recent call last):
File “/code/run.py”, line 57, in
app.execute()
File “/code/stages/odm_app.py”, line 92, in execute
self.first_stage.run()

File “/code/opendm/types.py”, line 464, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 464, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 464, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 464, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 464, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 464, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 464, in run
self.next_stage.run(outputs)
File “/code/opendm/types.py”, line 445, in run
self.process(self.args, outputs)
File “/code/stages/mvstex.py”, line 115, in process
‘-n {nadirWeight}’.format(**kwargs))
File “/code/opendm/system.py”, line 76, in run
raise Exception(“Child returned {}”.format(retcode))
Exception
: Child returned 137

If you need the full log report, I will provide the link.

50 (or 500?) GB should be more than sufficient to process ~500 images.

Perhaps there’s a problem with the dataset. Does it work with other images?

Ive tried with other images. As a matter of fact, i have processed the same dataset in agisoft metashape, and there didn’t seem to be any camera calibration issues. Just to let you know, we captured the data using automated flight plan (DJI GSPRO), keeping 80% frontal overlap, and 70% side overlap.

And yea, 50GB RAM, and not 502GB :joy: (sorry for the typo)

If you’re able to share the dataset I (or others) could try to process it.

3 Likes

ok will send you the link within today!

Did you manage to figure this out?