Update:
There have been several stallings since my last attempt. But something odd happened. One instance where I had trimmed everything down to 988 images appeared to have stalled but when I ran a webodm down, update, start, the data set was marked as completed.
It didn’t look great but it was complete.
I tried to run two other datasets for about 20 or so hours. They were 1303 and 5110 images respectively. It appeared as though they had stalled so I attempted the webodm command again but this time I got a processing node went offline error for both.
I feel like this dataset is triggering a bug where the front end and task output may not be updating with what is actually going on in the background. In addition, the dataset is taking a long time to process given the number of images and amount of RAM I am working with.
Below is the output of the dataset that appeared to stall but completed upon running: ./webodm.sh down && ./webodm.sh update && ./webodm.sh start --ssl --hostname omit --default-nodes 0&
....(Trimmed)
00:35:22 [App ] Build date: Aug 6 2022, 08:53:23
00:35:22 [App ] CPU: Intel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz (32 cores)
00:35:22 [App ] RAM: 688.96GB Physical Memory 863.57GB Virtual Memory
00:35:22 [App ] OS: Linux 5.4.0-125-generic (x86_64)
00:35:22 [App ] Disk: 2.43TB (5.90TB) space
00:35:22 [App ] SSE & AVX compatible CPU & OS detected
00:35:22 [App ] Command line: ReconstructMesh -i /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_meshing/odm_25dmesh.dirty.ply -o /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_meshing/odm_25dmesh.ply --remove-spikes 0 --remove-spurious 0 --smooth 0 --target-face-num 400000 -v 0
00:35:25 [App ] MEMORYINFO: {
00:35:25 [App ] VmPeak: 182992 kB
00:35:25 [App ] VmSize: 83516 kB
00:35:25 [App ] } ENDINFO
[INFO] Finished odm_meshing stage
[INFO] Running mvs_texturing stage
[INFO] Writing MVS Textured file in: /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_texturing/odm_textured_model_geo.obj
[INFO] running "/code/SuperBuild/install/bin/texrecon" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/undistorted/reconstruction.nvm" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_meshing/odm_mesh.ply" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_texturing/odm_textured_model_geo" -d gmi -o gauss_clamping -t none --no_intermediate_results --max_texture_size=8192
/code/SuperBuild/install/bin/texrecon (built on Aug 6 2022, 08:33:43)
Load and prepare mesh:
Reading PLY: 176922 verts... 356879 faces... done.
Generating texture views:
NVM: Loading file...
NVM: Number of views: 672
NVM: Number of features: 321212
Loading 100%... done. (Took 1.84s)
Building adjacency graph:
Adding edges 100%... done. (Took 0.878s)
534221 total edges.
View selection:
Building BVH from 356879 faces... done. (Took: 361 ms)
Calculating face qualities 100%... done. (Took 7.364s)
Postprocessing face infos 100%... done. (Took 0.18s)
Maximum quality of a face within an image: 2962.52
Clamping qualities to 380.722 within normalization.
Optimizing:
Time[s] Energy
0 371608
13 365815
14 360240
14 357498
14 356452
15 355918
15 355629
20 355315
21 355153
21 355056
22 354993
22 354939
22 354908
23 354882
161558 faces have not been seen
Took: 33.871s
Generating texture patches:
Running... done. (Took 1.944s)
24922 texture patches.
Running global seam leveling:
Create matrices for optimization... done.
Lhs dimensionality: 192874 x 192874
Calculating adjustments:
Color channel 1: CG took 137 iterations. Residual is 8.84558e-05
Color channel 0: CG took 137 iterations. Residual is 8.77051e-05
Color channel 2: CG took 133 iterations. Residual is 9.46827e-05
Took 0.636 seconds
Adjusting texture patches 100%... done. (Took 0.236s)
Running local seam leveling:
Blending texture patches 100%... done. (Took 9.641s)
Generating texture atlases:
Sorting texture patches... done.
Working on atlas 119 100%... done.
Finalizing texture atlases... done. (Took: 0s)
Building objmodel:
Saving model... done.
Whole texturing procedure took: 142.061s
[INFO] Writing MVS Textured file in: /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_texturing_25d/odm_textured_model_geo.obj
[INFO] running "/code/SuperBuild/install/bin/texrecon" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/undistorted/reconstruction.nvm" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_meshing/odm_25dmesh.ply" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_texturing_25d/odm_textured_model_geo" -d gmi -o gauss_clamping -t none --no_intermediate_results --nadir_mode --max_texture_size=8192
/code/SuperBuild/install/bin/texrecon (built on Aug 6 2022, 08:33:43)
Load and prepare mesh:
Reading PLY: 200280 verts... 394679 faces... done.
Warning: Zero-length normals detected: 0 face normals, 22 vertex normals
Generating texture views:
NVM: Loading file...
NVM: Number of views: 672
NVM: Number of features: 321212
Loading 100%... done. (Took 2.025s)
Building adjacency graph:
Adding edges 100%... done. (Took 0.802s)
589078 total edges.
View selection:
Building BVH from 394679 faces... done. (Took: 408 ms)
Calculating face qualities 100%... done. (Took 6.231s)
Postprocessing face infos 100%... done. (Took 0.997s)
Maximum quality of a face within an image: 9999.99
Clamping qualities to 9741.96 within normalization.
Optimizing:
Time[s] Energy
0 194341
1 188651
2 179492
3 175291
3 173538
4 172686
5 172196
5 171869
6 171606
7 171375
7 171207
8 171100
8 171035
9 170989
10 170950
10 170911
5525 faces have not been seen
Took: 25.839s
Generating texture patches:
Running... done. (Took 1.667s)
6626 texture patches.
Running global seam leveling:
Create matrices for optimization... done.
Lhs dimensionality: 238358 x 238358
Calculating adjustments:
Color channel 0: CG took 102 iterations. Residual is 9.90613e-05
Color channel 2: CG took 106 iterations. Residual is 9.3417e-05
Color channel 1: CG took 106 iterations. Residual is 8.93171e-05
Took 0.62 seconds
Adjusting texture patches 100%... done. (Took 0.358s)
Running local seam leveling:
Blending texture patches 100%... done. (Took 4.565s)
Generating texture atlases:
Sorting texture patches... done.
Working on atlas 28 100%... done.
Finalizing texture atlases... done. (Took: 0s)
Building objmodel:
Saving model... done.
Whole texturing procedure took: 80.214s
[INFO] Finished mvs_texturing stage
[INFO] Running odm_georeferencing stage
[INFO] Georeferencing point cloud
[INFO] running pdal translate -i "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_filterpoints/point_cloud.ply" -o "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz" ferry transformation --filters.ferry.dimensions="views => UserData" --writers.las.compression="lazip" --filters.transformation.matrix="1 0 0 560333.0 0 1 0 2832515.0 0 0 1 0 0 0 0 1" --writers.las.offset_x=560333.0 --writers.las.offset_y=2832515.0 --writers.las.scale_x=0.001 --writers.las.scale_y=0.001 --writers.las.scale_z=0.001 --writers.las.offset_z=0 --writers.las.a_srs="+proj=utm +zone=17 +datum=WGS84 +units=m +no_defs +type=crs"
[INFO] Calculating cropping area and generating bounds shapefile from point cloud
[INFO] running pdal translate -i "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz" -o "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.decimated.las" decimation --filters.decimation.step=40
[INFO] running pdal info --boundary --filters.hexbin.edge_size=1 --filters.hexbin.threshold=0 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.decimated.las" > "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.boundary.json"
[INFO] running pdal info --summary "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz" > "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.summary.json"
[INFO] running ogr2ogr -overwrite -f GPKG -a_srs "+proj=utm +zone=17 +datum=WGS84 +units=m +no_defs" /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.bounds.gpkg /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.bounds.geojson
[INFO] Creating Entwine Point Tile output
[INFO] running entwine build --threads 40 --tmp "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/entwine_pointcloud-tmp" -i /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz -o "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/entwine_pointcloud"
1/1: /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz
Dimensions: [
X:int32, Y:int32, Z:int32, Intensity:uint16, ReturnNumber:uint8,
NumberOfReturns:uint8, ScanDirectionFlag:uint8, EdgeOfFlightLine:uint8,
Classification:uint8, ScanAngleRank:float32, UserData:uint8,
PointSourceId:uint16, GpsTime:float64, Red:uint16, Green:uint16, Blue:uint16
]
Points: 98,785,944
Bounds: [(560261, 2832445, -60), (560404, 2832578, 2)]
Scale: 0.001
SRS: EPSG:32617
Adding 0 - /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz
Joining
00:10 - 4% - 3,502,080 - 1,260 (1,260) M/h - 0W - 0R - 96A
00:20 - 7% - 6,852,608 - 1,233 (1,206) M/h - 0W - 0R - 167A
00:30 - 10% - 9,854,976 - 1,182 (1,080) M/h - 0W - 0R - 231A
00:40 - 13% - 13,012,992 - 1,171 (1,136) M/h - 0W - 0R - 299A
00:50 - 16% - 16,105,472 - 1,159 (1,113) M/h - 0W - 0R - 371A
01:00 - 19% - 18,968,576 - 1,138 (1,030) M/h - 0W - 0R - 449A
01:10 - 22% - 21,733,376 - 1,117 (995) M/h - 0W - 0R - 503A
01:20 - 25% - 24,670,208 - 1,110 (1,057) M/h - 0W - 0R - 561A
01:30 - 28% - 27,467,776 - 1,098 (1,007) M/h - 5W - 4R - 610A
01:40 - 31% - 30,281,728 - 1,090 (1,013) M/h - 0W - 1R - 664A
01:50 - 33% - 32,940,032 - 1,078 (956) M/h - 0W - 0R - 708A
02:00 - 36% - 35,622,912 - 1,068 (965) M/h - 3W - 1R - 746A
02:10 - 39% - 38,461,440 - 1,065 (1,021) M/h - 2W - 2R - 799A
02:20 - 42% - 41,054,208 - 1,055 (933) M/h - 0W - 2R - 838A
02:30 - 44% - 43,646,976 - 1,047 (933) M/h - 0W - 0R - 883A
02:40 - 47% - 46,223,360 - 1,040 (927) M/h - 14W - 0R - 939A
...Trimmed
06:10 - 77% - 75,706,368 - 736 (610) M/h - 215W - 26R - 1196A
06:20 - 77% - 75,837,440 - 718 (47) M/h - 0W - 97R - 1295A
06:30 - 77% - 76,398,592 - 705 (202) M/h - 0W - 78R - 1382A
06:40 - 79% - 77,950,976 - 701 (558) M/h - 27W - 36R - 1425A
06:50 - 81% - 79,781,888 - 700 (659) M/h - 0W - 19R - 1482A
07:00 - 83% - 81,829,888 - 701 (737) M/h - 13W - 22R - 1530A
07:10 - 84% - 83,439,616 - 698 (579) M/h - 81W - 34R - 1511A
07:20 - 85% - 84,381,696 - 690 (339) M/h - 129W - 55R - 1458A
07:30 - 87% - 85,536,768 - 684 (415) M/h - 0W - 68R - 1553A
07:40 - 87% - 86,339,584 - 675 (289) M/h - 147W - 58R - 1476A
07:50 - 88% - 87,269,376 - 668 (334) M/h - 0W - 75R - 1564A
08:00 - 89% - 88,276,992 - 662 (362) M/h - 271W - 45R - 1355A
08:10 - 89% - 88,354,816 - 649 (28) M/h - 0W - 93R - 1450A
08:20 - 90% - 89,272,320 - 642 (330) M/h - 0W - 70R - 1537A
08:30 - 92% - 90,759,168 - 640 (535) M/h - 126W - 30R - 1462A
08:40 - 93% - 91,430,912 - 632 (241) M/h - 0W - 76R - 1550A
08:50 - 94% - 92,450,816 - 627 (367) M/h - 11W - 73R - 1632A
09:00 - 94% - 93,249,536 - 621 (287) M/h - 30W - 71R - 1680A
09:10 - 96% - 94,687,232 - 619 (517) M/h - 158W - 36R - 1586A
09:20 - 97% - 95,387,648 - 613 (252) M/h - 0W - 74R - 1667A
09:30 - 98% - 96,653,312 - 610 (455) M/h - 214W - 39R - 1530A
09:40 - 98% - 97,222,656 - 603 (204) M/h - 0W - 80R - 1601A
09:50 - 99% - 97,853,440 - 597 (227) M/h - 0W - 84R - 1698A
10:00 - 100% - 98,785,944 - 592 (335) M/h - 334W - 59R - 1479A
10:10 - 100% - 98,785,944 - 582 (0) M/h - 1078W - 0R - 404A
Done 0
Saving
Wrote 98,785,944 points.
[INFO] Finished odm_georeferencing stage
[INFO] Running odm_dem stage
[INFO] Classify: True
[INFO] Create DSM: True
[INFO] Create DTM: True
[INFO] DEM input file /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz found: True
[INFO] Classifying /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz using Simple Morphological Filter
[INFO] running pdal translate -i /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz -o /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz smrf --filters.smrf.scalar=1.25 --filters.smrf.slope=0.15 --filters.smrf.threshold=0.5 --filters.smrf.window=18.0
[INFO] Created /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz in 0:04:52.785038
[INFO] running pdal info --summary "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz" > "/tmp/tmp13sqa5ct.json"
[INFO] Point cloud bounds are [minx: 560261.658, maxx: 560403.437] [miny: 2832445.344, maxy: 2832577.448]
[INFO] DEM resolution is (2643, 2836), max tile size is 4096, will split DEM generation into 1 tiles
[INFO] Generating /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm_r0.1_x0_y0.tif (max, radius: 0.1, resolution: 0.05)
[INFO] Generating /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm_r0.05_x0_y0.tif (max, radius: 0.05, resolution: 0.05)
[INFO] running pdal pipeline -i /tmp/tmperguzzxt.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp8zl678go.json > /dev/null 2>&1
[INFO] Generating /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm_r0.025_x0_y0.tif (max, radius: 0.025, resolution: 0.05)
[INFO] running pdal pipeline -i /tmp/tmp0dmzl8b7.json > /dev/null 2>&1
[INFO] running gdalbuildvrt -input_file_list "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles_list.txt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.vrt"
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -co NUM_THREADS=40 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 48.2% "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.vrt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tmp.tif"
Input file size is 2836, 2643
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -co NUM_THREADS=40 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 48.2% -outsize 10% 0 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tmp.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.small.tif"
100 - done.
0
...(Trimmed)
.
.
.
80
.
.
.
90
.
.
.
Input file size is 2836, 2643
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdalbuildvrt -resolution highest -r bilinear "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/merged.vrt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.small_filled.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tmp.tif"
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -co NUM_THREADS=40 -co TILED=YES -co BIGTIFF=IF_SAFER -co COMPRESS=DEFLATE --config GDAL_CACHEMAX 48.2% "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/merged.vrt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tif"
Input file size is 2836, 2643
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Starting smoothing...
[INFO] Smoothing iteration 1
[INFO] Smoothing completed in 0:00:00.828202
[INFO] Completed smoothing to create /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.tif in 0:00:02.570829
[INFO] Completed dsm.tif in 0:03:12.695921
[INFO] Cropping /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.tif
[INFO] running gdalwarp -cutline /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.bounds.gpkg -crop_to_cutline -co TILED=YES -co COMPRESS=DEFLATE -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co BIGTIFF=IF_SAFER -co NUM_THREADS=40 /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.original.tif /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.tif --config GDAL_CACHEMAX 48.2%
Creating output file that is 2318P x 2451L.
Processing /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.original.tif [1/1] : 0Using internal nodata values (e.g. -9999) for image /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.original.tif.
Copying nodata values from source /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.original.tif to destination /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.tif.
...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Optimizing /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.tif as Cloud Optimized GeoTIFF
[INFO] running gdal_translate -of COG -co NUM_THREADS=40 -co BLOCKSIZE=256 -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co RESAMPLING=NEAREST --config GDAL_CACHEMAX 48.2% --config GDAL_NUM_THREADS 40 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm_cogeo.tif"
Input file size is 2318, 2451
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running pdal info --summary "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz" > "/tmp/tmps9do5tfy.json"
[INFO] Point cloud bounds are [minx: 560261.658, maxx: 560403.437] [miny: 2832445.344, maxy: 2832577.448]
[INFO] DEM resolution is (2643, 2836), max tile size is 4096, will split DEM generation into 1 tiles
[INFO] Generating /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm_r0.1_x0_y0.tif (idw, radius: 0.1, resolution: 0.05)
[INFO] Generating /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm_r0.05_x0_y0.tif (idw, radius: 0.05, resolution: 0.05)
[INFO] Generating /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm_r0.025_x0_y0.tif (idw, radius: 0.025, resolution: 0.05)
[INFO] running pdal pipeline -i /tmp/tmp5y3qmymh.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp0ehit1ys.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpmufkrufk.json > /dev/null 2>&1
[INFO] running gdalbuildvrt -input_file_list "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles_list.txt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.vrt"
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -co NUM_THREADS=40 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 48.2% "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.vrt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tmp.tif"
Input file size is 2836, 2643
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -co NUM_THREADS=40 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 48.2% -outsize 10% 0 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tmp.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.small.tif"
100 - done.
0
...(Trimmed)
.
.
.
80
.
.
.
90
.
.
.
Input file size is 2836, 2643
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdalbuildvrt -resolution highest -r bilinear "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/merged.vrt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.small_filled.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tmp.tif"
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -co NUM_THREADS=40 -co TILED=YES -co BIGTIFF=IF_SAFER -co COMPRESS=DEFLATE --config GDAL_CACHEMAX 48.2% "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/merged.vrt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/tiles.tif"
Input file size is 2836, 2643
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Starting smoothing...
[INFO] Smoothing iteration 1
[INFO] Smoothing completed in 0:00:00.673347
[INFO] Completed smoothing to create /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.tif in 0:00:03.012276
[INFO] Completed dtm.tif in 0:02:43.470364
[INFO] Cropping /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.tif
[INFO] running gdalwarp -cutline /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.bounds.gpkg -crop_to_cutline -co TILED=YES -co COMPRESS=DEFLATE -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co BIGTIFF=IF_SAFER -co NUM_THREADS=40 /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.original.tif /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.tif --config GDAL_CACHEMAX 48.2%
Creating output file that is 2318P x 2451L.
Processing /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.original.tif [1/1] : 0Using internal nodata values (e.g. -9999) for image /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.original.tif.
Copying nodata values from source /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.original.tif to destination /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.tif.
...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Optimizing /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.tif as Cloud Optimized GeoTIFF
[INFO] running gdal_translate -of COG -co NUM_THREADS=40 -co BLOCKSIZE=256 -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co RESAMPLING=NEAREST --config GDAL_CACHEMAX 48.2% --config GDAL_NUM_THREADS 40 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm_cogeo.tif"
Input file size is 2318, 2451
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Finished odm_dem stage
[INFO] Running odm_orthophoto stage
[INFO] running "/code/SuperBuild/install/bin/odm_orthophoto" -inputFiles /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_texturing_25d/odm_textured_model_geo.obj -logFile "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto_log.txt" -outputFile "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto_render.tif" -resolution 20.0 -outputCornerFile "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto_corners.txt"
[INFO] Creating GeoTIFF
[INFO] running gdal_translate -a_ullr 560261.658157 2832577.524342 560403.432457 2832445.437637 -co TILED=YES -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co NUM_THREADS=40 -a_srs "+proj=utm +zone=17 +datum=WGS84 +units=m +no_defs +type=crs" --config GDAL_CACHEMAX 48.2% --config GDAL_TIFF_INTERNAL_MASK YES "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto_render.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.tif" > "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/gdal_translate_log.txt"
[INFO] Cropping /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.tif
[INFO] running gdalwarp -cutline /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.bounds.gpkg -crop_to_cutline -co TILED=YES -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co NUM_THREADS=40 -dstalpha /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.original.tif /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.tif --config GDAL_CACHEMAX 48.2%
Using band 4 of source image as alpha.
Creating output file that is 2319P x 2452L.
Processing /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.original.tif [1/1] : 0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Optimizing /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.tif as Cloud Optimized GeoTIFF
[INFO] running gdal_translate -of COG -co NUM_THREADS=40 -co BLOCKSIZE=256 -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co RESAMPLING=NEAREST --config GDAL_CACHEMAX 48.2% --config GDAL_NUM_THREADS 40 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto_cogeo.tif"
Input file size is 2319, 2452
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Finished odm_orthophoto stage
[INFO] Running odm_report stage
[INFO] Exporting shots.geojson
[INFO] Wrote /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_report/shots.geojson
[INFO] running pdal info --dimensions "X,Y,Z" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz" > "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.info.json"
[INFO] running pdal translate -i "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.laz" -o "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.tif" --writer gdal --writers.gdal.resolution=0.10127142857136537 --writers.gdal.data_type=uint8_t --writers.gdal.dimension=UserData --writers.gdal.output_type=max --writers.gdal.radius=0.14321942776652308
[INFO] Cropping /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.tif
[INFO] running gdalwarp -cutline /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_georeferencing/odm_georeferenced_model.bounds.gpkg -crop_to_cutline -co TILED=YES -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co NUM_THREADS=40 /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.original.tif /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.tif --config GDAL_CACHEMAX 48.2%
Creating output file that is 1144P x 1210L.
Processing /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.original.tif [1/1] : 0Using internal nodata values (e.g. 255) for image /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.original.tif.
Copying nodata values from source /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.original.tif to destination /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.tif.
...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdaldem color-relief "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.tif" "/code/opendm/report/overlap_color_map.txt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/overlap.png" -of PNG -alpha
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -of png "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_orthophoto/odm_orthophoto.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/ortho.png" -outsize 1400 0 --config GDAL_CACHEMAX 48.2%
Input file size is 2319, 2452
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -outsize 1400 0 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.preview.tif" --config GDAL_CACHEMAX 48.2%
Input file size is 2318, 2451
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Computing raster stats for /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.preview.tif
[INFO] running gdaldem color-relief "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.preview.tif" "/code/opendm/tiles/color_relief.txt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.previewcolor.tif" -alpha -co ALPHA=YES
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdaldem hillshade "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.preview.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.previewhillshade.tif" -z 1.0 -s 1.0 -az 315.0 -alt 45.0
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running /usr/bin/python3 "/code/opendm/tiles/hsv_merge.py" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.previewcolor.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.previewhillshade.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.previewcolored_hillshade.tif"
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -outsize 1400 0 -of png "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dsm.previewcolored_hillshade.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/dsm.png" --config GDAL_CACHEMAX 48.2%
Input file size is 1400, 1480
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -outsize 1400 0 "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.preview.tif" --config GDAL_CACHEMAX 48.2%
Input file size is 2318, 2451
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Computing raster stats for /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.preview.tif
[INFO] running gdaldem color-relief "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.preview.tif" "/code/opendm/tiles/color_relief.txt" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.previewcolor.tif" -alpha -co ALPHA=YES
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdaldem hillshade "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.preview.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.previewhillshade.tif" -z 1.0 -s 1.0 -az 315.0 -alt 45.0
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running /usr/bin/python3 "/code/opendm/tiles/hsv_merge.py" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.previewcolor.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.previewhillshade.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.previewcolored_hillshade.tif"
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] running gdal_translate -outsize 1400 0 -of png "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_dem/dtm.previewcolored_hillshade.tif" "/var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/opensfm/stats/dtm.png" --config GDAL_CACHEMAX 48.2%
Input file size is 1400, 1480
0...10...20...30...40...50...60...70...80...90...100 - done.
[INFO] Exporting report to /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca/odm_report/report.pdf
2022-08-31 01:12:15,443 DEBUG: Page break on page 6 at y=290 for element of height 10 > 277
2022-08-31 01:12:17,541 DEBUG: Final doc sections size summary:
2022-08-31 01:12:17,541 DEBUG: - header.size: 9.0B
2022-08-31 01:12:17,542 DEBUG: - pages.size: 5.2KiB
2022-08-31 01:12:17,542 DEBUG: - resources.fonts.size: 199.0B
2022-08-31 01:12:17,595 DEBUG: - resources.images.size: 17.3MiB
2022-08-31 01:12:17,595 DEBUG: - resources.dict.size: 263.0B
2022-08-31 01:12:17,596 DEBUG: - info.size: 55.0B
2022-08-31 01:12:17,596 DEBUG: - catalog.size: 104.0B
2022-08-31 01:12:17,596 DEBUG: - xref.size: 770.0B
2022-08-31 01:12:17,596 DEBUG: - trailer.size: 68.0B
[INFO] Finished odm_report stage
[INFO] Running odm_postprocess stage
[INFO] Post Processing
[INFO] Finished odm_postprocess stage
[INFO] No more stages to run
[INFO] ...(Trimmed)
[INFO] ODM app finished - Wed Aug 31 01:12:17 2022
100 - done.
Postprocessing: /var/www/data/6e48cefd-0f6a-4628-9d38-293c41eaf6ca
Found point cloud: odm_georeferencing/odm_georeferenced_model.laz
Entwine point cloud is already built.
Entwine point cloud is already built.
Postprocessing: done (•̀ᴗ•́)و!
Compressing all.zip
Done!