Contours plugin, how to?

Davidwes · 29 April 2022 13:49

Hello, newbie here
Trying out WebODM Lightning (150 points) and having some difficulty with the contour plugin

Both Preview and Export seem NOT working.
Both circle icons just keep turning for hours with GPU running, until (4 hours later) GPU stops but the circle icons keep turning.

Preview: Contour lines never appear on the map
Export: No dialog to save or download
I’ve tried various combinations of intervals (0.25,1,2), DSM, DTM, simplify (0.2, 0), DXF and SHP; and view set to Orthophoto, Surface model or Terrain model.

Note: After Clicking on Preview or Export, I noticed a new folder was created: [results folder]/tmp/[…_grass_engine]
with subfolder …/vector/contour containing some files including a +1Gb file name “coor”

System: Windows 10 Pro, 48Gb Ram, AMD Ryzen7 Pro

Am I doing it wrong? How can I get get those contours in DXF or SHP, where would I find the actual dxf or shp files?

Thanks

Saijin_Naib · 29 April 2022 13:53

Welcome!

The Contours are not currently very well multi-threaded, so they can take a very long time to run if you have the intervals set high, low/no simplification, and a large area of reconstruction.

Can you give us an idea of what your Task is like?

For instance:

Created on:	4/26/2022, 11:20:30 AM
Processing Node:	node-odm-1 (manual)
Options:	auto-boundary: true, dsm: true, fast-orthophoto: true, matcher-neighbors: 4, sfm-algorithm: planar
Average GSD:	4.65 cm
Area:	45,403.66 m²
Reconstructed Points:	263,504

Davidwes · 29 April 2022 14:05

Thanks for prompt response!

It shows less details on my screen, see screenshot (attached) and Task Output below

Area (measured on the map): 15,888.38 Sq Meters
GSD: not sure where to find it, but in another software it showed as 1.68cm

Created on: 4/28/2022, 12:33:32 PM

Processing Node: Lightning (manual)

Options: build-overviews: true, dsm: true, dtm: true, feature-quality: medium, min-num-features: 18000, orthophoto-compression: JPEG, pc-classify: true, pc-geometric: true, pc-quality: high, skip-report: true

The problem is not not threading or GPU or the time it takes, its that I’m not getting any output afterwards, or maybe I dont know where to look should there be a download/save dialog?

Blockquote
… output truncated at undefined lines …
60
.
.
.
70
.
.
.
80
.
.
.
90
.
.
.
Input file size is 8699, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdalbuildvrt -resolution highest -r bilinear “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/merged.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/tiles.small_filled.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/tiles.tmp.tif”
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdal_translate -co NUM_THREADS=16 -co TILED=YES -co BIGTIFF=IF_SAFER -co COMPRESS=DEFLATE --config GDAL_CACHEMAX 46.15% “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/merged.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/tiles.tif”
Input file size is 8699, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Starting smoothing…
[INFO] Smoothing iteration 1
[INFO] Completed smoothing to create /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/mesh_dsm.tif in 0:00:31.595992
[INFO] Completed mesh_dsm.tif in 0:01:16.507693
[INFO] Creating mesh from DSM: /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/mesh_dsm.tif
[INFO] running “/code/SuperBuild/install/bin/dem2mesh” -inputFile “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/tmp/mesh_dsm.tif” -outputFile “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/odm_25dmesh.dirty.ply” -maxTileLength 2000 -maxVertexCount 200000 -maxConcurrency 16 -edgeSwapThreshold 0.15
[INFO] running “/code/SuperBuild/install/bin/OpenMVS/ReconstructMesh” -i “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/odm_25dmesh.dirty.ply” -o “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/odm_25dmesh.ply” --remove-spikes 0 --remove-spurious 0 --smooth 0 --target-face-num 400000 -v 0
18:20:45 [App ] Build date: Feb 26 2022, 03:53:56
18:20:45 [App ] CPU: AMD EPYC Processor (16 cores)
18:20:45 [App ] RAM: 30.67GB Physical Memory 61.35GB Virtual Memory
18:20:45 [App ] OS: Linux 4.15.0-176-generic (x86_64)
18:20:45 [App ] SSE & AVX compatible CPU & OS detected
18:20:45 [App ] Command line: -i /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/odm_25dmesh.dirty.ply -o /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/odm_25dmesh.ply --remove-spikes 0 --remove-spurious 0 --smooth 0 --target-face-num 400000 -v 0
18:20:47 [App ] MEMORYINFO: {
18:20:47 [App ] VmPeak: 165868 kB
18:20:47 [App ] VmSize: 129000 kB
18:20:47 [App ] } ENDINFO
[INFO] Finished odm_meshing stage
[INFO] Running mvs_texturing stage
[INFO] Writing MVS Textured file in: /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_texturing/odm_textured_model_geo.obj
[INFO] running “/code/SuperBuild/install/bin/texrecon” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/opensfm/undistorted/reconstruction.nvm” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/odm_mesh.ply” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_texturing/odm_textured_model_geo” -d gmi -o gauss_clamping -t none --no_intermediate_results --max_texture_size=8192
/code/SuperBuild/install/bin/texrecon (built on Feb 26 2022, 03:53:07)
Load and prepare mesh:
Reading PLY: 156617 verts… 313684 faces… done.
Generating texture views:
NVM: Loading file…
NVM: Number of views: 225
NVM: Number of features: 72487
.
Loading 100%… done. (Took 4.644s)
Building adjacency graph:
.
Adding edges 100%… done. (Took 0.601s)
470439 total edges.
View selection:
Building BVH from 313684 faces… done. (Took: 317 ms)
.
Calculating face qualities 100%… done. (Took 11.325s)
.
Postprocessing face infos 100%… done. (Took 0.213s)
Maximum quality of a face within an image: 17296.4
Clamping qualities to 1370.01 within normalization.
Optimizing:
Time[s] Energy
0 348618
4 341840
4 334375
4 330547
5 328905
5 328032
5 327514
7 326936
7 326642
7 326467
7 326357
7 326269
8 326219
8 326172
8 326134
79143 faces have not been seen
Took: 21.563s
Generating texture patches:
Running… done. (Took 3.873s)
15267 texture patches.
Running global seam leveling:
Create matrices for optimization… done.
Lhs dimensionality: 194076 x 194076
Calculating adjustments:
Color channel 0: CG took 129 iterations. Residual is 9.23062e-05
Color channel 1: CG took 129 iterations. Residual is 8.97025e-05
Color channel 2: CG took 129 iterations. Residual is 9.26921e-05
Took 0.472 seconds
.
Adjusting texture patches 100%… done. (Took 0.949s)
Running local seam leveling:
.
Blending texture patches 100%… done. (Took 26.614s)
Generating texture atlases:
Sorting texture patches… done.
.
Working on atlas 79 100%… done.
Finalizing texture atlases… done. (Took: 0s)
Building objmodel:
Saving model… done.
Whole texturing procedure took: 192.597s
[INFO] Writing MVS Textured file in: /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_texturing_25d/odm_textured_model_geo.obj
[INFO] running “/code/SuperBuild/install/bin/texrecon” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/opensfm/undistorted/reconstruction.nvm” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_meshing/odm_25dmesh.ply” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_texturing_25d/odm_textured_model_geo” -d gmi -o gauss_clamping -t none --no_intermediate_results --nadir_mode --max_texture_size=8192
/code/SuperBuild/install/bin/texrecon (built on Feb 26 2022, 03:53:07)
Load and prepare mesh:
Reading PLY: 168753 verts… 337041 faces… done.
Generating texture views:
NVM: Loading file…
NVM: Number of views: 225
NVM: Number of features: 72487
.
Loading 100%… done. (Took 4.375s)
Building adjacency graph:
.
Adding edges 100%… done. (Took 0.578s)
505341 total edges.
View selection:
Building BVH from 337041 faces… done. (Took: 237 ms)
.
Calculating face qualities 100%… done. (Took 9.774s)
.
Postprocessing face infos 100%… done. (Took 0.726s)
Maximum quality of a face within an image: 9986.64
Clamping qualities to 9684.01 within normalization.
Optimizing:
Time[s] Energy
0 122812
1 119402
1 110656
1 107531
2 106343
2 105707
2 105386
2 105153
3 105006
3 104900
3 104825
4 104789
4 104771
4 104750
4 104725
5 104714
4304 faces have not been seen
Took: 17.849s
Generating texture patches:
Running… done. (Took 3.612s)
10087 texture patches.
Running global seam leveling:
Create matrices for optimization… done.
Lhs dimensionality: 206821 x 206821
Calculating adjustments:
Color channel 0: CG took 108 iterations. Residual is 8.79683e-05
Color channel 2: CG took 108 iterations. Residual is 9.13656e-05
Color channel 1: CG took 108 iterations. Residual is 8.48048e-05
Took 0.446 seconds
.
Adjusting texture patches 100%… done. (Took 1.496s)
Running local seam leveling:
.
Blending texture patches 100%… done. (Took 12.025s)
Generating texture atlases:
Sorting texture patches… done.
.
Working on atlas 55 100%… done.
Finalizing texture atlases… done. (Took: 0s)
Building objmodel:
Saving model… done.
Whole texturing procedure took: 87.847s
[INFO] Finished mvs_texturing stage
[INFO] Running odm_georeferencing stage
[INFO] Georeferencing point cloud
[INFO] running pdal translate -i “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_filterpoints/point_cloud.ply” -o “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz” ferry transformation --filters.ferry.dimensions=“views => UserData” --writers.las.compression=“lazip” --filters.transformation.matrix=“1 0 0 565329.0 0 1 0 4635652.0 0 0 1 0 0 0 0 1” --writers.las.offset_x=565329.0 --writers.las.offset_y=4635652.0 --writers.las.offset_z=0 --writers.las.a_srs="+proj=utm +zone=18 +datum=WGS84 +units=m +no_defs +type=crs"
[INFO] Calculating cropping area and generating bounds shapefile from point cloud
[INFO] running pdal translate -i “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz” -o “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.decimated.las” decimation --filters.decimation.step=40
[INFO] running pdal info --boundary --filters.hexbin.edge_size=1 --filters.hexbin.threshold=0 “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.decimated.las” > “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.boundary.json”
[INFO] running pdal info --summary “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz” > “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.summary.json”
[INFO] running ogr2ogr -overwrite -f GPKG -a_srs “+proj=utm +zone=18 +datum=WGS84 +units=m +no_defs” /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.bounds.gpkg /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.bounds.geojson
[INFO] Creating Entwine Point Tile output
[INFO] running entwine build --threads 16 --tmp “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/entwine_pointcloud-tmp” -i /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz -o “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/entwine_pointcloud”
1/1: /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz
Dimensions: [
X:int32, Y:int32, Z:int32, Intensity:uint16, ReturnNumber:uint8,
NumberOfReturns:uint8, ScanDirectionFlag:uint8, EdgeOfFlightLine:uint8,
Classification:uint8, ScanAngleRank:float32, UserData:uint8,
PointSourceId:uint16, GpsTime:float64, Red:uint16, Green:uint16, Blue:uint16
]
Points: 20,166,678
Bounds: [(565220, 4635578, 236), (565395, 4635708, 283)]
Scale: 0.01
SRS: EPSG:32618
.
Adding 0 - /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz
Joining
00:10 - 24% - 4,890,624 - 1,760 (1,760) M/h - 0W - 0R - 121A
00:20 - 46% - 9,293,824 - 1,672 (1,585) M/h - 0W - 0R - 218A
00:30 - 66% - 13,287,424 - 1,594 (1,437) M/h - 0W - 0R - 302A
00:40 - 86% - 17,297,408 - 1,556 (1,443) M/h - 0W - 0R - 410A
Done 0
Saving
00:50 - 100% - 20,166,678 - 1,452 (1,032) M/h - 456W - 0R - 0A
Wrote 20,166,678 points.
[INFO] Finished odm_georeferencing stage
[INFO] Running odm_dem stage
[INFO] Classify: True
[INFO] Create DSM: True
[INFO] Create DTM: True
[INFO] DEM input file /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz found: True
[INFO] Classifying /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz using Simple Morphological Filter
[INFO] running pdal translate -i /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz -o /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz smrf --filters.smrf.scalar=1.25 --filters.smrf.slope=0.15 --filters.smrf.threshold=0.5 --filters.smrf.window=18.0
[INFO] Created /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz in 0:00:48.867996
[INFO] running pdal info --summary “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz” > “/tmp/tmp1icp9vji.json”
[INFO] Point cloud bounds are [minx: 565220.86, maxx: 565394.82] [miny: 4635578.92, maxy: 4635707.45]
[INFO] DEM resolution is (6427, 8698), max tile size is 4096, will split DEM generation into 4 tiles
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.04_x0_y0.tif (max, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.04_x0_y1.tif (max, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.04_x1_y0.tif (max, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.04_x1_y1.tif (max, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.02_x0_y0.tif (max, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.02_x0_y1.tif (max, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.02_x1_y0.tif (max, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.02_x1_y1.tif (max, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.01_x0_y0.tif (max, radius: 0.01, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.01_x0_y1.tif (max, radius: 0.01, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.01_x1_y0.tif (max, radius: 0.01, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_r0.01_x1_y1.tif (max, radius: 0.01, resolution: 0.02)
[INFO] running pdal pipeline -i /tmp/tmp1em6f9_4.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpmnfq9jex.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpqid5361f.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp411v9qet.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpe4s4ft3c.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp4pcmx0vk.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpcfnbnhj_.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpqdgnk0_g.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmplyraf9uk.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp10c03vdp.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmps44guk3q.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpl664k1iu.json > /dev/null 2>&1
[INFO] running gdalbuildvrt -input_file_list “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles_list.txt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.vrt”
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdal_translate -co NUM_THREADS=16 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 46.15% “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tmp.tif”
Input file size is 8698, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdal_translate -co NUM_THREADS=16 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 46.15% -outsize 10% 0 “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tmp.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.small.tif”
100 - done.
0
.
.
.
10
.
.
.
20
.
.
.
30
.
.
.
40
.
.
.
50
.
.
.
60
.
.
.
70
.
.
.
80
.
.
.
90
.
.
.
Input file size is 8698, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdalbuildvrt -resolution highest -r bilinear “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/merged.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.small_filled.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tmp.tif”
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdal_translate -co NUM_THREADS=16 -co TILED=YES -co BIGTIFF=IF_SAFER -co COMPRESS=DEFLATE --config GDAL_CACHEMAX 46.15% “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/merged.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tif”
Input file size is 8698, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Starting smoothing…
[INFO] Smoothing iteration 1
[INFO] Completed smoothing to create /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.tif in 0:00:30.492664
[INFO] Completed dsm.tif in 0:01:03.569668
[INFO] Cropping /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.tif
[INFO] running gdalwarp -cutline /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.bounds.gpkg -crop_to_cutline -co TILED=YES -co COMPRESS=DEFLATE -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co BIGTIFF=IF_SAFER -co NUM_THREADS=16 /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.original.tif /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.tif --config GDAL_CACHEMAX 46.15%
Creating output file that is 8188P x 6233L.
Processing /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.original.tif [1/1] : 0Using internal nodata values (e.g. -9999) for image /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.original.tif.
Copying nodata values from source /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.original.tif to destination /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.tif.
…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Optimizing /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.tif as Cloud Optimized GeoTIFF
[INFO] running gdal_translate -of COG -co NUM_THREADS=16 -co BLOCKSIZE=256 -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co RESAMPLING=NEAREST --config GDAL_CACHEMAX 46.15% --config GDAL_NUM_THREADS 16 “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dsm_cogeo.tif”
Input file size is 8188, 6233
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running pdal info --summary “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.laz” > “/tmp/tmplnhdt2z_.json”
[INFO] Point cloud bounds are [minx: 565220.86, maxx: 565394.82] [miny: 4635578.92, maxy: 4635707.45]
[INFO] DEM resolution is (6427, 8698), max tile size is 4096, will split DEM generation into 4 tiles
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.04_x0_y0.tif (idw, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.04_x0_y1.tif (idw, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.04_x1_y0.tif (idw, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.04_x1_y1.tif (idw, radius: 0.04, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.02_x0_y0.tif (idw, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.02_x0_y1.tif (idw, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.02_x1_y0.tif (idw, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.02_x1_y1.tif (idw, radius: 0.02, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.01_x0_y0.tif (idw, radius: 0.01, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.01_x0_y1.tif (idw, radius: 0.01, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.01_x1_y0.tif (idw, radius: 0.01, resolution: 0.02)
[INFO] Generating /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_r0.01_x1_y1.tif (idw, radius: 0.01, resolution: 0.02)
[INFO] running pdal pipeline -i /tmp/tmpexyt_zie.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpjkhy0mcx.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpmm_yd223.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpcxxhhin7.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp6ry8s36k.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpo06biep0.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpugulekkj.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp0jo4rx57.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpd7xkg6o5.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpjzvzwklp.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmp2b7x4i99.json > /dev/null 2>&1
[INFO] running pdal pipeline -i /tmp/tmpgjh_sbo0.json > /dev/null 2>&1
[INFO] running gdalbuildvrt -input_file_list “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles_list.txt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.vrt”
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdal_translate -co NUM_THREADS=16 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 46.15% “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tmp.tif”
Input file size is 8698, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdal_translate -co NUM_THREADS=16 -co BIGTIFF=IF_SAFER --config GDAL_CACHEMAX 46.15% -outsize 10% 0 “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tmp.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.small.tif”
100 - done.
0
.
.
.
10
.
.
.
20
.
.
.
30
.
.
.
40
.
.
.
50
.
.
.
60
.
.
.
70
.
.
.
80
.
.
.
90
.
.
.
Input file size is 8698, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdalbuildvrt -resolution highest -r bilinear “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/merged.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.small_filled.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tmp.tif”
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] running gdal_translate -co NUM_THREADS=16 -co TILED=YES -co BIGTIFF=IF_SAFER -co COMPRESS=DEFLATE --config GDAL_CACHEMAX 46.15% “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/merged.vrt” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/tiles.tif”
Input file size is 8698, 6427
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Starting smoothing…
[INFO] Smoothing iteration 1
[INFO] Completed smoothing to create /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.tif in 0:00:32.244239
[INFO] Completed dtm.tif in 0:01:07.220616
[INFO] Cropping /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.tif
[INFO] running gdalwarp -cutline /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.bounds.gpkg -crop_to_cutline -co TILED=YES -co COMPRESS=DEFLATE -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co BIGTIFF=IF_SAFER -co NUM_THREADS=16 /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.original.tif /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.tif --config GDAL_CACHEMAX 46.15%
Creating output file that is 8188P x 6233L.
Processing /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.original.tif [1/1] : 0Using internal nodata values (e.g. -9999) for image /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.original.tif.
Copying nodata values from source /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.original.tif to destination /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.tif.
…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Optimizing /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.tif as Cloud Optimized GeoTIFF
[INFO] running gdal_translate -of COG -co NUM_THREADS=16 -co BLOCKSIZE=256 -co COMPRESS=DEFLATE -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co RESAMPLING=NEAREST --config GDAL_CACHEMAX 46.15% --config GDAL_NUM_THREADS 16 “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_dem/dtm_cogeo.tif”
Input file size is 8188, 6233
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Finished odm_dem stage
[INFO] Running odm_orthophoto stage
[INFO] running “/code/SuperBuild/install/bin/odm_orthophoto” -inputFiles /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_texturing_25d/odm_textured_model_geo.obj -logFile “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto_log.txt” -outputFile “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto_render.tif” -resolution 50.0 -outputCornerFile “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto_corners.txt”
[INFO] Creating GeoTIFF
[INFO] running gdal_translate -a_ullr 565220.8581924438 4635707.465602875 565394.7581939697 4635579.005607605 -co TILED=YES -co COMPRESS=JPEG -co PREDICTOR=1 -co BIGTIFF=IF_SAFER -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co NUM_THREADS=16 -a_srs “+proj=utm +zone=18 +datum=WGS84 +units=m +no_defs +type=crs” --config GDAL_CACHEMAX 46.15% --config GDAL_TIFF_INTERNAL_MASK YES “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto_render.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto.tif” > “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/gdal_translate_log.txt”
[INFO] Cropping /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto.tif
[INFO] running gdalwarp -cutline /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_georeferencing/odm_georeferenced_model.bounds.gpkg -crop_to_cutline -co TILED=YES -co COMPRESS=JPEG -co PREDICTOR=1 -co BIGTIFF=IF_SAFER -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co NUM_THREADS=16 -dstalpha /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto.original.tif /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto.tif --config GDAL_CACHEMAX 46.15%
Using band 4 of source image as alpha.
Creating output file that is 8188P x 6234L.
Processing /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto.original.tif [1/1] : 0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Optimizing /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto.tif as Cloud Optimized GeoTIFF
[INFO] running gdal_translate -of COG -co NUM_THREADS=16 -co BLOCKSIZE=256 -co COMPRESS=JPEG -co PREDICTOR=1 -co BIGTIFF=IF_SAFER -co RESAMPLING=NEAREST --config GDAL_CACHEMAX 46.15% --config GDAL_NUM_THREADS 16 “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto.tif” “/var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_orthophoto/odm_orthophoto_cogeo.tif”
Warning 6: ‘1’ is an unexpected value for PREDICTOR creation option of type string-select.
Input file size is 8188, 6234
0…10…20…30…40…50…60…70…80…90…100 - done.
[INFO] Finished odm_orthophoto stage
[INFO] Running odm_report stage
[INFO] Exporting shots.geojson
[INFO] Wrote /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e/odm_report/shots.geojson
[WARNING] Skipping report generation as requested
[INFO] Finished odm_report stage
[INFO] Running odm_postprocess stage
[INFO] Post Processing
[INFO] Finished odm_postprocess stage
[INFO] No more stages to run
[INFO] MMMMMMMMMMMNNNMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNNNMMMMMMMMMMM
[INFO] MMMMMMdo:…—…/sNMMMMMMMMMMMMMMMMMMMMMMMMMMNs/…—…:odMMMMMM
[INFO] MMMMy-.odNMMMMMNy//mMMMMMMMMMMMMMMMMMMMMMMm//hNMMMMMNdo.-yMMMM
[INFO] MMN/sMMMMMMMMMNNMm/yMMMMMMMMMMMMMMMMMMMMy/mMNNMMMMMMMMNs/MMM
[INFO] MM/ hMMMMMMMMNs.+MMM/ dMMMMMMMMMMMMMMMMMMh +MMM+.sNMMMMMMMMh +MM
[INFO] MN /MMMMMMNo/./mMMMMN :MMMMMMMMMMMMMMMMMM: NMMMMm/./oNMMMMMM: NM
[INFO] Mm +MMMMMN+ /MMMMMMM-MMMMMMMMMMMMMMMMMM-MMMMMMM: oNMMMMM+ mM
[INFO] MM…NMMNs./mNMMMMMMMy sMMMMMMMMMMMMMMMMMMo hMMMMMMMNm/.sNMMN-MM [INFO] MMd:mMNomMMMMMMMMMy:MMMMMMMNmmmmNMMMMMMN:hMMMMMMMMMdoNMm-dMM [INFO] MMMm:.omMMMMMMMMNh/ sdmmho/.…-``-/sddh+ /hNMMMMMMMMdo.:mMMM [INFO] MMMMMd+--/osss+:-:/ :- .ym+ hmo``:-` `+:-:ossso/-:+dMMMMM [INFO] MMMMMMMNmhysosydmNMo /ds`/NMM+ hMMd..dh. sMNmdysosyhmNMMMMMMM [INFO] MMMMMMMMMMMMMMMMMMMs .:-:``hmmN+ yNmds -:.:`-NMMMMMMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMMMMMMN.-mNm- //:::. -:://: +mMd`-NMMMMMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMMMMMM+ dMMN -MMNNN+ yNNNMN :MMMs sMMMMMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMMMMMM`.mmmy /mmmmm/ smmmmm``mmmh :MMMMMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMMMMMM``:::- ./////. -:::::` :::: -MMMMMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMMMMMM:`mNNd /NNNNN+ hNNNNN .NNNy +MMMMMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMMMMMMd`/MMM.`ys+//. -/+oso +MMN.`mMMMMMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMMMMMMMy /o:- `oyhd/ shys+ `-:s-`hMMMMMMMMMMMMMMMMMM [INFO] MMMMMMMMNmdhhhdmNMMM` +d+ sMMM+ hMMN:`hh- sMMNmdhhhdmNMMMMMMMM [INFO] MMMMMms:::/++//::+ho .+- /dM+ hNh- +/` -h+:://++/::/smMMMMM [INFO] MMMN+./hmMMMMMMNds- ./oso:.``:. :-``.:os+- -sdNMMMMMMmy:.oNMMM [INFO] MMm-.hMNhNMMMMMMMMNo`/MMMMMNdhyyyyhhdNMMMM+`oNMMMMMMMMNhNMh.-mMM [INFO] MM:`mMMN/-sNNMMMMMMMo yMMMMMMMMMMMMMMMMMMy sMMMMMMMNNs-/NMMm`:MM [INFO] Mm /MMMMMd/.-oMMMMMMN :MMMMMMMMMMMMMMMMMM-`MMMMMMMo-./dMMMMM/ NM [INFO] Mm /MMMMMMm:-`sNMMMMN :MMMMMMMMMMMMMMMMMM-`MMMMMNs`-/NMMMMMM/ NM [INFO] MM:`mMMMMMMMMd/-sMMMo yMMMMMMMMMMMMMMMMMMy sMMMs-/dMMMMMMMMd`:MM [INFO] MMm-.hMMMMMMMMMdhMNo`+MMMMMMMMMMMMMMMMMMMM+`oNMhdMMMMMMMMMh.-mMM [INFO] MMMNo./hmNMMMMMNms--yMMMMMMMMMMMMMMMMMMMMMMy--smNMMMMMNmy/.oNMMM [INFO] MMMMMms:-:/+++/:-+hMMMMMMMMMMMMMMMMMMMMMMMMMNh+-:/+++/:-:smMMMMM [INFO] MMMMMMMMNdhhyhdmMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmdhyhhmNMMMMMMMM [INFO] MMMMMMMMMMMMMMMNNNNNMMMMMMNNNNNNMMMMMMMMNNMMMMMMMNNMMMMMMMMMMMMM [INFO] MMMMMMMMMMMMMh/-...-+dMMMm......:+hMMMMs../MMMMMo..sMMMMMMMMMMMM [INFO] MMMMMMMMMMMM/ /yhy- sMMm -hhy/ :NMM+ oMMMy /MMMMMMMMMMMM [INFO] MMMMMMMMMMMy /MMMMN` NMm /MMMMo +MM: .` yMd :MMMMMMMMMMMM
[INFO] MMMMMMMMMMM+ sMMMMM: hMm /MMMMd -MM- /s h.d- -MMMMMMMMMMMM
[INFO] MMMMMMMMMMMs +MMMMM. mMm /MMMMy /MM. +M/ yM: MMMMMMMMMMMM [INFO] MMMMMMMMMMMN- smNm/ +MMm :NNdo .mMMoMM+/yMM/ MMMMMMMMMMMM [INFO] MMMMMMMMMMMMNo- :yMMMm :sNMMM sMMMMMMM+ NMMMMMMMMMMM
[INFO] MMMMMMMMMMMMMMMNmmNMMMMMMMNmmmmNMMMMMMMNNMMMMMMMMMNNMMMMMMMMMMMM
[INFO] ODM app finished - Thu Apr 28 18:31:07 2022
100 - done.
Postprocessing: /var/www/data/27c24c7a-dc7c-4d91-a296-b99e45c6c98e
.
Found point cloud: odm_georeferencing/odm_georeferenced_model.laz
.
Entwine point cloud is already built.
.
Entwine point cloud is already built.
.
Postprocessing: done (•̀ᴗ•́)و!
.
Compressing all.zip
.
Done!

Saijin_Naib · 29 April 2022 14:28

The Contours are generated on-the-fly via the View Map function, so they won’t be anywhere to download until they have fully generated, then you export them from the Contours plugin:

I would try maybe setting the interval to something like 30m and simplification to 30m and it should generate quite quickly. If that works, then we know the other settings are just too fine and it is taking a really long time to generate.

Davidwes · 29 April 2022 15:11

It worked!
interval 10m (entire model including trees is 37m height), smoothing 10m
it took 5mn

So I guess, for smaller intervals, I should do EITHER Preview OR Export, and wait for one to finish before trying the other

Thank you Saijin!

Davidwes · 29 April 2022 15:54

Just one more thing,

How do you stop or cancel a contours operation thats taking too long? (small interval and simplification)
I’ve tried closing WebODM but a process “Grass” remains running in the background
Just force stop Grass?

Saijin_Naib · 29 April 2022 16:06

Yep! Until we figure out how to get this more parallel, it will take a while. If speed is of the utmost importance, you can always generate contours in QGIS.

Unfortunately, that’s the best answer I know of at the moment.

system · 29 May 2022 16:06

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.