Split-Merge, RasterioIOError: Read or write failed. An error occurred while writing a dirty block

Running latest updated today (20 June, 2022). Command line initiated, run through command line with ClusterODM and a few nodes.

docker pull opendronemap/odm&& docker run -ti -v /location:/datasets opendronemap/odm --project-path /datasets datasetname --sm-cluster https://localIPAddress:port --split 450 --split-overlap 320 --max-concurrency 32

I am occasionally seeing the following:

self.next_stage.run(outputs)
[Previous line repeated 7 more times]
File "/code/opendm/types.py", line 328, in run
self.process(self.args, outputs)
File "/code/stages/odm_orthophoto.py", line 130, in process
orthophoto.compute_mask_raster(tree.odm_orthophoto_tif, cutline_file,
File "/code/opendm/orthophoto.py", line 134, in compute_mask_raster
dst.write(out_image)
File "rasterio/_io.pyx", line 1395, in rasterio._io.DatasetWriterBase.write
rasterio.errors.RasterioIOError: Read or write failed. An error occurred while writing a dirty block from GDALRasterBand::IRasterIO

==> submodel_0006/error.log <==
self.next_stage.run(outputs)
[Previous line repeated 7 more times]
File "/code/opendm/types.py", line 328, in run
self.process(self.args, outputs)
File "/code/stages/odm_orthophoto.py", line 130, in process
orthophoto.compute_mask_raster(tree.odm_orthophoto_tif, cutline_file,
File "/code/opendm/orthophoto.py", line 134, in compute_mask_raster
dst.write(out_image)
File "rasterio/_io.pyx", line 1395, in rasterio._io.DatasetWriterBase.write
rasterio.errors.RasterioIOError: Read or write failed. An error occurred while writing a dirty block from GDALRasterBand::IRasterIO

Googling around, it’s either I am running out of space (1.1TB free, so not likely) or an issue with BigTIFF failing to be used in Rasterio.

1 Like

Pull request in: #1477 Fix for RasterioIOError BigTIFF by smathermather · Pull Request #1477 · OpenDroneMap/ODM · GitHub

1 Like