Repeated Code 1 error on exit

agadmin · 11 April 2018 15:49

I have been unable to process any images successfully into an orthomosaic. Images have been collected with a DJI Matrice 100 using a Zen Muse 3 camera. Have tried using images collected with three mapping programs: DJI GC, Precision Flight, and Drone Deploy. In each instance an error Code 1 is returned. Have tried adjusted the paramaters suggested with no success.
Here is a sample of the errors and warning that occur early in the processing:

Error: Directory Iop: Next pointer is out of bounds; ignored.
Error: Directory (Last IFD item) with 41992 entries considered invalid; not read.
Error: Directory (Last IFD item): Next pointer is out of bounds; ignored.
Error: Directory Iop: Next pointer is out of bounds; ignored.
Error: Directory (Last IFD item): Next pointer is out of bounds; ignored.
Error: Upper boundary of data for directory (Last IFD item), entry 0x4a49 is out of bounds: Offset = 0x00000001, size = 65540, exceeds buffer size by 56472 Bytes; truncating the entry
Error: Upper boundary of data for directory (Last IFD item), entry 0x0100 is out of bounds: Offset = 0x000000cd, size = 1441794, exceeds buffer size by 1432930 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0xcccc has unknown Exif (TIFF) type 48388; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0xcccc is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x00f0 has unknown Exif (TIFF) type 16389; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x00f0 is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0080 has unknown Exif (TIFF) type 16134; setting type size 1.
Error: Upper boundary of data for directory (Last IFD item), entry 0x0080 is out of bounds: Offset = 0x0000009a, size = 720897, exceeds buffer size by 711982 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0x9901 has unknown Exif (TIFF) type 49415; setting type size 1.
Error: Upper boundary of data for directory (Last IFD item), entry 0x9901 is out of bounds: Offset = 0x00000033, size = 720897, exceeds buffer size by 711879 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0x33ae has unknown Exif (TIFF) type 16904; setting type size 1.
Error: Upper boundary of data for directory (Last IFD item), entry 0x33ae is out of bounds: Offset = 0x0000009a, size = 720897, exceeds buffer size by 711982 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0x9919 has unknown Exif (TIFF) type 49161; setting type size 1.
Error: Upper boundary of data for directory (Last IFD item), entry 0x9919 is out of bounds: Offset = 0x000000cd, size = 720897, exceeds buffer size by 712033 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0xcca0 has unknown Exif (TIFF) type 49674; setting type size 1.
Error: Upper boundary of data for directory (Last IFD item), entry 0xcca0 is out of bounds: Offset = 0x0000009a, size = 720897, exceeds buffer size by 711982 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0x99b4 has unknown Exif (TIFF) type 16907; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x99b4 is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 256; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0000 is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0100 has unknown Exif (TIFF) type 512; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0100 is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0200 has unknown Exif (TIFF) type 1280; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0200 is out of bounds: Offset = 0x00058500; truncating the entry
Warning: Directory (Last IFD item), entry 0x0300 has unknown Exif (TIFF) type 512; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0300 is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0400 has unknown Exif (TIFF) type 1280; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0400 is out of bounds: Offset = 0x00059d00; truncating the entry
Warning: Directory (Last IFD item), entry 0x0500 has unknown Exif (TIFF) type 256; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0500 is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0600 has unknown Exif (TIFF) type 1280; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0600 is out of bounds: Offset = 0x0005b500; truncating the entry
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 9984; setting type size 1.
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 256; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0000 is out of bounds: Offset = 0x00271000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 19712; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0000 is out of bounds: Offset = 0x00003a00; truncating the entry
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 256; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0000 is out of bounds: Offset = 0x00271000; truncating the entry
Warning: Directory (Last IFD item), entry 0x039b has unknown Exif (TIFF) type 61952; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x039b is out of bounds: Offset = 0x01000100; truncating the entry
Warning: Directory (Last IFD item), entry 0x0200 has unknown Exif (TIFF) type 0; setting type size 1.
Error: Upper boundary of data for directory (Last IFD item), entry 0x0200 is out of bounds: Offset = 0x00000601, size = 72497464, exceeds buffer size by 72489932 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0x0300 has unknown Exif (TIFF) type 768; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0300 is out of bounds: Offset = 0x06000001; truncating the entry
Warning: Directory (Last IFD item), entry 0x1a00 has unknown Exif (TIFF) type 1280; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x1a00 is out of bounds: Offset = 0x00061901; truncating the entry
Warning: Directory (Last IFD item), entry 0x1b00 has unknown Exif (TIFF) type 1280; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x1b00 is out of bounds: Offset = 0x00062101; truncating the entry
Warning: Directory (Last IFD item), entry 0x2800 has unknown Exif (TIFF) type 768; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x2800 is out of bounds: Offset = 0x02000002; truncating the entry
Warning: Directory (Last IFD item), entry 0x0100 has unknown Exif (TIFF) type 1024; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0100 is out of bounds: Offset = 0x00062902; truncating the entry
Warning: Directory (Last IFD item), entry 0x0200 has unknown Exif (TIFF) type 1024; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0200 is out of bounds: Offset = 0x001d4400; truncating the entry
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Error: Upper boundary of data for directory (Last IFD item), entry 0x0000 is out of bounds: Offset = 0x00000100, size = 18432, exceeds buffer size by 9619 Bytes; truncating the entry
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 18432; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0000 is out of bounds: Offset = 0xd8ffdb00; truncating the entry
Warning: Directory (Last IFD item), entry 0x8400 has unknown Exif (TIFF) type 1027; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x8400 is out of bounds: Offset = 0x04030303; truncating the entry
Warning: Directory (Last IFD item), entry 0x0404 has unknown Exif (TIFF) type 1029; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0404 is out of bounds: Offset = 0x0505060c; truncating the entry
Warning: Directory (Last IFD item), entry 0x0809 has unknown Exif (TIFF) type 1802; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0809 is out of bounds: Offset = 0x0e0c0d0d; truncating the entry
Warning: Directory (Last IFD item), entry 0x0f11 has unknown Exif (TIFF) type 5651; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0f11 is out of bounds: Offset = 0x0d0d131a; truncating the entry
Warning: Directory (Last IFD item), entry 0x1315 has unknown Exif (TIFF) type 5912; setting type size 1.
Error: Directory (Last IFD item), entry 0x1315 has invalid size 4210752151; skipping entry.
Warning: Directory (Last IFD item), entry 0x181d has unknown Exif (TIFF) type 5656; setting type size 1.
Error: Directory (Last IFD item), entry 0x181d has invalid size 4210035241; skipping entry.
Warning: Directory (Last IFD item), entry 0x060b has unknown Exif (TIFF) type 1542; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x060b is out of bounds: Offset = 0x10181818; truncating the entry
Warning: Directory (Last IFD item), entry 0x1818 has unknown Exif (TIFF) type 6168; setting type size 1.
Error: Directory (Last IFD item), entry 0x1818 has invalid size 4042322161; skipping entry.
Warning: Directory (Last IFD item), entry 0x1818 has unknown Exif (TIFF) type 6168; setting type size 1.
Error: Directory (Last IFD item), entry 0x1818 has invalid size 4042322161; skipping entry.
Warning: Directory (Last IFD item), entry 0x1818 has unknown Exif (TIFF) type 6168; setting type size 1.
Error: Directory (Last IFD item), entry 0x1818 has invalid size 4042322161; skipping entry.
Warning: Directory (Last IFD item), entry 0x1818 has unknown Exif (TIFF) type 6168; setting type size 1.
Error: Directory (Last IFD item), entry 0x1818 has invalid size 4042322161; skipping entry.
Warning: Directory (Last IFD item), entry 0xc000 has unknown Exif (TIFF) type 4360; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0xc000 is out of bounds: Offset = 0x03012100; truncating the entry
Warning: Directory (Last IFD item), entry 0x0211 has unknown Exif (TIFF) type 259; setting type size 1.
Error: Directory (Last IFD item), entry 0x0211 has invalid size 2853436841; skipping entry.
Warning: Directory (Last IFD item), entry 0x0105 has unknown Exif (TIFF) type 257; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0105 is out of bounds: Offset = 0x00000000; truncating the entry
Warning: Directory (Last IFD item), entry 0x0000 has unknown Exif (TIFF) type 0; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0000 is out of bounds: Offset = 0x05060708; truncating the entry
Warning: Directory (Last IFD item), entry 0x090a has unknown Exif (TIFF) type 2832; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x090a is out of bounds: Offset = 0x03020403; truncating the entry
Warning: Directory (Last IFD item), entry 0x0505 has unknown Exif (TIFF) type 1028; setting type size 1.
Error: Offset of directory (Last IFD item), entry 0x0505 is out of bounds: Offset = 0x01020300; truncating the entry
Warning: Directory (Last IFD item), entry 0x0411 has unknown Exif (TIFF) type 1298; setting type size 1.
Error: Directory (Last IFD item), entry 0x0411 has invalid size 5568760381; skipping entry.
Warning: Directory (Last IFD item), entry 0x2271 has unknown Exif (TIFF) type 5170; setting type size 1.
Error: Directory (Last IFD item), entry 0x2271 has invalid size 21738048081; skipping entry.
Warning: Directory (Last IFD item), entry 0x1552 has unknown Exif (TIFF) type 53744; setting type size 1.
Error: Directory (Last IFD item), entry 0x1552 has invalid size 6073473141; skipping entry.
Warning: Directory (Last IFD item), entry 0x1718 has unknown Exif (TIFF) type 6426; setting type size 1.
Error: Directory (Last IFD item), entry 0x1718 has invalid size 6232573841; skipping entry.
Warning: Directory (Last IFD item), entry 0x3637 has unknown Exif (TIFF) type 14393; setting type size 1.
Error: Directory (Last IFD item), entry 0x3637 has invalid size 9774869171; skipping entry.
Warning: Directory (Last IFD item), entry 0x4a53 has unknown Exif (TIFF) type 21589; setting type size 1.
Error: Directory (Last IFD item), entry 0x4a53 has invalid size 14485648251; skipping entry.
Warning: Directory (Last IFD item), entry 0x6667 has unknown Exif (TIFF) type 26729; setting type size 1.
Error: Directory (Last IFD item), entry 0x6667 has invalid size 17859513491; skipping entry.
Warning: Directory (Last IFD item), entry 0x7a83 has unknown Exif (TIFF) type 33925; setting typ

pierotofy · 11 April 2018 17:36

Could you copy/paste the entire output?

Thanks!

PhilCHK · 15 April 2018 13:37

I have the same problem… with images taken with Mavic Air. It is the first time that I am using WebODM and been trying for 2 days without success with different batch of image here in Dropbox the images I used for the last trial and the entire task’s output. https://www.dropbox.com/sh/cin75y8ly5xtb9g/AABT2Hw7hHWscuOF5c_Imroza?dl=0
I worked with 5 GB ram (8 GB on the computer) and 20 GB storage. Images resized at 2086.

I would really appreciate some help. Thanks a lot.

pierotofy · 15 April 2018 20:02

Hi Phil, it looks like you’ve run out of memory:

CImgInstanceException *** [instance(0,0,0,0,(nil),non-shared)] CImg<double>::CImg(): Failed to allocate memory (1.2 Gio) for image (11563,13465,1,1).
runtime error

Try lowering --dem-gapfill-steps to 3 or 2, or increase --dem-resolution to 0.2 or 0.3.

PhilCHK · 15 April 2018 23:55

Thank you very much Pierotofy,

Sorry, I am very green using WebODM, Where should I paste these code lines and when? Is it just after ./webodm.sh start? Could it be also a too small storage allocation? I have 20 GB allocated to Docker.

I also thought that might be a problem of memory, though there is a video on Youtube with a pretty similar configuration which works even without geotags https://www.youtube.com/watch?v=kJQegRQUhWU. How can I process just .jpg images without georeferences?

I tried to do a much small batch of 5 images and got this result: see Task’s Output and screenshot https://www.dropbox.com/sh/m3w9w3i6kki40tn/AADmc0Nhfp7oRjUApEJY3VA8a?dl=0
Everything seems stuck in a loop. Will try again now, but it is getting a little bit frustrating after 3 unsuccessful days. Probably my fault though. Thank you very much for your support. Phil

pierotofy · 17 April 2018 03:20

@PhilCHK are you running the latest version of WebODM (did you run ./webodm.sh update or install WebODM in the last 5 days)? We had a problem with locks that should have been solved with https://github.com/OpenDroneMap/WebODM/pull/428.

Processing without georeferencing is currently a regression bug https://github.com/OpenDroneMap/OpenDroneMap/issues/799 that we hope to fix soon.

PhilCHK · 18 April 2018 06:24

Hello Pierotofy, yes I updated WebODM before using it within the last 5 days. I sent the same batch of 144 photos to be process by companies online such as Drone Deploy, Precision Mapper and Map Made Easy. They all came back with satisfying comparable results: orthomosaics, DEM, contours, Model .obj, pointcloud .las, Colored elevation map, NDVI (not calibrated of course) Green Leaves Index, Kmz files, So, the good news is that is doesn’t come from the pictures or the georeferenced data. Maybe my hardware configuration? I have 8 GB Ram, 5 dedicated to Docker, a i5 Windows 10 Pro laptop and 100 GB dedicated storage. Anyway WebODM keep stalling at ALIGN even with the minimum image. I am really looking for a solution that will allow me to process drone data on a regular base where there is no Internet. It is for an environmental development project in the Philippines and I would love also to train local students to use this great remote sensing technology, for all of us to learn and care for our daily environment. Let me know if you make progress, I will try again WebODM, on an other computer if possible. Best.

pierotofy · 18 April 2018 13:54

It might be a problem related to low memory, but WebODM should do a better job (fail with an error message) instead of hanging. One of these days I’ll run some tests to see if I can simulate a low memory scenario and reproduce this.