Feature Request DNG input

I am having difficulties getting anything useful out of this application.
___I have put all my pictures in and tried several options, all I want right now is an orthophoto, and despite taking an hour to compute with a 5950x and 2 3090s, extremely fast storage and ram, I end up with basically nothing usable. The orthophoto comes out at 166x189px. 65kb. Comically low res, as per the title. The images input are 189 6k photos. What I want is a comically large image, no data lost at all, and Ill edit it down in other software as I see fit.
___Part of this could be my fault as the images that I took, I took in .dng format which, annoyingly, are not accepted. I used pixillion image converter to convert them in a large batch to .png. Despite the program saying it would preserve the exif data, it might not have. However, I dont think this is an issue as, despite being comically low resolution, the output orthophoto does look correct. To see if this is or isn’t an issue, I included both a png and dng in the dropbox folder for anyone to examine.
___I am puzzled and tried a few things such as mucking about with the settings such as skipping 3d, enabling fast orthophoto, turning the gsd way up or way down, and nothing seems to work. I was hoping to be able to use this software extensively but I am getting pretty discouraged as I cant even find what is going wrong, or how to fix it. Youtube tutorials seem to be lacking in quantity and quality, but enough is present for me to see that it does indeed work for some people… Yall are my last hope before I pull the plug, please help a noob out!

  1. Include a link to your images! You can use https://www.dropbox.com or https://drive.google.com. No images = difficult to help.
    I have attached everything I think is relevant in the dropbox folder HERE
    Dropbox - WebODM help - Simplify your life
    This is my latest attempt where I just used the default setting.

  2. Copy/paste the entire task output (not just parts of it) for everyone to read.
    in the dropbox folder, console.txt

  3. Did you fine tune any parameters? Which ones?
    tried default twice, fast orthophoto dropdown with default settings and with .01 as gsd
    same results except for the .01 which just didn’t output anything.

  4. If applicable, what browser are you using? What operating system? How did you install the software? Be precise.
    I am not using a browser. I installed using the paid windows version. I am using windows.

ps.
feature request: PLEASE look into accepting .dng

1 Like

Can you please convert to JPG? Without Geolocation information, the reconstruction can’t guess properly what the scale might be, hence the small reconstruction resolution.

PNG doss not have EXIF Geolocation as part of the standard , the closest thing is a PNGW (World file).

I can try that, yes, I just really dont want that lossy format.
Is pngw accepted in webodm?

Is there just not any way to just set the resolution scale? I’m floored that when I input 3.8 billion pixels that the program assumes that an output of 31,000 is acceptable… I want all 3.8 billion pixels!
Furthermore, if this is what happens when png is the input… why is it even accepted as an input? This is not usable data.

I’m converting to jpg now and I already really dont like that I’m losing over half of the data.
There must be a better way.

GeoTIFF would be the best lossless format.

I can only convert to TIFF and cant find anything online quickly about how to convert to geotiff. any ideas?
and no manual way to tell Webodm that I want all the data possible back out?

Also the jpgs dont seem to have the exif data either… Ill put a sample in attempt 2 folder in the dropbox

Without geolocation information, the reconstruction is naive and has no way to know what scale of object it is being asked to reconstruct, so it just makes a (usually wrong) guess.

If you have geolocation information, you won’t have this issue. You can provide that via the EXIF metadata, a geo.txt file, or a GCP (this would be an (ab)use of the GCP format, but folks still do this).

geo.txt:
https://docs.opendronemap.org/geo/

GCP:
https://docs.opendronemap.org/gcp/

GeoTIFF is mostly just a plain TIFF but with geolocation metadata. JPG would honestly be the easiest in this instance, though I’m not familiar with the tool you’re using so I can’t give you specific workflow recommendations.

well… I have dng files, that have everything I should need.
FEATURE REQUEST

Do you have any idea what program I could use to convert them into a usable file type for the program?

I just dont understand… All I want is the photos stitched together with minor angle adjustments. Are map coordinates really so absolutely essential to do this? There is no way to just tell the program to give me out the maximum size it can without interpolation?

The jpg version came out the exact same.
I uploaded the relevant data to the same dropbox folder

how does it know image 6 should match the overlap with image 9 without location?

Exactly how any other program, including this one does, by matching points between the pictures from the large amount of overlap. It obviously worked in this one as well because, even though the resolution is comically small, the photos ARE stiched together correctly.

Okay, I’ve found a way to convert to jpg and keep the exif data, its just incredibly annoying. I have to do my colour work and light editting BEFORE I run the images through the ortho builder.
So instead of doing it after the ortho process, I have to do 2 kinds of edits before hand on 189 pictures individually, then convert them one at a time, then run them through the ortho builder, then edit the final ortho to my liking, and then, finally, converting to a lossless filetype such as png.
If it works.
This is only if the coordinates and other exif data is the only problem.

please.
Whoever is working on this program, PLEASE make it work with DNG and other raw file types.
There is no reason that making a very high quality ortho should be this needlessly complex

https://docs.opendronemap.org/requesting-features/

1 Like

I believe we have at least two parts to implementing DNG support.

  1. XMP Metadata handling
    Feature Request: Optionally Support XMP Metadata when EXIF is missing · Issue #1254 · OpenDroneMap/ODM · GitHub

  2. DNG format reading/transcoding

This might be a pretty significant undertaking. Are you able to help contribute time, development effort, and/or money to help us build this for the Community?

If we can get enough Community interest, we might be able to launch another Quadratik Fundraising event:
https://fund.webodm.org/#/howitworks

I can contribute time and effort, though my coding knowledge is limited. Besides what ive already contributed monetarily, I really cant at the moment, im still growing my vusiness so anything i dont need to live and pay bills is going to building up equipment and marketing.

If theres anything i can do to help further this please dm me and im happy to anything i can

Also dng files have built in exif metadata, inless ots formatted completely differently, that shouldnt be a concern.

Windows at least, reads ot the same

TIFF, PNG or JPEG seem ok to me, all you need is to copy the EXIF metadata. Geotransformed images (like GeoTIFF or world files) are not the same.

You can use ExifTool to copy the EXIF tags to not-dng files, with something like exiftool -tagsFromFile MAX_0001.DNG MAX_0001.tif or any other extension. Lot of examples including copy tags for all the files in a directory at: exiftool Application Documentation.

Right now, your files have the following EXIF tags:

$ exiftool MAX_0001.DNG

ExifTool Version Number         : 10.10
File Name                       : MAX_0001.DNG
Directory                       : .
File Size                       : 39 MB
File Modification Date/Time     : 2022:06:16 05:46:57-03:00
File Access Date/Time           : 2022:06:16 05:48:03-03:00
File Inode Change Date/Time     : 2022:06:16 05:46:57-03:00
File Permissions                : rw-rw-r--
File Type                       : DNG
File Type Extension             : dng
MIME Type                       : image/x-adobe-dng
Exif Byte Order                 : Little-endian (Intel, II)
Make                            : Autel Robotics
Camera Model Name               : XT705
Orientation                     : Horizontal (normal)
Software                        : V0.2.30.30
Modify Date                     : 2022:06:13 15:41:44
Image Width                     : 5472
Image Height                    : 3648
Bits Per Sample                 : 16
Compression                     : Uncompressed
Photometric Interpretation      : Color Filter Array
Strip Offsets                   : 499706
Samples Per Pixel               : 1
Rows Per Strip                  : 3648
Strip Byte Counts               : 39923712
Planar Configuration            : Chunky
CFA Repeat Pattern Dim          : 2 2
CFA Pattern 2                   : 1 2 0 1
CFA Plane Color                 : Red,Green,Blue
CFA Layout                      : Rectangular
Linearization Table             : (Binary data 382105 bytes, use -b option to extract)
Black Level Repeat Dim          : 2 2
Black Level                     : 200 200 200 200
White Level                     : 4095
Default Scale                   : 1 1
Default Crop Origin             : 0 0
Default Crop Size               : 5472 3648
Bayer Green Split               : 0
Anti Alias Strength             : 1
Best Quality Scale              : 1
Opcode List 2                   : (Binary data 76 bytes, use -b option to extract)
Opcode List 3                   : (Binary data 184 bytes, use -b option to extract)
Default User Crop               : 0 0 1 1
Subfile Type                    : Reduced-resolution image
Preview Image Start             : 167756
Preview Image Length            : 331949
Y Cb Cr Coefficients            : 0.299 0.587 0.114
Y Cb Cr Sub Sampling            : YCbCr4:2:0 (2 2)
Y Cb Cr Positioning             : Co-sited
Reference Black White           : 0 255 128 255 128 255
XMP Toolkit                     : XMP Core 5.5.0
Creator Tool                    : V0.2.30.30
Date Created                    : 2022:06:13 15:41:44
Exposure Time                   : 1/640
F Number                        : 6.3
Exposure Program                : Manual
ISO                             : 100
Exif Version                    : 0230
Date/Time Original              : 2022:06:13 15:41:44
Create Date                     : 2022:06:13 15:41:44
Shutter Speed Value             : 1/640
Aperture Value                  : 8.9
Exposure Compensation           : -1.7
Max Aperture Value              : 2.8
Metering Mode                   : Center-weighted average
Light Source                    : Unknown
Focal Length                    : 10.6 mm
Exposure Mode                   : Manual
White Balance                   : Manual
Digital Zoom Ratio              : 1
Contrast                        : Normal
Saturation                      : Normal
Sharpness                       : Normal
GPS Version ID                  : 2.3.0.0
GPS Latitude Ref                : North
GPS Longitude Ref               : West
GPS Altitude Ref                : Above Sea Level
DNG Version                     : 1.4.0.0
DNG Backward Version            : 1.3.0.0
Unique Camera Model             : XT705
Localized Camera Model          : XT705
Color Matrix 1                  : 1.3007 -0.771 0.092 -0.1262 0.8047 0.3842 0.0122 0.0834 0.5144
Color Matrix 2                  : 0.9945 -0.355 -0.0868 -0.2576 1.0944 0.1866 -0.0426 0.1697 0.5299
Analog Balance                  : 1 1 1
As Shot Neutral                 : 0.448336 1 0.521385
Baseline Exposure               : 0
Baseline Noise                  : 3
Baseline Sharpness              : 1.33
Linear Response Limit           : 1
Shadow Scale                    : 1
Calibration Illuminant 1        : Standard Light A
Calibration Illuminant 2        : D65
Profile Name                    : XT705
Profile Hue Sat Map Dims        : 30 25 1
Profile Hue Sat Map Data 1      : (Binary data 38077 bytes, use -b option to extract)
Profile Hue Sat Map Data 2      : (Binary data 38303 bytes, use -b option to extract)
Profile Embed Policy            : Allow Copying
Profile Copyright               : Autel Robotics
Original Default Final Size     : 0 0
Original Best Quality Size      : 0 0
Original Default Crop Size      : undef undef
Aperture                        : 6.3
CFA Pattern                     : [Green,Blue][Red,Green]
GPS Altitude                    : 399.7 m Above Sea Level
GPS Latitude                    : 35 deg 14' 35.79" N
GPS Longitude                   : 85 deg 56' 4.04" W
GPS Position                    : 35 deg 14' 35.79" N, 85 deg 56' 4.04" W
Image Size                      : 5472x3648
Megapixels                      : 20.0
Preview Image                   : (Binary data 331949 bytes, use -b option to extract)
Shutter Speed                   : 1/640
Focal Length                    : 10.6 mm
Light Value                     : 14.6

$ exiftool MAX_0001.jpg

ExifTool Version Number         : 10.10
File Name                       : MAX_0001.jpg
Directory                       : .
File Size                       : 17 MB
File Modification Date/Time     : 2022:06:16 07:24:30-03:00
File Access Date/Time           : 2022:06:16 07:25:05-03:00
File Inode Change Date/Time     : 2022:06:16 07:24:30-03:00
File Permissions                : rw-rw-r--
File Type                       : JPEG
File Type Extension             : jpg
MIME Type                       : image/jpeg
JFIF Version                    : 1.01
Resolution Unit                 : inches
X Resolution                    : 0
Y Resolution                    : 0
Exif Byte Order                 : Little-endian (Intel, II)
Subfile Type                    : Reduced-resolution image
Compression                     : JPEG
Photometric Interpretation      : YCbCr
Make                            : Autel Robotics
Camera Model Name               : XT705
Strip Offsets                   : 156250
Orientation                     : Horizontal (normal)
Samples Per Pixel               : 3
Rows Per Strip                  : 120
Strip Byte Counts               : 11536
Planar Configuration            : Chunky
Software                        : V0.2.30.30
Modify Date                     : 2022:06:13 15:41:44
Warning                         : Bad SubIFD directory
Y Cb Cr Coefficients            : 0.299 0.587 0.114
Y Cb Cr Positioning             : Co-sited
Reference Black White           : 0 255 128 255 128 255
XMP Toolkit                     : XMP Core 5.5.0
Creator Tool                    : V0.2.30.30
Create Date                     : 2022:06:13 15:41:44
Date Created                    : 2022:06:13 15:41:44
DNG Backward Version            : 1.3.0.0
Unique Camera Model             : XT705
Localized Camera Model          : XT705
Color Matrix 1                  : 1.3007 -0.771 0.092 -0.1262 0.8047 0.3842 0.0122 0.0834 0.5144
Color Matrix 2                  : 0.9945 -0.355 -0.0868 -0.2576 1.0944 0.1866 -0.0426 0.1697 0.5299
Analog Balance                  : 1 1 1
As Shot Neutral                 : 0.448336 1 0.521385
Baseline Exposure               : 0
Baseline Noise                  : 3
Baseline Sharpness              : 1.33
Linear Response Limit           : 1
Shadow Scale                    : 1
Calibration Illuminant 1        : Standard Light A
Calibration Illuminant 2        : D65
Profile Name                    : XT705
Profile Hue Sat Map Dims        : 30 25 1
Profile Hue Sat Map Data 1      : (Binary data 24478 bytes, use -b option to extract)
Profile Hue Sat Map Data 2      : (Binary data 24473 bytes, use -b option to extract)
Profile Embed Policy            : Allow Copying
Profile Copyright               : Autel Robotics
Original Default Final Size     : 0 0
Original Best Quality Size      : 0 0
Original Default Crop Size      : undef undef
Image Width                     : 5472
Image Height                    : 3648
Encoding Process                : Baseline DCT, Huffman coding
Bits Per Sample                 : 8
Color Components                : 3
Y Cb Cr Sub Sampling            : YCbCr4:2:0 (2 2)
Image Size                      : 5472x3648
Megapixels                      : 20.0

$ exiftool MAX_0001.png

ExifTool Version Number         : 10.10
File Name                       : MAX_0001.png
Directory                       : .
File Size                       : 36 MB
File Modification Date/Time     : 2022:06:16 07:30:17-03:00
File Access Date/Time           : 2022:06:16 07:27:17-03:00
File Inode Change Date/Time     : 2022:06:16 07:50:50-03:00
File Permissions                : rw-rw-r--
File Type                       : PNG
File Type Extension             : png
MIME Type                       : image/png
Image Width                     : 5472
Image Height                    : 3648
Bit Depth                       : 8
Color Type                      : RGB
Compression                     : Deflate/Inflate
Filter                          : Adaptive
Interlace                       : Noninterlaced
SRGB Rendering                  : Perceptual
Gamma                           : 2.2
Image Size                      : 5472x3648
Megapixels                      : 20.0

So the EXIF GPS tags are not being actually copied.

2 Likes

About DNG postprocessing inside ODM: IMHO, postprocessing images is a task that ODM must avoid and seems better to me postprocess the raw images and send to ODM well processed images.

But you can open the feature request if you want it.

4 Likes