Recommedations for processing thermal images - Mavic 3T

Hello everyone,

For the past few months, I’ve been experimenting with ODM and WebODM in areas related to photogrammetry in general and processing thermal images for creating orthomosaics. My main focus is on using these techniques to inspect solar panels.

To collect data and capture images, I’ve been using a DJI Mavic 3T drone.

I’ve been following many forums here, code on Github, EXIFtools forums, issues on GitHub, etc., regarding the issue with the drone’s thermal sensor data. (Links below)

Is possible calibration the thermal images of DJI MAVIC 3T?
Processing DJI Mavic 3T imagery
Mapping Thermal images (Mavic 3T)
Celsius values - image looks good but celsius ranges are not correct
[Thermal support for DJI M3T [WIP] by pierotofy · Pull Request #1670 · OpenDroneMap/ODM · GitHub](https://Thermal support for DJI M3T [WIP])
[DJI H20T thermal radiometric jpeg file - Page 4](https://DJI H20T thermal radiometric jpeg file)

At the moment, the only way I’ve been able to process the thermal orthomosaic map is by converting the resulting drone images *T.JPG (R.JPG?) to a single-band .TIFF using codes available on GitHub from different sources. Although all of them are based on the DJI Thermal SDK, I’ve been able to achieve results with a lot of opportunities for improvement.

In an effort to improve the processing, I acquired the book “OpenDroneMap - The Missing Guide” 1st Edition by Piero Toffanin. After reading the entire book, I was able to improve the results slightly. However, I still believe that to improve the ODM result, I also need to improve image acquisition.

That said, I would like you to share with me and the community your recommendations for obtaining high-quality thermal images, as well as your recommendations for obtaining the best possible thermal orthomosaic.

Any help would be much appreciated.

Even if you don’t know for sure the answer, try to help anyway. Some help is better than no help.
Piero Toffanin, “OpenDroneMap - The Missing Guide” 1st Edition

3 Likes

Hey there!

We’re using the exact same drone for thermal inspection of solar power plants. Converting the images to .tiff seems to work fine for you, nice! I found that after you converted the images to tiff you absolutely have to copy the original exif-file-tags to the tiff-images, otherwise strange things will happen in ODM.

The command I’ve been using in scripts for that is:

exiftool -overwrite_original -tagsfromfile ./pre/%f.JPG -all:all ./post/ 

This takes the tags from the files in the local “pre” folder and copies them onto the files in the “post” folder. You can check the tags with exiftool ‘path/to/image/imagename.tiff’.

Also see the topic I opened here in the forums. :slight_smile: Still haven’t managed to, but planning to create some proper camera calibration values for the distortion using OpenCV. https://community.opendronemap.org/t/lens-calibration-of-thermal-camera-dji-3t

Welcome to the forum!
Cheers

4 Likes

This is super helpful. Any objection to us including this at docs.opendronemap.org?

1 Like

Hello @noro,

Thank you so much for your recommendations. I have done some research and found out that the R.JPG to .TIFF conversion that I’m using already copies the original exif-file-tags to the tiff-images (referenced to the code below).

DJI-Tools-and-Stuff

Besides this, I’m thinking about the flight itself and the drone configuration. After this, I’m also considering calibration, as mentioned before. But I still believe there is room for improvement in the flight.

Could you or anyone share some tips or your current configuration for the image taking process? Also, which parameters do you use for converting the R.JPG pictures? (Emissivity, especially).

1 Like

Of course not, please go ahead! :smiley:

For that I’ve been orienting myself on flight guides of commercial software. An example of such a flight guide is: DJI Mavic 3 Thermal (M3T) Flight Guidelines - Raptor Maps They are specifying a 70% side overlap and a 20% front overlap, I’ve been playing it safe with 80%/80%. Biggest issue so far are random artifacts in the thermal orthophotos.

My best results of that:

But as you can see, still lots of artifacts, sadly. Also the brightness of the middle rows seems to be a sky reflection. The parameters for the image calculation in WebODM are:

auto-boundary: true, camera-lens: fisheye_opencv, feature-type: sift, gps-accuracy: 2.8, min-num-features: 100000, optimize-disk-space: true, orthophoto-resolution: 1, radiometric-calibration: camera, use-fixed-camera-params: true

Cheers!

Hi, Sorry for my late response. I’ve been taking some data, following your recommendations, and experimenting with it. Fortunately, the data now seems to be more accurate. Nevertheless, I haven’t been able to find the right configuration for generating the thermal orthomosaic.

Also try to convert the *T.JPG to .TIFF following your steps, the results seem to be the same as in GitHub - MiroRavaProj/DJI-Tools-and-Stuff: This is a project that tries to combine various DJI related tools, which was the first one I used. This part would be considered a solved!

As of now, the only things to be the generated image composition and quality.

Related to the image taking process, see the Excel table below with the flights done at the time of writing this. The whether have not been great for the past week, so I’m planning to perform other flights at the end of next week. Any recommendations?

Hi, Noro:

I was wondering if you get this results after the camera calibration mention in?

I look forward to your feedback.

Kind regards.

This looks amazing, I’ve been trying to get the same results with some very mixed results.

Using your settings above I’m getting a plain grey image and a very, very messy 3d model.

I am currently running the images through the processor as I missed that step the first time. Fingers crossed!

Alright folks, took me a while to get back to you but here we go!

Looks good to me! One thing which came to mind was the use of GCPs. One could use black and white tiles as gcp-markers… maybe. Not sure about that and the effects on the reconstruction in ODM.

Actually without them! A lot of experimenting with different parameters brought me there. I still haven’t found the time to conduct the calibration, sadly. But still got the checkerboard pattern on my desk! So I won’t forget it. :smiley:

The conversion to .tiff is a MUST! Without it ODM can only use the different pixels and some metadata in the JPG, all the thermal data is lost since ODM can’t interpret the proprietary DJI-format. Converting the images to .tiff fixes that! Makes a huge difference!

I’m really looking forward to your own results, please share them here, if you can.
Cheers!

The result is actually a plain gray image. If you are on WebODM when switching to “Plant Health” you will be able to see the thermal orthomosaic. If everything works well, you should see on Layers the Algorithm “Celsius” and the Color applied to it. Normally, Magma.

Looking forward to seeing your results. I’m still worried about quality.

I’m planning on making a much larger area by the end of this week. Hope to get back to you soon.

2 Likes

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.