This is really in some ways a continuation of this topic First attempt at a 3D model - methane flue dataset but it’s locked so this is a new thread.
I’m wondering how important it is to mask areas of the input images that you don’t want to be considered for a 3D model. So for example for the flue that I’ve been using as a test case, the surrounding ground is really not of interest at all – really I only care about the fence and everything it encloses in images such as this which are typical:
AFAIU the main way this would be accomplished is with
_mask images which is straightforward in principle but quite a bit of additional effort. So I have a number questions to hopefully save me some rabbit-hole exploration:
- Is my assumption that masking is important to remove the extraneous parts of these images?
- To what extent does masking improve processing time/memory requirements etc., as opposed to simply omitting areas that aren’t of interest in the result?
- How important is it to be consistent with masking the same areas in each image? I.e. what happens if in most of the images something in the background, e.g. a tree or bush, gets masked out but in some others it does not?
- I expect masking moving objects is pretty important, but is there some threshold where I shouldn’t really worry about that?
- More generally are there particular types of things that are very important to mask out? For example I thought I read somewhere that it’s very important to mask out the horizon and things above?
- Are there tools that can be used to help speed up the creation of the mask images? E.g. for successive images probably the mask is similar as the parts to be masked will have moved only slightly. So a manual workflow would be something like having a 3-layer image in GIMP where the top layer is the mask, the bottom is all white and the middle is the image to be masked. You’d update the top layer with black wherever the mask should be, hide the middle layer, export the
_maskfile, replace the middle layer with the next image and re-show it, and repeat. Are there scripts for GIMP or something like that extant? Or maybe dedicated tools?
- What about tools that automatically mask the horizon and above?
One random thing I was thinking was whether having all these _mask files could be avoided, and the workflow simplified, by allowing a key color, something that doesn’t occur in the image (bright magenta perhaps), be considered the mask by the algorithm.
Here’s another specific question that comes to mind: Suppose you have this image
Obviously you don’t want background area behind the flue to be part of the reconstruction, but do you want to mask it very precisely to the edges of the actual flue or is it better to go a bit more inward, i.e.: