We recently had Markus add webXR functionality to potree (now here but probably soon to be in the v1.8 release). We’re keen to see this version available in ODM because then you could natively view ODM produced pointclouds in VR right off the web ODM interface (which is just cool, but also let’s you do interesting things like hand-photograph your room with your phone, stitch it into a point cloud with ODM and then natively view the pointcloud via ODM in VR and walk around in your actual house but in the VR point cloud version at 1:1 scale)
Anyways, I wanted to check with the community if there was a potential to either add a feature in ODM to choose a development branch of potree when viewing the point cloud so we can use the one that ssupports webXR, or to update the current viewer to v1.8 when it comes out or some other option to enable this functionality. We could potentially do this ourselves, but I’m guessing there are folks in the community who have worked with ODM far more and might be better suited to implement this.
We have funding to support this work if anyone is interested in helping out. Apologies if there is far more to this question then I realise, I’m new to this
(for Quest 1, keep the point budget at 1M points, 2M for Quest 2)
Note that unfortunately there is no way for Virtual Desktop to support webXR via desktop to the Quest (I checked with the developers) so for now we’re stuck with either max 2M point resolution on the Quest or using a desktop headset for larger datasets.
Great project - I’ve been looking for environments where I can pull in point clouds of terrain and integrate them with scene information for reviews. NVIDIA Omniverse Nucleus is the ultimate package for this apparently but seeing that using Potree the terrain could be visited at a URL with an HMD browser is awesome. Please let me know if we can help. I’ve got a Quest 2 so can help test that side.
I have quest 2 and orthophoto/dsm/dem is crazy cool.You are there!!! You can feeling every bump in the topography.
But can’t walk/see trough point cloud/texture model. Can’t enter full screen mode of the browser.
You have to just use quest 2 browser to reach WebODM .
Someone could help walk/see trough point cloud?
When you go to the potree page in your Quest browser, there should be a “VR” link available that will let you launch the view as a full webVR experience. If you aren’t seeing that can you post a screenshot of what you are seeing?
I generally create short links to make it easier to type the url into the browser. Note that there are now custom short links you can set w/in ODM, or you can use something like bitly.
Also note this all only works via the browser on the actual quest and can’t be done wirelessly from a desktop via Virtual Desktop and a desktop browser. Apparently this is a hard limitation due how webVR is implemented (I asked the VD developer). Which is too bad because it would be really sweet to view massive point point cloud on the quest via a desktop system!
Awesome. I’ll try to test this today, sounds exactly like how I’ve had to interact with Quest/VR thus far. I saw they’ve added hand tracking but have not tried anything but the grips.
Quick question - is it safe to assume this is a Potree mod so that I can view models created in ODM but run straight off the Potree viewer, for instance while viewing their ept? Should we be seeing a VR goggle link in potree embedded in WebODM before we visit the Quest browser?
@Tim I’ve set up a secure webserver for Potree and can view all of the Potree examples in the latest version. I can also view my own models there by simply adding an HTML file of the pattern shown in the examples. In particular, I’ve viewed the ept clouds. I was able to view the models in the Quest browser, but only saw the “Enter VR” tag on the Potree VR examples being served at potree.org. Those same models directly out of the potree directory structure don’t appear to show the VR entry point. Not sure if this is something I’ve missed in the HTML or an indication that I don’t have WebXR doing its thing.
I notice the VR examples all have metadata.json files referenced for loading the point clouds. I take it that is the result of a potreeconverter operation on the pointcloud. Safe to assume that can be run on the odm generated cloud?
I’ve posed this question to Markus but will mention it here. Potree github has VR examples running on the Potree webserver that utilize the potreeconverter generated octree’s. These show the ‘Enter VR’ icon in the potree screen when accessed. The same examples are provided as vr_* in the examples directory of potree and do not provide the same behavior in appropriate browsers (Firefox) with my own secure webserver (TLS 1.2). My question is what is different about those environments? It seems as straightforward as referencing the metadata.json file created by potreeconverter as the point cloud that should be loaded.
When you say “model” do you mean the meshed 3D model or the point clouds? I haven’t tested to see if we can configure the ODM outputs to show the meshed models in potree when one loads it in VR but it would be awesome if we could (although the models are usually very heavy and not optimised so it would likely be hard on the Quest to show them… but that’s a downstream issue from getting model viewing working)
We will be working on getting the meshed 3D models viewable in VR either via our cesium platform that is linked to ODM or within potree/ODM directly. I’ll post an update if when we make some progress.
Thank you! Any thoughts about why potree.org has examples VR-enabled in the browser but those same examples, with the same html, are not VR-enabled in my web server?
No, sorry. I’m not a web developer so I’m not the right person to ask
Markus is usually pretty good with email so you can probably email him and ask him directly. his email is on the potree github page