The model viewer is great, but the functionality is really limited. Not having to make the AR content in an app will really make it more scaleable.
It would be great if we can add more functionality, some basic buttons being able to play more then 1 animation, if you want realistic models you will need to increase the poly and texture count (especially for something like realestate).
@aiursrage2k Thanks for the feedback. I think you may be thinking about Scene Viewer, which is the native app that <model-viewer> launches for AR on Android devices. <model-viewer> does not have a strict poly limit, and the texture count is limited by the browser so we can't control that. <model-viewer> also supports any custom UI you want, and as many animations as you want.
Okay very interesting ill need to look more into this. We were able to get it working using "apples reality composer", the problem is its pretty limited and not scalable as you have to edit the content in there basic editor. We need something that would allow the basic functionality of "reality composer" which can be created using an API and generate something like the ".reality" file format -- this way we will have more functionality to AR content without requiring an app. This will especially be needed if we are looking to scale imagine thousands of AR content in app (absurd) -- by making AR in the web we can really scale projects. AR should break away from only being in apps so that all websites can easily make use of them
@aiursrage2k that definitely sounds like what we are striving for. Although the <model-viewer> project is being built at Google, it is an open source project with limited resources (compared to Reality Composer). However, our goal is to build the tools needed to realize all of those kinds of use cases (and more) on the web. We are an open-source, community-driven project, so hopefully we can all work towards that goal together 馃檶
Can we modify the source code, is this simply using a modified version of threejs? Can I do things with the raycaster when its selected the model in AR?
https://threejs.org/docs/#api/en/core/Raycaster
Yah, please do! It's an open source project and we hope folks will experiment with the source. From a high-level, we are just a web component wrapper for Three.js APIs. So if you are familiar with Three.js, it should be easy for you to modify the renderer internals.
Okay great. Theres 1 more issue for whatever reason the android AR part of the app isnt working on my test device -- for example I have a simple html using the viewer, I enabled the AR flag but when I try to open it using google chromium it just takes the model into fullscreen mode -- I dont see the option to put into AR. I know it can work on my test device because in the actual google demo it does work.
For example the link below does not allow me to take the model into AR mode, whereas the modelviewer link does work -- is there something else missing I am not getting the "view in your space popup" to appear in my example. It works fine when I try to open the Astronaut on my iphone in safari...
I assume it will only work with https
http://178.128.237.107/test0/test0.html
Okay that was the problem, once i setup a domain name and https it worked...
https://modelviewer.dev/examples/augmented-reality.html
</head>
<body>
<model-viewer src="assets/Astronaut.glb" camera-controls autoplay background-co
lor="#70BCD1" shadow-intensity="1"
stage-light-intensity="3" environment-intensity="2" ar width="800px" height="600px"
```
Right now I am just using the CDN version of the model viewer, is there anyway to get access to the threeJS scene/camera or to instantiate the model-viewer using javascript?
@aiursrage2k yes, you would have to clone the project repo, install the dependencies and build it (per the instructions in our README). From there, you can make changes to the code and re-build it as needed.
We have plans for a public API that would allow you to do similar things without building the library yourself. See #738 for more details on that.
Yeah that sounds about right. I was playing around with "Adobe aero" today, almost a clone of the reality kit. I am little worried everything will be locked into a very limited functionality set unless we expand it to be more expansive.
Most helpful comment
Okay great. Theres 1 more issue for whatever reason the android AR part of the app isnt working on my test device -- for example I have a simple html using the viewer, I enabled the AR flag but when I try to open it using google chromium it just takes the model into fullscreen mode -- I dont see the option to put into AR. I know it can work on my test device because in the actual google demo it does work.
For example the link below does not allow me to take the model into AR mode, whereas the modelviewer link does work -- is there something else missing I am not getting the "view in your space popup" to appear in my example. It works fine when I try to open the Astronaut on my iphone in safari...
I assume it will only work with https
http://178.128.237.107/test0/test0.html
Okay that was the problem, once i setup a domain name and https it worked...
https://modelviewer.dev/examples/augmented-reality.html
lor="#70BCD1" shadow-intensity="1"
stage-light-intensity="3" environment-intensity="2" ar width="800px" height="600px"