meta-quest / immersive-web-emulator Goto Github PK

Hey - is it planned to release this on the Chrome Extension store to make it more widely available?
Thanks!

Meta browser returns a plane for the user defined meshes (e.g a table). The emulator only returns XRMeshes.

I think that currently the emulator picks "local-floor" if enabled, and switch to "local" if not or something like that.

Would be nice to be able to test what happens on different headset that might not have local-floor by disabling it manually in the emulator

The pro controllers has a third pressure sensitive button on the top plate adjacent to the X/Y buttons this is missing in the extension

Would be very useful for testing to be able to control the application directly with mouse and keyboard. Both the headset and controllers. Probably disabled by default so it doesn't conflict with the application inadvertently surprising the dev.

This is the error I get when I tried to run a WebXR sample from this link-
https://immersive-web.github.io/webxr-samples/inline-session.html

Can someone help me understand what is causing this?

xrFrame.session.inputSources[n].gamepad.axes[0] can be undefined even though the gamepad object exists and is not null.

This apparently happens for the Quest Pro emulator, perhaps as a result of using a polyfill.

The Mozilla extension reports a number as required by the gamepad spec.

Hi @RaananW,

Can I add support to the Oculus web browser to enable it to detect my haptic gloves? I am using tact gloves to get haptic feedback upon touching any object in the VR scene.

The XRSession functions requestHitTestSource and requestHitTestSourceForTransientInput are not checking if the hit-test feature was requested.
As described in the specs
https://www.w3.org/TR/webxr-hit-test-1/#requesting-hit-test
"If hit-test feature descriptor is not contained in the session’s list of enabled features, reject promise with NotSupportedError and abort these steps."

I can add / remove meshes but cannot change the size of an existing one. My understanding is that the geometry of detected meshes can change during an immersive session (lastChangedTime parameter). It would be useful if that can be also emulated.

I enter immersive-ar session and in the meshes tab I can add new ones (desk, lamp, ceiling). The new ones are added in frame.detectedMeshes but those I remove remain until I reload the page and enter immersive-ar again

With this I mean what happens if u long press the oculus button.
In my case, working on locomotion features, I want to recenter to actually keep the same view so it would be nice to be able to test it.

Trying to cycle the gizmo modes is not working. Tested on multiple websites.
Sorry for non-descriptive issue. I am willing to provide more info if needed.

Also is there a way to group move headset and controllers together?

Thanks for your response.

For testing custom hand models, it would be great if this extension had a few hand recordings packed with it to choose from.

What the title says, when using a bigger external monitor the scene looks as it should. But on a smaller screen (macbook pro 14') only half of the scene is shown, like if only seeing from one eye.

It appears these layers samples don't work unless this polyfill is used.

EmulatedXRDevice.gamepads objects have no "connected" property.
After entering in VR mode, gamepad has property "connected" = undefined.
Modules that depend on this status may not work correctly.

In Chrome (at least Chrome on Windows latest version) you need to deactivate the older extension or it will consume all the events and the app will not respond to headset movements in the new extension.

Clicking on button is nice but for testing not ideal. As mentioned in MozillaReality/WebXR-emulator-extension#296 being able to make calls directly from the browser console allows for testing programmatically, that means tests could be provided with the WebXR page itself and make the development cycle more efficient.

I go to my VR website, click on open vr and it gives this message not enough vertical space.
Tried to change the window size but didnt work.
No clue how to make this work
Chrome version 111.0.5563.148

The WebXR simulation window cannot be found in the debug window that appears after pressing F12 in the Edge browser.

When using the Controller State sample
https://immersive-web.github.io/webxr-samples/controller-state.html
First there's an error

motion-controllers.module.js:120 Uncaught (in promise) Error: No matching handedness, , in profile generic-hand
    at fetchProfile (motion-controllers.module.js:120:13)
fetchProfile @ motion-controllers.module.js:120
Promise.then (async)
(anonymous) @ input-renderer.js:248
dispatchEvent @ webxr-polyfill.js:2958
_checkInputSourcesChange @ webxr-polyfill.js:3391
XRSession$1.<computed>.onDeviceFrame @ webxr-polyfill.js:3161
requestAnimationFrame (async)
requestAnimationFrame @ webxr-polyfill.js:27152
XRSession$1.<computed>.startDeviceFrameLoop @ webxr-polyfill.js:3178
XRSession$1 @ webxr-polyfill.js:3252
requestSession @ webxr-polyfill.js:4461
await in requestSession (async)
CustomWebXRPolyfill.XRSystem.requestSession @ webxr-polyfill.js:32464
initXR @ controller-state.html:254
(anonymous) @ controller-state.html:364

And when entering the XR session, the hands poses are tracked, but not the joints or pinch input.

Get the following warning in A-Frame:

WARNING: Multiple instances of Three.js being imported.

By the time A-Frame loads theres a THREE r147 revision defined

Hi, see attached video

expected:

• down and holding "press" button in simulator presses the button (value increases to 1) - triggering "selectstart"
• releasing "press" button releases the button (values decreases to 0) - triggering "selectend"

actual:

• down and holding "press" button does have no imediate effect
• releasing "press" button increases and decreases value and triggers "selectstart" and "selectend" at once

If I set the space type to "local floor", the emulator does actually set it as local floor, but only the frame after the session started (or so).

U can check this by simply logging the space type on session start.

On a real headset, the space type will be the proper on session start already.

This make it so I have to add special cases for the emulator.

For some reason the devtools panel no longer appears.

https://threejs.org/examples/webxr_xr_dragging

Sometimes it does appear but it's all white.

And when it appears and it shows the controls, changing then doesn't affect the app anymore.

Seems like something got pretty unstable... I fear it may be a collision of multiple instances of three.js in memory...?

Hi, thanks for working on this

I have two questions regarding input:

1. I can't find an option for adding or removing controllers or hands at runtime. I'd like to be able to test the removal of one or both controllers (or one or two hands)
2. Is it possible to mix and match hands + controllers (e.g. one hand and one controller) - It looks like this is not yet exposed to WebXR but in discussion?

Since the press on the emulator requires the "value" bar to reach the end and back, is hard to perform quick clicks, which I use in my games and are easy to perform with the actual controller.

The emulator doesn't require 'anchors' to be passed as optional feature to navigator.xr.requestSession

To match spec behavior. The optional feature should be required and if not available an error should be thrown when calling frame.createAnchor ...not available for this kind of session...

Notice that if I press the buttons below (to switch from hands to controller or viceversa) before entering immersive mode it has no effect. It retains the option / state that had at page load. It works as expected once I enter immersive mode (I can switch from hands to controllers or viceversa)

In the actual quest, the new reference type is already local floor when the session start, but with the emulator is not which is annoying and requires me to have special cases to handle the emulator if I want to test with it.

As u can see in the video, if I ask for it after the session started is properly updated to local-floor in this case.

This is with Wonderland Engine

Hi, unfortunately the emulator is not working for me, with either three.js or A-Frame samples (pls see attached screenshots, tested in Edge). It does work with the babylon.js samples and the immersive-web samples. Have I done smth wrong, with the the setup, or any ideas what might be the problem here?

best regards :)

The hex room/cube appears in the scene

Developing in AFRAME

To be able to integration test WebXR applications in commodity virtualized Linux containers, it would be useful if the emulator could record/save and load/playback a series of controller, hands, and plane detection events.

Being able to get this quality feedback before going to expensive on-device testing is key for scaling engineering efforts in an economically defensible way.

FWIW, we took this same approach on a game console project I worked on where we used react-native-web and injected some extra gamepad extensions, so we could get app startup profiling data and basic integration smoke test feedback before running a fuller test suite on rare prototype hardware.

And those can't be selected / removed unless I clear all the settings. The object label renders in the emulator view but it's not selectable

Details: https://immersive-web.github.io/webxr/#dom-xrsession-enabledfeatures

Maybe I'm missing something, but seems that currently when the extension is installed it always polyfills - since we also want to test codepaths where XR is not available that's not very helpful, so I had to remove the extension again.

Could maybe be as simple as having "None" in the device dropdown?

This also extends to a note written in the docs:

Even if native WebXR API is available the extension overrides it with WebXR polyfill

which is also not really ideal... I find the extension useful but constantly uninstalling / installing it while testing something is a bit.

Hello, currently when ending the XRSession the renderer seems to be broken.

It works as expected on device returning to the original rendering state

Same issue #200 forWebXR-emulator-extension.

The frame buffer remains black and no particular error is raised in the dev console. However with WebXR-emulator-extension](https://github.com/MozillaReality/WebXR-emulator-extension), the Offscreencanvas works with the "Samsung Galaxy S8+ (AR)" emulator with an immersive-ar session.

Is there a way to detect the immersive-web-emulator (and eventually the WebXR-emulator-extension) at runtime?

When using local floor, it's nice to have the head at a default normal height, but when local floor is not enabled, the head should be at height 0, because in that case if u enter VR normally that would be the case.

Having it set at 1.75 make it so I have to make work-around when the device is emulated to adjust the height of the head so not to have it super high.

I noticed that the emulator always renders the XRMeshes in the app viewport. It would be nice to have a way to hide them so they don't interfere with the application scene.

Hello!

This tool looks awesome! When I'm playing around with it, I see that it supports the WebXR "VR" features, but it doesn't have support for AR. Would it be possible to enable this? Maybe by providing a default "pass through" image of the user's surroundings? (As I say this, I'm thinking that there would probably need to be spatial anchors, "plane detectors", etc. which would make this significantly more complicated, especially to be as customizable as the rest of the browser extension appears to be.)

Would be nice to not have "AR NOT FOUND"

When I installed this on Chrome, I got this error:

Manifest version 2 is deprecated, and support will be removed in 2023. See https://developer.chrome.com/blog/mv2-transition/ for more details.

I understand this may not be a priority for Meta, but I wanted to capture my thoughts here nonetheless.
We're using the simulator for AR cases as well, including phones.

A couple of behaviours differ right now that could be improved:

• DOMOverlay element isn't styled as it should, should be using styles like this to ensure it fills the screen
• Clicks / touches should simulate controllers in targetRayMode screen

And some more of lower importance:

• leaving AR sessions ends up in a bad state (this is just the case with the simulator right now but could be better I think)
• ability to choose the environment blend mode and simulation for those modes

On this demo https://de-panther.github.io/WebXR-Unity-Samples/VR/WebXR-Quick-VR/Build/
The hand_tracking feature is not requested, but they are displayed when using the emulator in hands mode.

https://webkit.org/blog/15162/introducing-natural-input-for-webxr-in-apple-vision-pro/

I've been a long time user of Firefox, and for a while I was able to load this extension as a temporary add-on (I assume this was before aligning it with Manifest V3). As someone with no experience in WebExtensions development, what exactly is the primary issue preventing this from working on Firefox now? From a quick skim of resources Mozilla seems to declare that they're supporting V3, but maybe you can shed some more light on the subject.

Sometimes for testing one wanna try precise values.

Hi, is there a way to reset the pose to the original default pose?