juniorxsound / depthkit.js Goto Github PK

Using:

npm i depthkit
import Depthkit from "depthkit";
const depthkit = new Depthkit(); //error

How do I properly import this as a module?

Thank you for sharing nice tool.
Mesh mode and Wire mode is completely worked for me.
However Point mode looks does not work.
I'm pleased you fix this issue.

in my app it plays fine on desktop, on mobile (ios safari) i get this error over and over again.

Unhandled Promise Rejection: NotAllowedError: The request is not allowed by the user agent or the platform in the current context, possibly because the user denied permission.
(anonymous function)
rejectPromise
play
value — depthkit.min.js:2:9573
(anonymous function) — main.js:620
update — main.js:300
animate — main.js:321
value — depthkit.min.js:2:9573

I do have it so the the user must tap the screen to start the whole experience, but the play itself is triggered by something else that happens after the user taps the screen. I suspect it might be because its not directly inside a user gesture? I say this because this toy project works fine: https://depthkit.glitch.me

this is whats supposed to happen: https://www.youtube.com/watch?v=_pZPpvudI7I&feature=youtu.be

This is my project: https://glitch.com/~ht94 you dont need to go through the experience just know its like the video except the character doesnt play. Posting it here incase you wanted to see the code (sorry i need to comment it)

how I got that video in the first place is that it used to work but i made some changes, i have been trying to pinpoint them to the exact moment it broken but its been taking hours, I thought id post this, keep looking and update when i find it, incase you have a suggestion for a quick fix... thank you!!

edit: I am not sure why it was working before I couldnt find any change in the code that caused it to break, I am sure it is there somewhere & there is a logical explanation but for now i cant spend any more time looking.

It's been a moment since this plugin was last maintained and quite a lot has changed so wanted to collect some thoughts on potential future improvements.

• New build system (perhaps Vite) to produce an ES module and externalizing three.js
• Typescript
• Build plugin in Github action on commit to avoid having to checkin built plugin file (i.e ./build/depthkit.js)
• Deploy npm package via Github action on tag
• Add support for new Depthkit metadata structure (i.e #24)
• Better examples for WebXR API usage

The metadata that gets exported from depthkit app (without refinement workflow), does not match the format that this library expects, therefore clips cannot be loaded. Example:

{ "_versionMajor" : "0", "_versionMinor" : "1", "depthFocalLength" : { "x" : 505.453, "y" : 505.598 }, "depthImageSize" : { "x" : 640, "y" : 576 }, "depthPrincipalPoint" : { "x" : 321.734, "y" : 334.185 }, "farClip" : 8.192, "format" : "perpixel", "nearClip": 0.25, "clipEpsilon" : 0.000629564 }
Are the rest of the parameters not necessary? Why are they not exported in current depthkit version?

I have started implementing the ability to relight the mesh under lighting branch, does it make sense? is someone actually interested in being able to have the scene lights affect the mesh?

Hey,

any plans to support THREEjs BufferGeometry?

i use it Combined-Per-Pixel video ,its genereating metadata txt file of json data format are different with your examples. so i can't make depthkit.js work. can you help me ? i am in a hurry. thank you

I think it would make sense to add one or two WebAR examples, is someone interested in helping with this?