non906 / handmr Goto Github PK

View Code? Open in Web Editor NEW

20.0 1.0 1.0 319.11 MB

スマホVR（cardboard）・だんグラ上で、ハンドトラッキングを行うためのUnityアセット

License: Other

C# 97.18% ShaderLab 2.82%

arcore arkit unity cardboard

handmr's People

Contributors

Stargazers

Watchers

Forkers

pishiko

handmr's Issues

ビルド時にエラーが出てしまいます．

素晴らしいアセットを公開していただきありがとうございます．
「アセットの使用方法」に従い，ビルドを試していたところ，2.に表記されているような確認画面が開きませんでした．また，次のようなエラーが出てしまいました．

Undefined symbols for architecture arm64:
  "_hand3dSetHandPoint", referenced from:
      _HandVRMain_hand3dSetHandPoint_mE658042FFC311527CAF9A5C3B3A47D34B0FF84C4 in Assembly-CSharp.o
      _HandVRMain_resetHandValues_mEE00C8C78F9AE01113E06512DBC1C201C917EB8B in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_hand3dSetHandPoint_mE658042FFC311527CAF9A5C3B3A47D34B0FF84C4)
  "_hand3dExec", referenced from:
      _HandVRMain_hand3dExec_m4AB1FA171C2567B05CBA9F8E33DA51BDB627E46A in Assembly-CSharp.o
      _HandVRMain_calcLandmark_mE8846AE8BB224290CC89A5E6FD5042F043DB072F in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_hand3dExec_m4AB1FA171C2567B05CBA9F8E33DA51BDB627E46A)
  "_hand3dInitWithValues", referenced from:
      _HandVRMain_hand3dInitWithValues_mA0B002EB23779FB4C165EDD2B248AE42DDF8FD2B in Assembly-CSharp.o
      _HandVRMain_Start_m8B811DE7D75105438FC85175B61F71D9C1FA671B in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_hand3dInitWithValues_mA0B002EB23779FB4C165EDD2B248AE42DDF8FD2B)
  "_hand3dGetCameraValues", referenced from:
      _HandVRMain_hand3dGetCameraValues_m71E4727D523C93EA46B20BA4BB3378BC5EBF7659 in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_hand3dGetCameraValues_m71E4727D523C93EA46B20BA4BB3378BC5EBF7659)
  "_hand3dGet3dPosition", referenced from:
      _HandVRMain_hand3dGet3dPosition_mF5FF7474D61593D8F6FCD2916A7CABE27AF860F5 in Assembly-CSharp.o
      _HandVRMain_calcLandmark_mE8846AE8BB224290CC89A5E6FD5042F043DB072F in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_hand3dGet3dPosition_mF5FF7474D61593D8F6FCD2916A7CABE27AF860F5)
  "_hand3dInit", referenced from:
      _HandVRMain_hand3dInit_m7D1FC396F9E1ACD53B3E2F34308ACC12F6109BEF in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_hand3dInit_m7D1FC396F9E1ACD53B3E2F34308ACC12F6109BEF, _HandVRMain_hand3dInitWithValues_mA0B002EB23779FB4C165EDD2B248AE42DDF8FD2B )
  "_multiHandGetHandednesses", referenced from:
      _HandVRMain_multiHandGetHandednesses_m90A46E15C9B42469A9D9DA59AFC47162D31977C2 in Assembly-CSharp.o
      _HandVRMain_GetHandednesses_mA817731A3B980B46870DB481687EB68AAFC4E434 in Assembly-CSharp.o
      _HandVRMain_GetHandDirection_m49503E53C069A0A7CAF59AA08FD575416BF38D71 in Assembly-CSharp.o
      _HandVRMain_GetHandRotation_m76C75FC035826828B1455C7691AEBA1508D38B41 in Assembly-CSharp.o
      _HandVRSphereHand_Update_mB62AAB5E1BBC62427AC7CFAFA312C0566B61CEC8 in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandGetHandednesses_m90A46E15C9B42469A9D9DA59AFC47162D31977C2)
  "_multiHandSetup", referenced from:
      _HandVRMain_multiHandSetup_m5D6882FBD35C96A94C9F7FEA6C8B0D47F923934F in Assembly-CSharp.o
      _HandVRMain_Start_m8B811DE7D75105438FC85175B61F71D9C1FA671B in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandSetup_m5D6882FBD35C96A94C9F7FEA6C8B0D47F923934F)
  "_multiHandGetIsUpdated", referenced from:
      _HandVRMain_multiHandGetIsUpdated_mB5614810389E8B19D48BAC82A294590DA5FE4753 in Assembly-CSharp.o
      _HandVRMain_GetLandmark_m44700B7F1FAA9DA472FA825547326EB5FDC2B9D3 in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandGetIsUpdated_mB5614810389E8B19D48BAC82A294590DA5FE4753)
  "_multiHandSetFrame", referenced from:
      _HandVRMain_multiHandSetFrame_mE2E5742F309F3F4E4FAE6B635C807B5339068AC5 in Assembly-CSharp.o
      _HandVRMain_updateFrame_mA10D96EFAA1F90F0F997CB22CE3B9F8E04510AA4 in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandSetFrame_mE2E5742F309F3F4E4FAE6B635C807B5339068AC5)
  "_multiHandGetLandmark", referenced from:
      _HandVRMain_multiHandGetLandmark_m14CCA29D17397BA6D4270978DAE7959823C34285 in Assembly-CSharp.o
      _HandVRMain_GetLandmarkOnImage_mC4AC8488D63DBCE1EC813675945F3C66914F073C in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandGetLandmark_m14CCA29D17397BA6D4270978DAE7959823C34285)
  "_multiHandGetHandCount", referenced from:
      _HandVRMain_multiHandGetHandCount_m328EF73B4B57DABA8FB2A38A93E0C812F2F4B7B5 in Assembly-CSharp.o
      _HandVRMain_GetLandmarkOnImage_mC4AC8488D63DBCE1EC813675945F3C66914F073C in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandGetHandCount_m328EF73B4B57DABA8FB2A38A93E0C812F2F4B7B5)
  "_multiHandStartRunningGraph", referenced from:
      _HandVRMain_multiHandStartRunningGraph_m163DBA9A07603EA87E5A25A0DDA04703A01990F8 in Assembly-CSharp.o
      _HandVRMain_updateFrame_mA10D96EFAA1F90F0F997CB22CE3B9F8E04510AA4 in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandStartRunningGraph_m163DBA9A07603EA87E5A25A0DDA04703A01990F8)
  "_multiHandCleanup", referenced from:
      _HandVRMain_multiHandCleanup_mD97AFA68639B06AB8D11B72B3B5A7A755A8090B9 in Assembly-CSharp.o
      _HandVRMain_OnDestroy_m1506D8C974B3AE6BFC46E5B7E633DC5C76F217C6 in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandCleanup_mD97AFA68639B06AB8D11B72B3B5A7A755A8090B9)
  "_hand3dReset", referenced from:
      _HandVRMain_hand3dReset_m5183DA56743A84105B3FECABF405B24AE78AA764 in Assembly-CSharp.o
      _HandVRMain_ResetHandValues_mC3668B1011D4EF74E2176D11E76D8F69EA8D4B36 in Assembly-CSharp.o
      _HandVRMain_OnDestroy_m1506D8C974B3AE6BFC46E5B7E633DC5C76F217C6 in Assembly-CSharp.o
      _U3CStartU3Ed__10_MoveNext_m9DAAF3B30AFF7AEADC973FC6A3EC82FB753013B2 in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_hand3dReset_m5183DA56743A84105B3FECABF405B24AE78AA764)
  "_handSizeCalibTransform", referenced from:
      _HandSizeCalibMain_handSizeCalibTransform_m955CDD6E8689A1598DBD27D2330828B93B15A9FA in Assembly-CSharp.o
      _U3CStartU3Ed__10_MoveNext_m9DAAF3B30AFF7AEADC973FC6A3EC82FB753013B2 in Assembly-CSharp.o
     (maybe you meant: _HandSizeCalibMain_handSizeCalibTransform_m955CDD6E8689A1598DBD27D2330828B93B15A9FA)
  "_handSizeCalibFindHomography", referenced from:
      _HandSizeCalibMain_handSizeCalibFindHomography_m72CB1E7F14D37218EA960E4CEEE1B53F18BDD047 in Assembly-CSharp.o
      _U3CStartU3Ed__10_MoveNext_m9DAAF3B30AFF7AEADC973FC6A3EC82FB753013B2 in Assembly-CSharp.o
     (maybe you meant: _HandSizeCalibMain_handSizeCalibFindHomography_m72CB1E7F14D37218EA960E4CEEE1B53F18BDD047)
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

アーキテクチャ周りのエラーを調べましたが，原因がわかりませんでした．解決方法を教えていただけると幸いです．
unityバージョンは2020.1.4f1, iOSバージョンは14.2.1です．

Error while reading the input

Hi, I was trying to read the input of grab interrraction but unfortunalty I am getting this error on logcat

NullReferenceException: Object reference not set to an instance of an object. at HandMR.HandVRSphereHand.get_IsGrab () [0x00000] in <00000000000000000000000000000000>:0 at HandMR.HandVRController.Update () [0x00000] in <00000000000000000000000000000000>:0

used the input system which has came with the package and genarated a c# class to test the input is working or not

I wrote by code like this to do a basic testing.

HandMRXRIDefaultInputActions actionsHand;
private void Awake()
{
    actionsHand = new HandMRXRIDefaultInputActions();
}

private void OnEnable()
{
    actionsHand.Enable();
    actionsHand.XRILeftHand.Select.performed += IsGrabPressed;
}

private void IsGrabPressed(InputAction.CallbackContext context) 
{
    Debug.Log("GrabPressed");
}

I think from line no. 79 of HandVRSphereHand.cs is causing the issue

Which has this code

public bool IsGrab { get { var gestures = handVRMain_.GetGestures(handVRMain_.GetIdFromHandednesses(ThisEitherHand)); return gestures[(int)HandVRMain.GestureType.Open] < gestures[(int)HandVRMain.GestureType.Close] || gestures[(int)HandVRMain.GestureType.Open] < gestures[(int)HandVRMain.GestureType.Grab]; } }

Please let me know the solution.

Please update the ARCore

It is not working with the latest version of ARCore

marker traking or slam

Hi! Can I add a tracking marker or slam here?
I don't need hand recognition, I just want marker tracking in the cardboard

iOS Failed to compile (v 1.1)

Hello,

I'm trying to get the projet to work on iPhone.
I'm also using AR Foundation Remote 2.0

In both cases I'm getting an error in Xcode when compiling the application:

  "_multiHandGetGesture", referenced from:
      _HandVRMain_multiHandGetGesture_m6D95AD5C22BB59AE8FFD6A009FCD17F557AA23E2 in Assembly-CSharp.o
      _HandVRMain_GetGestures_m5087DB6F80F3EBB417108461F5A4B30E773F530D in Assembly-CSharp.o
     (maybe you meant: _HandVRMain_multiHandGetGesture_m6D95AD5C22BB59AE8FFD6A009FCD17F557AA23E2)
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

I tried compiling for iOS 13 et iOS 15. No luck. Any advice?

UPDATE: I'm trying to compile for AR, maybe that is the problem? In this case how to I switch from VR to AR?

HandMRのAR機能を利用できるようにする

HandMRのAR機能を利用できるようにしたい

やりたいこと

HandMRの背景をバーチャル背景からカメラ画像へ変更したい.
Handを黒いものが覆われているような表示の仕方ではなく, 関節に点が打たれているような表示の仕方がしたい.
関節に点が打たれている表示の仕方で, ３次元オブジェクトの操作をできるようにしたい.

バージョン

PC

エディション：Windows 11 Home
バージョン：22H2

Android

Google Pixel 3 XL
Androidバージョン：12

Unity Hub

3.4.1

Unity

2021.3.2f1(LTS)

やったこと

Unityプロジェクトを起動.
ブラウザから, アセットサイトを開き, 「マイアセットに追加」を選択.
承認を求められたので, 「同意する」を選択.
「Unityを開く」を選択.
次に「Unity Editorで開きますか？」と指示されてので, 「Unity Editorで開く」を選択.
5の手順を実行するとUnity 側で「Package Manager」が開かれ,「Mobile XR Kit - HandMR Sample」の画面が表示された.
「Download」ボタンをクリック.
「Download」ボタンをクリックすると, 「import」ボタンが出てきたので「import」ボタンをクリック.
「Import Unity Package」が表示させたので, 「All」をクリックして「Import」ボタンをクリック. するとAssetsに「HandMR」フォルダーが追加された.
ツールバーから, 「Tools >> HandMR >> Show Start Dialog Windows」をクリック.
「Step 1.Add Packages to PackageManager」の「Execute」をクリックする. 数分すると自動的にUnity が再起動された.
次に, 「Tools >>HandMR >>Show Start DialogWindows」で「HandMR」の画面まで戻り, 「Step2.Setting Project, Layers and Prefabs」の「Execute」をクリック
「Step 3.Setting XR」の設定を行った.

1. Open Project Settings ->XR-Plugin Management.
1. Put check(s) ARCore (for Android) and/or ARKit(for iOS)
1. Open Project Setting ->Player.
1. Change ’Active Input Handing’ to ’Both’.

上記の3 つは既に設定済みだったため, 4の設定のみを行った. 「Both」に変更すると再起動された.

「Step 4.Copy Settting Files for Andriod Plugins」の「Execute」をクリック.
「Step 5.Download and Install iOS Plugins」は, 今回はiOSでBuildしないため, 今回は割愛.
「Step 6.Select Languages」を, 「English」から「Japanese」に変更.
「Step 7」と「Step 8」は実行せず, 「Close」ボタンをクリック.
サンプルアプリを起動させるため, Assets >> HandMR >> Sample >> Scenes >> Main.unity(シーン)を開く.
File >> Build Settings >> Build And RunでBuild.

上記の手順で, HandMRの導入を行い, 動作確認は完了しています.

HandMRManagerURPをScene上に配置(配置場所に指定無し)し, SettingFromPlayerPrefsをアタッチ.
HandMRManager/View Modeを, MRからARへ変更.
HandMRManagerURP/View Modeを, MRからARへ変更.
HandMRManagerURP内のVR Sub Camera, Left Eye Frame, Right Eye Frameを3つとも設定をnoneに変更.

現状

errorは出力されている.
Logcat_error.txt
背景をバーチャル背景から, カメラ画像へ変更することができている.
手を認識している.

screen-20230427-134219.1.mp4

サンプルシーンについてお教え下さい。

お久しぶりです。以前ビルド時のエラーについて質問させていただいた者です。

公開してくださっているサンプルシーンについての質問です。このシーン内でボタンとスライダーが実装されていますが、これらの接触判定をどのように行なっているかお教え下さい。見たところUI側にはスクリプトが設定されておらず、hand側にもcolliderが付いていなかったため、仕組みがわかりませんでした。

抽象的な質問になってしまい申し訳ありません。お答えいただけると幸いです。

tracking alignment issues

Hi - have noticed the alignment is slightly off - see video attached.
Is there anything I could do to improve this ? Do I need to set a screen ratio somewhere ?

video link below.
https://drive.google.com/file/d/1tjWU0rLbo7S3p9z2NNEx6nLxWUAm293t/view?usp=sharing

ok thanks !

gradle build failed

hi there,
at first thank you for your awesome work. i tried the test app and it is very cool.

but if i try to bind it in an unity project and build it for android i got a bunch of errors. perhaps you got an idea if there is a bug or i do something horrible wrong.

Unable to download ios plugins.

Android plug-in downloads fine off the dialogue. But when I select download plug-in it begins download, then never completes.
Have tried this on 2020 and 2021 LTS versions.

As a result the plug-in never appears in the build xcode project.