Animation Blending about babylon-mmd HOT 9 CLOSED

I have thought about this problem today, and I have come to the conclusion that it might be difficult to create a simple sample code for it. (It's not simple to load animation data to run, even if it's theoretically possible.)

Furthermore, I plan to support the following features in the near future to enable animation blending.

• Support for animation blending in MmdRuntimeAnimation.
• Load VMD files using Babylon.js Animation container.

From the information you've provided, it seems that ultimately you want to utilize MMD characters as player characters or NPC characters.

So, I will also provide automatic retargeting to allow humanoid animations to be used with MMD models.

from babylon-mmd.

MmdRuntime is designed to be compatible with Babylon.js's existing animation system.

It seems that your desired outcome involves manipulating a skinned mesh with MMD's runtime elements such as IK, and Physics and blending them into animations. In this case, by using MmdRuntime.createMmdModel, you can activate MMD's runtime and then utilize Babylon.js's animation system to animate the mesh. This approach would enable animation blending.

In conclusion, Babylon.js's animation system already includes blending, so utilizing it would solve the issue at hand.

If you're planning to blend multiple VMD animations, I can implement animation blending for you.

from babylon-mmd.

If you provide me with detailed information about the problem situation you're currently trying to address and the data you intend to use, I'll be able to consider various solutions.

from babylon-mmd.

Here's an example using Three.js MMDLoader where the MMD file transitions from idle -> walking -> running:

This uses animation blending. Are you able to provide sample code showing how using MmdRuntime.createMmdModel() and Babylon's animation blending can do this?

from babylon-mmd.

Thanks those will be very useful features.

from babylon-mmd.

Starting from babylon-mmd 0.26.0. It is now possible to blend animation using Babylon.js animation runtime.

There is no document yet and the sample code is here:
https://github.com/noname0310/babylon-mmd/blob/main/src/Test/Scene/babylonAnimationBlendingTestScene.ts

Read the codes and ask any questions

from babylon-mmd.

This is great! Thanks!

from babylon-mmd.

Since 0.27.0, it is possible to retarget any humanoid animation to an MMD skeleton.

I implemented this because I thought it might be in your potential requirements.

This will be documented quite a bit later, but if you're interested, ask in an issue and I'll show you how to use it in detail.

• Here is the code that uses the AnimationRetargeter to retarget the mixamo animation to the MMD skeleton and then serialize it to JSON to save it:
  https://github.com/noname0310/babylon-mmd/blob/main/src/Test/Scene/humanoidAnimationTestScene.ts

• And here's the code to load the json serialized AnimationGroup into the mmd skeleton:
  https://github.com/noname0310/babylon-mmd/blob/main/src/Test/Scene/babylonAnimationLoadTestScene.ts

• Here is what the retargeted animation looks like. The mixamo skeleton is on the right and the mmd skeleton is on the left:

  2023-09-15.13-20-37.mp4

And animation blending support in mmd custom animation runtime will be implemented quite later. The reasons are as follows:

• It's already possible with the animation runtime of babylon.js(and very easy to do since 0.26.0).

• Since most MMD animations were not designed with animation blending in mind, I figured that very few of the assets distributed in VMD format would be available for animation blending.

from babylon-mmd.

The MMD animation runtime now also supports animation blending since 0.32.0. It's frame-perfect animation blending, so you'll need a bit of code to apply it to locomotion.

Here is an example code if you want to try it out
https://github.com/noname0310/babylon-mmd/blob/main/src/Test/Scene/compositeAnimationTestScene.ts

If you have any questions, please open a new issue :)

from babylon-mmd.