Git Product home page Git Product logo

osclivelink's Introduction

OscLiveLink

Warning The System currently supports Degrees, which can be selected in Project Settings. Radians will be supported in the next update.

Using the Hallway Tile standard, this plugin receives OSC messages and applies them as a LiveLink source to animate MetaHumans in Unreal.





Example using web platform and local Bridge application on Windows

Installation

  • To install the plugin, download the latest release from the Releases page on Github.

  • Create a new folder named "Plugins" in the root of your Unreal Engine Project.

  • Unzip the contents of the latest release ZIP file downloaded from Github into the Plugins folder.

Note: If you're working with a different version of Unreal (such as on Mac instead of PC), you'll need your project to be a C++ project in order to compile the binaries for your platform. Adding a new C++ class before installing the plugin will convert a Blueprint-only project to a C++ project.

  • Open your Unreal project and navigate to Edit>Plugins>Project. If installed properly, the plugin will appear and be enabled by default.

Usage

Note: Be sure to read through both this section and AR Kit Bugfix if your are using Unreal 5.0.1.

  • This plugin acts as a host for the Hallway application client. This means you will need to configure the correct IP address and port in both the Hallway application and Unreal Engine to share information between the two. You can configure the plugin's settings by navigating to Edit > Project Settings > Plugins > LiveLink OSC.

  • If both applications are on the same computer, then you can use the localhost address: 127.0.0.1 for Hallway Tile's Host, and 0.0.0.0 for Unreal's Listening Address. (0.0.0.0 represents any possible address.)

  • If Hallway and Unreal are running on different computers in the same network, use 0.0.0.0 or the IP address for the Hallway computer as Unreal's _Listening Address; and use the Unreal computer's IP address as Hallway's Host.

Note: Look up how to find your local IP address online if you're not familiar.

  • The default port is 9001. This can remain unchanged unless another application requires that port.

  • To use the OSC source, once per project you will need to navigate to Window > Virtual Production > LiveLink

  • Add the source by pressing + Source > Message Bus Source > Hallway Tile OSC

  • It will appear in the bottom left list of LiveLink sources. If the dot is green, everything is working properly. If the dot is yellow, there may be a address/port misconfiguration or a firewall blocking the OSC stream.

  • Halway Tile OSC will now appear as an option in the list of possible options when you view your Metahuman's Detail's panel in Outliner > Default > LLink Face Subj.

  • Use the Simulate play mode to control your camera while projecting face shapes on your Metahuman Character. You're all set!

_Subject selected, running in simulate mode with AR Kit Bugfix_

AR Kit Bugfix

There is a bug in Unreal's 5.0.1 version of Metahumans that has a missing blenshape name. This offsets most blendshapes to the wrong order, completely breaking the effect of face capture. This is not unique to Hallway Tile, it applies to AR Kit LiveLink as well. The solution to this bug involves copying the pose library from Unreal 4.27 to Unreal 5.0.1 and is described here.

Web Demo

If you’re running on Windows you can use the web version of Hallway + Bridge app. This is temporary and the Hallway team is working on a dedicated Windows app right now.

If you're running the web-version of Hallway, you'll need to contact Hallway and request the Bridge application to convert from the web's TCP to the UDP protocol. (If you're using the Mac version of HallwayTile, it will broadcast UDP directly.)

The web demo will broadcast TCP to port 9000, and the bridge application will convert it from TCP to UDP and forward to port 9001 by default.

osclivelink's People

Contributors

lv-iberget avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.