• Unreal Engine 4
• Additional UE4 plugins, for instance, Runtime Audio Importer, VA REST, Json Blueprint
• 3D model from Metahuman Creators
• Your HUD setup for dialog
• Emotion animations for 3D model
• Connection variable keys should be bought from Tilde (TildeAI ([email protected]), Machine Translation and Tildes Balss ([email protected]))

Create a new U4 project with Blueprint support, import 3D model from Metahuman Creator and add the blueprint structure for your 3D avatar as in BP_Laura7.uasset.

Import also VA2.uasset for connection structure to TildeAI dialog system. All TildeAI ([email protected]), Machine Translation and Tildes Balss ([email protected]) connection variables should filled in with appropriate information, these connection links and keys should be bought separately from Tilde. Create emotion animations and add those to Frustration recognition step.

Create a HUD and define the text input area, also you can add the field for showing the full dialog.

This research has been supported by the European Regional Development Fund within the joint project of SIA TILDE and University of Latvia “Multilingual Artificial Intelligence Based Human Computer Interaction” No. 1.1.1.1/18/A/148.