PoseAI LiveLink

Connect your phone for real-time motion capture input

  • 지원 플랫폼
  • 지원 엔진 버전
    4.26 - 4.27, 5.0 - 5.1
  • 다운로드 유형
    엔진 플러그인
    이 제품은 코드 플러그인과 함께 미리 빌드한 바이너리와 언리얼 엔진에 통합되는 모든 소스 코드를 포함하고 있으며 원하시는 엔진 버전에 설치하여 프로젝트에 따라 활성화할 수 있습니다.

This plugin adds a LiveLink source for connecting with Pose Camera, our full body motion capture app developed for mobile devices. This allows you to use your phone to capture and stream live, low-latency animation data into the Unreal Engine. With a single node in your animation blueprint LiveLink allows you to take an incoming stream and animate rigged characters.


Pair your phone and record animations using Unreal's tools or use motion input from players to generate exciting new gameplay.


In order to effectively use this software you need the Pose Cam app installed on your phone. The app is now available on the iOS App Store. There is a free trial period and then a subscription is required. We recommend an iPhone 8 or later (ideally an Iphone XR/XS or later), or a recent IPad (A12 chipset or better).


For developers: we have versions of our engine for iOS, Android and Windows, which can be embedded in third party applications. Try it first with our iOS showcase app and then get in contact to discuss licensing and our other versions.


No meshes, characters or content included in the plugin. Meshes used in project gallery are available from third parties on the Unreal Marketplace.


Newest Changes 

  • Better hands and smart IK driven hand placement with our 1.3 app update
  • UE plugin v1.4 - see our new animation graph nodes and UE5 demo for our arm/hand IK which maps the player's pose onto an avatar with different proportions for better results. See our YouTube video for a demo and setup guide.




To upgrade to the latest version of the plugin, click under your Engine Version from the Epic Games Unreal launcher, where it says "Installed Plugins!", and then click update next to our plugin.

기술적 세부사항

Features:

  • Works with simple phone cameras - we do not need depth sensors, and we get game ready frame rates even on older phones
  • Sandboxed AI - Our AI runs fully on the connected phone: no server queries and no competing with Unreal for desktop or console resources.
  • Multiple rigs - Select from different rigs (UE4 Mannequin, MetaHuman, Mixamo, DazUE). We include fully articulated hands.
  •  Different modes - tailor for different phone camera setups, such as Room (full body standing at a distance), Desktop (upper body seated at your pc), or Portrait (full body in tighter spaces).
  • Player Events - simplify game logic by using our motion input events similar to keyboard input
  • Convenience options - stream in third-person or mirror mode (i.e. flipped left/right sides), separate root motion etc.

Code Modules:

  •  PoseAILiveLink


Supported Development Platforms: Windows

Supported Target Build Platforms: Windows, Mac

Documentation: here

Simple Mocap Animation Project - UE4: here UE5: here

Advanced Mocap Event Gameplay Project: here