Unity SDK release notes

Release notes for the AR 51 Unity SDK, the C# package that connects a Unity project to an AR 51 capture server (Mocap Unleashed) and receives live motion, hand, object-detection and camera streams. Newest release first.

2.2.2.2R

2023-03 · Unity · initial release

The first shipped AR 51 Unity SDK. It gives a Unity project a direct, real-time link to an AR 51 capture server so you can drive avatars and scene logic from live markerless capture.

New

• Server discovery and connection. Find an AR 51 capture server on the local network automatically and open a live streaming session, with no manual endpoint configuration required in the common case.
• Live skeleton streaming. Receive full-body skeletons for every tracked person in real time and drive your own rigs, avatars or gameplay from the incoming pose data.
• Hand skeleton streaming. Receive detailed hand and finger tracking as a separate stream, for hand-driven interaction and gestures.
• Object detection. Subscribe to tracked physical objects (markers/props) in the capture volume and react to their position in your scene.
• Live camera feeds. Pull video frames from the server's cameras, read per-camera characteristics, and record video.
• Spatial anchors. Align your Unity scene to the capture volume through the anchor service so tracked people and objects appear in the correct place.
• Calibration access. Read camera and device calibration state from the server.
• Scene and gameplay services. Helper services for drawing debug geometry, placing and tracking in-scene objects, and exchanging game state with the server.

Compatibility

• Requires a compatible AR 51 capture server (Mocap Unleashed) on the same network.
• Delivered as a C# SDK for integration into a Unity project.

Notes

• 2.2.2.2R (2023-03) is the current published Unity SDK release. For capabilities beyond it, contact AR 51.