Gemini: Ultraleap Hand Tracking Software

• Improved initialization. Hands are tracked as soon as they enter the field of view
• Improved performance across a wide range of hand sizes
• Robust interaction with both hands together
• Works in challenging environments
• Flexible integration options
• Superior pose accuracy

Windows

The minimum system requirements for Desktop use are:

Windows® 10, 64-bit

Intel® CoreTM i3 processor 5th Gen (must support AVX instructions)

2 GB RAM

USB 2.0 port

VR headsets may come with their own system requirements.

MacOS

The minimum system requirements for Desktop use are:

MacOS version 11.0+

Supported processors: Intel® i7, Apple M1, M2

2 GB RAM

USB 2.0 port

Control Panel

From the Control Panel you can visualise camera feeds, and adjust settings for the tracking service and your Ultraleap Hand Tracking Camera.

Tracking Service

The software that runs the camera module and sends hand tracking data to applications that need it.

Software Development Kit

What you need to build applications if you’re using the LeapC API. Alternatively use our Unity or Unreal plugins.

OpenXR API Layer

We automatically install our OpenXR API Layer to add support for any application that uses OpenXR hand tracking data

Windows installer

Tracking Service 5.13.2

– Leap Motion Controller 2 support: all tracking modes supported.

Control Panel 3.3.0

– USB hub/low device framerate warning

– Enabled screentop for LMC2

OpenXR API Layer 1.5.0

Added

– Beta support for the extension XR_EXT_hand_interaction, XR_MSFT_hand_interaction and XR_EXT_palm_pose behind the flag ULTRALEAP_OPENXR_force_enable_hand_interaction.

Fixed

– Resolved an issue where the joints tracked bit was getting unset incorrectly.

– Removed workaround for runtimes incorrectly raising an error on unrecognised extension structures.

– Fixed palm wobble introduced by palm filter.

– A regression in palm joint radius and correction for metacarpal joint radii.

Known Issues

– Tracked bits being unset in tracked scenario on SteamVR via Pico Link.

– Over-extrapolation leading to rubber banding effect when hand speed is greatly reduced in a small time period.

Android XR2 (Pico Neo 3 and Vive Focus 3 installers)

Release Notes

Tracking Service v5.14.0

– Automatic firmware upgrade for Leap 2, 3Di and SIR170 device.

– Frame rate on the Leap Motion Controller 2 is more consistent when connecting and disconnecting the camera

Known Issues

– If using a Stereo IR 170, occasionally the Stereo IR 170 will run at reduced frame rates after prolonged use. Workaround: Restart the headset or let the headset cool down.

– If using a Stereo IR 170, tracking can be flaky when using a USB 3.0 cable. Workaround: Ensure that you are using a USB2.0 cable.

– There is an issue when using QVR devices if you attempt to plug in a Stereo IR 170 (without disabling QVR cameras first) when hand tracking will not work due to hands “flying away” on app open.

– Workaround: in adb shell, run echo “{ “allowFake”: false, “allowQVR”: false, “allowUVC”: true }” > /data/user/0/com.ultraleap.tracking.service/files/ultraleap/CaptureDeviceConfig.json to disable access to QVR cameras.

– Hand tracking may freeze when switching between apps built with versions of our Unity plugin older than 5.12. If an update for the app is not yet available, you can work around this by disconnecting and reconnecting the Stereo IR 170 or reopening the app.

– Connecting an Ultraleap device to a Pico 4 while an application is running will give a pop up asking the user to “Exit to Continue“. Not exiting the application will mean hand tracking is not present. Exiting the application and starting it with the device connected will allow for hand tracking.

– The first application launch on Pico 4 with an Ultraleap device connected will give a pop up asking the user to “Exit to Continue“. Subsequent application launches with the device connected will not show this pop up.

Control Panel v2.2.0

– Added support for new hardware

MacOS installers (both x64 and Apple Silicon)

Tracking Service 5.14.0

– There was an issue where the Leap Motion Controller 2 sometimes stopped working after a short period of time. This has now been resolved and is now more robust.

– Mac Installer is now a .app in .pkg file instead of installed to Application Support.

– Updating Third Party License file to include missing licenses

Desktop Control Panel 3.3.0

– USB hub/low device framerate warning

– Enabled screentop for LMC2

Linux

Beta release of Gemini for Linux. Compatible with Ultraleap 3Di and SIR 170 devices. Not compatible with Leap Motion Controller or Leap Motion Controller 2. To use Linux with a Leap Motion Controller download V2 here.

Ultraleap Gemini hand tracking software is subject to the SDK agreement and End User Licence Agreement . By downloading this software you are agreeing to these terms.

This license allows:

– Personal, non-commercial use
– Consumer game development
– Technical evaluation

For any other use, including commercial use, please contact us