Unity-based application that allows to control a Reachy robot (version 2021+), or a virtual one, with a VR headset. The user documentation is available here.
The app should run with any VR headset compatible with Unity. It has been tested with the Oculus Quest 2, and the Valve Index. The Oculus Quest 2 can be used in standalone mode or with the Oculus link.
For any custom development we recommend to use Unity LTS 2020.3. Versions above 2020.3 will not work due to compatibility issues with the gRPC library.
Using a release build [recommended]
For the Oculus Quest 2, you may ask to join the list of beta users to install the app directly from the app store. Please contact us on our discord channel!
For Windows and Android platforms, the simplest way to use the application is to download a release here (Assets section). The Windows package is a zip file that contains the .exe to run. Your VR headset should be plugged in and ready to be used. The Android package is an *.apk that should be installed on your device.
Clone the main branch of the repo. Make sure that git lfs is enabled. If you want to contribue to the project please see the Issues/Contribution section.
git clone -b main https://github.com/pollen-robotics/ReachyTeleoperation.git
Download the grpc_unity_package from the gRPC daily builds. Unzip it in the Assets/Plugins folder. You can now run the app from Unity or build an executable for your platform.
This is the quick-start documentation. For a detailed manual, please visit the main documentation website.
Teleoperating a robot takes place in three basic steps:
The first step is to select the robot you want to control. For that you'll need the ip address of the robot (please refer to the robot documentation for the first connection), or the ip address of the computer running the Unity simulator. Press new robot button and add your robot.
Note that there is a built-in virtual robot for local testing of the application.
This step checks that the connection to the (virtual) robot is fine, and allows to set various parameters. Side menus (status, help, settings) can be opened by clicking on the related icons.
Get familiar with the controls of the robot. Press X to play with the emotions or change the gripper grasping mode. Once you are ready, press the Ready button and button A to take control of the robot.
Please not that A and X refers to the buttons of the Oculus controllers. They may differ on your device.
You are now controlling Reachy! Press and hold A to return to the previous step.
If you have any problem, you can create an issue or chat with us on our discord server. Finally, anyone is welcome to contribute to this project. Feel free to checkout the develop branch and to pull request any modifications.