The RealSense Plugin provides support for the Intel RealSense SDK to Unreal Engine 4 by exposing features of the SDK to the Blueprints Visual Scripting System.
The plugin is developed as a set of components, each of which encapsulates a specific set of features. It also makes use of an actor known as the RealSense Session Manager, which manages access to the RealSense SDK functions and maintains the master copy of all RealSense data. It allows for the use of multiple instances of the same RealSense component class, easing the process of sharing data between objects.
RealSense processing takes place on its own dedicated thread. On every tick of the game thread, the RealSense Session Manager polls for new RealSense data, and updates the RealSense components accordingly. This separation helps keep the game thread running quickly even when the RealSense thread is doing some heavy lifting.
For more details, you can read this article.
RealSense SDK R2 documentation
You can also check out these tutorial videos to get started using the RealSense plugin:
- SR300 Short-Range RealSense Camera
- F200 Front-Facing RealSense Camera
- R200 World-Facing RealSense Camera
- 4th Generation Intel CPU or higher
- Intel(R) RealSense(TM) SDK 2016 R2
- The correct DCM for your camera (found also at the previous link)
- Unreal Engine 4.17.1 min
- SR300 – Windows 10 only
- F200 / R200 – Windows 8.1 or 10
- Camera Streams – Provides access to raw color and depth image buffers
- Scan 3D – Supports the scanning of faces and objects into 3D models
- Head Tracking – Tracking of hand joints, center and rotation