Multiverse Computing partnered with a major European aerospace OEM to develop a robust gesture recognition system for pilot hand gesture control inside aircraft cockpits. The project delivered a real-time computer vision pipeline that performs reliably with gloved and barehanded operation under varying cockpit lighting conditions, opening a new path for natural, hands-on-instrument interaction between pilot and aircraft.
The Challenge
The client required a gesture recognition system for pilot hand gesture control in aircraft cockpits, capable of working reliably with gloved hands, barehanded operation and varying lighting conditions. Standard hand-landmark approaches break down with gloved hands, which is the default operational state for the target use case. The mission demanded a custom computer vision approach that could recognize 25 static and dynamic gestures in real time and run inside cockpit hardware constraints.