Arrow Electronics and NVIDIA have collaborated on a groundbreaking AI-powered steering system designed for the Semi-Autonomous Mobility Car. Utilizing NVIDIA's Jetson AGX Orin module — which is known for its high accuracy and minimal latency — the system employs facial recognition technology to interpret head movements for steering control. This innovation allows quadriplegic racecar driver Sam Schmidt to operate the vehicle at competitive speeds with greater control and responsiveness compared to previous technologies.
The AI-powered steering system captures Schmidt's head movements through a stereo camera pair on the car's dashboard in real-time. Through machine learning algorithms, the system swiftly adjusts the car's steering angle with extraordinary precision, enabling instantaneous response times crucial for speeds up to 213 mph.
Beyond its application in racing, the AI steering system holds potential for diverse everyday uses across sectors such as agriculture, warehousing, public transit, and construction.