Typing on a virtual keyboard floating in mid-air sounds cool until your arms give out. That’s the reality of many AR (augmented reality) and MR (mixed reality ) headsets today. You’re either fumbling with handheld controllers or holding your hands up for too long, causing fatigue.
Researchers at Tohoku University think they’ve found a better way. The team has developed a system that turns any regular flat surface into a touch input area for AR and MR headsets. No extra sensors. No special markers. Nothing to set up.
How does it work?
When you press a fingertip against a hard surface, the skin under your fingertip turns white for a brief moment. This phenomenon is known as the blanching effect, and researchers have developed a method to identify it using the headset cameras.
Tohoku UniversityThe researchers trained an AI model to detect this
...Keep reading this article on Digital Trends.
