The U.S.Patent and Trademark Office just granted Apple U.S.Patent No.
12,353,649, suggesting the company is thinking well beyond the iPad when it comes to the future of the Apple Pencil.Here are the details.According to the filing, “INPUT DEVICE WITH OPTICAL SENSORS” (via ), Apple has been exploring a stylus equipped with optical sensors that can track motion, orientation, and position in 3D space, without needing to touch a screen.
That would allow users to draw on virtually any surface, or even just above it, within a short range.And if that sounds familiar, that’s because it is.First, current Apple Pencils already detect tilt and pressure.
And second, just last month at WWDC25, Apple showcased the Logitech Muse, a spatial stylus for Vision Pro that lets users sketch in the air.The patent describes multiple methods for drawing without touching Apple’s patent details two types of optical sensors that could be built into the stylus in a pretty similar way: Optical flow sensors, which work a bit like optical mice by analyzing frame-to-frame changes in light to detect motion.Laser speckle flow sensors, which track how granular laser reflections shift as the stylus moves.Laser speckle flow sensors, which track how granular laser reflections shift as the stylus moves.
As described in the patent, both systems can detect movement even when hovering above a surface (up to 100mm, or 3.94 inches), while also allowing the stylus to operate on non-touch-sensitive materials like wood or paper.The patent also describes how a trackball might feed internal sensors One version of the Pencil described in the patent features a trackball tip, which rolls as you move the stylus.But instead of using mechanical encoders (like those little internal wheels in traditional mice that detect ball rotation), Apple proposes using internal optical sensors to track the ball’s movement.
Here’s how Apple describes this system on paragraph 64: And a few extra sensors to boot The patent also describes combining this tech with other sensors, like inertial measurement units, force detectors, and even machine vision, potentially enabling things like gesture input, handwriting recognition, and 3D drawing.While that would make it a natural fit for devices like the Vision Pro or future headsets, where input tools need to work beyond a flat touchscreen, it also shows that Apple is not done investigating what else it can add to its vision for the spatial computing era.AirPods deals on Amazon AirPods Pro 2, USB-C Charging: $149, down from $249 AirPods 4 USB-C Charging: $89, down from $129 AirPods 4, USB-C and Wireless Charging: $119, down from $179 AirPods Max, USB-C Charging, Midnight: $449.99, down from $549 You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day.
Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop.Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel
