Apple Patents Trackball Apple Pencil with Advanced Optical Sensors

Apple has patented a new Apple Pencil that uses optical sensors to track motion, orientation, and position in 3D space, allowing users to draw on virtually any surface. The stylus features a trackball tip and two types of optical sensors: optical flow and laser speckle flow. This technology would enable users to draw in the air or on non-touch-sensitive materials like wood or paper.

Apple has recently been granted a patent that outlines a next-generation Apple Pencil featuring advanced optical sensors. This innovation allows users to generate content on non-touch-sensitive surfaces, such as wood or paper, as well as in mid-air. The patent, filed with the U.S. Patent and Trademark Office, suggests that Apple is expanding the capabilities of its Apple Pencil beyond the traditional iPad interface [1].

The patent details two types of optical sensors: optical flow sensors and laser speckle flow sensors. Optical flow sensors detect motion by analyzing frame-to-frame changes in light, while laser speckle flow sensors track granular laser reflections to estimate movement. These sensors enable the Apple Pencil to detect motion, orientation, and position in 3D space, even when hovering above a surface [2].

Additionally, the patent describes a trackball tip that uses optical sensors to track the ball's movement, providing a more accurate measurement of displacement. This design aims to reduce scratches and contamination while improving signal-to-noise ratios [1].

The patent also mentions combining these optical sensors with other technologies such as inertial measurement units, force detectors, and machine vision. This could enable advanced features like gesture input, handwriting recognition, and 3D drawing, making the Apple Pencil a versatile tool for future spatial computing devices like the Vision Pro or upcoming headsets [2].

This patent indicates Apple's continued exploration into the realm of spatial computing, where input tools need to work beyond traditional flat touchscreens. By incorporating optical sensors and a trackball tip, Apple is pushing the boundaries of what is possible with a stylus, potentially opening up new avenues for creative expression and productivity.

References:
[1] https://9to5mac.com/2025/07/08/apple-just-patented-a-trackball-apple-pencil-that-works-on-almost-any-surface/
[2] https://www.patentlyapple.com/2025/07/an-apple-patent-reveals-a-trackball-tip-based-apple-pencil-with-advanced-sensors-that-allows-content-generation-on-non-touch.html