US 12,169,598 B2
AR glasses as IoT remote control
Sharon Moll, Wetzikon (CH); and Piotr Gurgul, Hergiswil (CH)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Sharon Moll, Wetzikon (CH); and Piotr Gurgul, Hergiswil (CH)
Filed on Sep. 19, 2022, as Appl. No. 17/947,607.
Prior Publication US 2024/0094822 A1, Mar. 21, 2024
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01); G06F 3/0346 (2013.01); G06K 7/14 (2006.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06V 20/20 (2022.01); G16Y 40/30 (2020.01)
CPC G06F 3/017 (2013.01) [G02B 27/0172 (2013.01); G06F 3/012 (2013.01); G06F 3/0346 (2013.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06V 20/20 (2022.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0178 (2013.01); G06K 7/1417 (2013.01); G06T 2207/30244 (2013.01); G16Y 40/30 (2020.01)] 19 Claims
OG exemplary drawing
 
1. An eyewear device adapted to remotely control an Internet of Things (IOT) enabled device having an IoT display, the eyewear device comprising:
a camera;
a memory that stores instructions; and
a processor coupled to the camera and the memory, wherein the processor executes the instructions to configure the eyewear device to:
pair the eyewear device with the IoT enabled device for communications over a communications interface therebetween by configuring the eyewear device to subscribe for dynamic events including messages relating to at least one of hand gestures or head gestures on the communications interface;
calibrate the eyewear device to a real-world coordinate position of the IoT display;
determine an intersection point of a field of view (FOV) of the eyewear device with the IoT display; and
send a cursor position update to the IoT enabled device based on the intersection point over the communications interface.