US 12,169,276 B2
Head-mounted display for virtual and mixed reality with inside-out positional, user body and environment tracking
Simon Fortin-Deschenes, Cupertino, CA (US); Vincent Chapdelaine-Couture, Cupertino, CA (US); Yan Cote, Cupertino, CA (US); and Anthony Ghannoum, Cupertino, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jun. 14, 2023, as Appl. No. 18/209,651.
Application 18/209,651 is a continuation of application No. 17/514,082, filed on Oct. 29, 2021, granted, now 11,693,242.
Application 17/514,082 is a continuation of application No. 17/032,141, filed on Sep. 25, 2020, granted, now 11,199,706, issued on Dec. 14, 2021.
Application 17/032,141 is a continuation of application No. 16/063,004, granted, now 10,838,206, issued on Nov. 17, 2020, previously published as PCT/CA2017/000033, filed on Feb. 20, 2017.
Claims priority of provisional application 62/296,829, filed on Feb. 18, 2016.
Prior Publication US 2023/0324684 A1, Oct. 12, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G02B 27/01 (2006.01); G02B 27/00 (2006.01); G06T 19/00 (2011.01)
CPC G02B 27/017 (2013.01) [G02B 27/0093 (2013.01); G06T 19/006 (2013.01); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0187 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
at a head-mounted device (HMD) including non-transitory memory, one or more processors, and a communications interface for communicating with a first camera sensor, and a display;
obtaining, via the first camera sensor, a pass-through image of a physical environment;
obtaining a depth map associated with the physical environment;
generating rendered graphics associated with virtual content;
generating a display image by blending the rendered graphics with the pass-through image of the physical environment by using the depth map; and
displaying, via the display, the display image.