US 12,169,890 B2
Personalized avatar real-time motion capture
Avihay Assouline, Tel Aviv (IL); Itamar Berger, Hod Hasharon (IL); Gal Dudovitch, Tel Aviv (IL); and Matan Zohar, Rishon LeZion (IL)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Aug. 9, 2022, as Appl. No. 17/818,539.
Application 17/818,539 is a continuation of application No. 16/951,884, filed on Nov. 18, 2020, granted, now 11,450,051.
Prior Publication US 2022/0383577 A1, Dec. 1, 2022
Int. Cl. G06T 13/40 (2011.01); G06F 3/04817 (2022.01); G06F 3/0488 (2022.01); G06T 7/20 (2017.01); G06T 15/20 (2011.01); G06T 19/00 (2011.01)
CPC G06T 13/40 (2013.01) [G06F 3/04817 (2013.01); G06F 3/0488 (2013.01); G06T 7/20 (2013.01); G06T 15/205 (2013.01); G06T 19/006 (2013.01); G06T 2207/10016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
adding a three-dimensional (3D) avatar to a video that depicts a person, the person and the 3D avatar being depicted together in the video;
identifying a given skeletal joint of a set of skeletal joints that moves less than other skeletal joints of the set of skeletal joints; and
selecting, as a reference point, the given skeletal joint that has been identified as moving less than the other skeletal joint;
receiving input to begin recording a new movement;
recording real-time movement of the set of skeletal joints in a movement vector while updating an avatar rig in real-time based on the real-time movement of the set of skeletal joints to cause the 3D avatar to move in a same manner as the set of skeletal joints while the real-time movement of the set of skeletal joints is being recorded; and
positioning and animating the 3D avatar based on the reference point and the movement vector instead of based on the real-time movement of the set of skeletal joints in response to receiving a request to stop recording the new movement.