CPC H04L 65/4015 (2013.01) [G06F 3/013 (2013.01); G06N 3/04 (2013.01); G06N 3/045 (2023.01); G06T 7/11 (2017.01); G06T 7/70 (2017.01); G06T 15/04 (2013.01); G06T 15/20 (2013.01); G06T 15/205 (2013.01); G06T 17/20 (2013.01); G06T 19/00 (2013.01); G06T 19/20 (2013.01); H04L 12/1818 (2013.01); H04L 63/101 (2013.01); H04L 63/108 (2013.01); H04L 65/403 (2013.01); H04N 7/144 (2013.01); H04N 7/147 (2013.01); H04N 7/152 (2013.01); H04N 7/157 (2013.01); G06T 2200/08 (2013.01); G06T 2207/30201 (2013.01); G06T 2219/2004 (2013.01)] | 20 Claims |
1. A method for virtually mimicking an arm movement of participant of a three dimensional (3D) video conference, the method comprises:
obtaining joints movement information about joints movements of an arm of a participant of the 3D video conference, based on a movement of the arm of the participant that was captured by a video taken by a camera of the participant, wherein arm of the participant is free of physical joint movement markers;
generating, an arm skeletal model that represents the joins movement of the arm, based on the joints movement information;
generating, by a machine learning process, a renderable 3D model of the arm that mimics the movement of the arm of the participant; wherein the machine learning process was trained to take into account an impact of the joints movement on arm muscle movement and on arm skin appearance;
responding to the generating of the renderable 3D model, wherein the responding comprises at least one out of (a) rendering an avatar of the participant based on the renderable 3D model, (b) storing renderable 3D model information, or (c) sending the renderable 3D model information to another computerized device related to the 3D video conference; and
selecting renderable 3D model parameters to be transmitted to another participant of the 3D videoconference out of a group of renderable 3D model parameters that represent the renderable 3D model, and transmitting to the other participant the selected renderable 3D model parameter during the 3D video conference.
|