CPC G06V 10/7792 (2022.01) [G06V 10/26 (2022.01); G06V 10/82 (2022.01); G06V 20/49 (2022.01); G06V 40/20 (2022.01)] | 20 Claims |
1. A computer-implemented method for providing weakly-supervised online action segmentation comprising:
receiving image data associated with multi-view videos of a procedure, wherein the procedure involves a plurality of atomic actions;
analyzing the image data using weakly-supervised action segmentation to identify each of the plurality of atomic actions by using an ordered sequence of action labels;
training a neural network with data pertaining to the plurality of atomic actions based on the weakly-supervised action segmentation; and
executing online action segmentation to label atomic actions that are occurring in real-time based on the plurality of atomic actions trained to the neural network, wherein at least one computing system is controlled to provide automation or feedback with respect to real-time atomic actions involved in completing the procedure based on the online action segmentation.
|