US 12,169,909 B2
Many-to-many splatting-based digital image synthesis
Simon Niklaus, San Jose, CA (US); and Ping Hu, Boston, MA (US)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on Apr. 6, 2022, as Appl. No. 17/714,356.
Prior Publication US 2023/0325968 A1, Oct. 12, 2023
Int. Cl. G06T 3/4007 (2024.01); G06T 3/18 (2024.01); G06T 5/50 (2006.01)
CPC G06T 3/4007 (2013.01) [G06T 3/18 (2024.01); G06T 5/50 (2013.01); G06T 2207/20016 (2013.01); G06T 2207/20221 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by a computing device, a plurality of digital images and a plurality of optical flows describing pixel movement between the plurality of digital images, respectively;
generating, by the computing device, data describing:
many-to-many relationships mapped for pixels in the plurality of digital images based on the plurality of optical flows; and
reliability scores of the many-to-many relationships, respectively; and
synthesizing, by the computing device, a synthesized digital image by forward warping the pixels of at least one said digital image based on the many-to-many relationships and fusing the forward warped pixels based on the reliability scores.