US 12,169,502 B1
Predictive data processing
Israel Abraham, Springfield, MA (US); and Michael Roche, Springfiled, MA (US)
Assigned to Massachusetts Mutual Life Insurance Company, Springfield, MA (US)
Filed by Massachusetts Mutual Life Insurance Company, Springfield, MA (US)
Filed on Feb. 16, 2022, as Appl. No. 17/673,476.
Int. Cl. G06F 16/25 (2019.01); G06F 16/178 (2019.01)
CPC G06F 16/258 (2019.01) [G06F 16/1794 (2019.01)] 18 Claims
OG exemplary drawing
 
1. A method for improving computational efficiency of data processing and storage, the method comprising:
identifying, by one or more processors coupled to a non-transitory memory that is executing a data transformation process, a plurality of computing devices capable of performing the data transformation process on a data feed of a data repository;
determining, by the one or more processors, based on attributes of the data feed and computational resources used to process a set of historic processing jobs that are associated with the data feed, an amount of computational resources needed to perform the data transformation process on the data feed;
dynamically provisioning, by the one or more processors while performing the data transformation process, a subset of the plurality of computing devices based on the amount of computational resources;
executing, by the one or more processors, the data transformation process at the subset of the plurality of computing devices to process the data feed;
detecting, by the one or more processors and during execution of the data transformation process, an update to the data feed indicating that an amount of additional data has been added to the data feed for processing using the data transformation process; and
upon determining, by the one or more processors, based on the amount of the additional data indicated in the update, that a second amount of computational resources are required to process the additional data of the data feed using the data transformation process, dynamically provisioning, by the one or more processors, during execution of the data transformation process at the subset of the plurality of computing devices, a second subset of the plurality of computing devices to process additional data of the data feed, the second subset of the plurality of computing devices selected according to the amount of the additional data added to the data feed.