US 12,169,486 B2
File-based error handling during ingestion with transformation
Abdullah Al Mahmood, Bothell, WA (US); Ruta Dhaneshwar, Redmond, WA (US); Max Heimel, Berlin (DE); Xin Huang, Bellevue, WA (US); Canzhou Qu, Bellevue, WA (US); Purav B. Saraiya, Kirkland, WA (US); and Konstantinos Zoumpatianos, Berlin (DE)
Assigned to Snowflake Inc., Bozeman, MT (US)
Filed by Snowflake Inc., Bozeman, MT (US)
Filed on May 23, 2023, as Appl. No. 18/321,994.
Claims priority of provisional application 63/380,163, filed on Oct. 19, 2022.
Prior Publication US 2024/0134844 A1, Apr. 25, 2024
Prior Publication US 2024/0232167 A9, Jul. 11, 2024
Int. Cl. G06F 16/23 (2019.01); G06F 16/215 (2019.01); G06F 16/25 (2019.01)
CPC G06F 16/2365 (2019.01) [G06F 16/215 (2019.01); G06F 16/258 (2019.01)] 30 Claims
OG exemplary drawing
 
1. A method comprising:
generating, by one or more processors, based on one or more input files, one or more input data columns, each input data column comprising an input value array of one or more input values;
generating, by the one or more processors, based on the input data columns and one or more expressions, one or more result data columns, each result data column comprising one or more result value arrays and one or more result error indicator arrays;
detecting, by the one or more processors, one or more projection errors during the generating of the one or more result data columns;
storing, by the one or more processors, a result error indicator in the one or more error indicator arrays of the one or more result data columns based on the one or more projection errors;
generating, by the one or more processors, one or more filtered result data columns based on the one or more result data columns and the one or more result error indicator arrays of the one or more result data columns; and
storing, by the one or more processors, the one or more filtered result data columns in a database of a data platform.