Page History

...

1. A component to figure the optimal number of partitions to fetch data from source with an upper limit on the number of tasks and batch fetch size (rows per filetable).
2. Query builder based on incremental logic configured by the user. Strategy types can be 
1. Incrementing column
2. Timestamp column
3. Timestamp and incrementing columns
4. Customer query-based
5. Full refresh 
3. Component to execute part operations independently with retry mechanism (spark map).
4. Component to handle schema evolution and database-specific type conversions. 

...