Alex Punnen
Jul 6, 2022

--

It is similar to the data lakehouse in that it used AWS/GCP S3 as backend for storage. Since S3 objects are immutable, they use micro partions, to enable UPDATES. As smaller micro paritions can be pruned easily. There would be additonal complexity in magaing the indices then, and pruning them. It's of course commerical and proprietary.

--

--

Alex Punnen
Alex Punnen

Written by Alex Punnen

SW Architect/programmer- in various languages and technologies from 2001 to now. https://www.linkedin.com/in/alexpunnen/

No responses yet