DuckLake

There are some great names in software engineering and this is most definitely one of them. The lakehouse architecture promised to combine the best of data warehouses and data lakes. In practice, it delivered quite a lot of complexity. We found ourselves managing snapshot files, dealing with compaction strategies, and debugging obscure metadata oddities (I … Continue reading DuckLake