Zone Maps

The fastest query is the one you don’t need to make. Zone maps are a lightweight indexing technique that lets the query engine skip large chunks of data by storing…

Data Governance

As your organisation grows, so does the overhead of managing and controling the data. In large organisations, it is one of the most complex and time consuming activities, requiring teams…

Data Skipping

In large-scale analytics systems, scanning every record to answer a query is a recipe for slow performance and high cost.Data skipping is the technique that lets the engine read only…

Spatial Databases

Spatial databases are designed to store, query, and manipulate data that represents objects in space — from cities and roads to oceans and underground utility lines. Unlike traditional databases that…

Lance Tables

Now for something a bit different. In a world where data is no longer just rows in a database, the rise of vector databases and machine learning pipelines has pushed…

Spatial Indexing

When you query a traditional (relational) database column, a B-tree index usually handles the search efficiently.Spatial data, however, is not just a single dimension; it’s at least two (latitude, longitude)…

From Tape to Terabytes

We don’t really think about where the data is physically stored. In the digital world, storage is the unsung hero. Data scientists, AI models and analytics tools often take centre…

Data Literacy

Every software project begins with someone deciding how to structure data. A developer creates database tables. An analyst designs a dimensional model. A product manager sketches entities and relationships on…