In industries like manufacturing and logistics, digital twins are dynamic digital replicas of physical systems. These are are well established. For example, here is NVIDIA presention of how digital twins can drive industrial innovation: SOURCE NVIDIA And it makes sense.…
Data architectures need organizing principles that help teams understand where data lives, what quality to expect, and how transformations progress. And what better than a catchy description. Without clear structure, data lakes devolve into swamps where nobody knows which datasets…
Most databases are designed around storing things: Relationships between these things exist, but are treated as secondary concerns, represented through foreign keys and join tables that the database supports. Queries that traverse relationships deeply become unwieldy, requiring multiple self-joins that…
Data Lakes promised everything. Store all your data in one place, in any format, ready for any workload. The reality was horrific. Data Lakes became data swamps, filled with inconsistent data, failed jobs leaving partial writes, no way to roll…
The question of REST versus GraphQL has become one of those debates in software engineering where everyone has an opinion, most of it strong (if sometimes wrong), and much of it colored by their most recent project experience. Like most…
The backbone of any data modelling strategy. A backbone so critical, so important, so key that … it is almost always ignored. See my post that talks to this: So why is the logical model not something that has equal…
Ask five different systems in your organization for information about customer number 12345, and you’ll likely get five different answers. The CRM shows one address, the order management system shows another, billing has a third, and the data warehouse has…
You don’t need to understand the origin stories of why technology works the way it does. But we stand on the shoulders of giants that dedicated their time to solving hard problems. Leslie Lamport was one of those people. You…
Not only does it sound cool, but a vector database is a specialized type of database designed to store, index, and search high-dimensional vectors. These are numerical representations of data such as text, images, audio, or video. In the AI…
When you index data you don’t often think “I wonder where all this data physically resides”. Or maybe you do, but anyway, when working with massive datasets, even the smartest indexes and metadata can’t help if your data is scattered…
You must be logged in to post a comment.