Recently I was discussing with a colleague that SQL is a pervasive part of a data stack. Their counterargument was SQL has not yet penetrated the ML...
Part 2: Performance, Catalog and Access Control · This is part 2 of the series Evolution of data platform. I would recommend reading part 1 before this...
Part 1: How it began and what we learned · In this post, we will look at how we built a data platform on AWS and our team's learning while building it. I...
This section is all about author's speculations about the future of data systems. Martin Klepmann: The goal of data integration is to make sure that...
In previous post we discussed about batch processing. The key assumption in batch processing is that data has a defined start and end. In reality...
Broadly data systems can be grouped into two categories Systems of Record : Act as source of truth. In case of conflict, data in this system is...
