Part 2: Performance, Catalog and Access Control · This is part 2 of the series Evolution of data platform. I would recommend reading part 1 before this...
Part 1: How it began and what we learned · In this post, we will look at how we built a data platform on AWS and our team's learning while building it. I...
This section is all about author's speculations about the future of data systems. Martin Klepmann: The goal of data integration is to make sure that...
In previous post we discussed about batch processing. The key assumption in batch processing is that data has a defined start and end. In reality...
Broadly data systems can be grouped into two categories Systems of Record : Act as source of truth. In case of conflict, data in this system is...
This chapter is all about building fault tolerant distributed systems. We will look at tow measures for these - Consistency and consensus. Consensus...
