Building distributed storage is a hard problem. In this lecture, we'll examine the Google File System and highlight the challenges involved in building distributed storage. We'll consider the tradeoffs that were made in building this system, and briefly discuss why Google eventually had to build a successor to GFS.

mit-6.824 distributed-systems learning-diary

Concurrency is important in distributed systems, but is often easy to get wrong. In this post, we'll learn about threads and why one needs to be careful when dealing with them. We'll also discuss an alternative to having to manage multiple threads and some downsides of that too. Finally, we'll discuss Remote Procedure Calls(RPC), which are a technique for client-server communication, highlighting their challenges and semantics.

mit-6.824 distributed-systems learning-diary

I started a study group with some friends where we will be going through the MIT. 6.824: Distributed Systems course. Over the next couple of weeks, I intend to upload my notes from studying each week's material. This post contains my notes from the first lecture on the MapReduce paradigm for large-scale data processing.

mit-6.824 distributed-systems learning-diary

A brief description of Serial Consistency, External Consistency and Linearizability in distributed database systems.

distributed-systems learning-diary

Second part of my notes from Chapter 9 of Martin Kleppmann's 'Designing Data-Intensive Applications' book.

distributed-systems learning-diary ddia

Notes from Chapter 9 of Martin Kleppmann's 'Designing Data-Intensive Applications' book.

distributed-systems learning-diary ddia

In this post, we'll continue from the previous post about pages and records, and learn about how these pages are organized in a way that makes it easy to search for specific records in your database.

data-storage expository

My notes from Chapter 8 of Martin Kleppmann's 'Designing Data-Intensive Applications' book.

learning-diary distributed-systems ddia

My notes from Chapter 7 of 'Designing Data-Intensive Applications' by Martin Kleppmann.

learning-diary distributed-systems ddia

My notes from Chapter 6 of 'Designing Data-Intensive Applications by Martin Kleppmann'.

learning-diary distributed-systems ddia