swadhin / awesome-db-roadmap public

Optimized for Obsidian

swadhinbiswas committed 11 months ago
5ee8827
1 parent e598c7b
commit 5ee8827
5 files changed
+80 -111
Showing 5 changed files+80-111
00 - Roadmap Overview.md01 - Fundamentals.mdObsidian Templates & Dataview.mdPractice Projects.mdREADME.md
▼00 - Roadmap Overview.md
+12-12
@@ -12,14 +12,14 @@ Use this vault in Obsidian:
12
12
13
13
## 🌳 High-Level Tree
14
14
15
-1. [[01 - Fundamentals|Fundamentals]]
16
-2. [[02 - RDBMS|Relational Databases (RDBMS)]]
17
-3. [[03 - NoSQL|NoSQL Ecosystem]]
18
-4. [[04 - Big Data|Big Data & Analytics]]
19
-5. [[05 - Cloud Databases|Cloud Databases]]
20
-6. [[06 - Internals|Database Internals]]
21
-7. [[07 - Data Modeling|Data Modeling & Architecture]]
22
-8. [[08 - Modern Databases|Modern Distributed Databases]]
15
+1. [Fundamentals](01%20-%20Fundamentals.md)
16
+2. [Relational Databases (RDBMS)](02%20-%20RDBMS.md)
17
+3. [NoSQL Ecosystem](03%20-%20NoSQL.md)
18
+4. [Big Data & Analytics](04%20-%20Big%20Data.md)
19
+5. [Cloud Databases](05%20-%20Cloud%20Databases.md)
20
+6. [Database Internals](06%20-%20Internals.md)
21
+7. [Data Modeling & Architecture](07%20-%20Data%20Modeling.md)
22
+8. [Modern Distributed Databases](08%20-%20Modern%20Databases.md)
23
23
24
24
---
25
25
@@ -38,9 +38,9 @@ Use this vault in Obsidian:
38
38
39
39
## 📚 How to Use This Roadmap
40
40
41
-- Start with [[01 - Fundamentals]] and **do not rush**. These concepts appear everywhere.
42
-- After fundamentals, move to [[02 - RDBMS]] and [[03 - NoSQL]] to understand trade-offs.
43
-- Use [[06 - Internals]] and [[08 - Modern Databases]] once you’re comfortable with basics.
44
-- Revisit [[07 - Data Modeling]] often – good modeling is what separates juniors from seniors.
41
+- Start with [01 - Fundamentals](01%20-%20Fundamentals.md) and **do not rush**. These concepts appear everywhere.
42
+- After fundamentals, move to [02 - RDBMS](02%20-%20RDBMS.md) and [03 - NoSQL](03%20-%20NoSQL.md) to understand trade-offs.
43
+- Use [06 - Internals](06%20-%20Internals.md) and [08 - Modern Databases](08%20-%20Modern%20Databases.md) once you’re comfortable with basics.
44
+- Revisit [07 - Data Modeling](07%20-%20Data%20Modeling.md) often – good modeling is what separates juniors from seniors.
45
45
46
46
When in doubt, come back to this page as your **home base**.
47
47
▼01 - Fundamentals.md
+14-14
@@ -14,67 +14,67 @@ Foundational ideas that power **all** database systems, regardless of technology
14
14
15
15
## 🧱 Core Topics
16
16
17
-### [[ACID]]
17
+### [ACID](01%20-%20Fundamentals/ACID.md)
18
18
19
19
- [ ] Define **Atomicity, Consistency, Isolation, Durability**
20
20
- [ ] Recognize ACID in real-world scenarios (bank transfers, orders)
21
21
- [ ] Understand how ACID relates to **transactions** and **constraints**
22
22
23
-### [[CAP Theorem]]
23
+### [CAP Theorem](01%20-%20Fundamentals/CAP%20Theorem.md)
24
24
25
25
- [ ] Learn what **Consistency, Availability, Partition Tolerance** mean in practice
26
26
- [ ] Understand why under partition, you must trade **C vs A**
27
27
- [ ] Map real systems (e.g., Cassandra, MongoDB, Spanner) onto CAP choices
28
28
29
-### [[Transactions & Isolation]]
29
+### [Transactions & Isolation](01%20-%20Fundamentals/Transactions%20&%20Isolation.md)
30
30
31
31
- [ ] Understand what a **transaction** is and why we need it
32
32
- [ ] Learn isolation levels: **Read Uncommitted, Read Committed, Repeatable Read, Serializable**
33
33
- [ ] Recognize anomalies: **dirty reads, non-repeatable reads, phantom reads**
34
34
35
-### [[Concurrency Control]]
35
+### [Concurrency Control](01%20-%20Fundamentals/Concurrency%20Control.md)
36
36
37
37
- [ ] Understand **locks**, **latches**, and **optimistic vs pessimistic** control
38
38
- [ ] Learn about **deadlocks** and how systems detect/avoid them
39
39
- [ ] Connect concurrency control to **isolation levels**
40
40
41
-### [[Indexes]]
41
+### [Indexes](01%20-%20Fundamentals/Indexes.md)
42
42
43
43
- [ ] Explain what an **index** is and why it speeds up queries
44
44
- [ ] Compare **B-Tree** vs **hash** indexes at a high level
45
45
- [ ] Understand trade-offs: **read vs write performance**, extra storage, maintenance
46
46
47
-### [[Query Optimization]]
47
+### [Query Optimization](01%20-%20Fundamentals/Query%20Optimization.md)
48
48
49
49
- [ ] Understand what a **query planner/optimizer** does
50
50
- [ ] Read and interpret a simple **EXPLAIN plan**
51
51
- [ ] Recognize common anti-patterns (SELECT \*) and how indexes help
52
52
53
-### [[Sharding]]
53
+### [Sharding](01%20-%20Fundamentals/Sharding.md)
54
54
55
55
- [ ] Learn what **horizontal partitioning / sharding** means
56
56
- [ ] Compare **range**, **hash**, and **directory** sharding
57
57
- [ ] Understand challenges: **resharding, hotspots, cross-shard joins**
58
58
59
-### [[Replication]]
59
+### [Replication](01%20-%20Fundamentals/Replication.md)
60
60
61
61
- [ ] Understand **leader-follower**, **multi-leader**, and **leaderless** replication
62
62
- [ ] Learn about **synchronous vs asynchronous** replication
63
63
- [ ] Connect replication to **high availability** and **read scaling**
64
64
65
-### [[Caching]]
65
+### [Caching](01%20-%20Fundamentals/Caching.md)
66
66
67
67
- [ ] Understand why caches exist: **latency** and **load reduction**
68
68
- [ ] Compare **in-process**, **near-cache**, and **distributed** caches
69
69
- [ ] Learn about **cache invalidation** strategies and consistency issues
70
70
71
-### [[Storage Engines]]
71
+### [Storage Engines](01%20-%20Fundamentals/Storage%20Engines.md)
72
72
73
73
- [ ] Understand the difference between a **database** and its **storage engine**
74
74
- [ ] Compare high-level characteristics of **B-Tree** and **LSM-tree**-based engines
75
75
- [ ] Connect engines to workloads: **OLTP vs OLAP** patterns
76
76
77
-### [[WAL & MVCC]]
77
+### [WAL & MVCC](01%20-%20Fundamentals/WAL%20&%20MVCC.md)
78
78
79
79
- [ ] Learn what a **Write-Ahead Log (WAL)** is and why it’s critical
80
80
- [ ] Understand **MVCC (Multi-Version Concurrency Control)** at a conceptual level
@@ -85,6 +85,6 @@ Foundational ideas that power **all** database systems, regardless of technology
85
85
## 🔗 Next Steps
86
86
87
87
- After this module, you’re ready to go deeper into:
88
- - [[02 - RDBMS]] for relational systems
89
- - [[03 - NoSQL]] for non-relational paradigms
90
- - [[06 - Internals]] when you want to understand how engines are built
88
+ - [02 - RDBMS](02%20-%20RDBMS.md) for relational systems
89
+ - [03 - NoSQL](03%20-%20NoSQL.md) for non-relational paradigms
90
+ - [06 - Internals](06%20-%20Internals.md) when you want to understand how engines are built
91
91
▼Obsidian Templates & Dataview.md
+2-2
@@ -42,8 +42,8 @@ difficulty: intermediate
42
42
- [ ] Example task 2
43
43
44
44
## 🔗 Related
45
-- [[01 - Fundamentals]]
46
-- [[02 - RDBMS]]
45
+- [01 - Fundamentals](01%20-%20Fundamentals.md)
46
+- [02 - RDBMS](02%20-%20RDBMS.md)
47
47
48
48
```
49
49
50
50
▼Practice Projects.md
+13-13
@@ -10,9 +10,9 @@ End-to-end projects that connect multiple topics across this roadmap. Treat thes
10
10
11
11
### Topics Used
12
12
13
-- [[01 - Fundamentals]] – ACID, Transactions & Isolation, Indexes, Query Optimization
14
-- [[02 - RDBMS]] – [[PostgreSQL]] and [[Concepts]]
15
-- [[07 - Data Modeling]] – [[ER Modeling]], normalization, basic [[Star Schema]] for simple reports
13
+- [01 - Fundamentals](01%20-%20Fundamentals.md) – ACID, Transactions & Isolation, Indexes, Query Optimization
14
+- [02 - RDBMS](02%20-%20RDBMS.md) – [PostgreSQL](02%20-%20RDBMS/PostgreSQL.md) and [Concepts](02%20-%20RDBMS/Concepts.md)
15
+- [07 - Data Modeling](07%20-%20Data%20Modeling.md) – [ER Modeling](07%20-%20Data%20Modeling/ER%20Modeling.md), normalization, basic [Star Schema](07%20-%20Data%20Modeling/Star%20Schema.md) for simple reports
16
16
17
17
### Checklist
18
18
@@ -34,8 +34,8 @@ End-to-end projects that connect multiple topics across this roadmap. Treat thes
34
34
35
35
### Topics Used
36
36
37
-- [[04 - Big Data]] – [[Distributed Storage]], [[Data Warehouses]], [[Query Engines]]
38
-- [[07 - Data Modeling]] – [[Star Schema]], [[Snowflake Schema]], [[SCD Types]]
37
+- [04 - Big Data](04%20-%20Big%20Data.md) – [Distributed Storage](04%20-%20Big%20Data/Distributed%20Storage.md), [Data Warehouses](04%20-%20Big%20Data/Data%20Warehouses.md), [Query Engines](04%20-%20Big%20Data/Query%20Engines.md)
38
+- [07 - Data Modeling](07%20-%20Data%20Modeling.md) – [Star Schema](07%20-%20Data%20Modeling/Star%20Schema.md), [Snowflake Schema](07%20-%20Data%20Modeling/Snowflake%20Schema.md), [SCD Types](07%20-%20Data%20Modeling/SCD%20Types.md)
39
39
40
40
### Checklist
41
41
@@ -54,8 +54,8 @@ End-to-end projects that connect multiple topics across this roadmap. Treat thes
54
54
55
55
### Topics Used
56
56
57
-- [[03 - NoSQL]] – [[Time-Series Databases]], possibly [[Wide-Column Stores]]
58
-- [[04 - Big Data]] – [[Streaming Systems]]
57
+- [03 - NoSQL](03%20-%20NoSQL.md) – [Time-Series Databases](03%20-%20NoSQL/Time-Series%20Databases.md), possibly [Wide-Column Stores](03%20-%20NoSQL/Wide-Column%20Stores.md)
58
+- [04 - Big Data](04%20-%20Big%20Data.md) – [Streaming Systems](04%20-%20Big%20Data/Streaming%20Systems.md)
59
59
60
60
### Checklist
61
61
@@ -73,9 +73,9 @@ End-to-end projects that connect multiple topics across this roadmap. Treat thes
73
73
74
74
### Topics Used
75
75
76
-- [[03 - NoSQL]] – [[Document Stores]], [[Key-Value Stores]]
77
-- [[07 - Data Modeling]] – [[Polyglot Persistence]], [[Microservice DB Patterns]], [[CQRS]], [[Event Sourcing]]
78
-- [[05 - Cloud Databases]] – one managed DB of your choice
76
+- [03 - NoSQL](03%20-%20NoSQL.md) – [Document Stores](03%20-%20NoSQL/Document%20Stores.md), [Key-Value Stores](03%20-%20NoSQL/Key-Value%20Stores.md)
77
+- [07 - Data Modeling](07%20-%20Data%20Modeling.md) – [Polyglot Persistence](07%20-%20Data%20Modeling/Polyglot%20Persistence.md), [Microservice DB Patterns](07%20-%20Data%20Modeling/Microservice%20DB%20Patterns.md), [CQRS](07%20-%20Data%20Modeling/CQRS.md), [Event Sourcing](07%20-%20Data%20Modeling/Event%20Sourcing.md)
78
+- [05 - Cloud Databases](05%20-%20Cloud%20Databases.md) – one managed DB of your choice
79
79
80
80
### Checklist
81
81
@@ -93,9 +93,9 @@ End-to-end projects that connect multiple topics across this roadmap. Treat thes
93
93
94
94
### Topics Used
95
95
96
-- [[08 - Modern Databases]] – [[Google Spanner]], [[CockroachDB]], [[YugabyteDB]], [[TiDB]], [[PlanetScale]], [[SingleStore]]
97
-- [[06 - Internals]] – [[Raft Consensus]], [[B-Tree vs LSM]], [[2PC & 3PC]]
98
-- [[01 - Fundamentals]] – [[CAP Theorem]], [[Sharding]], [[Replication]]
96
+- [08 - Modern Databases](08%20-%20Modern%20Databases.md) – [Google Spanner](08%20-%20Modern%20Databases/Google%20Spanner.md), [CockroachDB](08%20-%20Modern%20Databases/CockroachDB.md), [YugabyteDB](08%20-%20Modern%20Databases/YugabyteDB.md), [TiDB](08%20-%20Modern%20Databases/TiDB.md), [PlanetScale](08%20-%20Modern%20Databases/PlanetScale.md), [SingleStore](08%20-%20Modern%20Databases/SingleStore.md)
97
+- [06 - Internals](06%20-%20Internals.md) – [Raft Consensus](06%20-%20Internals/Raft%20Consensus.md), [B-Tree vs LSM](06%20-%20Internals/B-Tree%20vs%20LSM.md), [2PC & 3PC](06%20-%20Internals/2PC%20&%203PC.md)
98
+- [01 - Fundamentals](01%20-%20Fundamentals.md) – [CAP Theorem](01%20-%20Fundamentals/CAP%20Theorem.md), [Sharding](01%20-%20Fundamentals/Sharding.md), [Replication](01%20-%20Fundamentals/Replication.md)
99
99
100
100
### Checklist
101
101
102
102
▼README.md
+39-70
@@ -1,15 +1,25 @@
1
+<p align="center">
2
+ <img src="https://www.dataversity.net/wp-content/uploads/2025/09/kf_typesofdbms_oct23.png" alt="Database Types Banner">
3
+</p>
4
+
1
5
# The 2026 Database Engineering Roadmap
2
6
3
-[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat-square)](http://makeapullrequest.com)
4
-[![GitHub stars](https://img.shields.io/github/stars/swadhinbiswas/jobprep.svg?style=social&label=Star)](https://github.com/swadhinbiswas/jobprep)
7
+<p align="center">
8
+ <a href="http://makeapullrequest.com">
9
+ <img src="https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=for-the-badge" alt="PRs Welcome">
10
+ </a>
11
+ <a href="https://github.com/swadhinbiswas/Awesome-DB-Roadmap">
12
+ <img src="https://img.shields.io/github/stars/swadhinbiswas/Awesome-DB-Roadmap.svg?style=for-the-badge&logo=github&label=Star" alt="GitHub stars">
13
+ </a>
14
+</p>
5
15
6
-An industry-grade, comprehensive roadmap for anyone looking to master database engineering in 2026. This guide is designed for beginners and experienced developers who want to understand everything from fundamental concepts to modern, distributed database systems.
16
+> An industry-grade, comprehensive roadmap for anyone looking to master database engineering in 2026. This guide is designed for beginners and experienced developers who want to understand everything from fundamental concepts to modern, distributed database systems.
7
17
8
18
Whether you're aiming for a career in backend engineering, data engineering, or as a database administrator (DBA), this roadmap provides a structured learning path to help you succeed.
9
19
10
20
---
11
21
12
-## Why This Roadmap?
22
+## 💡 Why This Roadmap?
13
23
14
24
* **Comprehensive & Structured:** We cover everything from the ground up. No black boxes. The roadmap is organized logically, from fundamentals to advanced, specialized topics.
15
25
* **Industry-Focused:** This isn't just a list of topics. It's a curated guide to the skills and technologies that are in demand in the industry today.
@@ -18,87 +28,46 @@ Whether you're aiming for a career in backend engineering, data engineering, or
18
28
19
29
---
20
30
21
-## The Roadmap
31
+## 🚀 The Roadmap
22
32
23
33
This roadmap is divided into 8 key sections. While you can jump to any topic that interests you, we recommend following the sections in order for a more structured learning experience.
24
34
25
-### 1. Fundamentals
26
-The building blocks of every database system.
27
-- [ACID Properties](01%20-%20Fundamentals/ACID.md)
28
-- [CAP Theorem](01%20-%20Fundamentals/CAP%20Theorem.md)
29
-- [Indexes and Query Optimization](01%20-%20Fundamentals/Indexes.md)
30
-- [Transactions & Concurrency Control](01%20-%20Fundamentals/Transactions%20&%20Isolation.md)
31
-- [Replication & Sharding](01%20-%20Fundamentals/Replication.md)
32
-- [Storage Engines (WAL, MVCC)](01%20-%20Fundamentals/Storage%20Engines.md)
33
-- [Caching](01%20-%20Fundamentals/Caching.md)
34
-
35
-### 2. Relational Databases (RDBMS)
36
-The foundation of most applications. Master SQL and the most popular relational databases.
37
-- [SQL](02%20-%20RDBMS/Concepts.md)
38
-- [PostgreSQL](02%20-%20RDBMS/PostgreSQL.md)
39
-- [MySQL](02%20-%20RDBMS/MySQL.md)
40
-- [SQLite](02%20-%20RDBMS/SQLite.md)
41
-
42
-### 3. NoSQL Databases
43
-Explore the world beyond relational databases and understand when to use them.
44
-- [Key-Value Stores](03%20-%20NoSQL/Key-Value%20Stores.md) (e.g., Redis)
45
-- [Document Stores](03%20-%20NoSQL/Document%20Stores.md) (e.g., MongoDB)
46
-- [Wide-Column Stores](03%20-%20NoSQL/Wide-Column%20Stores.md) (e.g., Cassandra)
47
-- [Graph Databases](03%20-%20NoSQL/Graph%20Databases.md) (e.g., Neo4j)
48
-- [Vector Databases](03%20-%20NoSQL/Vector%20Databases.md) (e.g., Pinecone, Milvus)
49
-- [Search Engines](03%20-%20NoSQL/Search%20Engines.md) (e.g., Elasticsearch)
50
-
51
-### 4. Data Modeling
52
-Learn how to design efficient, scalable, and maintainable database schemas.
53
-- [ER Modeling](07%20-%20Data%20Modeling/ER%20Modeling.md)
54
-- [Star & Snowflake Schema](07%20-%20Data%20Modeling/Snowflake%20Schema.md)
55
-- [CQRS & Event Sourcing](07%20-%20Data%20Modeling/CQRS.md)
56
-- [Polyglot Persistence](07%20-%20Data%20Modeling/Polyglot%20Persistence.md)
57
-
58
-### 5. Big Data & Analytics
59
-Scale your knowledge to handle massive datasets.
60
-- [Data Warehouses](04%20-%20Big%20Data/Data%20Warehouses.md) (e.g., Snowflake, BigQuery)
61
-- [Distributed Storage](04%20-%20Big%20Data/Distributed%20Storage.md) (e.g., HDFS)
62
-- [Streaming Systems](04%20-%20Big%20Data/Streaming%20Systems.md) (e.g., Kafka, Flink)
63
-- [Query Engines](04%20-%20Big%20Data/Query%20Engines.md) (e.g., Presto, Trino)
64
-
65
-### 6. Cloud Databases
66
-Leverage the power of the cloud with managed database services.
67
-- [AWS (RDS, DynamoDB, Aurora)](05%20-%20Cloud%20Databases/AWS.md)
68
-- [Google Cloud (Cloud SQL, Spanner)](05%20-%20Cloud%20Databases/GCP.md)
69
-- [Azure (Cosmos DB, Azure SQL)](05%20-%20Cloud%20Databases/Azure.md)
70
-
71
-### 7. Database Internals
72
-Go deep and understand how databases *really* work.
73
-- [B-Trees vs. LSM Trees](06%20-%20Internals/B-Tree%20vs%20LSM.md)
74
-- [Query Planners & Optimizers](06%20-%20Internals/Query%20Planner.md)
75
-- [Consensus Algorithms (Paxos, Raft)](06%20-%20Internals/Raft%20Consensus.md)
76
-- [2PC & 3PC](06%20-%20Internals/2PC%20&%203PC.md)
77
-
78
-### 8. Modern Databases
79
-Explore the next generation of distributed SQL databases.
80
-- [Google Spanner](08%20-%20Modern%20Databases/Google%20Spanner.md)
81
-- [CockroachDB](08%20-%20Modern%20Databases/CockroachDB.md)
82
-- [TiDB](08%20-%20Modern%20Databases/TiDB.md)
83
-- [YugabyteDB](08%20-%20Modern%20Databases/YugabyteDB.md)
35
+| Section | Topic | Description |
36
+| :-----: | ----------------------------------- | --------------------------------------------------------------- |
37
+| 1 | **Fundamentals** | The building blocks of every database system. |
38
+| 2 | **Relational Databases (RDBMS)** | Master SQL and the most popular relational databases. |
39
+| 3 | **NoSQL Databases** | Explore the world beyond relational databases. |
40
+| 4 | **Data Modeling** | Design efficient, scalable, and maintainable database schemas. |
41
+| 5 | **Big Data & Analytics** | Scale your knowledge to handle massive datasets. |
42
+| 6 | **Cloud Databases** | Leverage the power of the cloud with managed database services. |
43
+| 7 | **Database Internals** | Go deep and understand how databases *really* work. |
44
+| 8 | **Modern Databases** | Explore the next generation of distributed SQL databases. |
84
45
85
46
---
86
47
87
-## How to Use This Roadmap
48
+## 📖 How to Use This Roadmaps
88
49
89
50
1. **Clone the repository:**
90
51
```bash
91
- git clone https://github.com/swadhinbiswas/jobprep.git
52
+ git clone https://github.com/swadhinbiswas/Awesome-DB-Roadmap.git
92
53
```
93
54
2. **Explore the sections:** Start with the fundamentals and work your way through the topics. Each file contains key concepts, resources, and things to learn.
94
-3. **Track your progress:** The notes are in Markdown, so you can edit them and add checkboxes to track your learning.
55
+3. **Track your progress:** The notes are in Markdown, so you can edit them and add check boxes to track your learning.
95
56
4. **Build the projects:** The best way to learn is by doing. Check out the `Practice Projects.md` file for ideas to apply your knowledge.
96
57
97
-**Tip for Obsidian Users:** This repository is also a pre-built Obsidian vault. Just open the `Database Roadmap` folder as a vault in Obsidian to get features like graph view, wikilinks, and more.
58
+---
59
+
60
+## ✨ Tip for Obsidian Users
61
+
62
+This repository is also a pre-built Obsidian vault. Just open the `Database Roadmap` folder as a vault in Obsidian to get features like graph view, wikilinks, and more.
63
+
64
+<p align="center">
65
+ <img src="https://blog.lulu.com/content/images/2024/11/092622-Obsidian-Review-FB-Blog.png" alt="Obsidian Vault" width="600">
66
+</p>
98
67
99
68
---
100
69
101
-## Contributing
70
+## 🙌 Contributing
102
71
103
72
This is a community-driven project, and we welcome contributions! If you see something missing, a topic that could be improved, or a new database that should be on the roadmap, please open an issue or submit a pull request.
104
73
@@ -106,6 +75,6 @@ Check out our contribution guidelines for more information (coming soon).
106
75
107
76
---
108
77
109
-## License
78
+## 📝 License
110
79
111
80
This project is licensed under the MIT License. See the [LICENSE](LICENSE) file for details.
112
81