DS614 - Big Data Engineering | DAU

Welcome to the course on Big Data Engineering.

---

Lectures

• Storage Layer
  • Prerequisites
    • System Prerequisites
    • Concurrency Prerequisites
    • Python Profiling (optional reading)
  • Log based storage + Hash indexes
  • SSTables + LSM Trees
  • B-trees
  • Columnar Storage
    • Overview
    • Pandas/Parquet
• Transform Layer
  • Batch Processing
  • Distributed Filesystem
  • Map reduce framework
  • Spark Intro

---