An end-to-end data engineering project on Azure, built around the NYC TLC Yellow Taxi trip dataset. It implements a Lambda architecture — a batch layer for deep historical analysis and a streaming ...
Delta Lake is an open source project to build a transactional data storage layer for Spark on top of a data lake. Delta Lake adds support for relational semantics for both batch and streaming data ...