May 8, 2023Data warehouse layers are a structured approach to managing your organization's data flow. A layered data architecture aims to ingest and Types of Data LayersAvoiding Unnecessary
Raw data layer – also called the Ingestion Layer/Landing Area, because it is literally the sink of our Data Lake. The main objective is to ingest data into Raw as quickly and as efficiently as possible. To do so, data should remain in its native format. We don't allow any transformations at this stage.
What Is A Data Vault?
A Data Vaultis a more recent data modeling design pattern used to build data warehouses for enterprise-scale analytics compared to Kimball and Inmon What Is Dimensional Modeling?
Dimensional modeling is a bottom-up approach to designing data warehouses in order to optimize them for analytics Data Organization Principles in Each Layer of The Lakehouse
A modern lakehouse is an all-encompassing enterprise-level data platform Bronze Layer — The Landing Zone
The Bronze layer is where we land all the data from source systems Silver Layer — The Enterprise Central Repository
In the Silver layer of the Lakehouse, the data from the Bronze layer is matched, merged Gold Layer — The Presentation Layer
In the Gold layer, multiple data marts or warehouses can be built as per dimensional modeling/Kimball methodology. As discussed earlier The Lakehouse Data Organization Paradigm
To summarize, data is curated as it moves through the different layers of a Lakehouse. 1. The Bronze layeruses the data models of source systems Further Reading
1. Five Simple Steps for Implementing a Star Schema in Databricks With Delt…
2