Data Governance & Modeling
Technical strategies to ensure data trust, quality, and scalability. It moves beyond "moving data" to "managing data as a product".
Data Modeling Architectures
| Pattern | Status | Context |
|---|---|---|
| Medallion Architecture | ADOPT | The standard Bronze/Silver/Gold layering. Simple, effective, and widely understood for Lakehouse setups. |
| Data Vault 2.0 | ASSESS | Investigating for complex enterprise hubs where auditing and historical tracking are critical, despite the complexity overhead. |
| Kimball (Star Schema) | ADOPT | The Gold standard for the presentation layer (Data Marts) to ensure fast BI performance. |
Quality & Validation
| Tool | Status | Context |
|---|---|---|
| Great Expectations | TRIAL | Comprehensive validation framework. powerful but heavy. Evaluating lighter alternatives for simple pipelines. |
| SQLMesh | ASSESS | Monitoring this as a potential successor to dbt for more robust environment management and semantic understanding. |
Essential Resources
| Resource | Description |
|---|---|
| Data Vault 2.0 | Official resources for the Data Vault system of business intelligence. |
| Great Expectations | The shared standard for data quality and pipeline validation. |