Dev Productivity & Tools
Data as a Product — Part 1: Foundations
2026-03-1719 min read
Foundations & concepts: DaaP, product thinking, self-service, quality, anatomy.
Data-engineeringData-productData as a Product
#Lakehouse
13 posts
Dev Productivity & ToolsGitLab Flow Strategy — Lakehouse Program
2026-03-17·7 min read
Git workflow strategy for Lakehouse: 5 work streams, main/staging/develop, feature branches, monthly review, CI/CD, hotfix, best practices.
DevelopmentDevopsGit- Engineering Leadership
Lakehouse architecture overview (7 layers)
2026-03-17·1 min read
Seven-layer Lakehouse: Ingestion (Airbyte, Kafka), Processing (Spark, Flink, dbt), Storage Format (Iceberg, Delta), MinIO, Metadata, Trino, Consumption.
Data-platformLakehouseArchitecture 
Dev Productivity & ToolsLakehouse BRD — Chapter 1: Overview
2026-03-17·2 min read
Strategic goals, project rationale, data ecosystem, Lakehouse scope, and success criteria for a unified data platform.
Data-platformLakehouseGovernance
Dev Productivity & ToolsLakehouse BRD — Chapter 2: Proposed system architecture
2026-03-17·2 min read
Seven-layer Lakehouse architecture: Ingestion, Processing, Storage Format, Storage, Metadata, Query, Consumption. Batch and streaming.
Data-platformLakehouseArchitecture- Dev Productivity & Tools
Lakehouse BRD — Chapter 3: Data flow
2026-03-17·2 min read
End-to-end data flow: sources (Core, CRM, Payment, Risk, API), Airbyte/Kafka/Flink, Spark/dbt, Iceberg/MinIO, DataHub, Trino, Superset/ML/API.
Data-platformLakehouseData-flow - Dev Productivity & Tools
Lakehouse BRD — Chapter 4: Ingestion Layer (Airbyte, Kafka, Logstash)
2026-03-17·2 min read
Ingestion Layer: collect from CRM, Core, Risk, Payment, API; batch (Airbyte) and streaming (Kafka); CDC, retry, schema registry, quality control.
Data-platformLakehouseIngestion - Dev Productivity & Tools
Lakehouse BRD — Chapter 8: Security & Data Privacy (RBAC, Masking)
2026-03-17·1 min read
Security & Privacy: protect all layers, RBAC, PII masking, audit, encryption, compliance with personal data protection regulations.
Data-platformLakehouseSecurity 
Dev Productivity & ToolsLakehouse BRD — Appendix: Layer spec & standard lineage
2026-03-17·2 min read
BRD appendix: 6 layers (Raw, Staging, Curated, Analytics, Lineage & Metadata, Audit); 4-step lineage raw→stg→cur→ana.
Data-platformLakehouseGovernance- Dev Productivity & ToolsSeries
Series: Lakehouse Layer Spec (7 layers)
2026-03-17·1 min read
Intro to a 7-post series specifying each Lakehouse layer: Raw, Staging, Curated, Analytics, Metadata & Governance, Query & BI, Consumption.
Data-platformLakehouseSeries - Dev Productivity & Tools
MinIO Object Storage Guide — Lakehouse
2026-03-17·20 min read
MinIO trong Lakehouse: S3 API, buckets, security.
Data-engineeringTrainingLakehouse - Dev Productivity & Tools
PostgreSQL Database Guide — Lakehouse
2026-03-17·16 min read
PostgreSQL trong Lakehouse: schema, labs, integration.
Data-engineeringTrainingLakehouse - Dev Productivity & Tools
Lakehouse — Team Development Guidelines
2026-03-17·5 min read
Development guidelines for Lakehouse team: Git workflow, coding standards, testing, security, deployment, code review, communication.
Data-engineeringDevelopmentDevops