Data Mesh

Data mesh is an architectural pattern for large-scale data management that aims to decentralize data ownership and decision making. The key principles of data mesh are: – Domain-oriented decentralization – Data is organized around domains rather than technical systems. Each domain owns its data and makes decisions about it. – Data as a product – Data is treated as a product with its own lifecycle and workflow for discovery, access, and understanding. Data products are the primary way data is exposed. – Self-serve data infrastructure – Common data infrastructure services like storage, processing, and governance are provided in a decentralized way for domains to use. – Federated computational governance – Technical governance is decentralized so domains can choose their own technologies but aligned on things like security and accessibility. – Discoverability – Data and its meaning are organized and documented so they can easily be found and understood. Common metadata standards aid discovery. The goal is to shift away from centralized, monolithic data lakes towards more decentralized and autonomous data management aligned with business domains. This allows faster innovation and scaling for large complex organizations.