Closing Session: Data Governance in Big Data: Boon or Encumbrance?
Data Governance in Big Data: Boon or Encumbrance?
On the Bastille Day of the Big Data Revolution, data governance was overthrown along with Enterprise Data Warehouses and their tightly controlled data representation (“schema-on-write”). Data was democratized. Anyone could store their data in the data lake, in any structure (or no consistent structure). Since then, data representation and self-service access have blossomed. But data discovery and semantics-driven data integration have suffered. Today, data scientists seeking to integrate data from multiple silos are unable to identify
where the data resides in the lake. Once found, diverse datasets are very hard to integrate, since the data typically contains no documentation on the semantics of its attributes. Did we throw the baby out with the proverbial bathwater? Can we reinstate a Post-Revolutionary form of Data Governance? Come to this session and see.