DataKitchen Written by DataKitchen Authors

Eckerson Group Best Practices Report On DataOps

Eckerson Group Best Practices Report On DataOps

Leading a DataOps Cultural Revolution

Eckerson Group Best Practices in DataOps: How to Create Robust, Automated Data Pipelines

DataOps promises to take the pain out of managing data for reporting and analytics. In most companies, data travels a tortuous route from source systems to business users. Behind the scenes, data professionals go through gyrations to extract, ingest, move, clean, format, integrate, transform, calculate, and aggregate data before releasing it to the business community.

These “data pipelines” are inefficient and error prone: data hops across multiple systems and is processed by various software programs. Humans intervene to apply manual workarounds to fix recalcitrant transaction data that was never designed to be combined, aggregated, and analyzed by knowledge workers. Reuse and automation are scarce. Business users wait months for data sets or reports. The hidden costs of data operations are immense.

In their latest report, the Eckerson Group walks the reader through an explanation of DataOps Best Practices. You can check out their whitepaper here.