How do you create KPI and collect metrics for a data warehouse/ data center when looking to identify the value objectively/quantifiable?

1.6k views1 Upvote3 Comments
Sort By:
Oldest
Co-founder/Practicum Director in Travel and Hospitalitya year ago
This one is pretty context-driven imo but we can start with looking at the individual columns captured inside the data warehouse and set up quality metrics accordingly building it up to the dataset level and then to the database level. 
1
Director in IT Servicesa year ago
There are multiple KPIs/metrics that you can define and collect data for correspondingly, to be able to look at the functioning and/or the success of a datawarehouse. Some of them might be easy to quantify, while the others are bit more difficult.

Some metrics that can be easy to quantify can be

Data Availability metrics : Such as system uptime, % of system availability
Performance metrics : Such as data latency, Query response time and concurrency
Cost metrics : such as storage costs, processing costs trending over time

Some metrics may be harder to quantify, such as Data quality (completeness, integrity) or Data governance (lineage, ownership)
lock icon

Please join or sign in to view more content.

By joining the Peer Community, you'll get:

  • Peer Discussions and Polls
  • One-Minute Insights
  • Connect with like-minded individuals
The Data Governance Coach in Miscellaneousa year ago
In my experience this has to be defined by the consumers of the data in the data warehouse/data center.  They need to articulate what outcomes they want to achieve from having the data warehouse and then you can create metrics to measure whether this is being achieved.  You can also ask the same people to define what makes that data good enough for them to use for those purposes and you can then measure and report on data quality in the data warehouse
1

Content you might like

Open AI (Game Changer: adoption w/ChatGPT)41%

Google (Game Changer: inventor of Transformers, Bard)19%

Microsoft (Game Changer: real time BingGPT+Search plus enterprise enablement)19%

Meta (Game Changer: LLM that can run on single GPU)6%

Amazon (Game Changer: TBD)4%

X.AI / Elon Musk (Game Changer: TBD)3%

Baidu (Chinese tech giant, with GPT version released in March)2%

Someone completely new6%

View Results
46.7k views49 Upvotes15 Comments
15 views
919 views2 Upvotes

Microsoft Power Bi80%

Tableau17%

Qlik Sense1%

View Results
1.5k views