Google sheets dashboard and data
KPI Measures and Rating Scales
QA / Defect rate
Count of bug tickets created, count of bug tickets resolved
Kill: This is the same as the Defect escape rate
Bug report to mainnet release time
New: Average time from bug report to mainnet release
Measure:
For all bugs reported: sum of number days from report to mainnet / number of bugs
Rating:
Green: < 120
Yellow: 120 - 180
Red: > 180 days
Code coverage
Measure:
For each action and endpoint: number of parameters tested / number of parameters
Rating:
Green: > 80%
Yellow: 50% - 80%
Red: < 50%
Defect escape rate (counts how many critical bugs make it past testing into production)
Measure:
For each major release: count of new bugs and measure of severity
Rating:
Severity 1
Green: 0
Red: > 0
Severity 2
Green: < 3
Yellow: 3-5
Red: > 5
Releases
Testnet and mainnet release cycle duration
This KPI needs improvement so it provides meaningful information that is actionable.
Measure:
Performance
Readability/queryability of FIO state
Transactional performance of blocks
Security
Security coverage
Devops: Count of active security processes / total security processes (sorted by level)
Chain: Lines of code that have been audited / Total lines of code
Community Engagement
Discord developer community chat activity
Community developer commits