Google sheets dashboard and data

KPI Measures and Rating Scales

QA / Defect rate

...

Count of bug tickets created, count of bug tickets resolved

• Kill: This is the same as the Defect escape rate

...

Bug report to mainnet release time

• New: Average time from bug report to mainnet release

• Measure:

  • For all bugs reported: sum of number days from report to mainnet / number of bugs

• Rating:

  • Green: < 120

  • Yellow: 120 - 180

  • Red: > 180 days

...

Code coverage

• Measure:

  • For each action and endpoint: number of parameters tested / number of parameters

• Rating:

  • Green: > 80%

  • Yellow: 50% - 80%

  • Red: < 50%

KPI Spreadsheet: https://docs.google.com/spreadsheets/d/1n3-VemSyPLd_FsC80iJ3Ht6DmhSIpdrCOpxOfP0Ihh4/edit?usp=sharing

KPI Web Dashboard: https://bit.ly/fiodao49

Core Chain KPIs

Releases

• Measure:

  • For each major release: count of new bugs and measure of severity

• Rating:

  • Severity 1

    • Green: 0

    • Red: > 0

  • Severity 2

    • Green: < 3

    • Yellow: 3-5

    • Red: > 5

• This KPI needs improvement so it provides meaningful information that is actionable.

• Measure:

• Devops: Count of active security processes / total security processes (sorted by level)

• Chain: Lines of code that have been audited / Total lines of code

QA Test Coverage

Security Playbook

Chain Performance

Community Engagement