Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • 1 FTE for updating test harness and overseeing QA automated test development

  • 12 months 1 FTE for adding missing regression tests (can be done by multiple developers)

    • Bounties or outsourcing?

  • 1.5 FTE for adding new regression tests for new features (2:1 ratio of developers to QA)

  • 0.2 25 FTE to maintain Proof’d or other automated test suite.

  • 0.2 FTE for release testing

  • 0.1 FTE for SDK release testing (does not include SDK unit test development)

...

Task

Description

KPIs

fio and fio.contracts new feature

Writing automated tests for new fio and fio.contracts features

Timely delivery of automated tests for new features. TBD on this process.

Backlog of fio and fio.contracts regression tests

Writing automated tests for backlog fio and fio.contracts features

Full test coverage for all FIO endpoints and actions

Devnet release testing

Work with devops to update Devnet test harness and manage all Devnet release testing

Timely Devnet testing

Testnet release testing

Manage all manual and automated Testnet release testing

Testnet testing completed within 2 hours of new releases

Mainnet release testing

Manage all manual and automated Mainnet release testing

Mainnet testing completed within 2 hours of new releases

Application testing

Maintain automated application harness (or write UI automated tests).

Timely reporting of new bugs.

Development and maintenance of automated tests.

CI Pipeline

Integrated fio.test and application testing into CI pipeline

Timely reporting of new bugs found by automated tests

SDK testing

Run SDK unit tests for every release

SDK tests run within 5 days of SDK releases or within 5 days of fio and fio.contract releases

Structure

Possible QA org structures

Centralized

  • 1 x QA Manager

    • Test harness architecture

    • Oversee test development

  • 2.5 FTE

    • fio.test new and backlog automated tests

    • Proof’d tests

  • 0.5 FTE release testing

Community / Bounty

  • 1 x QA Manager

    • Test harness architecture

    • Oversee test development

  • Create bounties for:

    • fio.test new and backlog automated tests

  • 0.5 FTE

    • release testing

    • Develop/Maintain Proof’d

Outsource

  • 1 x QA Manager

    • Test harness architecture

    • Oversee test development with outsource group

    • Release testing

  • Outsource

    • fio.test new and backlog automated tests

    • Develop/Maintain Proof’d test scripts