...
1 FTE for updating test harness and overseeing QA automated test development
12 months 1 FTE for adding missing regression tests (can be done by multiple developers)
Bounties or outsourcing?
1.5 FTE for adding new regression tests for new features (2:1 ratio of developers to QA)
0.2 25 FTE to maintain Proof’d or other automated test suite.
0.2 FTE for release testing
0.1 FTE for SDK release testing (does not include SDK unit test development)
...
Task | Description | KPIs |
---|---|---|
fio and fio.contracts new feature | Writing automated tests for new fio and fio.contracts features | Timely delivery of automated tests for new features. TBD on this process. |
Backlog of fio and fio.contracts regression tests | Writing automated tests for backlog fio and fio.contracts features | Full test coverage for all FIO endpoints and actions |
Devnet release testing | Work with devops to update Devnet test harness and manage all Devnet release testing | Timely Devnet testing |
Testnet release testing | Manage all manual and automated Testnet release testing | Testnet testing completed within 2 hours of new releases |
Mainnet release testing | Manage all manual and automated Mainnet release testing | Mainnet testing completed within 2 hours of new releases |
Application testing | Maintain automated application harness (or write UI automated tests). | Timely reporting of new bugs. Development and maintenance of automated tests. |
CI Pipeline | Integrated fio.test and application testing into CI pipeline Timely reporting of new bugs found by automated tests | |
SDK testing | Run SDK unit tests for every release | SDK tests run within 5 days of SDK releases or within 5 days of fio and fio.contract releases |
Structure
Possible QA org structures
Centralized
1 x QA Manager
Test harness architecture
Oversee test development
2.5 FTE
fio.test new and backlog automated tests
Proof’d tests
0.5 FTE release testing
Community / Bounty
1 x QA Manager
Test harness architecture
Oversee test development
Create bounties for:
fio.test new and backlog automated tests
0.5 FTE
release testing
Develop/Maintain Proof’d
Outsource
1 x QA Manager
Test harness architecture
Oversee test development with outsource group
Release testing
Outsource
fio.test new and backlog automated tests
Develop/Maintain Proof’d test scripts