[2.7.1] Release Management Checklist
Document Description –
This document is intended to assist release managers in tracking the progress of required work items for a given release. Lead developers can use this checklist to understand how they might assist the release manager in achieving a release of the FIO protocol.
Please refer to the field descriptions below the checklist for more information on each item.
Task | Check Status | Notes | Deliverables |
---|---|---|---|
Security | Excluded Included |
|
|
Code audit | Excluded In Progress Completed |
|
|
Vulnerability testing | Excluded In Progress Completed |
|
|
Bug bounty | Excluded In Progress Completed |
|
|
SDK Release | Excluded Included |
|
|
SDK Review | Excluded In Progress Completed |
|
|
Kolin tests | Excluded In Progress Completed |
|
|
Typescript tests | Excluded In Progress Completed |
|
|
Devnet | Excluded In Progress Completed |
|
|
Contract rollout commands | In Progress Completed |
|
|
contract testing | In Progress Completed |
|
|
fork testing | Excluded In Progress Completed |
|
|
performance testing | Excluded In Progress Completed |
|
|
QA tests | Excluded In Progress Completed |
|
|
Testnet | In Progress Completed |
|
|
fiosdk_typescript repo | Create release/n.n.x branch (where n=contract release number) | NA - no changes to sdk |
|
fio.test repo | Create release/n.n.x_m.m.x branch (where n=contract release number and m=chain release number) Confirm that the package.json references the new kiosk_typescript branch | N/A - no changes. Will use existing release/2.7.x_3.3.x branch |
|
fio.devtools repo | Create release/n.n.x_m.m.x branch (where n=contract release number and m=chain release number) | N/A - no changes. Will use existing release/2.7.x_3.3.x branch |
|
fio.contracts repo | Create release/n.n.x branch (where n=contract release number) Create pre-release (Testnet Release Candidate - FIO Contracts vx.x.x-rc1) Update release notes Create PR for hashes on fio.mainnet > releases-testnet.md |
| |
fio repo | Create release/m.m.x branch (where m=chain release number) Create pre-release (Testnet Release Candidate - FIO vx.x.x-rc1) Update release notes Replay test by BP Track chain upgrade of BPs | NA - no changes to fio |
|
addaction and createfee | BP to create msig to set addaction and createfee for new actions Encourage BPs to vote on new endpoint fee Example:
| NA - no new actions |
|
Contract msigs | BP to create msigs for updated and new contracts Review msigs BP to post msigs to Testnet |
| |
Communication | Socialize changes with all BPs on Testnet and the community and marketing Monitor and coordinate the rollout with BPs |
| |
SDK and Wallet Testing | Typescript Wallet: Build Edge Demo Testnet build and go through Wallet checklist Kotlin Wallet: Can we get a regular build of a Testnet wallet? Mycelium? | TBD: need to create Edge wallet test checklist |
|
SDK Release | Confirm develop branch has all updates for new release Create “vn.n.n-rc1” tag | NA - No changes to sdk |
|
Testnet validation | Run fio.test Testnet smoketest, confirm FIO Request getters still work Confirm hashes of testnet Confirm ABIs deployed correctly (using ./clio get abi) Confirm createfee added fees with correct endpoint and type Confirm addaction added correct actions with correct contracts |
| |
Mainnet |
|
|
|
Mainnet prep | Create upgrade checklist of BPs and integration partners Work with Brit to coordinate Mainnet rollout plan with the BP, wallet, and exchange community, watch over the execution and help to ensure rollout is completed in full. Socialize release changes with all BPs and the community and marketing |
|
|
fio.test repo | Merge release/n.n.x_m.m.x branch to master, create vn.n.n_m.m.m tag Run test tag against new release |
|
|
fio.devtools repo | Merge release/n.n.x_m.m.x branch to master, create vn.n.n_m.m.m tag Update base contracts to current mainnet contracts Update readme to show new version changes on fio Merge to master and cut a new tag/release |
|
|
fio.contract repo | Merge release/n.n.x branch to master, create vn.n.n tag Move pre-release to release (Release - FIO Contracts vx.x.x) Create PR for hashes on fio.mainnet Encourage BPs to vote on new endpoint fee msig fio.contracts release Perform the rollout verification and report findings Post msig links to main FIO Telegram channel so member can track progress |
|
|
addaction and createfee msigs | msig to set addaction and createfee for new actions Encourage BPs to vote on new endpoint fee Example:
|
|
|
Contract msigs | BP to create msigs for updated and new contracts Review msigs BP to post msigs to Mainnet |
|
|
fio repo | Merge release/m.m.x branch to master, create vm.m.m tag Move pre-release to release (Release - FIO vx.x.x) Generate .deb and .tgz build files using fio.package Upload .deb and .tgz build files to AWS > S3 > fioprotocol > Mainnet for use with fio-docker BP mainnet node upgrade checklist is complete (BP spreadsheet, or create one in Jira) Perform the rollout verification and report findings Confirm BP upgrade: https://health.fioprotocol.io |
|
|
Mainnet validation | Confirm hashes of mainnet Confirm versions of mainnet nodes (chain) Confirm ABIs deployed correctly (using ./clio get abi) Confirm createfee added fees with correct endpoint and type Confirm addaction added correct actions with correct contracts |
|
|
General | Move FIP status to Final and include release links; update master README index Update Initiative and Epic status |
|
|
FIO API Nodes | Upgrade Registration site API nodes (2 load balanced nodes) Upgrade Analytics API node (single State History node) |
|
|
SDK and Wallet Testing | Run Typescript SDK regression tests against latest build, confirm new actions and getters are included in the tests Run Kotlin SDK regression tests against latest build, confirm new actions and getters are included in the tests Run GO SDK regression tests against latest build, confirm new actions and getters are included in the tests |
|
|
Post-deployment |
|
|
|
Post release | Encourage BPs to vote on new endpoint fee |
|
|
Mainnet validation - fio chain | Confirm versions of mainnet nodes (chain) Create tracking spreadsheet Confirm BP upgrade: https://health.fioprotocol.io |
|
|
General | Move FIP status to Final and include release links; update master README index Update Initiative and Epic status |
|
|
Partner upgrades | Create upgrade blog post and send to Account Management team to manage upgrades Work with Account Management to coordinate Mainnet rollout plan with the BP, wallet, and exchange community, watch over the execution and help to ensure rollout is completed in full. |
|
|
Update FIO Hosted API Nodes | Upgrade Registration site API nodes (2 load balanced nodes) Upgrade Analytics API node (single State History node) |
|
|
SDK |
|
|
|
Typescript SDK Release | Create fiosdk_typescript release candidate tag from develop QA: Test SDK release tag version against latest production releases (master branches) of fio, fio.contracts, fio.devtools, fio.test (If updates to test are needed, confirm fixes are put into the fio.test release/vn.n.n release branch and the develop branch (i.e., merge fixes from release branch)) Merge develop to master and create production release tag from master Typescript: Publish new SDK release on NPM QA: Test published SDK release tag version against latest production releases (master branches) of fio, fio.contracts, fio.devtools, fio.test |
|
|
Process Description --
Each item that is to be addressed in the checklist should have a story associate with it under the release epic in jira. also there should be a release section of the wiki which contains all of the artifacts generated for a given release, and under this wiki should also be contained all the details of the release planning and execution for future reference of the community.
Checklist Field Descriptions –
Security –
Background – The security of the FIO protocol against DDOS and man in the middle attacks is one of the primary security objectives of the prorftol. The FIO protocol also concerns itself with the many ways that users might attempt to game the provided interfaces in order to gain FIO or to impede the experience of other users.
Objective – The objective of the Security section is to guide the lead developer of each project within a release to perform any of the necessary security testing for a given project. If changes are simple in nature this section may be excluded.
Recommended tactics – Core team members, and other FIO community members may be enlisted to perform security reviews of the changes being proposed by a project. 3rd party security audits are also welcomed on all projects delivering into the FIO protocol. Please contact the release manager if you desire recommendations for 3rd party reviewers. When time and resources permit, there may also be consideration of placing the changes into either a private test instance of the FIO protocol (private test network), or placing the changes onto test net for an extended period of vetting by the community.
Deliverables – Findings for security audit, bounties, and vulnerability tests are sensitive materials and may be published to the public after careful consideration of the consequences of publishing this material. Once vulnerabilities have been adequately addressed all findings and remediations should be posted to the wiki for the project in question. provide a set of links to completed items, or provide a point of contact for your project if items are in work.
Code Audit – A security focused audit of contract modifications should be strongly considered for any new actions, or any modifications to actions that involve changes in authorizations, or error logic. Code audits can be performed by core team members, or they can be performed by third parties specializing in EOSIO security issues.
Vulnerability Testing – The project may benefit from security focused stress testing. This testing may be performed by core team members, or by contracted parties hired for the project. The testing might take an EOSIO specific focus, with the addition of penetration, fuzz, gaming the system, and other vulnerability testing is strongly advised.
Bug Bounty – Your project may benefit from placing a bounty on the contract modifications. Your project should consider offering a reward if any community member is able to discover security flaws, or vulnerabilities in new features. These bounties may be long lived, and they may require the use of private test instances of the fio test net to provide hackers ample opportunity to “break the chain”.
SDK Release –
Background – Changes to Kotlin, javascript, and Golang SDKs may be necessary for each release of the FIO protocol. SDK changes should go through a QA process. The release manager must integrate the SDK changes required for a release, then perform acceptance tests on these changes.
Objective – The objective is to provide integrators with the new features and functions which they will integrate. The release manager ensures that the necessary SDK changes have been rolled up, and that unit testing is successful on the resulting SDK release
Deliverables – The release manager will post testing results on the wiki for each SDK release to provide an audit trail demonstrating the acceptance testing performed on an SDK release.
Kotlin Tests – The release manager will run the unit tests on the release image of the Kotlin SDK and will post results to the wiki.
Typescript Tests – The release manager will run the unit tests on the release image of the typescript SDK and will post results on the wiki
Devnet testing
Background – In order for a release of the FIO protocol to be rolled out on test net and main net, the release manager must first assemble the set of commands that will upgrade the current main net version to become the new release. The commands may include adding actions to FIOs list of allowed contract actions, adding/modifying the fees associated with FIO actions, creating new FIO system accounts and contracts, and updating all of the required FIO contracts with the changes for the new release. The release manager must assemble a complete list of the required commands, and execute them on a private test network, then perform validations of the resulting release. The commands, and test results must be posted on the wiki for this release.
Objective – The objective of dev net testing is to assemble the list of commands required to upgrade FIO for this release, and to complete acceptance testing of a local private FIO network upgraded using these commands.
Tactics – on dev net, build the release version of the FIO Core code and the FIO contracts, copy these off to the side. Then build the dev net using the Main net versions of the contracts and core, and spin up the dev net. Perform all of the necessary clio commands to upgrade the contracts. once this is completed run a regression test to ensure all chain operations function as expected. if there are significant changes to the FIO Core code which result in special logic and timing regarding the core and contracts rollout (this is called a forking change), then special test plans must be made and executed in accordance with the needs of the releases unique needs. If no forking logic is being released then acceptance and QA tests and some performance tests will be performed and published onto the wiki
Deliverables – The release manager will post on the wiki the commands for this release, and they will also post on the wiki the test results for the tests performed.
Contract rollout commands – The release commands for each project included in the release should be a part of the rollout plan for each project included in the release, assemble the commands for the release into one list of commands, and fill any missing gaps by cooperating with the necessary leads if commands have not yet been provided. the following actions are commonly required --
Add action – add an action to the permitted list of actions in the FIO protocol
Add Fee – add a new fee for a new action in the FIO protocol.
Add new system account – When new contracts are added to FIO an owning account must be created.
Set system account authorizations – set permissions and authorizations on new system accounts
Set privileged.
update authorizations
Set Contract – set a new contract on the FIO protocol, or update an existing contract.
Set ABI – set a new ABI on the FIO protocol, or update an existing ABI.
See also
Contract testing – After contracts have been upgraded, acceptance testing must be completed, and findings must be published to the wiki.
Fork testing – If there are changes to the protocol which require backwards compatibility considerations then forking tests must be performed, these test require code changes to be made before the fork testing to ensure that the forking logic works equivalently in the dev net environment. Results and findings must be published to the wiki upon completion.
Performance testing – Some projects have dev net level performance test considerations, when a release includes the need for performance testing then tests must be run and findings published to the wiki for the release.
QA testing – QA regression tests should be completed on each release before dev net testing, but full regression on dev net only increases our confidence in a release. findings should be published to the wiki.
NOTE – other descriptions may be added if this is seen as helpful for the document