Merge pull request #1680 from mattermost/lfbrock-patch-1

Update release-process.md

doc/process/release-process.md

@@ -1,68 +1,81 @@
-We're working on making internal processes in the Mattermost core team more transparent for the community. Below is a working draft of our software development process, which will be updated live as we refine our process.
+# Mattermost Release Process
-
-Questions, feedback, comments always welcome, 
-
-----------
 
 Mattermost core team works on a monthly release process, with a new version shipping on the 16th of each month. 
 
 This document outlines the development process for the Mattermost core team, which draws from what we find works best for us from Agile, Scrum and Software Development Lifecycle approaches.
 
-This is a working document that will update as our process evolves.
+Notes: 
+- All cut-off dates are based on 10am PST (UTC-07/08) on the day stated. 
+- T-minus counts are measured in "working days" (weekdays other than major holidays concurrent in US and Canada) prior to release day.
 
+### (Code complete date of previous release) Beginning of release
+- Pre-work for the current release begins at the code complete date of the previous release. See "Code Complete" section below for details.
 
-### - Beginning of release
+### (T-minus 10 working days) Cut-off for major features
-- (Ops) Queue an agenda item for first team meeting of the release to review Roadmap
+- No pull requests for major features should be submitted to the current release after this date (except if release manager decides to add "release-exception" label)
-
+- (Ops) Post this checklist in Release channel 
-### - (10 weekdays before release date) Cut-off for major features
+- (PM) Write compatibility updates for config.json and database changes [See example](https://github.com/mattermost/platform/blob/master/CHANGELOG.md#compatibility)
-- No major features can be committed to the current release after this date
+- (PM) Confirm changes to config.json in compatibility section of Changelog are written back to [settings documentation](https://github.com/mattermost/platform/blob/master/doc/install/Configuration-Settings.md)
-- (Dev) Prioritize reviewing, updating, and merging of all pull requests that are going to make it into the release 
+- (Dev) Prioritize reviewing, updating, and merging of pull requests for current release until there are no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release 
-  - There should be no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release
 - (Leads) Meets to prioritize the final tickets of the release
   - Backlog is reviewed and major features that won’t make it are moved to next release
   - Triage tickets
-  - Review roadmap for next release
+  - Finalize roadmap for next release
-- (Marketing) Writes the "Highlights" section of the Changelog
+  - Draft roadmap for release after next (used to prioritize design tasks)
-- (PM) Write compatibility updates for config.json and database changes [See example](https://github.com/mattermost/platform/blob/master/CHANGELOG.md#compatibility)
+- (Marketing) Drafts marketing bullet points for next release based off of roadmap
+- (Marketing) Submits pull request for "Highlights" section of the Changelog
+- (Marketing) Notes date of announcements in release channel
 - (PM) Update [Upgrade Guide](https://github.com/mattermost/platform/blob/master/doc/install/Upgrade-Guide.md) for any steps needed to upgrade to new version
-- (PM) Prepare tickets for cutting RCs builds, filing issue in GitLab omnibus to take RC candidate, testing GitLab RC with Mattermost
+- (PM) Prepare tickets for [cutting RC builds](https://mattermost.atlassian.net/browse/PLT-985), [creating the final release candidate](https://mattermost.atlassian.net/browse/PLT-986), [creating AMIs](https://mattermost.atlassian.net/browse/PLT-1213), and [testing GitLab RC with Mattermost](https://mattermost.atlassian.net/browse/PLT-1013)
-- (Stand-up) Each team member discusses worst bug
+- (Stand-up) Each team member discusses worst bug (10-15s)
 
-### - (8 weekdays before release date) Feature Complete and Stabilization
+### (T-minus 8 working days) Feature Complete and Stabilization
-- After the cut-off time for Feature Complete, Dev prioritizes reviewing PRs and committing to master so Stabilization period can begin, with testing and high priority bug fixes
+- No pull requests for features can be submitted to the current release after this date (except if release manager add "release-exception" label to Jira ticket)
-- During Stabilization period only BUGS can be committed to master, non-bug tickets are tagged for next version and wait until after a release candidate is cut to be added to master
+- (Ops) Post this checklist in Release channel 
-  - (PM) Review all [S1 bugs](https://mattermost.atlassian.net/secure/IssueNavigator.jspa?mode=hide&requestId=10600) and mark important ones as high priority
+- (Dev) Prioritize reviewing, updating, and merging of pull requests for current release until there are no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release 
-  - (Dev + PM) Exceptions can be made by triage team consensus across PM and Dev. List of approved changes for release candidate 1 here: https://mattermost.atlassian.net/issues/?filter=10204
+- **Stablization** period begins when all features for release have been committed. 
-- (PM) Documentation 
+  - During this period, only **bugs** can be committed to master. Non-bug pull requests are tagged for next version and wait until after a release candidate is cut to be committed to master
+  - (RM) Exceptions can be made by release manager by setting priority to "Highest" and labelling "release-exception", which will add ticket to [Hotfix list for release candidate](https://mattermost.atlassian.net/issues/?filter=10204).
+  - (PM) Review all [Severity 1 bugs (data loss or security)](https://mattermost.atlassian.net/secure/IssueNavigator.jspa?mode=hide&requestId=10600) to consider for adding to Hotfix list. 
+- (PM) Complete documentation 
   - (PM) Make Changelog PR with updates for latest feature additions and changes
   - (PM) Make Changelog PR with updates to contributors
   - (PM) Make NOTICE.txt PR for any new libraries added from dev, if not added already 
   - (PM) Prioritize any developer documentation tickets
-- (PM and devs) Sign-off testing of their feature areas (i.e. PM/dev either signs-off that their area is well tested, or they flag that potential quality issues may exist)
+  - (PM) Draft [GitLab ticket](https://gitlab.com/gitlab-org/omnibus-gitlab/issues/942) to take next Mattermost version in the Omnibus, but do not post until RC1 is cut
-- (Ops) Mail out mugs to any new contributors
+- (PM) Check testing is complete 
-- (Team) Select "Top Contributor" for the release from external contributions to be mentioned in release announcement
+  - (PM) Works with Ops to check the [Quality Gate](https://github.com/mattermost/process/blob/master/release/quality-gates.md) for feature complete
-- (Marketing) Decides announce date (discuss in meeting)
+  - (PM + Dev) Sign-off testing of their feature areas (i.e. PM/dev either signs-off that their area is well tested, or they flag that potential quality issues may exist)
+- **(Team) Feature Complete Meeting (10:15am PST)**
+  - (PM) Leads review of Changelog
+  - (Team) Each team member discusses worst bug (10-15s) 
+  - (PM) Review feature list for next release
+  - (Marketing) Share draft of marketing announce for next release
+- (Marketing) Communicates checklist of items needed by specific dates to write the blog post announce (e.g. screenshots, GIFs, 
 - (Ops) Post Announce Date in Release channel + update the channel header to reflect date
-- (Marketing) Communicates checklist of items needed by specific dates to write the blog post announce (e.g. screenshots, GIFs, documentation) and begins to write the blog post, tweet, and email for the release announcement
+- (Ops) Mail out mugs to any new contributors
-- (PM) Works with Ops to check the Quality Gate for feature complete
-- (PM) Communicate to team the plan for next release
-- (Stand-up) Each team member discusses worst bug
 
-### - (5 weekdays before release date) Code Complete and Release Candidate Cut 
+### (T-minus 5 working days) Code Complete and Release Candidate Cut 
-- (Team) Meets to discuss release at 10am PST 
+- (Ops) Post this checklist in Release channel 
-  - (PM) Each area changed in latest release is assigned a PM owner to lead testing
+- (Ops) For the next release, create team meetings on Feature Complete and Code Complete dates
-  - (Ops) Walks through each item of the **Code Complete and Release Candidate Cut** checklist
+- (PM) Remove "Under Development" notice for current release from Changelog on master 
+- **(Team) Code Complete Meeting (10:15am PST meeting)** 
+  - (Ops) Walks through each item of this checklist
+  - (PM) Assigns each area of the release testing spreadsheet to a team member
   - (Dev) Last check of tickets that need to be merged before RC1
-  - (Team) Each team member discusses worst bug
+  - (Team) Each team member discusses worst bug (10-15s) 
-- After 10am PST meeting the release is considered “Code Complete”. 
+- **Code Complete** is declared after meeting
-  - (Dev) Completes final reviews and updates of PRs marked for the release version 
+  - (Dev) Prioritize reviewing, updating, and merging of pull requests for current release until there are no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release 
-    - There should be no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release
+  - (Build) Master is tagged and branched and “Release Candidate 1″ is cut (e.g. 1.1.0-RC1) according to the [Release Candidate Checklist](https://github.com/mattermost/process/blob/master/release/create-release-candidate.md)
-  - Master is tagged and branched and “Release Candidate 1″ is cut (e.g. 1.1.0-RC1) according to the Release Candidate Checklist
   - (PM) Create meta issue for regressions in GitHub (see [example](https://github.com/mattermost/platform/issues/574))
+  - (PM) Include link to meta-issue in release notes of RC1
+  - (PM) Tweet announcement that RC1 is ready (see [example](https://twitter.com/mattermosthq/status/664172166368264192))
+  - (PM) Submit GitLab ticket to take next Mattermost version in the Omnibus
   
-### - (4 weekdays before release date) Release Candidate Testing 
+### (T-minus 4 working days) Release Candidate Testing 
-- Final testing is conducted by the team on the acceptance server and any issues found are filed
+- (Team) Final testing is conducted by the team on the acceptance server and any issues found are filed
- - (Dev) Tests upgrade from previous version to current version, following the [Upgrade Guide](https://github.com/mattermost/platform/blob/master/doc/install/Upgrade-Guide.md) 
+- (Build) Tests upgrade from previous version to current version, following the [Upgrade Guide](https://github.com/mattermost/platform/blob/master/doc/install/Upgrade-Guide.md) 
+  - Database upgrade should be tested on both MySQL and Postgres
  - (Ops) Posts copy of the **Release Candidate Testing** checklist into Town Square in PRODUCTION 
     - (Ops) Moves meeting, test and community channels over to the production version of RC, and posts in Town Square asking everyone to move communication over to the new team for testing purposes
     - (PM) Test feature areas and post bugs to Bugs/Issues in PRODUCTION 
@@ -72,6 +85,7 @@ This is a working document that will update as our process evolves.
   - (PM) Posts links to all issues found in RC as comments on the meta issue
   - (PM) Updates description to include approved fixes
   - (PM) Posts screenshot and link to final tickets for next RC to the Release room
+  - (PM) Updates Release Notes with any new issues that will not be fixed for the current version
 - (PM & DEV leads) Triage hotfix candidates and decide on whether and when to cut next RC or final
 - (Dev) PRs for hotfixes made to release branch, and changes from release branch are merged into master
  - (Ops) Tests approved fixes on master
@@ -81,19 +95,28 @@ This is a working document that will update as our process evolves.
 - (Ops) verifies each of the issues in meta ticket is fixed
  - (PM) If no blocking issues are found, PM, Dev and Ops signs off on the release
 
-### - (2 weekdays before release date) Release
+### (T-minus 2 working days) Release Build Cut
- - (Dev) Tags a new release (e.g. 1.1.0) and runs an official build which should be essentially identical to the last RC
+- (Ops) Post this checklist in Release channel 
+- (Build) Tags a new release (e.g. 1.1.0) and runs an official build which should be essentially identical to the last RC
  - (PM) Any significant issues that were found and not fixed for the final release are noted in the release notes
-  - If an urgent and important issue needs to be addressed between major releases, a hotfix release (e.g. 1.1.1) may be released, however this should be very rare, given a monthly cadence
+   - If an urgent and important issue needs to be addressed between major releases, a bug fix release (e.g. 1.1.1) may be created
- - (PM) Copy and paste the Release Notes from the Changelog to the Release Description
+- (PM) Copy and paste the Release Notes from the Changelog to the Release Description
- - (PM) Update the mattermost.org/download page
+- (PM) Update the mattermost.org/download page
- - (Dev) Delete RCs after final version is shipped
+- (PM) Update the AMI links on mattermost.org/installation
- - (PM) Close final GitHub RC meta ticket
+- (PM) Close final GitHub RC meta ticket
+- (Dev) Delete RCs after final version is shipped
+- (Marketing) Finalize marketing
+  - (Marketing) Finalize mailchimp email blast
+  - (Marketing) Finalize blog post and put on timer for release
+  - (Marketing) Finalize tweet announcement
+  - (Marketing) Finalize announcement on general mailing list
+  - (Marketing) Finalize announcement for gitlab.mattermost.com
   
-### - (0 weekdays before release date) End of Release
+### (T-minus 0 working days) Release Day
-- (PM) Makes sure marketing has been posted (animated GIFs, screenshots, mail announcement, Tweets, blog posts) 
+- (Ops) Post this checklist in Release channel 
+- (PM) Confirm marketing has been posted (animated GIFs, screenshots, mail announcement, Tweets, blog posts) 
 - (PM) Close the release in Jira
+- (PM) Set header of next release as UNDER DEVELOPMENT in CHANGELOG on master
 - (Dev) Check if any libraries need to be updated for the next release, and if so bring up in weekly team meeting
-- (Ops) Post important dates for the next release in the header of the Release channel
+- (Ops) Post key dates for the next release in the header of the Release channel
-- (Ops) Queue an agenda item for next team meeting for "Stepping Back" Q&A
+- (Ops) Queue an agenda item for next team meeting for Release Process Kaizen/Q&A
-- (Ops) Queue an agenda item for next team meeting for Roadmap review