Mario Vitale
70b14c37c7
Daily E2E test fixes ( #29580 )
...
* [skip ci] Stabilize testcases, clean reporting for nighly unstables
* [skip ci] Better output naming
* [skip ci] Fix testcase failure fatal condition
* [skip ci] Make linter happy
* [skip ci] Revert global beforeEach change
* [skip ci] Fix workflow file, skip unstable tests
* [skip ci] Fix testcase_failure_fatal templating
2024-12-14 04:44:25 +08:00
Mario Vitale
7263ba4bc1
Enforce 0-failures for E2E tests ( #29521 )
2024-12-09 17:03:55 +01:00
Mario Vitale
9fee53fb14
E2E fix: use string for cypress/playwright selector ( #29020 )
2024-10-31 11:17:00 +08:00
dependabot[bot]
c61392db72
Bump the github-actions-updates group with 15 updates ( #28956 )
...
Bumps the github-actions-updates group with 15 updates:
| Package | From | To |
| --- | --- | --- |
| [actions/checkout](https://github.com/actions/checkout ) | `3` | `4` |
| [actions/setup-node](https://github.com/actions/setup-node ) | `4.0.2` | `4.1.0` |
| [actions/upload-artifact](https://github.com/actions/upload-artifact ) | `3` | `4` |
| [docker/login-action](https://github.com/docker/login-action ) | `3.0.0` | `3.3.0` |
| [docker/build-push-action](https://github.com/docker/build-push-action ) | `5.3.0` | `6.9.0` |
| [github/codeql-action](https://github.com/github/codeql-action ) | `2` | `3` |
| [actions/setup-go](https://github.com/actions/setup-go ) | `2` | `5` |
| [actions/download-artifact](https://github.com/actions/download-artifact ) | `3` | `4` |
| [tj-actions/changed-files](https://github.com/tj-actions/changed-files ) | `39.2.3` | `45.0.3` |
| [mikepenz/action-junit-report](https://github.com/mikepenz/action-junit-report ) | `3.7.7` | `4.3.1` |
| [ossf/scorecard-action](https://github.com/ossf/scorecard-action ) | `2.1.2` | `2.4.0` |
| [getsentry/action-release](https://github.com/getsentry/action-release ) | `1.3.0` | `1.7.0` |
| [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer ) | `3.1.2` | `3.7.0` |
| [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action ) | `3.1.0` | `3.7.1` |
| [actions/github-script](https://github.com/actions/github-script ) | `6.4.1` | `7.0.1` |
Updates `actions/checkout` from 3 to 4
- [Release notes](https://github.com/actions/checkout/releases )
- [Commits](https://github.com/actions/checkout/compare/v3...v4 )
Updates `actions/setup-node` from 4.0.2 to 4.1.0
- [Release notes](https://github.com/actions/setup-node/releases )
- [Commits](60edb5dd54...39370e3970https://github.com/actions/upload-artifact/releases )
- [Commits](https://github.com/actions/upload-artifact/compare/v3...v4 )
Updates `docker/login-action` from 3.0.0 to 3.3.0
- [Release notes](https://github.com/docker/login-action/releases )
- [Commits](https://github.com/docker/login-action/compare/v3...9780b0c442fbb1117ed29e0efdff1e18412f7567 )
Updates `docker/build-push-action` from 5.3.0 to 6.9.0
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](2cdde995de...4f58ea7922https://github.com/github/codeql-action/releases )
- [Commits](https://github.com/github/codeql-action/compare/v2...v3 )
Updates `actions/setup-go` from 2 to 5
- [Release notes](https://github.com/actions/setup-go/releases )
- [Commits](https://github.com/actions/setup-go/compare/v2...v5 )
Updates `actions/download-artifact` from 3 to 4
- [Release notes](https://github.com/actions/download-artifact/releases )
- [Commits](https://github.com/actions/download-artifact/compare/v3...v4 )
Updates `tj-actions/changed-files` from 39.2.3 to 45.0.3
- [Release notes](https://github.com/tj-actions/changed-files/releases )
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md )
- [Commits](95690f9ece...c3a1bb2c99https://github.com/mikepenz/action-junit-report/releases )
- [Commits](https://github.com/mikepenz/action-junit-report/compare/v3.7.7...db71d41eb79864e25ab0337e395c352e84523afe )
Updates `ossf/scorecard-action` from 2.1.2 to 2.4.0
- [Release notes](https://github.com/ossf/scorecard-action/releases )
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md )
- [Commits](e38b1902ae...62b2cac7edhttps://github.com/getsentry/action-release/releases )
- [Commits](85e0095193...e769183448https://github.com/sigstore/cosign-installer/releases )
- [Commits](11086d2504...dc72c7d5c4https://github.com/docker/setup-buildx-action/releases )
- [Commits](0d103c3126...c47758b77chttps://github.com/actions/github-script/releases )
- [Commits](d7906e4ad0...60a0d83039support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-25 12:07:17 +03:00
Mario Vitale
afbdfd9281
CLD-8147 Fix typo ( #28856 )
2024-10-19 09:46:03 +08:00
Mario Vitale
0a14eb3d45
E2E Tests: unify compose files, support Opensearch ( #28716 )
...
* Unify docker-compose files, support opensearch and redis
* Support cypress/playwright bools, MM_SERVICE_OVERRIDES input
* Remove unused directives from E2E tests
* [skip ci] Fix ES tests, PR messages
* [skip ci] Fix service pruning on server restart
* [skip ci] Make services overrides a CSV, better param descriptions
---------
Co-authored-by: Mattermost Build <build@mattermost.com >
2024-10-18 16:51:24 +02:00
Mario Vitale
429c41747c
CLD-8395 Integrate playwright into E2E tests ( #28492 )
...
* Finalize Playwright E2E scripts integration, add videos
* Add suggestion by Saturn
Co-authored-by: Saturnino Abril <5334504+saturninoabril@users.noreply.github.com >
---------
Co-authored-by: Mattermost Build <build@mattermost.com >
Co-authored-by: Saturnino Abril <5334504+saturninoabril@users.noreply.github.com >
2024-10-09 13:05:11 +02:00
Mario Vitale
948f8941f0
CLD-7841 Optimize E2E testing costs ( #27883 )
...
* Utilize free runners for E2E tests, report back to PR on run completion
* Increase test stability on smaller instances
* Merge worker reports
* merge start+prepare steps
* upgrade keycloak
* increase test timeouts
* Add video recording to report artifacts
Co-authored-by: Saturnino Abril <5334504+saturninoabril@users.noreply.github.com >
---------
Co-authored-by: Saturnino Abril <5334504+saturninoabril@users.noreply.github.com >
2024-08-14 21:39:08 +02:00
Mario Vitale
39ca104688
CLD-5783 Implement rolling upgrade tests ( #27842 )
...
* Make server.prepare idempotent, don't cleanup containers on server.start
* Implement rolling upgrade E2E tests
* Apply Akis' suggestions from code review
* Apply Saturn's suggestions from review
* Communicate RollingRelease on GHA and test automation results channel
* Implement E2E test case versioning for rolling release tests
---------
Co-authored-by: Mattermost Build <build@mattermost.com >
Co-authored-by: Akis Maziotis <akis.maziotis@mattermost.com >
2024-08-07 14:08:50 +02:00
Mario Vitale
88bbc9dcb8
Bump base image to Ubuntu 24 ( #27729 )
...
* Bump base image to Ubuntu 24
* Fix Noble dependencies
* Fix docker image build
---------
Co-authored-by: Mattermost Build <build@mattermost.com >
2024-07-25 14:23:37 +02:00
Mario Vitale
e05ec0efc3
Fix E2E test triggering ( #27669 )
...
Co-authored-by: Mattermost Build <build@mattermost.com >
2024-07-16 16:36:42 +02:00
Mario Vitale
731f056f54
Support release testing ( #27587 )
...
* Support release testing
* Merge resolve-ref and generate-test-variables jobs
2024-07-10 16:47:26 +02:00
Mario Vitale
3169f98982
Fix concurrency for daily tests ( #27480 )
2024-06-28 10:08:18 +02:00
Mario Vitale
4f68dbb96e
CLD-5704 Migrate daily master/cloud tests ( #27393 )
...
* [skip ci] Support Cloud/daily tests and Zephyr integration
* [skip ci] Fix workflow file
* [skip ci] Fix typo in workflow input name
* Fix cloud variable passing
* [skip ci] Fix typo
* Utilize master branch image for daily tests
* Apply Saturn's suggestion, fixes and improvements
2024-06-25 15:46:05 +02:00
Mario Vitale
4a77d9e964
CLD-7553 Implement per-MM_ENV runs, post the E2E test links back to user ( #27042 )
...
* Add per-env runs, post feedback back to user
2024-05-21 10:55:05 +02:00
Mario Vitale
1b69f2d79f
CLD-7473 Limit parallelism for full E2E tests ( #26741 )
...
* Limit parallelism for full E2E tests
* Add temporary changes for testing
* Better concurrency spec
* Do not consider github.ref for concurrency grouping
* Further improve the concurrency grouping
* Remove testing lines
2024-04-11 12:29:45 +08:00
Mario Vitale
dc36e42448
CLD-798 Add support for MM_ENV, various fixes ( #26616 )
...
* Add support for MM_ENV, various fixes
* Fix workflow template
* Fix reporting steps ordering
* Fix typo
* Improve state check message description
* Fix workflow syntax
* Fix fulltest variable generation
* Fix PR_NUMBER variable usage
* Fix BUILD_ID, add dashboard URL to status check
* Fix automation dashboard URL
---------
Co-authored-by: Mattermost Build <build@mattermost.com >
2024-04-03 12:14:19 +02:00
Mario Vitale
d7a77d8c42
CLD-7074 Implement full E2E tests on Github Actions ( #26093 )
...
* Move license setting from env var to mmctl upload
* Extract common E2E steps
* Add E2E fulltests
* Fix plugin_startup_fail_spec.js, timeout runners, fix local dashboard run
* Implement reporting script and job
* Bump artifact related actions
* Fix E2E variable generator script
* Skip reporting steps if not required
* Get rid of deprecation warnings
* Fix inbucket hostname parameter
* Support arbitrary refs in test template
* Fix cycle BRANCH var for non-PR commits
---------
Co-authored-by: Mattermost Build <build@mattermost.com >
2024-03-06 11:27:53 +01:00
