From 8abda5c1de7f6556f0dd4c23a856a339fcea8f3c Mon Sep 17 00:00:00 2001 From: Auto-quarantining bot <gitlab-auto-quarantine-bot@gitlab.com> Date: Mon, 10 Mar 2025 03:12:05 +0000 Subject: [PATCH] Quarantine a flaky test The `` API::Invitations EE Invitations POST /groups/:id/invitations with free user cap considerations when there are seats left and we add enough to exhaust all seats creates one member and errors on the other member `` test matches one of the following conditions: 1. has either ~"flakiness::1" or ~"flakiness::2" label set, which means the number of reported failures is at or above 95 percentile, indicating unusually high failure count. 2. has ~"severity::1" label set, which means the number of reported failures [spiked and exceeded its daily threshold](https://gitlab.com/gitlab-org/ruby/gems/gitlab_quality-test_tooling/-/blob/c9bc10536b1f8d2d4a03c3e0b6099a40fe67ad26/lib/gitlab_quality/test_tooling/report/concerns/issue_reports.rb#L51). This MR quarantines the test. This is a discussion starting point to let the responsible group know about the flakiness so that they can take action: - accept the merge request and schedule the associated issue to improve the test - close the merge request in favor of another merge request to delete the test Please follow the [Flaky tests management process](https://handbook.gitlab.com/handbook/engineering/infrastructure/engineering-productivity/flaky-tests-management-and-processes/#flaky-tests-management-process) to help us increase `master` stability. Please let us know your feedback in the [Engineering Productivity issue tracker](https://gitlab.com/gitlab-org/quality/engineering-productivity/team/-/issues). Related to https://gitlab.com/gitlab-org/gitlab/-/issues/448800. This change was generated by [gitlab-housekeeper](https://gitlab.com/gitlab-org/gitlab/-/tree/master/gems/gitlab-housekeeper) using the Keeps::QuarantineFlakyTests keep. To provide feedback on your experience with `gitlab-housekeeper` please create an issue with the label ~"GitLab Housekeeper" and consider pinging the author of this keep. Changelog: other --- ee/spec/requests/api/invitations_spec.rb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/ee/spec/requests/api/invitations_spec.rb b/ee/spec/requests/api/invitations_spec.rb index 36fe4a4c8f5f..e5a68c9900f6 100644 --- a/ee/spec/requests/api/invitations_spec.rb +++ b/ee/spec/requests/api/invitations_spec.rb @@ -410,7 +410,7 @@ stub_ee_application_setting(dashboard_limit: 1) end - it 'creates one member and errors on the other member' do + it 'creates one member and errors on the other member', quarantine: 'https://gitlab.com/gitlab-org/gitlab/-/issues/448800' do expect do stranger = create(:user) stranger2 = create(:user) -- GitLab