LibreChat/e2e/reporters
Danny Avila c6b7a5ac12
🎲 ci: Fail Playwright Runs When a Test Passes Only on a Retry (#18051)
Playwright reports a test that fails and then passes on a retry as "flaky" and exits 0, so a
regression that fails two attempts in three merges green. Set `failOnFlakyTests` in CI on the
mock profile (inherited by the Redis transport, registered-email and other derived profiles) and
on the base profile. Retry counts are unchanged: the later attempts still record the trace and
video and show whether a failure repeats.

A run failed this way still prints "N flaky" beside a passed count, so add a reporter that names
each retried pass in the job log and the job summary and says that it is what failed the run.
2026-11-11 10:31:06 -05:00
..
retried.mjs 🎲 ci: Fail Playwright Runs When a Test Passes Only on a Retry (#18051) 2026-11-11 10:31:06 -05:00
retried.test.mjs 🎲 ci: Fail Playwright Runs When a Test Passes Only on a Retry (#18051) 2026-11-11 10:31:06 -05:00