mirror of
https://github.com/danny-avila/LibreChat.git
synced 2026-06-30 11:24:09 +00:00
a1bfa3b298
* 🎭 test: Run Mock E2E Suite Through createRun With In-Process Fake Model Replace the standalone HTTP mock LLM server with an in-process fake model injected into the real createRun -> Run.create pipeline via run.Graph.overrideTestModel, so the mock suite exercises the agents integration end-to-end without a live provider or a separate server. - Bump @librechat/agents to 3.2.2 for the FakeChatModel/createFakeStreamingLLM exports - Add an env-gated applyTestRunHook seam in packages/api createRun (no /api changes) - Add e2e/setup/fake-model.js to drive default replies + the skill-authoring tool-call flow - Drop the mock-llm webServer from playwright.config.mock.ts and set LIBRECHAT_TEST_RUN_HOOK * 🧹 test: Retire Standalone Mock LLM Server From E2E Recorder Migrate the `--profile=mock` recorder onto the same in-process fake model as the Playwright mock suite, then delete the now-unused HTTP mock server so the fake-LLM logic lives in a single place. - Point record.js mock profile at the fake model via LIBRECHAT_TEST_RUN_HOOK - Remove the mock-llm-server spawn/wait and MOCK_LLM_PORT plumbing from record.js - Delete e2e/setup/mock-llm-server.js (e2e/setup/fake-model.js is now the only source) - Update e2e/README.md to describe the in-process fake LLM * 🏷️ ci: Rename Playwright Mock E2E Check to Playwright E2E Tests
40 lines
1.8 KiB
Markdown
40 lines
1.8 KiB
Markdown
# LibreChat e2e
|
|
|
|
The mock e2e profile is the safest default for generated tests. It starts LibreChat with `e2e/config/librechat.e2e.yaml`, injects an in-process fake LLM (via `LIBRECHAT_TEST_RUN_HOOK`), creates an authenticated e2e user, and avoids real provider credentials.
|
|
|
|
## Recording Tests
|
|
|
|
Use Playwright codegen when you want to turn an exploratory browser session into a draft test:
|
|
|
|
```sh
|
|
npm run e2e:record
|
|
```
|
|
|
|
That command builds the app, starts the LibreChat test server (with an in-process fake LLM) when needed, writes `e2e/storageState.json`, and opens Playwright codegen at `/c/new`. The npm script uses `http://localhost:3333` so it does not collide with a normal dev server on `3080`. Raw recordings are written to `e2e/recordings/` and ignored by git.
|
|
|
|
For a real local LibreChat config instead of the mock profile:
|
|
|
|
```sh
|
|
npm run e2e:record:local
|
|
```
|
|
|
|
Useful direct options:
|
|
|
|
```sh
|
|
node e2e/setup/record.js --url=http://localhost:3080/c/new
|
|
node e2e/setup/record.js --profile=local --no-output
|
|
node e2e/setup/record.js --auth-only
|
|
node e2e/setup/record.js --output=e2e/recordings/settings-draft.spec.ts
|
|
```
|
|
|
|
## LLM-Assisted Loop
|
|
|
|
1. Start `npm run e2e:record`.
|
|
2. Let the LLM use Computer Use to operate the headed Playwright browser.
|
|
3. Stop codegen after the workflow is captured.
|
|
4. Move the useful parts from `e2e/recordings/` into a committed spec under `e2e/specs/mock/`.
|
|
5. Replace brittle generated selectors with role, label, text, or `data-testid` locators.
|
|
6. Add assertions that prove the behavior, not just the clicked path.
|
|
7. Run the finished spec with `npm run e2e:mock -- <spec name>`.
|
|
|
|
Generated recordings are a draft, not the final test. The committed version should use the shared helpers in `e2e/specs/mock/helpers.ts` where possible, wait on network or visible UI state instead of fixed sleeps, and keep test data deterministic.
|