1) [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot Error: expect(locator).toHaveScreenshot(expected) 184 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 184 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 184 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

1) [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 184 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 184 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 184 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

1) [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 184 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 184 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 184 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

Process completed with exit code 1.

1) [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot Error: expect(locator).toHaveScreenshot(expected) 951 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 951 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 951 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", { tag: "@screenshot" }, async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

1) [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 951 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry1/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry1/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 951 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 951 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", { tag: "@screenshot" }, async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

1) [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 951 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry2/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry2/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 951 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 951 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", { tag: "@screenshot" }, async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

2) [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot Error: expect(locator).toHaveScreenshot(expected) 139 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 139 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 139 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", { tag: "@screenshot" }, async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

2) [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 139 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry1/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry1/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 139 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 139 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", { tag: "@screenshot" }, async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

2) [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 139 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry2/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry2/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 139 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 139 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", { tag: "@screenshot" }, async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

3) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot Error: expect(locator).toHaveScreenshot(expected) 796 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 796 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 796 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test( at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

3) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 796 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry1/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry1/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 796 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 796 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test( at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

3) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 796 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry2/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry2/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 796 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 796 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test( at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

4) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown @screenshot Error: expect(page).toHaveScreenshot(expected) 541 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/window-12px-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-Chrome/window-12px-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-Chrome/window-12px-diff.png Call log: - expect.toHaveScreenshot(window-12px.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 541 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 541 pixels (ratio 0.01 of all image pixels) are different. 40 | await fontDropdown.getByLabel("Font size").selectOption({ value: "-4" }); 41 | > 42 | await expect(page).toMatchScreenshot("window-12px.png", { includeDialogBackground: true }); | ^ 43 | }, 44 | ); 45 | at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:42:32

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Test timeout of 90000ms exceeded.

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Error: page.waitForRequest: Test timeout of 90000ms exceeded. 21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 23 | const tokenApiPromise = page.waitForRequest( | ^ 24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 25 | ); 26 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 90000ms exceeded.

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForRequest: Test timeout of 90000ms exceeded. 21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 23 | const tokenApiPromise = page.waitForRequest( | ^ 24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 25 | ); 26 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 90000ms exceeded. Call log: - waiting for getByRole('button', { name: 'Continue' }) 26 | 27 | await page.goto("/#/login"); > 28 | await page.getByRole("button", { name: "Continue" }).click(); | ^ 29 | await registerAccountMas(page, mailhog.api, "alice", "[email protected]", "Pa$sW0rD!"); 30 | 31 | // Eventually, we should end up at the home screen. at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:28:62

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Process completed with exit code 1.

[Chrome] › timeline/timeline.spec.ts took 2.8m

[Chrome] › threads/threads.spec.ts took 45.8s

[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 34.8s

[Chrome] › widgets/widget-pip-close.spec.ts took 22.9s

[Chrome] › widgets/stickers.spec.ts took 21.6s

[Chrome] › spotlight/spotlight.spec.ts took 2.3m

[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m

[Chrome] › spaces/spaces.spec.ts took 1.1m

[Chrome] › sliding-sync/sliding-sync.spec.ts took 24.5s

[Chrome] › share-dialog/share-dialog.spec.ts took 22.2s

[Chrome] › crypto/event-shields.spec.ts took 1.4m

[Chrome] › knock/knock-into-room.spec.ts took 39.6s

[Chrome] › integration-manager/kick.spec.ts took 39.3s

[Chrome] › editing/editing.spec.ts took 32.3s

[Chrome] › knock/manage-knocks.spec.ts took 30.1s

[Chrome] › composer/RTE.spec.ts took 1.3m

[Chrome] › audio-player/audio-player.spec.ts took 1.3m

[Chrome] › crypto/crypto.spec.ts took 1.0m

[Chrome] › crypto/decryption-failure-messages.spec.ts took 54.1s

[Chrome] › crypto/device-verification.spec.ts took 45.5s

[Chrome] › right-panel/file-panel.spec.ts took 39.7s

[Chrome] › polls/polls.spec.ts took 35.5s

[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 32.9s

[Chrome] › room/room-header.spec.ts took 28.1s

[Chrome] › register/register.spec.ts took 22.9s

[Chrome] › messages/messages.spec.ts took 2.3m

[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.8m

[Chrome] › login/login.spec.ts took 1.1m

[Chrome] › login/soft_logout.spec.ts took 25.6s

[Chrome] › oidc/oidc-aware.spec.ts took 20.9s

2 skipped 45 passed (6.3m)

1 failed [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot 10 skipped 43 passed (7.2m)

48 passed (7.4m)

54 passed (7.7m)

4 failed [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown @screenshot 1 flaky [Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot 1 skipped 46 passed (8.4m)