Skip to content

Rete QA Regression

Rete QA Regression #17

Manually triggered September 14, 2023 10:15
Status Success
Total duration 13m 32s
Artifacts 1

regression.yml

on: workflow_dispatch
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 1 notice
[firefox] › customization.spec.js:11:16 › customization: snapshot: dist/tests/customization.spec.js#L13
1) [firefox] › customization.spec.js:11:16 › customization: snapshot ───────────────────────────── Error: Screenshot comparison failed: 1698 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/customization.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/customization-customization-snapshot-firefox/customization-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/customization-customization-snapshot-firefox/customization-diff.png 11 | (0, test_1.test)('customization: snapshot', async ({ page }) => { 12 | await page.waitForTimeout(500); > 13 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('customization.png'); | ^ 14 | }); 15 | at /home/runner/work/rete-qa/rete-qa/dist/tests/customization.spec.js:13:49
[firefox] › customization.spec.js:11:16 › customization: snapshot: dist/tests/customization.spec.js#L13
1) [firefox] › customization.spec.js:11:16 › customization: snapshot ───────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1698 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/customization.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/customization-customization-snapshot-firefox-retry1/customization-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/customization-customization-snapshot-firefox-retry1/customization-diff.png 11 | (0, test_1.test)('customization: snapshot', async ({ page }) => { 12 | await page.waitForTimeout(500); > 13 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('customization.png'); | ^ 14 | }); 15 | at /home/runner/work/rete-qa/rete-qa/dist/tests/customization.spec.js:13:49
[firefox] › customization.spec.js:11:16 › customization: snapshot: dist/tests/customization.spec.js#L13
1) [firefox] › customization.spec.js:11:16 › customization: snapshot ───────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1698 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/customization.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/customization-customization-snapshot-firefox-retry2/customization-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/customization-customization-snapshot-firefox-retry2/customization-diff.png 11 | (0, test_1.test)('customization: snapshot', async ({ page }) => { 12 | await page.waitForTimeout(500); > 13 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('customization.png'); | ^ 14 | }); 15 | at /home/runner/work/rete-qa/rete-qa/dist/tests/customization.spec.js:13:49
[firefox] › index.spec.js:15:16 › select node: dist/tests/index.spec.js#L23
2) [firefox] › index.spec.js:15:16 › select node ───────────────────────────────────────────────── Error: Screenshot comparison failed: 1210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/selected.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-select-node-firefox/selected-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-select-node-firefox/selected-diff.png 21 | const selectedBg = await (0, helper_1.getBackgroundColor)(addNode); 22 | (0, test_1.expect)(tinycolor2_1.default.readability(selectedBg, 'yellow') < 3).toBeTruthy(); > 23 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('selected.png'); | ^ 24 | }); 25 | (0, test_1.test)('change input values', async ({ page }) => { 26 | const { findNodes } = await (0, helper_1.getGraphView)(getContainer()); at /home/runner/work/rete-qa/rete-qa/dist/tests/index.spec.js:23:49
[firefox] › index.spec.js:15:16 › select node: dist/tests/index.spec.js#L23
2) [firefox] › index.spec.js:15:16 › select node ───────────────────────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/selected.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-select-node-firefox-retry1/selected-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-select-node-firefox-retry1/selected-diff.png 21 | const selectedBg = await (0, helper_1.getBackgroundColor)(addNode); 22 | (0, test_1.expect)(tinycolor2_1.default.readability(selectedBg, 'yellow') < 3).toBeTruthy(); > 23 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('selected.png'); | ^ 24 | }); 25 | (0, test_1.test)('change input values', async ({ page }) => { 26 | const { findNodes } = await (0, helper_1.getGraphView)(getContainer()); at /home/runner/work/rete-qa/rete-qa/dist/tests/index.spec.js:23:49
[firefox] › index.spec.js:15:16 › select node: dist/tests/index.spec.js#L23
2) [firefox] › index.spec.js:15:16 › select node ───────────────────────────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/selected.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-select-node-firefox-retry2/selected-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-select-node-firefox-retry2/selected-diff.png 21 | const selectedBg = await (0, helper_1.getBackgroundColor)(addNode); 22 | (0, test_1.expect)(tinycolor2_1.default.readability(selectedBg, 'yellow') < 3).toBeTruthy(); > 23 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('selected.png'); | ^ 24 | }); 25 | (0, test_1.test)('change input values', async ({ page }) => { 26 | const { findNodes } = await (0, helper_1.getGraphView)(getContainer()); at /home/runner/work/rete-qa/rete-qa/dist/tests/index.spec.js:23:49
[firefox] › index.spec.js:33:16 › translate: dist/tests/index.spec.js#L41
3) [firefox] › index.spec.js:33:16 › translate ─────────────────────────────────────────────────── Error: Screenshot comparison failed: 1210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/translate.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-translate-firefox/translate-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-translate-firefox/translate-diff.png 39 | (0, test_1.expect)(after.x - before.x).toBeCloseTo(translateX, 1); 40 | (0, test_1.expect)(after.y - before.y).toBeCloseTo(translateY, 1); > 41 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('translate.png'); | ^ 42 | }); 43 | (0, test_1.test)('disconnect', async ({ page }) => { 44 | const { connections, findNodes } = await (0, helper_1.getGraphView)(getContainer()); at /home/runner/work/rete-qa/rete-qa/dist/tests/index.spec.js:41:49
[firefox] › index.spec.js:33:16 › translate: dist/tests/index.spec.js#L41
3) [firefox] › index.spec.js:33:16 › translate ─────────────────────────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/translate.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-translate-firefox-retry1/translate-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-translate-firefox-retry1/translate-diff.png 39 | (0, test_1.expect)(after.x - before.x).toBeCloseTo(translateX, 1); 40 | (0, test_1.expect)(after.y - before.y).toBeCloseTo(translateY, 1); > 41 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('translate.png'); | ^ 42 | }); 43 | (0, test_1.test)('disconnect', async ({ page }) => { 44 | const { connections, findNodes } = await (0, helper_1.getGraphView)(getContainer()); at /home/runner/work/rete-qa/rete-qa/dist/tests/index.spec.js:41:49
[firefox] › index.spec.js:33:16 › translate: dist/tests/index.spec.js#L41
3) [firefox] › index.spec.js:33:16 › translate ─────────────────────────────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 1210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/translate.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-translate-firefox-retry2/translate-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-translate-firefox-retry2/translate-diff.png 39 | (0, test_1.expect)(after.x - before.x).toBeCloseTo(translateX, 1); 40 | (0, test_1.expect)(after.y - before.y).toBeCloseTo(translateY, 1); > 41 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('translate.png'); | ^ 42 | }); 43 | (0, test_1.test)('disconnect', async ({ page }) => { 44 | const { connections, findNodes } = await (0, helper_1.getGraphView)(getContainer()); at /home/runner/work/rete-qa/rete-qa/dist/tests/index.spec.js:41:49
[firefox] › index.spec.js:43:16 › disconnect: dist/tests/index.spec.js#L57
4) [firefox] › index.spec.js:43:16 › disconnect ────────────────────────────────────────────────── Error: Screenshot comparison failed: 1210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/rete-qa/rete-qa/snapshots/react16/firefox/disconnecting.png Received: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-disconnect-firefox/disconnecting-actual.png Diff: /home/runner/work/rete-qa/rete-qa/test-results/react16/index-disconnect-firefox/disconnecting-diff.png 55 | await page.mouse.down(); 56 | await page.mouse.move(socketCenter.x - 50, socketCenter.y - 30); > 57 | (0, test_1.expect)(await page.screenshot()).toMatchSnapshot('disconnecting.png'); | ^ 58 | await page.mouse.up(); 59 | await page.waitForTimeout(500); 60 | (0, test_1.expect)(await connections()).toHaveLength(1); at /home/runner/work/rete-qa/rete-qa/dist/tests/index.spec.js:57:49
🎭 Playwright Run Summary
24 failed [firefox] › customization.spec.js:11:16 › customization: snapshot ────────────────────────────── [firefox] › index.spec.js:15:16 › select node ────────────────────────────────────────────────── [firefox] › index.spec.js:33:16 › translate ──────────────────────────────────────────────────── [firefox] › index.spec.js:43:16 › disconnect ─────────────────────────────────────────────────── [firefox] › index.spec.js:63:16 › disconnect with clicks ─────────────────────────────────────── [firefox] › index.spec.js:86:16 › snapshot: initial ──────────────────────────────────────────── [firefox] › minimap.spec.js:18:20 › Minimap › translate node ─────────────────────────────────── [firefox] › minimap.spec.js:27:20 › Minimap › translate area ─────────────────────────────────── [firefox] › minimap.spec.js:50:20 › Minimap › double click viewport ──────────────────────────── [firefox] › perf.spec.js:16:20 › Perf › snapshot ─────────────────────────────────────────────── [firefox] › reroute.spec.js:16:20 › Reroute › add pin ────────────────────────────────────────── [firefox] › reroute.spec.js:23:20 › Reroute › add pin and translate node ─────────────────────── [firefox] › reroute.spec.js:31:20 › Reroute › remove pin ─────────────────────────────────────── [webkit] › customization.spec.js:11:16 › customization: snapshot ─────────────────────────────── [webkit] › index.spec.js:15:16 › select node ─────────────────────────────────────────────────── [webkit] › index.spec.js:33:16 › translate ───────────────────────────────────────────────────── [webkit] › index.spec.js:43:16 › disconnect ──────────────────────────────────────────────────── [webkit] › index.spec.js:63:16 › disconnect with clicks ──────────────────────────────────────── [webkit] › index.spec.js:86:16 › snapshot: initial ───────────────────────────────────────────── [webkit] › minimap.spec.js:18:20 › Minimap › translate node ──────────────────────────────────── [webkit] › minimap.spec.js:50:20 › Minimap › double click viewport ───────────────────────────── [webkit] › reroute.spec.js:16:20 › Reroute › add pin ─────────────────────────────────────────── [webkit] › reroute.spec.js:23:20 › Reroute › add pin and translate node ──────────────────────── [webkit] › reroute.spec.js:31:20 › Reroute › remove pin ──────────────────────────────────────── 6 skipped 39 passed (8.0m)

Artifacts

Produced during runtime
Name Size
test-results Expired
23.3 MB