[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

Browse Source

* [test-runner] Fix failed tests, generate android specific expectations

* [test-runner] Check render test runner testing result

* [test-runner] Add error case to android ignore list

*  [test-runner] Update metrics

* [test-runner] Move Android render tests with big diff(>0.006) to ignore list

...

This commit is contained in:

zmiao

2019-12-04 18:10:58 +02:00

committed by GitHub

parent 1e2cd1e086

commit e619552a5d

31 changed files with 357 additions and 31 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

render-test/expected/android/render-tests/combinations/symbol-translucent--fill-translucent/expected.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 429 B

BIN

render-test/expected/android/render-tests/regressions/mapbox-gl-js#2305/expected.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 51 KiB

BIN

render-test/expected/android/render-tests/regressions/mapbox-gl-js#5978/expected.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 731 B

BIN

render-test/expected/android/render-tests/sprites/1x-screen-1x-pattern/expected.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 1.6 KiB

BIN

render-test/expected/android/render-tests/sprites/1x-screen-2x-pattern/expected.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 1.2 KiB

BIN

render-test/expected/android/render-tests/sprites/2x-screen-1x-pattern/expected.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 6.2 KiB

BIN

render-test/expected/android/render-tests/sprites/2x-screen-2x-pattern/expected.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 4.2 KiB