zmiao e619552a5d [test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994) ...

* [test-runner] Fix failed tests, generate android specific expectations

* [test-runner] Check render test runner testing result

* [test-runner] Add error case to android ignore list

*  [test-runner] Update metrics

* [test-runner] Move Android render tests with big diff(>0.006) to ignore list

2019-12-04 18:10:58 +02:00

..

android

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

expected

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

ignores

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

include/mbgl

[render-test] Wrap test data inside RenderTestRunner App + Add a new test app (#15887)

2019-11-19 20:45:30 +02:00

metrics

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

tests

[render-test] Add support for measuring compressed file size

2019-11-28 19:18:17 +02:00

allocation_index.cpp

[test runner] Use allocation peak values for memory metrics

2019-08-27 12:34:09 +03:00

allocation_index.hpp

[test runner] Use allocation peak values for memory metrics

2019-08-27 12:34:09 +03:00

android-manifest-probe-memory.json

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

android-manifest-probe-network-gfx.json

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

android-manifest.json

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

file_source.cpp

[render-test] Add support for collecting network metrics

2019-10-16 14:14:46 +03:00

file_source.hpp

[render-test] Add support for collecting network metrics

2019-10-16 14:14:46 +03:00

filesystem.hpp

[core] Implement C++ render test runner

2019-06-25 20:10:21 +03:00

linux-manifest-probe-gfx-network.json

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

linux-manifest-probe-memory.json

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

linux-manifest.json

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

linux-probe-manifest.json

[test-runner] Run render tests with metrics on linux

2019-11-29 15:08:34 +02:00

linux-query-manifest.json

[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)

2019-12-04 18:10:58 +02:00

mac-ignores.json

mbgl-render-test runner - use the same tolerance as with node render test

2019-08-07 10:26:39 +03:00

mac-manifest.json

[render-test] Add metric_paths into Manifest (#15973)

2019-11-27 11:08:55 +02:00

mac-probe-manifest.json

[render-test] Add metric_paths into Manifest (#15973)

2019-11-27 11:08:55 +02:00

manifest_parser.cpp

[test-runner] Allow to define filter inside manifest file

2019-12-03 16:26:22 +02:00

manifest_parser.hpp

[test-runner] Allow to define filter inside manifest file

2019-12-03 16:26:22 +02:00

metadata.hpp

[render-test] Add metric_paths into Manifest (#15973)

2019-11-27 11:08:55 +02:00

parser.cpp

[metrics] Make the parsing of metrics even more strict

2019-11-28 12:34:22 +02:00

parser.hpp

[render-test] Add metric_paths into Manifest (#15973)

2019-11-27 11:08:55 +02:00

render_test.cpp

[test-runner] Allow to define filter inside manifest file

2019-12-03 16:26:22 +02:00

runner.cpp

[test runner] Update test commands for Layer::setProperty()

2019-12-03 14:20:17 +02:00

runner.hpp

[test runner] Enable test results update from cmd line

2019-11-27 18:19:10 +02:00