Thiago Marcos P. Santos
13c5505572
[metrics] Use the cache database instead of file paths for fixtures
...
Now that we use a cache, we no longer need "asset_path" and
"vendor_path".
2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
970cabe0eb
[build] Reorganize the render tests
...
Move everything that might collect metrics to the metrics/ directory,
the only test manifests inside the render-test/ directory are the
unit tests of the probes.
2019-12-16 22:52:01 +02:00
zmiao
f848f07ad9
[metrics] Run Android RenderTestRunner bot in rebaseline mode ( #16036 )
2019-12-11 11:50:27 +02:00
zmiao
e619552a5d
[test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed ( #15994 )
...
* [test-runner] Fix failed tests, generate android specific expectations
* [test-runner] Check render test runner testing result
* [test-runner] Add error case to android ignore list
* [test-runner] Update metrics
* [test-runner] Move Android render tests with big diff(>0.006) to ignore list
2019-12-04 18:10:58 +02:00
zmiao
b2693f9d53
[test-runner] Add android RenderTestRunner baseline metrics ( #15979 )
...
* [test-runner] Enable probe-testing android render test runner
* [test-runner] Add pixel4 baseline metrics
* Add git ignored metrics
* Make renderTestrunner run two times with different manifest config
2019-12-02 13:29:13 +02:00
zmiao
a02ed76d5b
[render-test] Adding mvt-fixture to app asset content ( #15955 )
2019-11-21 17:22:40 +02:00
Thiago Marcos P. Santos
d6eeea1909
[build] Build Android release when running render tests
2019-11-21 15:31:59 +02:00
zmiao
03b7fe3326
[render-test] Config CircleCi to run RenderTestApp on Firebase with Pixel4 ( #15951 )
...
This reverts commit d2413d4ffffd087b352b6e4edd6e6322a311bc07.
2019-11-20 17:56:19 +02:00
zmiao
1b58e87f15
[render-test] Wrap test data inside RenderTestRunner App + Add a new test app ( #15887 )
...
* [render-test] Wrap test resources inside app
* [render-test] Add test app
* fix test app failure
* [render-test]add callback + add javaObjectWrapper
2019-11-19 20:45:30 +02:00
zmiao
c8576e089f
[render-test] Add manifest parser for render-test-runner ( #15861 )
...
* [render-test] Add manifest parser for render-test-runner
* [render-test] Refactory manifest parser
* [render-test] Parse full manifest file through CLI
* [render-test] Add linux probe manifest
2019-10-29 20:59:29 +02:00
zmiao
068befa9df
[test-runner] Run render test runner as a NativeActivity app on android device ( #15827 )
...
* [test-runner]Add android render-test-runner NativeActivity app
* [test-runner] Fix cmake for CI build failure
* [test-runner] Update folder location, change app configureation
* [test-runner] Add running instruction
2019-10-22 16:32:21 +03:00
