Thiago Marcos P. Santos
d148908cf1
[render-test] Make the manifest mandatory
...
At the moment we have an invalid path as default.
2020-01-08 14:58:05 +02:00
Thiago Marcos P. Santos
5a0f43037f
[render-test] Remove positional argument
...
Not in use, for running a single test, use -f instead.
2020-01-08 14:58:05 +02:00
Thiago Marcos P. Santos
f0d2a2f636
[render-test] Effectively use the offline cache for fixtures
2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
26cfddaf47
[render-test] Add access token to the test manifest
...
Needed if we want to run tests online. Will default to the
MAPBOX_ACCESS_TOKEN environment value.
2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
08f03b1bbb
[render-test] Add cache database path to the manifest
...
A path relative to the manifest pointing at the data cache.
2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
502ddd3c8a
[render-test] Fixed typo and remove unused
2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
8869d09b25
[build] Collect and publish new baselines
...
Also fail the bot in case there are new baselines.
2019-12-16 22:52:01 +02:00
zmiao
f848f07ad9
[metrics] Run Android RenderTestRunner bot in rebaseline mode ( #16036 )
2019-12-11 11:50:27 +02:00
Alexander Shalamov
41324842b2
[test-runner] Allow to define filter inside manifest file
...
Command line option is still available and allows to override filter
that is defined in a manifest file.
2019-12-03 16:26:22 +02:00
Alexander Shalamov
2f8501043c
[test-runner] Move probe related command line args to manifest
...
- Move probe related command line arguments to manifest, example:
"probes": ["probeGFX", "probeNetwork", "probeMemory"],
"metric_path": "metrics/linux"
- Use manifest file name as a postfix for a result page
- Move injected probes 'begin' section before map object creation
- Generalize artifact storing shell script
2019-11-27 16:43:33 +02:00
zmiao
11321497da
[render-test] Add metric_paths into Manifest ( #15973 )
...
* [render-test]Add expected metrics path in manifest file
* seperate metrics.json and expected.png
* fix expected path parsing
* keep expectation path if update is enabled
2019-11-27 11:08:55 +02:00
zmiao
1b58e87f15
[render-test] Wrap test data inside RenderTestRunner App + Add a new test app ( #15887 )
...
* [render-test] Wrap test resources inside app
* [render-test] Add test app
* fix test app failure
* [render-test]add callback + add javaObjectWrapper
2019-11-19 20:45:30 +02:00
zmiao
1d49c23b85
[render-test] Fix render-test manifest confilicted local and member names ( #15888 )
2019-11-05 13:41:46 +02:00
zmiao
d8b1b2bacf
[render-test]Fix regex match for testFilter input ( #15886 )
2019-11-04 18:34:30 +02:00
zmiao
c8576e089f
[render-test] Add manifest parser for render-test-runner ( #15861 )
...
* [render-test] Add manifest parser for render-test-runner
* [render-test] Refactory manifest parser
* [render-test] Parse full manifest file through CLI
* [render-test] Add linux probe manifest
2019-10-29 20:59:29 +02:00
