Alexander Shalamov
c0fee57367
[test-runner] Add desctiption for --update command
2019-12-10 22:02:58 +02:00
Mikhail Pozdnyakov
e31ad307f4
[test runner] Report absolute path to the results html file
2019-12-10 19:04:45 +02:00
Alexander Shalamov
a9ba572118
[test-runner] Add rebaseline flag
...
Rebaseline flag allows to update or create new metric, in cases when
metric check is failed or expected metric is missing.
2019-12-09 17:53:34 +02:00
Alexander Shalamov
3d0001642b
[test-runner] Simplify update option and remove obsolete ifdefs
2019-12-09 17:53:34 +02:00
Alexander Shalamov
41324842b2
[test-runner] Allow to define filter inside manifest file
...
Command line option is still available and allows to override filter
that is defined in a manifest file.
2019-12-03 16:26:22 +02:00
Mikhail Pozdnyakov
2b6a0e48ee
[test runner] Enable test results update from cmd line
...
Added the following command line argument:
```
-u[update], --update=[update] Test results update mode.
Supported values are: "default", "platform", "metrics"
```
2019-11-27 18:19:10 +02:00
Alexander Shalamov
2f8501043c
[test-runner] Move probe related command line args to manifest
...
- Move probe related command line arguments to manifest, example:
"probes": ["probeGFX", "probeNetwork", "probeMemory"],
"metric_path": "metrics/linux"
- Use manifest file name as a postfix for a result page
- Move injected probes 'begin' section before map object creation
- Generalize artifact storing shell script
2019-11-27 16:43:33 +02:00
Alexander Shalamov
17a5441768
[test-runner] Add render test runner options for injecting probes
...
This allows injection of memory, gfx and network probes before and
after operations defined in render test are run.
2019-11-22 15:29:25 +02:00
zmiao
1b58e87f15
[render-test] Wrap test data inside RenderTestRunner App + Add a new test app ( #15887 )
...
* [render-test] Wrap test resources inside app
* [render-test] Add test app
* fix test app failure
* [render-test]add callback + add javaObjectWrapper
2019-11-19 20:45:30 +02:00
zmiao
c8576e089f
[render-test] Add manifest parser for render-test-runner ( #15861 )
...
* [render-test] Add manifest parser for render-test-runner
* [render-test] Refactory manifest parser
* [render-test] Parse full manifest file through CLI
* [render-test] Add linux probe manifest
2019-10-29 20:59:29 +02:00
zmiao
2385f4cd86
[render-test] Add configurable rootPath, ignorePath via CLI arguments ( #15832 )
...
* [render-test] Add configurable path via CLI arguments
* [render-test] Change ignore path config
2019-10-23 12:04:23 +03:00
Mikko Pulkki
0ca96fd8a4
[render-test] Implement fps benchmarking tests ( #15803 )
2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
bb0e5ffb2c
[test runner] Improve error messaging for memory metrics tests
2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
eb3c203d4e
[test runner] Adjust memory metrics test results
2019-10-21 16:10:45 +03:00
zmiao
e829d1ae6f
[test-runner] make render-test a shared lib ( #15816 )
...
* [test-runner] make render-test a shared lib
[test-runner] nit
[test-runner] nit again
* [test-runner] Remove redundant linked file in cmake
2019-10-15 19:16:32 +03:00
