tei/MapLibreParticleLab
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,439 Commits 3 Branches 22 Tags
5a4568b2ac355f807b7ea8e7d99b812db8a01a15
Commit Graph

23 Commits

Author SHA1 Message Date
Thiago Marcos P. Santos
d148908cf1 [render-test] Make the manifest mandatory 
At the moment we have an invalid path as default.
 2020-01-08 14:58:05 +02:00
Thiago Marcos P. Santos
5a0f43037f [render-test] Remove positional argument 
Not in use, for running a single test, use -f instead.
 2020-01-08 14:58:05 +02:00
Thiago Marcos P. Santos
f0d2a2f636 [render-test] Effectively use the offline cache for fixtures 2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
4d815d8306 [render-test] Add flag to run tests online 
And also make it not go to the network by setting the status
explicitly when when the -o flag is not passed.
 2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
ad1a7c595d [render-test] Cleanup on the render tests results 
Simplify the code path and make it print both rendering error and
metrics on fail.
 2019-12-16 22:52:01 +02:00
Thiago Marcos P. Santos
1c138124a6 [render-test] Fix metrics passing when failing 
Metrics will now fail, but the tool will return 0 when *ONLY* metrics
fail, to make the bot continue. We will also run ignored tests and
check if they are ignored but passing.
 2019-12-16 22:52:01 +02:00
Mikhail Pozdnyakov
515cb4e0fc [render test] Fix probes failure reports 2019-12-13 15:34:06 +02:00
Alexander Shalamov
91ba9b655e [test-runner] Don't update nor create metrics baseline for ignored test 2019-12-12 17:03:25 +02:00
Alexander Shalamov
c0fee57367 [test-runner] Add desctiption for --update command 2019-12-10 22:02:58 +02:00
Mikhail Pozdnyakov
e31ad307f4 [test runner] Report absolute path to the results html file 2019-12-10 19:04:45 +02:00
Alexander Shalamov
a9ba572118 [test-runner] Add rebaseline flag 
Rebaseline flag allows to update or create new metric, in cases when
metric check is failed or expected metric is missing.
 2019-12-09 17:53:34 +02:00
Alexander Shalamov
3d0001642b [test-runner] Simplify update option and remove obsolete ifdefs 2019-12-09 17:53:34 +02:00
Alexander Shalamov
41324842b2 [test-runner] Allow to define filter inside manifest file 
Command line option is still available and allows to override filter
that is defined in a manifest file.
 2019-12-03 16:26:22 +02:00
Mikhail Pozdnyakov
2b6a0e48ee [test runner] Enable test results update from cmd line 
Added the following command line argument:
```
-u[update], --update=[update]     Test results update mode.
Supported values are: "default", "platform", "metrics"
```
 2019-11-27 18:19:10 +02:00
Alexander Shalamov
2f8501043c [test-runner] Move probe related command line args to manifest 
- Move probe related command line arguments to manifest, example:

  "probes": ["probeGFX", "probeNetwork", "probeMemory"],
  "metric_path": "metrics/linux"

- Use manifest file name as a postfix for a result page
- Move injected probes 'begin' section before map object creation
- Generalize artifact storing shell script
 2019-11-27 16:43:33 +02:00
Alexander Shalamov
17a5441768 [test-runner] Add render test runner options for injecting probes 
This allows injection of memory, gfx and network probes before and
after operations defined in render test are run.
 2019-11-22 15:29:25 +02:00
zmiao
1b58e87f15 [render-test] Wrap test data inside RenderTestRunner App + Add a new test app (#15887) 
* [render-test] Wrap test resources inside app

* [render-test] Add test app

* fix test app failure

* [render-test]add callback + add javaObjectWrapper
 2019-11-19 20:45:30 +02:00
zmiao
c8576e089f [render-test] Add manifest parser for render-test-runner (#15861) 
* [render-test] Add manifest parser for render-test-runner

* [render-test] Refactory manifest parser

* [render-test] Parse full manifest file through CLI

* [render-test] Add linux probe manifest
 2019-10-29 20:59:29 +02:00
zmiao
2385f4cd86 [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832) 
* [render-test] Add configurable path via CLI arguments

* [render-test] Change ignore path config
 2019-10-23 12:04:23 +03:00
Mikko Pulkki
0ca96fd8a4 [render-test] Implement fps benchmarking tests (#15803) 2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
bb0e5ffb2c [test runner] Improve error messaging for memory metrics tests 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
eb3c203d4e [test runner] Adjust memory metrics test results 2019-10-21 16:10:45 +03:00
zmiao
e829d1ae6f [test-runner] make render-test a shared lib (#15816) 
* [test-runner] make render-test a shared lib

[test-runner] nit

[test-runner] nit again

* [test-runner] Remove redundant linked file in cmake
 2019-10-15 19:16:32 +03:00