tei/MapLibreParticleLab
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,246 Commits 3 Branches 22 Tags
8d163c159f7cc0699be488457cf14c67bb07f2c7
Commit Graph

36 Commits

Author SHA1 Message Date
Mikhail Pozdnyakov
2b6a0e48ee [test runner] Enable test results update from cmd line 
Added the following command line argument:
```
-u[update], --update=[update]     Test results update mode.
Supported values are: "default", "platform", "metrics"
```
 2019-11-27 18:19:10 +02:00
Alexander Shalamov
2f8501043c [test-runner] Move probe related command line args to manifest 
- Move probe related command line arguments to manifest, example:

  "probes": ["probeGFX", "probeNetwork", "probeMemory"],
  "metric_path": "metrics/linux"

- Use manifest file name as a postfix for a result page
- Move injected probes 'begin' section before map object creation
- Generalize artifact storing shell script
 2019-11-27 16:43:33 +02:00
zmiao
11321497da [render-test] Add metric_paths into Manifest (#15973) 
* [render-test]Add expected metrics path in manifest file

* seperate metrics.json and expected.png

* fix expected path parsing

* keep expectation path if update is enabled
 2019-11-27 11:08:55 +02:00
Alexander Shalamov
17a5441768 [test-runner] Add render test runner options for injecting probes 
This allows injection of memory, gfx and network probes before and
after operations defined in render test are run.
 2019-11-22 15:29:25 +02:00
zmiao
1b58e87f15 [render-test] Wrap test data inside RenderTestRunner App + Add a new test app (#15887) 
* [render-test] Wrap test resources inside app

* [render-test] Add test app

* fix test app failure

* [render-test]add callback + add javaObjectWrapper
 2019-11-19 20:45:30 +02:00
Dane Springmeyer
c1b2e8c9a0 fix -Wfor-loop-analysis and -Wreorder warnings (#15901) 2019-11-12 06:48:37 -08:00
Mikko Pulkki
a7a7e8cbe2 [render-test] Implement gfx probe for tracking gpu resources 2019-10-30 14:32:27 +02:00
zmiao
c8576e089f [render-test] Add manifest parser for render-test-runner (#15861) 
* [render-test] Add manifest parser for render-test-runner

* [render-test] Refactory manifest parser

* [render-test] Parse full manifest file through CLI

* [render-test] Add linux probe manifest
 2019-10-29 20:59:29 +02:00
zmiao
2385f4cd86 [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832) 
* [render-test] Add configurable path via CLI arguments

* [render-test] Change ignore path config
 2019-10-23 12:04:23 +03:00
Mikko Pulkki
0ca96fd8a4 [render-test] Implement fps benchmarking tests (#15803) 2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
bb0e5ffb2c [test runner] Improve error messaging for memory metrics tests 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b03982730e [test runner] Command line option for the tests expectations path 
-e[expectationsPath], --expectationsPath=[expectationsPath]

Test expectations path.
 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
8bdd8ec670 [test runner] Disable memory metrics checks on sanitize builds 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b0976feca2 [test runner] Tests for memory size metrics 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
9adc78134c [test runner] Threshold for memory metrics 2019-10-21 16:10:45 +03:00
Juha Alanen
b53093b522 [render-test] Add support for collecting network metrics 2019-10-16 14:14:46 +03:00
Thiago Marcos P. Santos
8b3a222c81 [render-test] Add tolerance to file-size tests 2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
7f5c630613 [render-test] Fix UPDATE_METRICS=1 changing the path of file size tests 
Should use the exact same path as described on style.json
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
2e002746eb [render-test] Make clang-format happy 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
a9f06f3b52 [render-test] Add instruction for verifying file size 
For a given absolute or relative path, measure the size of the file.

This is useful for measuring if the cache has increased as expected
after moving a camera or decreased after cleaning up.

In a more hackish manner, could be used for collecting binary size
statistics of shared libraries.
 2019-10-10 19:54:51 +03:00
Mikhail Pozdnyakov
b4e0224a57 [test runner] Fix finding of expected images paths 
Before this change, the found paths to the expected images
erroneously included the path to the `metrics.json` file
(if this file was present) leading to raising of an
unhandled exception.
 2019-10-09 14:35:08 +03:00
Juha Alanen
4eaaa9046e [tests] Share common code between test runners 2019-10-08 15:33:30 +03:00
Juha Alanen
13801f1b80 [render-test] Add support for query tests 2019-10-07 10:58:46 +03:00
Juha Alanen
18a426d748 [render-test] Support feature-state tests where featureID is a number 2019-10-07 10:58:46 +03:00
Juha Alanen
f58a25932a [render-test] Add support for setPitch operation 2019-10-07 10:58:46 +03:00
Juha Alanen
6b13c42314 [build] Fix clang format and tidy checks 2019-09-18 14:29:15 +03:00
Juha Alanen
045018905b [render-test] Add support for feature state APIs 2019-09-18 14:29:15 +03:00
Mikhail Pozdnyakov
766392f1f8 [test runner] Use allocation peak values for memory metrics 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
1b020eeb11 [test runner] Test metrics reports. Check metrics results. 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
d0a84cb7d9 [test runner] Introduce probe_memory_.. API for render tests 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
5de27d5200 [test runner] Expectations paths are represented with std::vector 2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
1580216469 [test-runner] UPDATE_GENERIC variable updates results at mapbox-gl-js submodule 2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
a1904e802c [test-runner] Introduce mapbox-gl-native test expectations 
The `mapbox-gl-native`-specific render tests expected results will
be stored at the `render-test/expected/` subfolder.

Test runner will automatically put new expected results there if
invoked with `UPDATE=true`.
 2019-08-16 16:25:59 +03:00
Aleksandar Stojiljkovic
b5d71fbca0 mbgl-render-test runner - use the same tolerance as with node render test 
Two render tests failing only with mbgl-render-tests are added to platform
specific ignores. This is to be extended with fill-extrusion-pattern failing only on mac.
 2019-08-07 10:26:39 +03:00
Mikhail Pozdnyakov
4c896cbb31 [core] Fix error handling in HeadlessFrontend::render() 2019-06-28 16:33:52 +03:00
Bruno de Oliveira Abinader
3b0e5a59a2 [core] Implement C++ render test runner 2019-06-25 20:10:21 +03:00