Mikhail Pozdnyakov
b03982730e
[test runner] Command line option for the tests expectations path
...
-e[expectationsPath], --expectationsPath=[expectationsPath]
Test expectations path.
2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
8bdd8ec670
[test runner] Disable memory metrics checks on sanitize builds
2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b0976feca2
[test runner] Tests for memory size metrics
2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
9adc78134c
[test runner] Threshold for memory metrics
2019-10-21 16:10:45 +03:00
Juha Alanen
b53093b522
[render-test] Add support for collecting network metrics
2019-10-16 14:14:46 +03:00
Thiago Marcos P. Santos
8b3a222c81
[render-test] Add tolerance to file-size tests
2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
7f5c630613
[render-test] Fix UPDATE_METRICS=1 changing the path of file size tests
...
Should use the exact same path as described on style.json
2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
2e002746eb
[render-test] Make clang-format happy
2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
a9f06f3b52
[render-test] Add instruction for verifying file size
...
For a given absolute or relative path, measure the size of the file.
This is useful for measuring if the cache has increased as expected
after moving a camera or decreased after cleaning up.
In a more hackish manner, could be used for collecting binary size
statistics of shared libraries.
2019-10-10 19:54:51 +03:00
Mikhail Pozdnyakov
b4e0224a57
[test runner] Fix finding of expected images paths
...
Before this change, the found paths to the expected images
erroneously included the path to the `metrics.json` file
(if this file was present) leading to raising of an
unhandled exception.
2019-10-09 14:35:08 +03:00
Juha Alanen
4eaaa9046e
[tests] Share common code between test runners
2019-10-08 15:33:30 +03:00
Juha Alanen
13801f1b80
[render-test] Add support for query tests
2019-10-07 10:58:46 +03:00
Juha Alanen
18a426d748
[render-test] Support feature-state tests where featureID is a number
2019-10-07 10:58:46 +03:00
Juha Alanen
f58a25932a
[render-test] Add support for setPitch operation
2019-10-07 10:58:46 +03:00
Juha Alanen
6b13c42314
[build] Fix clang format and tidy checks
2019-09-18 14:29:15 +03:00
Juha Alanen
045018905b
[render-test] Add support for feature state APIs
2019-09-18 14:29:15 +03:00
Mikhail Pozdnyakov
766392f1f8
[test runner] Use allocation peak values for memory metrics
2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
1b020eeb11
[test runner] Test metrics reports. Check metrics results.
2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
d0a84cb7d9
[test runner] Introduce probe_memory_.. API for render tests
2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
5de27d5200
[test runner] Expectations paths are represented with std::vector
2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
1580216469
[test-runner] UPDATE_GENERIC variable updates results at mapbox-gl-js submodule
2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
a1904e802c
[test-runner] Introduce mapbox-gl-native test expectations
...
The `mapbox-gl-native`-specific render tests expected results will
be stored at the `render-test/expected/` subfolder.
Test runner will automatically put new expected results there if
invoked with `UPDATE=true`.
2019-08-16 16:25:59 +03:00
Aleksandar Stojiljkovic
b5d71fbca0
mbgl-render-test runner - use the same tolerance as with node render test
...
Two render tests failing only with mbgl-render-tests are added to platform
specific ignores. This is to be extended with fill-extrusion-pattern failing only on mac.
2019-08-07 10:26:39 +03:00
Mikhail Pozdnyakov
4c896cbb31
[core] Fix error handling in HeadlessFrontend::render()
2019-06-28 16:33:52 +03:00
Bruno de Oliveira Abinader
3b0e5a59a2
[core] Implement C++ render test runner
2019-06-25 20:10:21 +03:00
