Commit Graph

13 Commits

Author SHA1 Message Date
Thiago Marcos P. Santos
307f9cede1 [render-test] Prettyfy metrics output 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
63116154fe [render-test] Only write metrics if they are available
Otherwise the file will have an empty tag.
2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
629c0e1142 [render-test] Add tests for filesize probe
And make sure we run it on the bots
2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
a9f06f3b52 [render-test] Add instruction for verifying file size
For a given absolute or relative path, measure the size of the file.

This is useful for measuring if the cache has increased as expected
after moving a camera or decreased after cleaning up.

In a more hackish manner, could be used for collecting binary size
statistics of shared libraries.
2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
026e15fe3d [render-test] Fix rootPath parameter being ignored
It was doing nothing and always using the default root path.
2019-10-10 19:54:51 +03:00
Mikhail Pozdnyakov
b4e0224a57 [test runner] Fix finding of expected images paths
Before this change, the found paths to the expected images
erroneously included the path to the `metrics.json` file
(if this file was present) leading to raising of an
unhandled exception.
2019-10-09 14:35:08 +03:00
Juha Alanen
13801f1b80 [render-test] Add support for query tests 2019-10-07 10:58:46 +03:00
Alexander Shalamov
9a42bdd7ae [core] Add filtering option to test-runner
This change adds filter command line option to render test runner,
so that test can be filtered by providing regular expression, for instance:

mbgl-render-test -f .*hillshade.*
2019-08-28 13:55:36 +03:00
Mikhail Pozdnyakov
766392f1f8 [test runner] Use allocation peak values for memory metrics 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
1b020eeb11 [test runner] Test metrics reports. Check metrics results. 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
a1904e802c [test-runner] Introduce mapbox-gl-native test expectations
The `mapbox-gl-native`-specific render tests expected results will
be stored at the `render-test/expected/` subfolder.

Test runner will automatically put new expected results there if
invoked with `UPDATE=true`.
2019-08-16 16:25:59 +03:00
Aleksandar Stojiljkovic
b5d71fbca0 mbgl-render-test runner - use the same tolerance as with node render test
Two render tests failing only with mbgl-render-tests are added to platform
specific ignores. This is to be extended with fill-extrusion-pattern failing only on mac.
2019-08-07 10:26:39 +03:00
Bruno de Oliveira Abinader
3b0e5a59a2 [core] Implement C++ render test runner 2019-06-25 20:10:21 +03:00