Commit Graph

18 Commits

Author SHA1 Message Date
Thiago Marcos P. Santos
f604280812 [build] Do not override new/delete on render-test for sanitize builds
Sanitizers will also do the same and it will conflict.
2019-09-17 12:28:55 +03:00
Alexander Shalamov
9a42bdd7ae [core] Add filtering option to test-runner
This change adds filter command line option to render test runner,
so that test can be filtered by providing regular expression, for instance:

mbgl-render-test -f .*hillshade.*
2019-08-28 13:55:36 +03:00
Mikhail Pozdnyakov
766392f1f8 [test runner] Use allocation peak values for memory metrics 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
1b020eeb11 [test runner] Test metrics reports. Check metrics results. 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
d0a84cb7d9 [test runner] Introduce probe_memory_.. API for render tests 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
e787f5f43a [test runner] Overload global new/delete 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
75b1e47f3a [test runner] Introduce AllocationIndex 2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
f365dcece4 [render tests] gl-native baseline for debug/collision- tests 2019-08-26 13:55:15 +03:00
Mikhail Pozdnyakov
d0529e7b19 [render test] mapbox-gl-native baseline for text-pitch-alignment tests 2019-08-21 17:07:05 +03:00
Mikhail Pozdnyakov
5de27d5200 [test runner] Expectations paths are represented with std::vector 2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
1580216469 [test-runner] UPDATE_GENERIC variable updates results at mapbox-gl-js submodule 2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
8792e7c322 Enable text-variable-anchor/{pitched-rotated-debug|rotated-offset} render tests 2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
a1904e802c [test-runner] Introduce mapbox-gl-native test expectations
The `mapbox-gl-native`-specific render tests expected results will
be stored at the `render-test/expected/` subfolder.

Test runner will automatically put new expected results there if
invoked with `UPDATE=true`.
2019-08-16 16:25:59 +03:00
Aleksandar Stojiljkovic
d1d5999354 Mark tests flaky on Linux only. #15322
fill-opacity/zoom-and-property-function-pattern,
fill-pattern/literal,
fill-pattern/opacity,
fill-pattern/zoomed,
line-translate/literal,

Addresses: #15322, #14423, #14870, #14768, #14859
2019-08-07 13:59:04 +03:00
Aleksandar Stojiljkovic
75f1c72618 Ignore flaky line-pattern/opacity test on Linux bot
Related to: https://github.com/mapbox/mapbox-gl-native/issues/15320
2019-08-07 10:26:39 +03:00
Aleksandar Stojiljkovic
b5d71fbca0 mbgl-render-test runner - use the same tolerance as with node render test
Two render tests failing only with mbgl-render-tests are added to platform
specific ignores. This is to be extended with fill-extrusion-pattern failing only on mac.
2019-08-07 10:26:39 +03:00
Mikhail Pozdnyakov
4c896cbb31 [core] Fix error handling in HeadlessFrontend::render() 2019-06-28 16:33:52 +03:00
Bruno de Oliveira Abinader
3b0e5a59a2 [core] Implement C++ render test runner 2019-06-25 20:10:21 +03:00