Thiago Marcos P. Santos
af8092a86f
[render-test] Use image from the cache for addImage operation
...
Instead of trying to read it from the filesystem.
2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
ad1a7c595d
[render-test] Cleanup on the render tests results
...
Simplify the code path and make it print both rendering error and
metrics on fail.
2019-12-16 22:52:01 +02:00
Mikhail Pozdnyakov
65140e3e60
[test runner] Explicitly initialize TestContext POD members
2019-12-14 23:49:58 +02:00
Mikhail Pozdnyakov
b2d06b8a17
[test runner] Split operations parsing and execution
2019-12-13 15:34:06 +02:00
Alexander Shalamov
91ba9b655e
[test-runner] Don't update nor create metrics baseline for ignored test
2019-12-12 17:03:25 +02:00
zmiao
11321497da
[render-test] Add metric_paths into Manifest ( #15973 )
...
* [render-test]Add expected metrics path in manifest file
* seperate metrics.json and expected.png
* fix expected path parsing
* keep expectation path if update is enabled
2019-11-27 11:08:55 +02:00
Dane Springmeyer
c1b2e8c9a0
fix -Wfor-loop-analysis and -Wreorder warnings ( #15901 )
2019-11-12 06:48:37 -08:00
Mikko Pulkki
a7a7e8cbe2
[render-test] Implement gfx probe for tracking gpu resources
2019-10-30 14:32:27 +02:00
Mikko Pulkki
0ca96fd8a4
[render-test] Implement fps benchmarking tests ( #15803 )
2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
b03982730e
[test runner] Command line option for the tests expectations path
...
-e[expectationsPath], --expectationsPath=[expectationsPath]
Test expectations path.
2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
9adc78134c
[test runner] Threshold for memory metrics
2019-10-21 16:10:45 +03:00
Juha Alanen
b53093b522
[render-test] Add support for collecting network metrics
2019-10-16 14:14:46 +03:00
Thiago Marcos P. Santos
8b3a222c81
[render-test] Add tolerance to file-size tests
2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
a9f06f3b52
[render-test] Add instruction for verifying file size
...
For a given absolute or relative path, measure the size of the file.
This is useful for measuring if the cache has increased as expected
after moving a camera or decreased after cleaning up.
In a more hackish manner, could be used for collecting binary size
statistics of shared libraries.
2019-10-10 19:54:51 +03:00
Juha Alanen
13801f1b80
[render-test] Add support for query tests
2019-10-07 10:58:46 +03:00
Mikhail Pozdnyakov
766392f1f8
[test runner] Use allocation peak values for memory metrics
2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
1b020eeb11
[test runner] Test metrics reports. Check metrics results.
2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
d0a84cb7d9
[test runner] Introduce probe_memory_.. API for render tests
2019-08-27 12:34:09 +03:00
Mikhail Pozdnyakov
5de27d5200
[test runner] Expectations paths are represented with std::vector
2019-08-16 16:25:59 +03:00
Mikhail Pozdnyakov
a1904e802c
[test-runner] Introduce mapbox-gl-native test expectations
...
The `mapbox-gl-native`-specific render tests expected results will
be stored at the `render-test/expected/` subfolder.
Test runner will automatically put new expected results there if
invoked with `UPDATE=true`.
2019-08-16 16:25:59 +03:00
Bruno de Oliveira Abinader
3b0e5a59a2
[core] Implement C++ render test runner
2019-06-25 20:10:21 +03:00
