tei/MapLibreParticleLab
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,250 Commits 3 Branches 22 Tags
d13562252da5b58926c59ac77ca4e6d047dfdbe2
Commit Graph

65 Commits

Author SHA1 Message Date
Thiago Marcos P. Santos
09b724ea33 [render-test] Fix regex matching the directory name 
This code was matching `style.json` instead of `metrics.json` if
the `style.json` was contained inside `metrics/.../style.json`.
 2019-11-27 18:32:58 +02:00
Mikhail Pozdnyakov
2b6a0e48ee [test runner] Enable test results update from cmd line 
Added the following command line argument:
```
-u[update], --update=[update]     Test results update mode.
Supported values are: "default", "platform", "metrics"
```
 2019-11-27 18:19:10 +02:00
Alexander Shalamov
2f8501043c [test-runner] Move probe related command line args to manifest 
- Move probe related command line arguments to manifest, example:

  "probes": ["probeGFX", "probeNetwork", "probeMemory"],
  "metric_path": "metrics/linux"

- Use manifest file name as a postfix for a result page
- Move injected probes 'begin' section before map object creation
- Generalize artifact storing shell script
 2019-11-27 16:43:33 +02:00
zmiao
11321497da [render-test] Add metric_paths into Manifest (#15973) 
* [render-test]Add expected metrics path in manifest file

* seperate metrics.json and expected.png

* fix expected path parsing

* keep expectation path if update is enabled
 2019-11-27 11:08:55 +02:00
Alexander Shalamov
17a5441768 [test-runner] Add render test runner options for injecting probes 
This allows injection of memory, gfx and network probes before and
after operations defined in render test are run.
 2019-11-22 15:29:25 +02:00
zmiao
a02ed76d5b [render-test] Adding mvt-fixture to app asset content (#15955) 2019-11-21 17:22:40 +02:00
Thiago Marcos P. Santos
d6eeea1909 [build] Build Android release when running render tests 2019-11-21 15:31:59 +02:00
zmiao
03b7fe3326 [render-test] Config CircleCi to run RenderTestApp on Firebase with Pixel4 (#15951) 
This reverts commit d2413d4ffffd087b352b6e4edd6e6322a311bc07.
 2019-11-20 17:56:19 +02:00
zmiao
1b58e87f15 [render-test] Wrap test data inside RenderTestRunner App + Add a new test app (#15887) 
* [render-test] Wrap test resources inside app

* [render-test] Add test app

* fix test app failure

* [render-test]add callback + add javaObjectWrapper
 2019-11-19 20:45:30 +02:00
Dane Springmeyer
c1b2e8c9a0 fix -Wfor-loop-analysis and -Wreorder warnings (#15901) 2019-11-12 06:48:37 -08:00
zmiao
1d49c23b85 [render-test] Fix render-test manifest confilicted local and member names (#15888) 2019-11-05 13:41:46 +02:00
zmiao
d8b1b2bacf [render-test]Fix regex match for testFilter input (#15886) 2019-11-04 18:34:30 +02:00
Mikko Pulkki
6900ac9837 [render-test] Add gfx probe test cases 2019-10-30 14:32:27 +02:00
Mikko Pulkki
a7a7e8cbe2 [render-test] Implement gfx probe for tracking gpu resources 2019-10-30 14:32:27 +02:00
zmiao
c8576e089f [render-test] Add manifest parser for render-test-runner (#15861) 
* [render-test] Add manifest parser for render-test-runner

* [render-test] Refactory manifest parser

* [render-test] Parse full manifest file through CLI

* [render-test] Add linux probe manifest
 2019-10-29 20:59:29 +02:00
Juha Alanen
360b8b4247 [core,android,darwin,qt] Add fields related to feature-state 
Move the fields from geometry.hpp/feature.hpp as they are not
part of the GeoJSON specification.
 2019-10-28 16:46:55 +02:00
zmiao
2385f4cd86 [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832) 
* [render-test] Add configurable path via CLI arguments

* [render-test] Change ignore path config
 2019-10-23 12:04:23 +03:00
zmiao
068befa9df [test-runner] Run render test runner as a NativeActivity app on android device (#15827) 
* [test-runner]Add android render-test-runner NativeActivity app

* [test-runner] Fix cmake for CI build failure

* [test-runner] Update folder location, change app configureation

* [test-runner] Add running instruction
 2019-10-22 16:32:21 +03:00
Mikko Pulkki
0ca96fd8a4 [render-test] Implement fps benchmarking tests (#15803) 2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
bb0e5ffb2c [test runner] Improve error messaging for memory metrics tests 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
61d1018087 [test runner] Memory metrics expectations for MAC 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b03982730e [test runner] Command line option for the tests expectations path 
-e[expectationsPath], --expectationsPath=[expectationsPath]

Test expectations path.
 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
eb3c203d4e [test runner] Adjust memory metrics test results 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
8bdd8ec670 [test runner] Disable memory metrics checks on sanitize builds 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b0976feca2 [test runner] Tests for memory size metrics 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
9adc78134c [test runner] Threshold for memory metrics 2019-10-21 16:10:45 +03:00
Juha Alanen
050b3360ec [render-test] Add network metrics test case 2019-10-16 14:14:46 +03:00
Juha Alanen
b53093b522 [render-test] Add support for collecting network metrics 2019-10-16 14:14:46 +03:00
zmiao
e829d1ae6f [test-runner] make render-test a shared lib (#15816) 
* [test-runner] make render-test a shared lib

[test-runner] nit

[test-runner] nit again

* [test-runner] Remove redundant linked file in cmake
 2019-10-15 19:16:32 +03:00
Thiago Marcos P. Santos
465d4e8cfa [render-test] Add test for file size tolerance 2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
8b3a222c81 [render-test] Add tolerance to file-size tests 2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
2fb1e47b75 [render-test] No camelCase on the metrics.json tag 
It is ugly.
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
307f9cede1 [render-test] Prettyfy metrics output 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
acd7fba3d5 [render-test] Add more probe tests for file size 
Also make the tests simpler.
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
7f5c630613 [render-test] Fix UPDATE_METRICS=1 changing the path of file size tests 
Should use the exact same path as described on style.json
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
63116154fe [render-test] Only write metrics if they are available 
Otherwise the file will have an empty tag.
 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
629c0e1142 [render-test] Add tests for filesize probe 
And make sure we run it on the bots
 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
2e002746eb [render-test] Make clang-format happy 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
a9f06f3b52 [render-test] Add instruction for verifying file size 
For a given absolute or relative path, measure the size of the file.

This is useful for measuring if the cache has increased as expected
after moving a camera or decreased after cleaning up.

In a more hackish manner, could be used for collecting binary size
statistics of shared libraries.
 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
026e15fe3d [render-test] Fix rootPath parameter being ignored 
It was doing nothing and always using the default root path.
 2019-10-10 19:54:51 +03:00
Mikhail Pozdnyakov
b4e0224a57 [test runner] Fix finding of expected images paths 
Before this change, the found paths to the expected images
erroneously included the path to the `metrics.json` file
(if this file was present) leading to raising of an
unhandled exception.
 2019-10-09 14:35:08 +03:00
Juha Alanen
4eaaa9046e [tests] Share common code between test runners 2019-10-08 15:33:30 +03:00
Juha Alanen
13801f1b80 [render-test] Add support for query tests 2019-10-07 10:58:46 +03:00
Juha Alanen
18a426d748 [render-test] Support feature-state tests where featureID is a number 2019-10-07 10:58:46 +03:00
Juha Alanen
f58a25932a [render-test] Add support for setPitch operation 2019-10-07 10:58:46 +03:00
Juha Alanen
6b13c42314 [build] Fix clang format and tidy checks 2019-09-18 14:29:15 +03:00
Juha Alanen
045018905b [render-test] Add support for feature state APIs 2019-09-18 14:29:15 +03:00
Thiago Marcos P. Santos
f604280812 [build] Do not override new/delete on render-test for sanitize builds 
Sanitizers will also do the same and it will conflict.
 2019-09-17 12:28:55 +03:00
Alexander Shalamov
9a42bdd7ae [core] Add filtering option to test-runner 
This change adds filter command line option to render test runner,
so that test can be filtered by providing regular expression, for instance:

mbgl-render-test -f .*hillshade.*
 2019-08-28 13:55:36 +03:00
Mikhail Pozdnyakov
766392f1f8 [test runner] Use allocation peak values for memory metrics 2019-08-27 12:34:09 +03:00