tei/MapLibreParticleLab
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,295 Commits 3 Branches 22 Tags
29bbfcccdecde7d3570dff418d10e460043ed409
Commit Graph

74 Commits

Author SHA1 Message Date
Alexander Shalamov
41324842b2 [test-runner] Allow to define filter inside manifest file 
Command line option is still available and allows to override filter
that is defined in a manifest file.
 2019-12-03 16:26:22 +02:00
Mikhail Pozdnyakov
75f8530ed1 [test runner] Update test commands for Layer::setProperty() 2019-12-03 14:20:17 +02:00
Alexander Shalamov
1f30b03047 [metrics] Add baselines for formatted-images and line-dasharray render tests 2019-12-02 17:11:49 +02:00
zmiao
b2693f9d53 [test-runner] Add android RenderTestRunner baseline metrics (#15979) 
* [test-runner] Enable probe-testing android render test runner

* [test-runner] Add pixel4 baseline metrics

* Add git ignored metrics

* Make renderTestrunner run two times with different manifest config
 2019-12-02 13:29:13 +02:00
Alexander Shalamov
0c348a8acf [test-runner] Log all 'probeFileSize' failures 
If there are multiple file size probes in a test file, it is
better to report all failures instead of first failed probe.
 2019-12-02 12:07:37 +02:00
Juha Alanen
2e93f1e982 [test-runner] Run render tests with metrics on linux 2019-11-29 15:08:34 +02:00
Juha Alanen
0ba4b5c93f [test-runner] Add baseline metrics for linux 2019-11-29 15:08:34 +02:00
Thiago Marcos P. Santos
8c9b038af3 [render-test] Add support for measuring compressed file size 
Useful because for platform such as Android, we want to measure
the size of the library inside the APK, which is usually compressed.
 2019-11-28 19:18:17 +02:00
Thiago Marcos P. Santos
1455f6f581 [metrics] Make the parsing of metrics even more strict 
File must be `metrics.json`.
 2019-11-28 12:34:22 +02:00
Thiago Marcos P. Santos
09b724ea33 [render-test] Fix regex matching the directory name 
This code was matching `style.json` instead of `metrics.json` if
the `style.json` was contained inside `metrics/.../style.json`.
 2019-11-27 18:32:58 +02:00
Mikhail Pozdnyakov
2b6a0e48ee [test runner] Enable test results update from cmd line 
Added the following command line argument:
```
-u[update], --update=[update]     Test results update mode.
Supported values are: "default", "platform", "metrics"
```
 2019-11-27 18:19:10 +02:00
Alexander Shalamov
2f8501043c [test-runner] Move probe related command line args to manifest 
- Move probe related command line arguments to manifest, example:

  "probes": ["probeGFX", "probeNetwork", "probeMemory"],
  "metric_path": "metrics/linux"

- Use manifest file name as a postfix for a result page
- Move injected probes 'begin' section before map object creation
- Generalize artifact storing shell script
 2019-11-27 16:43:33 +02:00
zmiao
11321497da [render-test] Add metric_paths into Manifest (#15973) 
* [render-test]Add expected metrics path in manifest file

* seperate metrics.json and expected.png

* fix expected path parsing

* keep expectation path if update is enabled
 2019-11-27 11:08:55 +02:00
Alexander Shalamov
17a5441768 [test-runner] Add render test runner options for injecting probes 
This allows injection of memory, gfx and network probes before and
after operations defined in render test are run.
 2019-11-22 15:29:25 +02:00
zmiao
a02ed76d5b [render-test] Adding mvt-fixture to app asset content (#15955) 2019-11-21 17:22:40 +02:00
Thiago Marcos P. Santos
d6eeea1909 [build] Build Android release when running render tests 2019-11-21 15:31:59 +02:00
zmiao
03b7fe3326 [render-test] Config CircleCi to run RenderTestApp on Firebase with Pixel4 (#15951) 
This reverts commit d2413d4ffffd087b352b6e4edd6e6322a311bc07.
 2019-11-20 17:56:19 +02:00
zmiao
1b58e87f15 [render-test] Wrap test data inside RenderTestRunner App + Add a new test app (#15887) 
* [render-test] Wrap test resources inside app

* [render-test] Add test app

* fix test app failure

* [render-test]add callback + add javaObjectWrapper
 2019-11-19 20:45:30 +02:00
Dane Springmeyer
c1b2e8c9a0 fix -Wfor-loop-analysis and -Wreorder warnings (#15901) 2019-11-12 06:48:37 -08:00
zmiao
1d49c23b85 [render-test] Fix render-test manifest confilicted local and member names (#15888) 2019-11-05 13:41:46 +02:00
zmiao
d8b1b2bacf [render-test]Fix regex match for testFilter input (#15886) 2019-11-04 18:34:30 +02:00
Mikko Pulkki
6900ac9837 [render-test] Add gfx probe test cases 2019-10-30 14:32:27 +02:00
Mikko Pulkki
a7a7e8cbe2 [render-test] Implement gfx probe for tracking gpu resources 2019-10-30 14:32:27 +02:00
zmiao
c8576e089f [render-test] Add manifest parser for render-test-runner (#15861) 
* [render-test] Add manifest parser for render-test-runner

* [render-test] Refactory manifest parser

* [render-test] Parse full manifest file through CLI

* [render-test] Add linux probe manifest
 2019-10-29 20:59:29 +02:00
Juha Alanen
360b8b4247 [core,android,darwin,qt] Add fields related to feature-state 
Move the fields from geometry.hpp/feature.hpp as they are not
part of the GeoJSON specification.
 2019-10-28 16:46:55 +02:00
zmiao
2385f4cd86 [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832) 
* [render-test] Add configurable path via CLI arguments

* [render-test] Change ignore path config
 2019-10-23 12:04:23 +03:00
zmiao
068befa9df [test-runner] Run render test runner as a NativeActivity app on android device (#15827) 
* [test-runner]Add android render-test-runner NativeActivity app

* [test-runner] Fix cmake for CI build failure

* [test-runner] Update folder location, change app configureation

* [test-runner] Add running instruction
 2019-10-22 16:32:21 +03:00
Mikko Pulkki
0ca96fd8a4 [render-test] Implement fps benchmarking tests (#15803) 2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
bb0e5ffb2c [test runner] Improve error messaging for memory metrics tests 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
61d1018087 [test runner] Memory metrics expectations for MAC 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b03982730e [test runner] Command line option for the tests expectations path 
-e[expectationsPath], --expectationsPath=[expectationsPath]

Test expectations path.
 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
eb3c203d4e [test runner] Adjust memory metrics test results 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
8bdd8ec670 [test runner] Disable memory metrics checks on sanitize builds 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b0976feca2 [test runner] Tests for memory size metrics 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
9adc78134c [test runner] Threshold for memory metrics 2019-10-21 16:10:45 +03:00
Juha Alanen
050b3360ec [render-test] Add network metrics test case 2019-10-16 14:14:46 +03:00
Juha Alanen
b53093b522 [render-test] Add support for collecting network metrics 2019-10-16 14:14:46 +03:00
zmiao
e829d1ae6f [test-runner] make render-test a shared lib (#15816) 
* [test-runner] make render-test a shared lib

[test-runner] nit

[test-runner] nit again

* [test-runner] Remove redundant linked file in cmake
 2019-10-15 19:16:32 +03:00
Thiago Marcos P. Santos
465d4e8cfa [render-test] Add test for file size tolerance 2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
8b3a222c81 [render-test] Add tolerance to file-size tests 2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
2fb1e47b75 [render-test] No camelCase on the metrics.json tag 
It is ugly.
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
307f9cede1 [render-test] Prettyfy metrics output 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
acd7fba3d5 [render-test] Add more probe tests for file size 
Also make the tests simpler.
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
7f5c630613 [render-test] Fix UPDATE_METRICS=1 changing the path of file size tests 
Should use the exact same path as described on style.json
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
63116154fe [render-test] Only write metrics if they are available 
Otherwise the file will have an empty tag.
 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
629c0e1142 [render-test] Add tests for filesize probe 
And make sure we run it on the bots
 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
2e002746eb [render-test] Make clang-format happy 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
a9f06f3b52 [render-test] Add instruction for verifying file size 
For a given absolute or relative path, measure the size of the file.

This is useful for measuring if the cache has increased as expected
after moving a camera or decreased after cleaning up.

In a more hackish manner, could be used for collecting binary size
statistics of shared libraries.
 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
026e15fe3d [render-test] Fix rootPath parameter being ignored 
It was doing nothing and always using the default root path.
 2019-10-10 19:54:51 +03:00
Mikhail Pozdnyakov
b4e0224a57 [test runner] Fix finding of expected images paths 
Before this change, the found paths to the expected images
erroneously included the path to the `metrics.json` file
(if this file was present) leading to raising of an
unhandled exception.
 2019-10-09 14:35:08 +03:00