tei/MapLibreParticleLab
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,703 Commits 3 Branches 22 Tags
0f5e5311faa7526d9f200e8defd25fbb3ba504dd
Commit Graph

60 Commits

Author SHA1 Message Date
Mikhail Pozdnyakov
9e80a9f922 [render tests] Unset MapOptions::keepRenderData() flag in tile mode 2020-03-18 20:14:15 +02:00
Mikhail Pozdnyakov
c5155dcf33 [render test runner] Enable pixel ratio in tile mode 2020-03-05 16:12:43 +02:00
zmiao
429292fb98 [test-runner] Add iOS RenderTestRunner test metrics (#16139) 
* [test-runner] Add iOS RenderTestRunner test metrics

* [test-runner] Add ios probe metrics
 2020-01-24 15:45:47 +02:00
zmiao
1ade6c7784 [test-runner] Enable IOS RenderTestRunner and run it on Firebase (#16111) 
* [test-runner] Setup iOS RenderTestRunner

* [test-runner] Make app runnable on firebase

* Add iOS platform dependent expectation and ignores; Run prepare script via cmake

* Make RenderTestRunner report test status
 2020-01-21 23:23:35 +02:00
Alexander Shalamov
879c44f661 [core] Modularize FileSource codebase (#15768) 
* [core] Introduce FileSourceManager and use it for default platform impl

  - Add `FileSourceManager` interface that provides access to `FileSource`
    instances and means of registering / unregistering `FileSource` factories
  - Split `DefaultFileSource` into smaller parts
  - Add `DatabaseFileSource` interface and it's default implementation
  - Remove inter-dependencies between concrete `FileSource` classes

* [build] Add files to next build system

* [core] Add generic property setters / getters

* [core] Remove setOnlineStatus from OnlineFileSource interface

* [core] Hide threading implementation details from DatabaseFileSource interface

* [core] Make DB file source methods virtual

* [core] Add documentation for DatabaseFileSource and rename one method

* [core] Use simple callback instead of ActorRef

* [core] Remove ActorRef from OnlineFileSource public header

* [core] Add callback to FileSource::forward async API

* [core] Pass OfflineRegionDefinition by value

* [core] Update tests to use modular file sources

* [core] Update unit tests

* [core] Update unit tests after rebase

* [core] Backport low prio fix for cached requests

* [core] Backport pack database

* [core] Return removed factory from unRegisterFileSourceFactory

* [core] Rename shadowed args in onlinefilesource

* [core] Remove simple std::function callback aliases

* [core] Expose online file source property keys in public header file

* [test-runner] Add proxy file source test runner

* [cache] Update mbgl-cache utility to use new file source

* [metrics] Rebaseline binary size metrics

* [offline] Update offline utility

* [core] Update changelog
 2020-01-13 10:57:23 +02:00
Thiago Marcos P. Santos
af8092a86f [render-test] Use image from the cache for addImage operation 
Instead of trying to read it from the filesystem.
 2020-01-08 13:07:12 +02:00
Thiago Marcos P. Santos
f0d2a2f636 [render-test] Effectively use the offline cache for fixtures 2020-01-08 13:07:12 +02:00
Mikhail Pozdnyakov
648392585e [test runner] Show all tiles independently in Tile mode 2019-12-18 13:48:52 +02:00
Mikhail Pozdnyakov
64a37ceb05 [test runner] Rendering a single tile in Tile mode 2019-12-18 13:48:52 +02:00
Thiago Marcos P. Santos
ad1a7c595d [render-test] Cleanup on the render tests results 
Simplify the code path and make it print both rendering error and
metrics on fail.
 2019-12-16 22:52:01 +02:00
Thiago Marcos P. Santos
1c138124a6 [render-test] Fix metrics passing when failing 
Metrics will now fail, but the tool will return 0 when *ONLY* metrics
fail, to make the bot continue. We will also run ignored tests and
check if they are ignored but passing.
 2019-12-16 22:52:01 +02:00
Alexander Shalamov
1fc4cd649e [test-runner] Fix network probe 2019-12-13 21:07:56 +02:00
Mikhail Pozdnyakov
515cb4e0fc [render test] Fix probes failure reports 2019-12-13 15:34:06 +02:00
Mikhail Pozdnyakov
06a2930342 [test runner] Refactor injected probes operations code 2019-12-13 15:34:06 +02:00
Mikhail Pozdnyakov
b2d06b8a17 [test runner] Split operations parsing and execution 2019-12-13 15:34:06 +02:00
Mikhail Pozdnyakov
426f714c04 [test runner] Introduce TestOperation 2019-12-13 15:34:06 +02:00
Mikhail Pozdnyakov
4a30f74699 [test runner] Introduce generic TestContext 2019-12-13 15:34:06 +02:00
Alexander Shalamov
91ba9b655e [test-runner] Don't update nor create metrics baseline for ignored test 2019-12-12 17:03:25 +02:00
Alexander Shalamov
f590b1082a [test-runner] Fix -Werror=shadow issues in test runner 2019-12-12 13:26:30 +02:00
Alexander Shalamov
a9ba572118 [test-runner] Add rebaseline flag 
Rebaseline flag allows to update or create new metric, in cases when
metric check is failed or expected metric is missing.
 2019-12-09 17:53:34 +02:00
Alexander Shalamov
3d0001642b [test-runner] Simplify update option and remove obsolete ifdefs 2019-12-09 17:53:34 +02:00
Mikhail Pozdnyakov
75f8530ed1 [test runner] Update test commands for Layer::setProperty() 2019-12-03 14:20:17 +02:00
Alexander Shalamov
0c348a8acf [test-runner] Log all 'probeFileSize' failures 
If there are multiple file size probes in a test file, it is
better to report all failures instead of first failed probe.
 2019-12-02 12:07:37 +02:00
Thiago Marcos P. Santos
8c9b038af3 [render-test] Add support for measuring compressed file size 
Useful because for platform such as Android, we want to measure
the size of the library inside the APK, which is usually compressed.
 2019-11-28 19:18:17 +02:00
Mikhail Pozdnyakov
2b6a0e48ee [test runner] Enable test results update from cmd line 
Added the following command line argument:
```
-u[update], --update=[update]     Test results update mode.
Supported values are: "default", "platform", "metrics"
```
 2019-11-27 18:19:10 +02:00
Alexander Shalamov
2f8501043c [test-runner] Move probe related command line args to manifest 
- Move probe related command line arguments to manifest, example:

  "probes": ["probeGFX", "probeNetwork", "probeMemory"],
  "metric_path": "metrics/linux"

- Use manifest file name as a postfix for a result page
- Move injected probes 'begin' section before map object creation
- Generalize artifact storing shell script
 2019-11-27 16:43:33 +02:00
zmiao
11321497da [render-test] Add metric_paths into Manifest (#15973) 
* [render-test]Add expected metrics path in manifest file

* seperate metrics.json and expected.png

* fix expected path parsing

* keep expectation path if update is enabled
 2019-11-27 11:08:55 +02:00
Alexander Shalamov
17a5441768 [test-runner] Add render test runner options for injecting probes 
This allows injection of memory, gfx and network probes before and
after operations defined in render test are run.
 2019-11-22 15:29:25 +02:00
zmiao
1b58e87f15 [render-test] Wrap test data inside RenderTestRunner App + Add a new test app (#15887) 
* [render-test] Wrap test resources inside app

* [render-test] Add test app

* fix test app failure

* [render-test]add callback + add javaObjectWrapper
 2019-11-19 20:45:30 +02:00
Dane Springmeyer
c1b2e8c9a0 fix -Wfor-loop-analysis and -Wreorder warnings (#15901) 2019-11-12 06:48:37 -08:00
Mikko Pulkki
a7a7e8cbe2 [render-test] Implement gfx probe for tracking gpu resources 2019-10-30 14:32:27 +02:00
zmiao
c8576e089f [render-test] Add manifest parser for render-test-runner (#15861) 
* [render-test] Add manifest parser for render-test-runner

* [render-test] Refactory manifest parser

* [render-test] Parse full manifest file through CLI

* [render-test] Add linux probe manifest
 2019-10-29 20:59:29 +02:00
zmiao
2385f4cd86 [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832) 
* [render-test] Add configurable path via CLI arguments

* [render-test] Change ignore path config
 2019-10-23 12:04:23 +03:00
Mikko Pulkki
0ca96fd8a4 [render-test] Implement fps benchmarking tests (#15803) 2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
bb0e5ffb2c [test runner] Improve error messaging for memory metrics tests 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b03982730e [test runner] Command line option for the tests expectations path 
-e[expectationsPath], --expectationsPath=[expectationsPath]

Test expectations path.
 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
8bdd8ec670 [test runner] Disable memory metrics checks on sanitize builds 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b0976feca2 [test runner] Tests for memory size metrics 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
9adc78134c [test runner] Threshold for memory metrics 2019-10-21 16:10:45 +03:00
Juha Alanen
b53093b522 [render-test] Add support for collecting network metrics 2019-10-16 14:14:46 +03:00
Thiago Marcos P. Santos
8b3a222c81 [render-test] Add tolerance to file-size tests 2019-10-14 21:15:21 +03:00
Thiago Marcos P. Santos
7f5c630613 [render-test] Fix UPDATE_METRICS=1 changing the path of file size tests 
Should use the exact same path as described on style.json
 2019-10-11 18:29:52 +03:00
Thiago Marcos P. Santos
2e002746eb [render-test] Make clang-format happy 2019-10-10 19:54:51 +03:00
Thiago Marcos P. Santos
a9f06f3b52 [render-test] Add instruction for verifying file size 
For a given absolute or relative path, measure the size of the file.

This is useful for measuring if the cache has increased as expected
after moving a camera or decreased after cleaning up.

In a more hackish manner, could be used for collecting binary size
statistics of shared libraries.
 2019-10-10 19:54:51 +03:00
Mikhail Pozdnyakov
b4e0224a57 [test runner] Fix finding of expected images paths 
Before this change, the found paths to the expected images
erroneously included the path to the `metrics.json` file
(if this file was present) leading to raising of an
unhandled exception.
 2019-10-09 14:35:08 +03:00
Juha Alanen
4eaaa9046e [tests] Share common code between test runners 2019-10-08 15:33:30 +03:00
Juha Alanen
13801f1b80 [render-test] Add support for query tests 2019-10-07 10:58:46 +03:00
Juha Alanen
18a426d748 [render-test] Support feature-state tests where featureID is a number 2019-10-07 10:58:46 +03:00
Juha Alanen
f58a25932a [render-test] Add support for setPitch operation 2019-10-07 10:58:46 +03:00
Juha Alanen
6b13c42314 [build] Fix clang format and tidy checks 2019-09-18 14:29:15 +03:00