Commit Graph

65 Commits

Author SHA1 Message Date
Juha Alanen
f4385a11d2 [android] Use stub HTTP file source for test runners 2020-01-10 17:19:30 +02:00
Juha Alanen
0b3942572e [test] Run unit tests as NativeActivity application on Android 2020-01-10 17:19:30 +02:00
Jordan Kiley
60a4b3eda3 [ios] Add native_apple_interface to ios.cmake (#16103)
* [ios] Add native_apple_interface to ios.cmake

* [ios] Use Xcode for next-macos-xcode11-release
2020-01-09 12:41:14 -08:00
Thiago Marcos P. Santos
d148908cf1 [render-test] Make the manifest mandatory
At the moment we have an invalid path as default.
2020-01-08 14:58:05 +02:00
Thiago Marcos P. Santos
f14985f783 [tools] Added cache tool
A tool for adding resources to a cache database, important for
adding fixtures to our render test cache database.
2020-01-08 13:07:12 +02:00
Juha Alanen
5e7e2d23e7 [android] Share common code between test runners 2020-01-03 11:52:50 +02:00
Juha Alanen
ee66940409 [benchmark] Run benchmark as NativeActivity application on Android 2020-01-03 11:52:50 +02:00
Thiago Marcos P. Santos
6d876f1d6b [build] Make the configuration simpler
Moved the Android flags to the compilation options interface
and removed build options we are not using and go back to CMake
defaults.
2019-12-21 00:38:41 +01:00
Thiago Marcos P. Santos
8869d09b25 [build] Collect and publish new baselines
Also fail the bot in case there are new baselines.
2019-12-16 22:52:01 +02:00
Thiago Marcos P. Santos
970cabe0eb [build] Reorganize the render tests
Move everything that might collect metrics to the metrics/ directory,
the only test manifests inside the render-test/ directory are the
unit tests of the probes.
2019-12-16 22:52:01 +02:00
m-stephen
f9b7284276 [ios, macos]Remove iOS/macOS codes from native codes (#16031)
* add source/header

* add ios files

* add configs

* modify name

* http_file_source

* add interface delegate when map init

* fix name

* fix delegate name

* support mac os

* add mac os support

* make optional delegate when mac os

* mac/ios difference

* add ios change log

* cancel iOS/mac OS judgement

* cancel iOS/mac OS judgement

* cancel judgement in .m

* update

* update

* update http_file_source

* update ios

* update mac os

* add mac os file

* add mac os file to `.cmake`

* change names

* add log & fix format

* reset changelog commit

* update changelog

* rename iOS network manager

* Add a test configuration(same as default configuration) when mac os run tests

* re-add account type into `http_file_source`

* refactor
2019-12-14 13:38:46 +08:00
Thiago Marcos P. Santos
8b9a4571a4 [build] Make the build fail when shadowing variables 2019-12-12 17:44:11 +02:00
Thiago Marcos P. Santos
3679315633 [build] Better isolate compiler flags
Previously we had UndefinedBehavior mixed with other sanitizers, in
special implicit conversions and overflows.

Also, run the sanitizers in Release configuration, so they will run
faster. -O1 is just needed for perfectly nice stack traces.

Also, moving the flags to an interface will prevent them to leak
to our external dependencies.
2019-12-11 17:12:25 +02:00
zmiao
f848f07ad9 [metrics] Run Android RenderTestRunner bot in rebaseline mode (#16036) 2019-12-11 11:50:27 +02:00
Alexander Shalamov
7eee124677 [metrics] Create gcc8-release metrics configuration 2019-12-09 17:53:34 +02:00
Alexander Shalamov
89665326c2 [core] Add unit test for calculateTileDistances 2019-12-09 17:26:13 +02:00
Alexander Shalamov
d36958997b [core] Add unit test for getAnchors and remove unused field 2019-12-09 17:26:13 +02:00
Thiago Marcos P. Santos
71054c8b60 [glfw] Add static render test creator
Press F1 to create a render test for the current view.

The test will be created at the base folder (current if nothing is
provided) + /NNNN (the next free entry).
2019-12-09 16:09:16 +02:00
Thiago Marcos P. Santos
6d425f8a7e [build] Detect unsigned-integer-overflow and implicit-conversion
This is a defined behavior but often unintentional.
2019-12-07 16:32:39 +02:00
zmiao
e619552a5d [test-runner] Make Android RenderTestRunner bot fail when test cases are not fully passed (#15994)
* [test-runner] Fix failed tests, generate android specific expectations

* [test-runner] Check render test runner testing result

* [test-runner] Add error case to android ignore list

*  [test-runner] Update metrics

* [test-runner] Move Android render tests with big diff(>0.006) to ignore list
2019-12-04 18:10:58 +02:00
Alexander Shalamov
41324842b2 [test-runner] Allow to define filter inside manifest file
Command line option is still available and allows to override filter
that is defined in a manifest file.
2019-12-03 16:26:22 +02:00
Alexander Shalamov
72e9388a61 [core] Add unit tests for Formatted class 2019-12-02 17:11:49 +02:00
Alexander Shalamov
26bf566f53 [core] Use new 'SymbolTextAndIcon' program to draw icons in text 2019-12-02 17:11:49 +02:00
Mikhail Pozdnyakov
7bacf5696c [core] Introduce Pass<> class and use it for Scheduler
Thus we enforce client to retain the returned `Scheduler` objects.
2019-12-02 14:12:18 +02:00
zmiao
b2693f9d53 [test-runner] Add android RenderTestRunner baseline metrics (#15979)
* [test-runner] Enable probe-testing android render test runner

* [test-runner] Add pixel4 baseline metrics

* Add git ignored metrics

* Make renderTestrunner run two times with different manifest config
2019-12-02 13:29:13 +02:00
Juha Alanen
2e93f1e982 [test-runner] Run render tests with metrics on linux 2019-11-29 15:08:34 +02:00
Thiago Marcos P. Santos
af0d46c367 [android] Use icf=all
Chromium is using it for a while on ARM.

https://codereview.chromium.org/1153143004/patch/20001/30002
2019-11-29 13:42:18 +02:00
Thiago Marcos P. Santos
efb567f1f5 [android] Use -Oz to reduce binary size 2019-11-28 12:34:22 +02:00
Thiago Marcos P. Santos
cf160a24d0 [build] Install some of our targets
This will make it easier to measure the binary size because we can
strip the binaries from symbols in a portable way.
2019-11-27 18:32:58 +02:00
Łukasz Paczos
f10097640a [android] do not fail on tautological-constant-compare error 2019-11-27 14:41:52 +01:00
Sudarsana Babu Nagineni
0f3eede6a6 [build] Add an option to include platform specific implementation
Add an option to include platform specific implementation sources
to mbgl-core.
2019-11-26 16:23:36 +02:00
Thiago Marcos P. Santos
656bc9c8bb [build] Run Valgrind instead of Memory Sanitizer
Memory Sanitizer requires all the dependencies, including
libstdc++ to be compiled with Memory Sanitizer, otherwise
we will get tons of false positives.
2019-11-20 13:56:48 +02:00
zmiao
1b58e87f15 [render-test] Wrap test data inside RenderTestRunner App + Add a new test app (#15887)
* [render-test] Wrap test resources inside app

* [render-test] Add test app

* fix test app failure

* [render-test]add callback + add javaObjectWrapper
2019-11-19 20:45:30 +02:00
Mikhail Pozdnyakov
9f24115d13 [core] Identation and build fixes 2019-11-19 15:03:28 +02:00
Thiago Marcos P. Santos
f73467786d [build] Enable more warnings on the next build
Make compilation more pedantic.
2019-11-15 23:38:47 +02:00
Alexander Shalamov
c6f3cc8b60 [core] Implement image expression (#15877)
* [core] Bump gl-js version
* [core] Implement image expression
* [core] Use new image expression
* [core] Coerce image expression to / from string
* [core] Serialize evaluated image
* [core] Pass available images to layout
* [core] Pass images to evaluation context
* [core] Set available flag value based on image availability
* [core] Allow image coercion to boolean to indicate image availability
* [core] Coalesce image expression
* [core] Add image expression to next build system
* [core] Align serialization format and evaluated type with gl-js
* [core] Add images to expression evaluation method
* [core] Add support for Image expression to expression test runner
* [core] Unskip image expression tests
* [core] Update unit tests
* [core] Use image expression in annotation manager
* [core] Add string to ImageExpression conversion
* [core] Add image expression to expression dsl
* [core] Convert tokens for implicitly created Image literal
* [core] Fix clang format
* [core] Split generated style code lines that are over 120 characters
* [core] Add unit test for image expression equality
* [core] Add image property expression evaluation unit test
* [core] Unskip image expression render test
* [core] Skip 'in' expression tests
* [core] Ignore fill-pattern/update-feature-state render test
* [core] Rename Image::serialize to Image::toValue
2019-11-11 18:20:01 +02:00
Mikko Pulkki
4176b28a77 [Linux] Remove CA certificate bundle 2019-11-11 10:11:49 +02:00
Mikhail Pozdnyakov
55e18a6f81 [core] Use expected.hpp from mapbox-base 2019-11-08 11:27:30 +02:00
Mikko Pulkki
fb062bb23e [render-test] Add resource usage tracking to gfx context 2019-10-30 14:32:27 +02:00
zmiao
c8576e089f [render-test] Add manifest parser for render-test-runner (#15861)
* [render-test] Add manifest parser for render-test-runner

* [render-test] Refactory manifest parser

* [render-test] Parse full manifest file through CLI

* [render-test] Add linux probe manifest
2019-10-29 20:59:29 +02:00
zmiao
2385f4cd86 [render-test] Add configurable rootPath, ignorePath via CLI arguments (#15832)
* [render-test] Add configurable path via CLI arguments

* [render-test] Change ignore path config
2019-10-23 12:04:23 +03:00
Alexander Shalamov
b1d048217a [node] Exclude node abi 79 (13.x) from build 2019-10-22 23:46:55 +03:00
Julian Rex
a4c2cdb507 [ios] Set xcode properties for cmake. (#15842)
* [ios] Set xcode properties for cmake.

* Fix Sanitize typo
2019-10-22 14:45:55 -04:00
zmiao
068befa9df [test-runner] Run render test runner as a NativeActivity app on android device (#15827)
* [test-runner]Add android render-test-runner NativeActivity app

* [test-runner] Fix cmake for CI build failure

* [test-runner] Update folder location, change app configureation

* [test-runner] Add running instruction
2019-10-22 16:32:21 +03:00
Mikko Pulkki
0ca96fd8a4 [render-test] Implement fps benchmarking tests (#15803) 2019-10-22 12:13:55 +03:00
Mikhail Pozdnyakov
61d1018087 [test runner] Memory metrics expectations for MAC 2019-10-21 16:10:45 +03:00
Mikhail Pozdnyakov
b03982730e [test runner] Command line option for the tests expectations path
-e[expectationsPath], --expectationsPath=[expectationsPath]

Test expectations path.
2019-10-21 16:10:45 +03:00
Bruno de Oliveira Abinader
f41f274ca1 [build] Only add mapbox-base if target is not set 2019-10-20 00:01:28 +03:00
Fabian Guerra Soto
bbeb86577e [ios] Add ARC config to the new build system. (#15833) 2019-10-18 13:59:04 -07:00
Juha Alanen
b53093b522 [render-test] Add support for collecting network metrics 2019-10-16 14:14:46 +03:00