#include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include namespace mbgl { Source::Source() {} Source::~Source() = default; bool Source::isLoaded() const { if (!loaded) return false; for (const auto& tile : tiles) { if (tile.second->data->getState() != TileData::State::parsed) { return false; } } return true; } bool Source::isLoading() const { return !loaded && req.operator bool(); } // Note: This is a separate function that must be called exactly once after creation // The reason this isn't part of the constructor is that calling shared_from_this() in // the constructor fails. void Source::load() { if (info.url.empty()) { loaded = true; return; } if (req) return; // URL may either be a TileJSON file, or a GeoJSON file. FileSource* fs = util::ThreadContext::getFileSource(); req = fs->request({ Resource::Kind::Source, info.url }, [this](Response res) { if (res.stale) { // Only handle fresh responses. return; } req = nullptr; if (res.error) { observer->onSourceError(*this, std::make_exception_ptr(std::runtime_error(res.error->message))); return; } rapidjson::GenericDocument, rapidjson::CrtAllocator> d; d.Parse<0>(res.data->c_str()); if (d.HasParseError()) { std::stringstream message; message << d.GetErrorOffset() << " - " << rapidjson::GetParseError_En(d.GetParseError()); observer->onSourceError(*this, std::make_exception_ptr(std::runtime_error(message.str()))); return; } if (info.type == SourceType::Vector || info.type == SourceType::Raster) { info.parseTileJSONProperties(d); } else if (info.type == SourceType::GeoJSON) { info.parseGeoJSON(d); } loaded = true; observer->onSourceLoaded(*this); }); } void Source::updateMatrices(const mat4 &projMatrix, const TransformState &transform) { for (const auto& pair : tiles) { Tile &tile = *pair.second; transform.matrixFor(tile.matrix, tile.id, std::min(static_cast(info.max_zoom), tile.id.z)); matrix::multiply(tile.matrix, projMatrix, tile.matrix); } } void Source::drawClippingMasks(Painter &painter) { for (const auto& pair : tiles) { Tile &tile = *pair.second; MBGL_DEBUG_GROUP(std::string { "mask: " } + std::string(tile.id)); painter.drawClippingMask(tile.matrix, tile.clip); } } void Source::finishRender(Painter &painter) { for (const auto& pair : tiles) { Tile &tile = *pair.second; painter.renderTileDebug(tile); } } std::forward_list Source::getLoadedTiles() const { std::forward_list ptrs; auto it = ptrs.before_begin(); for (const auto& pair : tiles) { if (pair.second->data->isReady()) { it = ptrs.insert_after(it, pair.second.get()); } } return ptrs; } const std::vector& Source::getTiles() const { return tilePtrs; } TileData::State Source::hasTile(const TileID& id) { auto it = tiles.find(id); if (it != tiles.end()) { Tile& tile = *it->second; if (tile.id == id && tile.data) { return tile.data->getState(); } } return TileData::State::invalid; } bool Source::handlePartialTile(const TileID& id, Worker&) { const TileID normalized_id = id.normalized(); auto it = tileDataMap.find(normalized_id); if (it == tileDataMap.end()) { return true; } auto tileData = it->second.lock(); if (!tileData) { return true; } return tileData->parsePending([this, id]() { observer->onTileLoaded(*this, id, false); }); } TileData::State Source::addTile(const TileID& id, const StyleUpdateParameters& parameters) { const TileData::State state = hasTile(id); if (state != TileData::State::invalid) { return state; } auto newTile = std::make_unique(id); // We couldn't find the tile in the list. Create a new one. // Try to find the associated TileData object. const TileID normalized_id = id.normalized(); auto it = tileDataMap.find(normalized_id); if (it != tileDataMap.end()) { // Create a shared_ptr handle. Note that this might be empty! newTile->data = it->second.lock(); } if (newTile->data && newTile->data->getState() == TileData::State::obsolete) { // Do not consider the tile if it's already obsolete. newTile->data.reset(); } if (!newTile->data) { newTile->data = cache.get(normalized_id.to_uint64()); } if (!newTile->data) { auto callback = std::bind(&Source::tileLoadingCompleteCallback, this, normalized_id, parameters.transformState, parameters.debugOptions & MapDebugOptions::Collision); // If we don't find working tile data, we're just going to load it. if (info.type == SourceType::Raster) { auto tileData = std::make_shared(normalized_id, parameters.texturePool, info, parameters.worker); tileData->request(parameters.pixelRatio, callback); newTile->data = tileData; } else { std::unique_ptr monitor; if (info.type == SourceType::Vector) { monitor = std::make_unique(info, normalized_id, parameters.pixelRatio); } else if (info.type == SourceType::Annotations) { monitor = std::make_unique(normalized_id, parameters.data); } else if (info.type == SourceType::GeoJSON) { monitor = std::make_unique(info.geojsonvt.get(), normalized_id); } else { Log::Warning(Event::Style, "Source type '%s' is not implemented", SourceTypeClass(info.type).c_str()); return TileData::State::invalid; } newTile->data = std::make_shared(normalized_id, std::move(monitor), info.source_id, parameters.style, callback); } tileDataMap.emplace(newTile->data->id, newTile->data); } const auto newState = newTile->data->getState(); tiles.emplace(id, std::move(newTile)); return newState; } double Source::getZoom(const TransformState& state) const { double offset = std::log(util::tileSize / info.tile_size) / std::log(2); return state.getZoom() + offset; } int32_t Source::coveringZoomLevel(const TransformState& state) const { double zoom = getZoom(state); if (info.type == SourceType::Raster || info.type == SourceType::Video) { zoom = ::round(zoom); } else { zoom = std::floor(zoom); } return zoom; } std::forward_list Source::coveringTiles(const TransformState& state) const { int32_t z = coveringZoomLevel(state); auto actualZ = z; const bool reparseOverscaled = info.type == SourceType::Vector || info.type == SourceType::Annotations; if (z < info.min_zoom) return {{}}; if (z > info.max_zoom) z = info.max_zoom; // Map four viewport corners to pixel coordinates box points = state.cornersToBox(z); const TileCoordinate center = state.pointToCoordinate({ state.getWidth() / 2.0f, state.getHeight()/ 2.0f }).zoomTo(z); std::forward_list covering_tiles = tileCover(z, points, reparseOverscaled ? actualZ : z); covering_tiles.sort([¢er](const TileID& a, const TileID& b) { // Sorts by distance from the box center return std::fabs(a.x - center.column) + std::fabs(a.y - center.row) < std::fabs(b.x - center.column) + std::fabs(b.y - center.row); }); return covering_tiles; } /** * Recursively find children of the given tile that are already loaded. * * @param id The tile ID that we should find children for. * @param maxCoveringZoom The maximum zoom level of children to look for. * @param retain An object that we add the found tiles to. * * @return boolean Whether the children found completely cover the tile. */ bool Source::findLoadedChildren(const TileID& id, int32_t maxCoveringZoom, std::forward_list& retain) { bool complete = true; int32_t z = id.z; auto ids = id.children(info.max_zoom); for (const auto& child_id : ids) { const TileData::State state = hasTile(child_id); if (TileData::isReadyState(state)) { retain.emplace_front(child_id); } if (state != TileData::State::parsed) { complete = false; if (z < maxCoveringZoom) { // Go further down the hierarchy to find more unloaded children. findLoadedChildren(child_id, maxCoveringZoom, retain); } } } return complete; } /** * Find a loaded parent of the given tile. * * @param id The tile ID that we should find children for. * @param minCoveringZoom The minimum zoom level of parents to look for. * @param retain An object that we add the found tiles to. * * @return boolean Whether a parent was found. */ void Source::findLoadedParent(const TileID& id, int32_t minCoveringZoom, std::forward_list& retain) { for (int32_t z = id.z - 1; z >= minCoveringZoom; --z) { const TileID parent_id = id.parent(z, info.max_zoom); const TileData::State state = hasTile(parent_id); if (TileData::isReadyState(state)) { retain.emplace_front(parent_id); if (state == TileData::State::parsed) { return; } } } } bool Source::update(const StyleUpdateParameters& parameters) { bool allTilesUpdated = true; if (!loaded || parameters.animationTime <= updated) { return allTilesUpdated; } double zoom = getZoom(parameters.transformState); if (info.type == SourceType::Raster || info.type == SourceType::Video) { zoom = ::round(zoom); } else { zoom = std::floor(zoom); } std::forward_list required = coveringTiles(parameters.transformState); // Determine the overzooming/underzooming amounts. int32_t minCoveringZoom = util::clamp(zoom - 10, info.min_zoom, info.max_zoom); int32_t maxCoveringZoom = util::clamp(zoom + 1, info.min_zoom, info.max_zoom); // Retain is a list of tiles that we shouldn't delete, even if they are not // the most ideal tile for the current viewport. This may include tiles like // parent or child tiles that are *already* loaded. std::forward_list retain(required); // Add existing child/parent tiles if the actual tile is not yet loaded for (const auto& id : required) { TileData::State state = hasTile(id); switch (state) { case TileData::State::partial: if (parameters.shouldReparsePartialTiles) { if (!handlePartialTile(id, parameters.worker)) { allTilesUpdated = false; } } break; case TileData::State::invalid: state = addTile(id, parameters); break; default: break; } if (!TileData::isReadyState(state)) { // The tile we require is not yet loaded. Try to find a parent or // child tile that we already have. // First, try to find existing child tiles that completely cover the // missing tile. bool complete = findLoadedChildren(id, maxCoveringZoom, retain); // Then, if there are no complete child tiles, try to find existing // parent tiles that completely cover the missing tile. if (!complete) { findLoadedParent(id, minCoveringZoom, retain); } } } if (info.type != SourceType::Raster && cache.getSize() == 0) { size_t conservativeCacheSize = ((float)parameters.transformState.getWidth() / util::tileSize) * ((float)parameters.transformState.getHeight() / util::tileSize) * (parameters.transformState.getMaxZoom() - parameters.transformState.getMinZoom() + 1) * 0.5; cache.setSize(conservativeCacheSize); } auto& tileCache = cache; auto& type = info.type; // Remove tiles that we definitely don't need, i.e. tiles that are not on // the required list. std::set retain_data; util::erase_if(tiles, [&retain, &retain_data, &tileCache, &type](std::pair> &pair) { Tile &tile = *pair.second; bool obsolete = std::find(retain.begin(), retain.end(), tile.id) == retain.end(); if (!obsolete) { retain_data.insert(tile.data->id); } else if (type != SourceType::Raster && tile.data->getState() == TileData::State::parsed) { // Partially parsed tiles are never added to the cache because otherwise // they never get updated if the go out from the viewport and the pending // resources arrive. tileCache.add(tile.id.normalized().to_uint64(), tile.data); } return obsolete; }); // Remove all the expired pointers from the set. util::erase_if(tileDataMap, [&retain_data, &tileCache](std::pair> &pair) { const util::ptr tile = pair.second.lock(); if (!tile) { return true; } bool obsolete = retain_data.find(tile->id) == retain_data.end(); if (obsolete) { if (!tileCache.has(tile->id.normalized().to_uint64())) { tile->cancel(); } return true; } else { return false; } }); updateTilePtrs(); for (auto& tilePtr : tilePtrs) { tilePtr->data->redoPlacement( { parameters.transformState.getAngle(), parameters.transformState.getPitch(), parameters.debugOptions & MapDebugOptions::Collision }); } updated = parameters.animationTime; return allTilesUpdated; } void Source::updateTilePtrs() { tilePtrs.clear(); for (const auto& pair : tiles) { tilePtrs.push_back(pair.second.get()); } } void Source::setCacheSize(size_t size) { cache.setSize(size); } void Source::onLowMemory() { cache.clear(); } void Source::setObserver(Observer* observer_) { observer = observer_; } void Source::tileLoadingCompleteCallback(const TileID& id, const TransformState& transformState, bool collisionDebug) { auto it = tileDataMap.find(id); if (it == tileDataMap.end()) { return; } util::ptr tileData = it->second.lock(); if (!tileData) { return; } if (tileData->getState() == TileData::State::obsolete && tileData->getError()) { observer->onTileError(*this, id, tileData->getError()); return; } tileData->redoPlacement({ transformState.getAngle(), transformState.getPitch(), collisionDebug }); observer->onTileLoaded(*this, id, true); } void Source::dumpDebugLogs() const { Log::Info(Event::General, "Source::id: %s", info.source_id.c_str()); Log::Info(Event::General, "Source::loaded: %d", loaded); for (const auto& tile : tiles) { tile.second->data->dumpDebugLogs(); } } } // namespace mbgl