aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFiles
* typofixGuilhem Moulin13 hours1
|
* Improve debug messages for ExecuteSQL() calls.Guilhem Moulin13 hours1
|
* Use PostgreSQL schemas to partition layers.Guilhem Moulin13 hours7
| | | | | | | | Rather than putting everything in the 'postgis' schema using ':' as hierarchy separator. When the destination dataset is not PostgreSQL, the layers names are prefixed using '$SCHEMA.' instead of '$SCHEMA:'
* ExecuteSQL: Use the context manager instead of calling ReleaseResultSet() ↵Guilhem Moulin20 hours2
| | | | | | | manually. This assumes gdal ≥3.7, see https://gdal.org/en/stable/api/python/raster_api.html#osgeo.gdal.Dataset.ExecuteSQL .
* SvK: Update filename.Guilhem Moulin20 hours1
|
* schema.sql: DROP some NOT NULL and UNIQUE contraints.Guilhem Moulin22 hours2
| | | | To match the layer definition found upstream.
* Set User-Agent value from Tor Browser 15.0.Guilhem Moulin2025-10-311
| | | | (Based on Mozilla Firefox 140.4.0esr.)
* webmap-import: Fail when the output layer doesn't have any geom field.Guilhem Moulin2025-08-141
|
* webmap-import: Warn when the output geometry column is nullable.Guilhem Moulin2025-08-142
|
* Add a NOT NULL contraint on geometry columns when creating the output layer.Guilhem Moulin2025-08-143
| | | | | | | | | | When the output driver supports altering GeomFieldDefn's nullable flag after the fact. PostgreSQL supports that. GPKG doesn't, but one can use GEOMETRY_NULLABLE=NO in layer creation options instead. See https://gdal.org/en/stable/development/rfc/rfc53_ogr_notnull_default.html This commit partially reverts 2c3ee79cb434fc4cf315ee3a6a526156053d76c4.
* Use .UpdateFeature() from gdal ≥3.7.Guilhem Moulin2025-08-142
|
* Create destination layer with CreateLayerFromGeomFieldDefn().Guilhem Moulin2025-08-141
| | | | | | Rather than CreateLayer(). Unfortunately not very helpful since .SetNullable() appears to be a no-op; it doesn't set a NOT NULL constraint on the geometry column.
* Use .GetDataSet() from gdal ≥3.9 instead of passing the ds around.Guilhem Moulin2025-08-143
|
* Drop support for gdal <3.9.Guilhem Moulin2025-08-143
|
* CGI: Use raw cursors.Guilhem Moulin2025-08-141
|
* CGI: Use PostgreSQL 17's json_serialize() function.Guilhem Moulin2025-08-141
| | | | To avoid JSON-encoding on the Python side.
* Adjust SQL schema to PG 17 from Debian Trixie.Guilhem Moulin2025-08-121
| | | | | Recent GDAL version can set comments on columns, which is now reflected on the schema.
* export_raster: Fix compatibility with older GDAL versions.Guilhem Moulin2025-07-231
| | | | | Older GDAL version need the destination path to be a string not a path-like argument.
* Fix logic error.Guilhem Moulin2025-07-231
|
* MVT: Set directory mtime to most recent source mtime.Guilhem Moulin2025-07-231
| | | | For consistency with raster handling.
* Add logic to export raster files (as COG).Guilhem Moulin2025-07-237
| | | | | | | | | | Raster data is not stored in the PostGIS database. Instead, the mtime of the target directory is used to determine whether the COG is up to date. Add a new flag --metadata-compress for JSON metadata compression (which also applies to MVT metadata), and --rasterdir for the target raster directory.
* Expose county and municipality boundaries to MVT.Guilhem Moulin2025-07-221
| | | | Add rename `administrativindelning` layer group to `adm`.
* SKS: Don't wait for 60h before checking whether sksUtfordAvverk_gpkg.zip has ↵Guilhem Moulin2025-06-141
| | | | been updated upstream.
* VBK: Fix schema for source layer again.Guilhem Moulin2025-06-141
| | | | | This reverses commit 86f1e635a647e94c33e10e4d230853fd5d84c0bc. It appears that .zip files have a consistent schema now…
* Rename MVT layers station_* to turbine_*.Guilhem Moulin2025-06-131
|
* MVT export: Rename field "age" to "ts".Guilhem Moulin2025-06-112
| | | | | | | “Age” is misleading as it suggests a value that increases over time as times stretches away from a fixed epoch. A timestamp (ts) is a more appropriate term for that field (it's rather a “daystamp” but that's a matter of precision).
* Export feature "age" to MVT.Guilhem Moulin2025-06-092
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This allows client-side filtering. The "age" attribute is a signed short (int16) expressing the number of days since 1970-01-01. This covers the range 1880-04-15 to 2059-09-18 which should be more than enough. The source value is a Date or Datetime and depends on the source layer. - For vbk:*, it's the date at which the project was last saved in Vindbrukskollen. - For mrr:*, it's the date at which the application came to Bergsstaten for applications, and decision date for granted permits. - For avverk:*, it's the date at which the application came to Skogsstyrelsen for applications, and the clearcut date (according to Skogsstyrelsen) for completed objects. For other layers, we don't export that attribute. This makes the tiles a bit larger. Before (without the extra attribute): vbk: 1261× tiles, 599kiB uncompressed (avg=487B/t), 389kiB brotli (35%, avg=316B/t) avverk: 3734× tiles 115MiB uncompressed (avg=32kiB/t), 72MiB brotli (37%, avg=20kiB/t) mrr: 1324× 331kiB uncompressed (avg=257kiB/t), 289kiB brotli (13%, avg=223B/t) → total 121631367B uncompressed (avg=19kiB/t), 76692807B brotli (37%, avg=12kiB/t) After (with the extra attribute): vbk: 1261× tiles, 714kiB uncompressed (avg=580B/t), 425kiB brotli (40%, avg=345B/t) avverk: 3734× tiles 127MiB uncompressed (avg=35kiB/t), 78MiB brotli (39%, avg=21kiB/t) mrr: 1324× 323kiB uncompressed (avg=322kiB/t), 342kiB brotli (18%, avg=265B/t) → total 134274796B uncompressed (avg=21kiB/t), 82264731B brotli (39%, avg=13kiB/t) Summary: +12.1MiB uncompressed (+10.4%, avg=+1.95kiB/t) +5.3MiB compressed (+7.3%, avg=+882B/t)
* find_config(): Ignore paths which can't be open due to permission errors.Guilhem Moulin2025-06-091
| | | | | This avoids crashing when `webmap-import` is run as another user on an homedir with restrictive permissions, for instance.
* Drop OBJECTID from layer `lst:pagaende_naturreservatsbildning` as it is not ↵Guilhem Moulin2025-06-092
| | | | a stable attribute.
* Rename cache prefix from ren/ to sametinget/.Guilhem Moulin2025-06-091
|
* Add missing f-string in RuntimeError() argument.Guilhem Moulin2025-06-081
|
* Add comment.Guilhem Moulin2025-06-071
|
* typofixGuilhem Moulin2025-06-071
|
* Add missing layers to schema.sql.Guilhem Moulin2025-06-071
|
* Rename “ren:*” tables to “sametinget:*”.Guilhem Moulin2025-06-072
|
* Rename “ri:*” tables to “nvk:riksintresse_*” and ↵Guilhem Moulin2025-06-072
| | | | “lst:riksintresse_*”.
* Rename “sks” group to “avverk”.Guilhem Moulin2025-06-072
| | | | | And “sks:AvverkAnm” resp. “sks:UtfordAvverk” to “sks:avverk_anmald” resp. “sks:avverk_utford”.
* Rename “nvr” group to “skydd” and drop “nva:” prefix.Guilhem Moulin2025-06-072
| | | | | It's clearer that way, after all Naturvårdsavtal and Återvätningsavtal are not part of Naturvårdsverkets Naturvårdsregistret.
* Add various nature value layers.Guilhem Moulin2025-06-073
| | | | | Including k-skog, but we leave that one alone for now as the script lacks some logic to process raster files.
* typofixGuilhem Moulin2025-06-061
|
* Add missing NOT NULL constraints on two wkb_geometry columns.Guilhem Moulin2025-06-061
|
* VBK: Split offshore wind farms layers when exporting to MVT.Guilhem Moulin2025-06-051
| | | | Inspired from https://vbk.lansstyrelsen.se/ .
* VBK: Improve description.Guilhem Moulin2025-06-041
|
* VBK: Fix schema for source layer LST.vbk_projekteringsomraden and ↵Guilhem Moulin2025-06-041
| | | | | | | | | | | LST.vbk_havsbaserad_vindkraft. It appears these source file are exported daily at 01:53, then again at 07:41 but different content and schema…. We're now targeting the latter. This reverts commit 59a0ebbb824eaa75dcf7b0e39c5b627fb5ace294 and partially reverts commit 2d8f839914feb2b9d31f2682b1c9992dd21c9b16.
* MRR: Drop field export_date.Guilhem Moulin2025-06-042
| | | | | | | All features have the same export date value, so the date is arguably a schema attribute not a feature attribute. Since exports from the mineral register happens daily nowdays the date should never be more than a day off compared with the zip file's mtime.
* VBK: Fix schema for source layer LST.vbk_projekteringsomraden.Guilhem Moulin2025-06-041
|
* VBK: Use the shapefile as source for offshore projects.Guilhem Moulin2025-06-042
| | | | | | | | | | | | | | | | | The file appears to be official and updated as often as the GPKG nowdays. Both have 101 distinct features. And unlike the GPKG the multipolygons are not split, so we add the UNIQUE CONSTRAINT on "OmrID". For some reason there are a lot of duplicates in the GPKG. sqlite> SELECT "ObjectID", COUNT(*) FROM "lst_vbk_havsbaserad_vindkraft" GROUP BY 1 ORDER BY 2; 101|9 1|24 2|24 […] 100|24
* MVT: Generate metadata.json with copyright and timing information.Guilhem Moulin2025-06-045
| | | | So the information can be exposed to the webmap's info dialog.
* webmap-download: Drop obsolete comment.Guilhem Moulin2025-05-271
| | | | We don't want to bump ctimes since they are used in the layer cache.
* CGI: Serve only the feature's properties not the entire feature as GeoJSON.Guilhem Moulin2025-05-271
| | | | | | | | | | | | | | | | | The Web Application doesn't need the original full/non-simplified geometry. After all, OpenLayers has fetched the tiles already and the (visible part of) the geometry is already cached in the target SRS with sensible simplification factors. So there is really no need to transfer megabytes of high-precison data to the client to highlight the feature. This changes means that CGI responses will remain small hence can be buffered. To further speed up things one could store geometry area/perimeter/length as generated columns (along with the list of municipality and county codes) and serve row directly from PostgreSQL (bypassing PostGIS). Also since buffering is now an option the rows don't need be served in the same order as the request, so one could batch queries using ANY[] or IN.
generated by cgit v1.2.3 (git 2.25.1) at 2026-03-06 11:11:16 +0000