| Commit message (Collapse) | Author | Age | Files |
|---|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
|
| |
The extent is expressed in config['SRS'] in traditional GIS order
(easting/northing ordered: minX, minY, maxX, maxY), but the destination
layers might be pre-existing and use other SRS:es or mapping strategy.
|
| | |
|
| |
|
|
|
|
| |
The configured extent is always expressed in the destination SRS, so it
needs to be transformed into the source SRS. Like apps/ogr2ogr_lib.cpp,
we segmentize it to make sure it is sufficiently densified.
|
| |
|
|
| |
(Commented out in config.yml for now since Bookworm has only v3.6.)
|
| | |
|
| |
|
|
| |
And getFieldSubTypeCode() to parseSubFieldType().
|
| |
|
|
|
|
| |
We're TRUNCATE'ing the output layers (tables) at every run and aren't
reseting the sequences so they would soon overflow 32-bits FIDs
("sks:UtfordAvverk" has almost 300k features within the extent…).
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
There is still a few things to do (such as reprojection and geometry
changes) but it's mostly working.
We roll out our own ogr2ogr/GDALVectorTranslate()-like function version
because GDALVectorTranslate() insists in calling StartTransaction()
https://github.com/OSGeo/gdal/issues/3403 while we want a single
transaction for the entire desination layer, including truncation,
source imports, and metadata changes.
Surprisingly our version is not much slower than the C++ one. Importing
the 157446 (of 667034) features from sksUtfordAvverk-2000-2015.shp takes
14.3s while
ogr2ogr -f PostgreSQL \
-doo ACTIVE_SCHEMA=postgis \
--config PG_USE_COPY YES \
--config OGR_TRUNCATE YES \
-append \
-fieldmap "0,-1,-1,-1,-1,1,2,3,4,5,6,7,8,9,10,11,12,13" \
-nlt MULTIPOLYGON -nlt PROMOTE_TO_MULTI \
-gt unlimited \
-spat 110720 6927136 1159296 7975712 \
-nln "sks:UtfordAvverk" \
PG:"dbname='webmap' user='webmap_import'" \
/tmp/x/sksUtfordAvverk-2000-2015.shp \
sksUtfordAvverk-2000-2015
takes 14s.
Merely opening /tmp/x/sksUtfordAvverk-2000-2015.shp and looping through
its (extent-filtered) features results in a runtime of 4.3s.
|
| |
|
|
|
| |
We'll need that for layer creation (description, fields, creation
options, etc.).
|
| |
|
|
| |
The configured extent is always relative to the configured SRS.
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
| |
We always exit after a single WMS request if the layer has no SVG paths.
Don't print the request count in that case.
|
| | |
|
| | |
|
| | |
|
| |
|
|
| |
Instead of sha1_hex().
|
| |
|
|
|
|
|
| |
passed only once.
This makes --debug less verbose by default and is useful for modules
that do lots of HTTP connections such as WMS probing.
|
| |
|
|
| |
(Incl. failure.)
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Unfortunately SGU/Bergsstaten doesn't offer layer files to download, but
it has an online webmap (WMS) at https://apps.sgu.se/kartvisare/kartvisare-mineralrattigheter.html
so we add a dedicated module to probe and fetch features from it.
Double checked that the resulting combination of GeoJSON files does not
result in data loss compared to the previous (private) script:
sort_features() { jq -S '.features |= sort_by(.properties.Name, .properties.Layer, .properties.Area)' }
diff -u --color=auto \
<(ogr2ogr -f GeoJSON -lco COORDINATE_PRECISION=2 /vsistdout/ $dir/Mineralrättigheter.gpkg \
SE.GOV.SGU.MRR.BEARBETNINGSKONCESSIONER_APPLIED_VY | jq '.name = "MRR:" + .name' | sort_features) \
<(ogr2ogr -f GeoJSON -lco COORDINATE_PRECISION=2 -nlt MULTIPOLYGON -nlt PROMOTE_TO_MULTI \
/vsistdout/ mrr/bearbetningskoncessioner_applied.geojson | sort_features)
(and similar for other layers).
|
| | |
|
| | |
|
| |
|
|
|
| |
We most likely only support POSIX systems, but best to hard code the
dependency.
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
| |
dest needs to be stringified before the membership check.
|
| | |
|
| |
|
|
| |
This can be turned off with --no-exit-code.
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
This costs an extra file descriptor when --cachedir is unsed, but
os.link(f'/proc/self/fd/{fp.fileno()}', newpath,
dst_dir_fd=None, follow_symlinks=True)
calls link("/proc/self/fd/…", newpath) rather than
linkat(AT_FDCWD, "/proc/self/fd/…", AT_FDCWD, newpath, AT_SYMLINK_FOLLOW)
and the former fails with EXDEV (Invalid cross-device link).
|
| |
|
|
|
| |
Instead of using a dedicated executable. There is too much code
duplicate otherwise.
|
| |
|
|
|
| |
Don't use a lockdir by default, and always use lockfiles of the form
‘sha1_hex(path).lck’ if --lockdir is set.
|
| | |
|
| | |
|
| | |
|
| |
|
|
| |
Spell out the project case as per https://www.klimatanalysnorr.se
|
| | |
|
| | |
|
| |
|
