aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFiles
...
* webmap-download: Use sha256_hex() for lock file names.Guilhem Moulin2024-06-031
| | | | Instead of sha1_hex().
* webmap-download: Make --debug repeatable and skip HTTP debugging if it's ↵Guilhem Moulin2024-06-031
| | | | | | | passed only once. This makes --debug less verbose by default and is useful for modules that do lots of HTTP connections such as WMS probing.
* webmap-download-mrr.py: Show number of WMS requests on exit.Guilhem Moulin2024-06-031
| | | | (Incl. failure.)
* Add layer definitions for Mineralrättigheter.Guilhem Moulin2024-06-032
| | | | | | | | | | | | | | | | | | Unfortunately SGU/Bergsstaten doesn't offer layer files to download, but it has an online webmap (WMS) at https://apps.sgu.se/kartvisare/kartvisare-mineralrattigheter.html so we add a dedicated module to probe and fetch features from it. Double checked that the resulting combination of GeoJSON files does not result in data loss compared to the previous (private) script: sort_features() { jq -S '.features |= sort_by(.properties.Name, .properties.Layer, .properties.Area)' } diff -u --color=auto \ <(ogr2ogr -f GeoJSON -lco COORDINATE_PRECISION=2 /vsistdout/ $dir/Mineralrättigheter.gpkg \ SE.GOV.SGU.MRR.BEARBETNINGSKONCESSIONER_APPLIED_VY | jq '.name = "MRR:" + .name' | sort_features) \ <(ogr2ogr -f GeoJSON -lco COORDINATE_PRECISION=2 -nlt MULTIPOLYGON -nlt PROMOTE_TO_MULTI \ /vsistdout/ mrr/bearbetningskoncessioner_applied.geojson | sort_features) (and similar for other layers).
* Add GPL-3+ license headers.Guilhem Moulin2024-06-032
|
* webmap-download: Move format_bytes() and format_time() to common.py.Guilhem Moulin2024-06-032
|
* webmap-download: Replace pathlib.as_posix() with str().Guilhem Moulin2024-06-031
| | | | | We most likely only support POSIX systems, but best to hard code the dependency.
* webmap-download: Improve comment.Guilhem Moulin2024-06-031
|
* webmap-download: Refactor download().Guilhem Moulin2024-06-031
|
* Add comment about dir_fd-aware functions.Guilhem Moulin2024-06-031
|
* Add gitignore(5).Guilhem Moulin2024-06-021
|
* webmap-download: Fix check for download duplicates.Guilhem Moulin2024-06-021
| | | | dest needs to be stringified before the membership check.
* webmap-download: Add --quiet flag to always skip progress bars.Guilhem Moulin2024-06-021
|
* webmap-download: Set --exit-code by default.Guilhem Moulin2024-06-021
| | | | This can be turned off with --no-exit-code.
* webmap-download: Ensure we always call linkat() not link().Guilhem Moulin2024-06-021
| | | | | | | | | | | | | This costs an extra file descriptor when --cachedir is unsed, but os.link(f'/proc/self/fd/{fp.fileno()}', newpath, dst_dir_fd=None, follow_symlinks=True) calls link("/proc/self/fd/…", newpath) rather than linkat(AT_FDCWD, "/proc/self/fd/…", AT_FDCWD, newpath, AT_SYMLINK_FOLLOW) and the former fails with EXDEV (Invalid cross-device link).
* Rename script into module and run module.download().Guilhem Moulin2024-06-023
| | | | | Instead of using a dedicated executable. There is too much code duplicate otherwise.
* webmap-download: Simplify locking logic.Guilhem Moulin2024-06-021
| | | | | Don't use a lockdir by default, and always use lockfiles of the form ‘sha1_hex(path).lck’ if --lockdir is set.
* Add layer definitions from Sametinget and Vindbrukskollen.Guilhem Moulin2024-06-011
|
* webmap-download: Add a progress bar.Guilhem Moulin2024-06-011
|
* Add `webmap-download` script.Guilhem Moulin2024-06-013
|
* Typofix.Guilhem Moulin2024-04-231
| | | | Spell out the project case as per https://www.klimatanalysnorr.se
* Improve ‘Copyright’ section in README.Guilhem Moulin2024-01-211
|
* Add README.Guilhem Moulin2024-01-181
|
* Initial commit.Guilhem Moulin2024-01-181