Skip to content

Impose non geodiff push limits #241

Closed

Description

@varmar05

Let's limit the size of single push by imposing:

  • 100 of files / per push, do not count 'deleted' files in push metadata, (do more pushes if hit) - ADDED/UPDATED
  • max 10 GB of media file (not .gpkg) (sorry, not possible to fix) - ADDED/UPDATED
  • max 5 GB of .gpkg (sorry, not possible, split manually into multiple gpkg files, e.g. in plugin) - ADDED/UPDATED no diff

And split the work into multiple pushes / files.

Activity

  1. changed the title [-]Impose push limits[/-] [+]Impose non geodiff push limits[/+] on Jun 18, 2025
  2. added this to the 0.11.0 milestone on Jun 30, 2025
  3. removed this from the 0.11.0 milestone on Sep 2, 2025
  4. self-assigned this
    on Sep 2, 2025
  5. MarcelGeo commented on Oct 31, 2025

    @MarcelGeo
    Contributor
  6. RastoHu commented on Nov 18, 2025

    @RastoHu

    Let's limit the size of single push by imposing:

    • 100 of files / per push, do not count 'deleted' files in push metadata, (do more pushes if hit) - ADDED/UPDATED
    • max 10 GB of media file (not .gpkg) (sorry, not possible to fix) - ADDED/UPDATED
    • max 5 GB of .gpkg (sorry, not possible, split manually into multiple gpkg files, e.g. in plugin) - ADDED/UPDATED no diff

    And split the work into multiple pushes / files.

    Testing

    100 of files / per push, do not count 'deleted' files in push metadata, (do more pushes if hit) - ADDED/UPDATED:
    108 files added, 1 updated =>

    1. version+1 -> 100 added
    2. version+2 -> 8 added, 1 updated

    max 10 GB of media file (not .gpkg) (sorry, not possible to fix) - ADDED/UPDATED
    set limit for media file to 2 GB in common.py:

    max 5 GB of .gpkg (sorry, not possible, split manually into multiple gpkg files, e.g. in plugin) - ADDED/UPDATED no diff
    set limit for .gpkg file to 1 GB in common.py:

    Two files exceeded the limits (.gpkg and media):

    @varmar05 @MarcelGeo is following behavior correct:

    1. set MAX_UPLOAD_VERSIONED_SIZE to 1 GB and restart QGIS
    2. upload 1.3 GB .gpkg file via MM dashboard
    3. sync changes to plugin
    4. do minor update (e.g. add two points) in this big .gpkg file
    5. click sync in plugin ---> sync successful?

    ...and new bug https://github.com/MerginMaps/server-private/issues/3136

  7. RastoHu commented on Nov 25, 2025

    @RastoHu

    testing ok

  8. added this to the 0.12.0 milestone on Jan 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions