Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[stable30] Transparent* database sharding #47561

Merged
merged 19 commits into from
Aug 28, 2024
Merged

[stable30] Transparent* database sharding #47561

merged 19 commits into from
Aug 28, 2024

Commits on Aug 28, 2024

  1. feat: track expected output columns in query builder 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8eaddbc View commit details
    Browse the repository at this point in the history

  2. fix: don't make ICacheFactory depend on database 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b1744e7 View commit details
    Browse the repository at this point in the history

  3. fix: delay calculating global cache prefix untill a cache is created 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    8f57d46 View commit details
    Browse the repository at this point in the history

  4. feat: add option to automatically partition queries by specific tables 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    4ec53e7 View commit details
    Browse the repository at this point in the history

  5. feat: implement distributing partitioned queries over multiple shards 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    82d7eaf View commit details
    Browse the repository at this point in the history

  6. test: mark share test cleanup as running across all shards 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ecf1cc2 View commit details
    Browse the repository at this point in the history

  7. fix: only allow pre-defined shards 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    3e51939 View commit details
    Browse the repository at this point in the history

  8. test: run sharding tests in ci 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    22f76fc View commit details
    Browse the repository at this point in the history

  9. fix: hint storage id in more places 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    693ee5e View commit details
    Browse the repository at this point in the history

  10. fix: run mimetype repair query across all shards 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0e40fa4 View commit details
    Browse the repository at this point in the history

  11. test: fix share provider tests for sharding 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    1b6d76a View commit details
    Browse the repository at this point in the history

  12. fix: make background scan job compatible with sharding 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    5500723 View commit details
    Browse the repository at this point in the history

  13. fix: adjust systemtag orphan cleanup query to work with sharding 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ddecae8 View commit details
    Browse the repository at this point in the history

  14. fix: fix share cleanup for deleted groups with sharding 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    dc5f0f5 View commit details
    Browse the repository at this point in the history

  15. fix: implement sharding compatible cleanup for various bits 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b264559 View commit details
    Browse the repository at this point in the history

  16. fix: make preload custom proterties sharding compatible 

    Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    57ffbb7 View commit details
    Browse the repository at this point in the history

  17. fix: mark systemconfig value as not being tainted because they are im… 

    …plicitly trusted

Signed-off-by: Robin Appelman <[email protected]>
    @icewind1991 @artonge
    icewind1991 authored and artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    e2bff39 View commit details
    Browse the repository at this point in the history

  18. chore: Apply php:cs recommendations 

    Signed-off-by: Louis Chemineau <[email protected]>

[skip ci]
    @artonge
    artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    e5a8f99 View commit details
    Browse the repository at this point in the history

  19. fix: Backport to 30 

    Signed-off-by: Louis Chemineau <[email protected]>
    @artonge
    artonge committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    140b36f View commit details
    Browse the repository at this point in the history