Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a parameter to the sync to specify the download/upload page #2408

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

m42e
Copy link

@m42e m42e commented Oct 4, 2024

This adds a parameter to change the upload/download page size, this could help if one gets a '413' in a selfhosted scenario.

Checks

  • I am happy for maintainers to push small adjustments to this PR, to speed up the review cycle
  • I have checked that there are no existing pull requests for the same thing

@m42e m42e force-pushed the custom-sync-page-count branch 4 times, most recently from 9d2a180 to 8e4280a Compare October 4, 2024 17:40
@m42e m42e force-pushed the custom-sync-page-count branch from 8e4280a to 0b69795 Compare October 4, 2024 17:54
@@ -19,6 +19,11 @@ pub struct Pull {
/// This will first wipe the local store, and then download all records from the remote
#[arg(long, default_value = "false")]
pub force: bool,

/// Page Size
/// How many records to upload at once. Defaults to 100
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
/// How many records to upload at once. Defaults to 100
/// How many records to download at once. Defaults to 100

@ellie
Copy link
Member

ellie commented Oct 7, 2024

I'd be pretty concerned if users would want a page_size to reduce the value from 100 tbh, it should be plenty small enough that a 413 isn't a problem. Wanting to increase it for a potentially faster sync might make sense, though

Is this an issue you've been hitting?

@m42e
Copy link
Author

m42e commented Oct 16, 2024

Yes, I had some expanded command lines with quite a lot of files in my history which caused a hang during the upload.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants