Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alternative package transfer #38

Open
ymartin59 opened this issue Aug 3, 2019 · 3 comments
Open

Alternative package transfer #38

ymartin59 opened this issue Aug 3, 2019 · 3 comments

Comments

@ymartin59
Copy link
Collaborator

Current POST implementation to upload a package in system suffers multiple issues:

  • slow, really slow
  • if interrupted or failed because of conflict, still has to wait for another transfer to succeed

Proposal: a regular task watches folder for packages on system and process them with basic file move (and of course database insertions)

That way, it allows to use other file transfer tool like scp/rsync and also to retries insertion in case of conflict (after removal of conflictual package for instance)

@Safihre
Copy link

Safihre commented Aug 4, 2019

But it would require direct "root" access to the FTP server, right?

@ymartin59
Copy link
Collaborator Author

I do not expect to use FTP server... If spkrepo code is granted access to a folder where ssh users may transfer packages, it should be OK and more secure than FTP. And there is only some accounts to create.

@Diaoul
Copy link
Member

Diaoul commented Sep 19, 2021

I think there is a way to make POST requests faster and this is the way to go. Not sure how anything can be done about that without some serious investigation though.
Consistency is pretty hard wired in spkrepo so introducing a retry and we risk forgetting about that and eternal retry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants