Skip to content
This repository has been archived by the owner on Dec 9, 2019. It is now read-only.

Pagination and some other changes bunched up #19

Open
wants to merge 21 commits into
base: master
Choose a base branch
from
Open

Conversation

adamcik
Copy link
Member

@adamcik adamcik commented Feb 24, 2019

Main fix is that we don't try and fetch "all", but instead try and support pagination via browse.

This also includes switching to https and some cosmetic changes to how browse results are grouped and sorted.

Add a DirbleURI named tuple that supports pagination. Also make URI parsing
stricter and prepare it for pagination.
Also switches to using requests for constructing the URL to use in the cache,
instead of re-inventing this wheel.
- Sort browse results as user countries, continents, categories rest.
- Add next browse page directory.
- Return next offset from pagination helper and client.
- Set limit to 20 and max per page to 30, this way we get one request per
  browse on average.
- Add offset to the dirble uri named tuple.
- Fix missing handling of dirble:root uri.
Code wasn't handling case where first query returned to few requests.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant