Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add scene and performer scrapers for ModelMediaAsia #2070

Merged
merged 4 commits into from
Oct 27, 2024

Conversation

NormanPriv
Copy link
Contributor

@NormanPriv NormanPriv commented Oct 18, 2024

Scrapers for a new site.

Scraper type(s)

  • performerByName
  • performerByFragment
  • performerByURL
  • sceneByName
  • sceneByQueryFragment
  • sceneByFragment
  • sceneByURL
  • movieByURL
  • galleryByFragment
  • galleryByURL

Examples to test

Scene example: https://modelmediaasia.com/zh-CN/videos/MD-0182
Performer example: https://modelmediaasia.com/zh-CN/models/11

Short description

I have used it for several scenes and things seem to work as expected so far.

The only thing I couldn't figure out is the way how performer URL should be added when a new performer is scraped with the scene scraper. See what I do with "Details" under "Performer" for the scene scraper. I am putting the URL there for the ease of use. For some unknown reason, if I directly set URL for performer, nothing will be set in the URL field for a newly created performer. I hope someone can take a look at that and see if it's a bug or something.

This should close #2068

@feederbox826
Copy link
Collaborator

URLs don't work for xpath scrapers since the URL type got bumped up stashapp/stash#5294

I'll comment out the description hack in the meantime

- add common selector
- use non-localized /videos/ URL
- add filename leak prevention
- add specific model/video links
- comment out details block URL override
- Remove fixed country [Rae Lil Black](https://modelmediaasia.com/en-US/models/129) is [Japanese](https://stashdb.org/performers/1a7df630-db4c-4d5d-9c4f-fd7c3c225d01)
- URL for performers is broken
@feederbox826 feederbox826 merged commit a361bd6 into stashapp:master Oct 27, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Scraper Request: modelmediaasia.com
2 participants