Skip to content

Commit

Permalink
refactor: consolidate two RecipeRadar regexes into one
Browse files Browse the repository at this point in the history
  • Loading branch information
jayaddison authored and lbarthon committed Sep 17, 2024
1 parent cee7823 commit c00d168
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions regexes.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -180,8 +180,7 @@ user_agent_parsers:
family_replacement: 'Facebook'

# RecipeRadar crawler
- regex: '(RecipeRadar)/(\d+)\.(\d+)\.(\d+)'
- regex: '(RecipeRadar)/(\d+)\.(\d+)'
- regex: '(RecipeRadar)/(\d+)\.(\d+)(?:\.(\d+)|)'

# Bots General matcher 'name/0.0'
- regex: '^.{0,200}?(?:\/[A-Za-z0-9\.]{0,50}|) {0,2}([A-Za-z0-9 \-_\!\[\]:]{0,50}(?:[Aa]rchiver|[Ii]ndexer|[Ss]craper|[Bb]ot|[Ss]pider|[Cc]rawl[a-z]{0,50}))[/ ](\d+)(?:\.(\d+)(?:\.(\d+)|)|)'
Expand Down

0 comments on commit c00d168

Please sign in to comment.