From 9fed2f0a3015a7bef519d9068516bca3f99bde63 Mon Sep 17 00:00:00 2001 From: dgtlmoon Date: Tue, 9 Apr 2024 11:04:40 +0200 Subject: [PATCH] Update README.md - Tuning tips --- README.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/README.md b/README.md index c1667b5..10e3456 100644 --- a/README.md +++ b/README.md @@ -62,6 +62,13 @@ Then the log will contain the CDP session, for example: ... ``` +### Tuning + +Some tips on high-concurrency scraping and tuning where you have a lot of chrome browsers running simultaneously + +- Set your `inotify` values higher https://stackoverflow.com/questions/32281277/too-many-open-files-failed-to-initialize-inotify-the-user-limit-on-the-total + + ### Future ideas - Some super cool "on the wire" hacks to add custom functionality to CDP, like issuing single commands to download files (PDF) to location https://github.com/dgtlmoon/changedetection.io/issues/2019