Please share your use case of Rod

[ysmood]

Please leave a comment here to share what you use Rod for. It will be great if you could share your project link.

Some popular projects that are using Rod:

• https://github.com/charmbracelet/vhs
• https://github.com/authelia/authelia
• https://github.com/projectdiscovery/nuclei
• https://github.com/projectdiscovery/katana
• https://github.com/semanser/codel
• https://github.com/philippta/flyscrape
• https://github.com/storj/storj
• https://github.com/kubeshop/botkube
• https://github.com/projectdiscovery/httpx
• https://github.com/Hackmanit/TInjA
• https://github.com/sigstore/sigstore
• https://github.com/SleepingBag945/dddd
• https://github.com/FrenchGithubUser/Hatt
• https://github.com/yaklang/yaklang
• https://github.com/janpfeifer/gonb
• https://github.com/sensepost/gowitness

[datoga]

For JS execution and data extraction, as puppeteer replacer, with better performance and cleaner API.

[imag]

Writing automation tests and data extraction

[BenjaminB64]

To extract cookie and localStorage from a website

[samueltuyizere]

@BenjaminB64 How did this go?

[gusanmaz]

Very recently created a CLI screenshot utility using Rod.
You could check it out here: Webshot

[deehidayat]

nice work man

[gusanmaz]

Thanks!

[mazihao66]

html to pdf

[Wiandono]

I second this

[deehidayat]

I used it to collect bank mutation data, thanks

[elbek]

I use it to collect available loads for booking in transportation area

[jaekook-neonesia]

To extract transaction history of indonesia web banking .

[Bolado]

Automation of long tasks in web applications

[audstanley]

Our team at CSUF is building a terminal UI application for windows, Mac, Linux, x86, arm64, arm64, and arm8 (ie: raspberry pi computers) to download books from LibGen without using the browser or API. It's a school project for a software testing course. I might even see if we can build in the pi functionality into go-rod [since go-rod needs to connect to the chromium web socket via a separate/or/subprocess] than make a pull request... hopefully... if time will permit. I think having platform/architecture detection during compile time is a good approach for go-rod's future (at least for a raspberry pi system, specifically). 🙂 We love this library, so far. Some really cool things could be built on a pi will full-blown pi compatibility at compile time. Would the go-rod team be interested in a dedicated "self-hosted" GitHub action runner on a pi4 (for builds/tests)? I haven't tested runners on a pi 4, but our team plans on it.

Edit:

I've just ran a dedicated GitHub action runner on a pi 4, and it's awesome (I've got a pi 0,2&3 - so I'll have to set those up also). For now, i think we will work around the fact that the raspberry pi doesn't work with the chrome binaries that go-rod gets from the web, but I've forked the go-rod repo, so hopefully this can be an enhancement for go-rod at some point, if the team is interested in such an undertaking.

[audstanley]

...I took a stab at recursive html parsing with Google's x/net/html... And, oh boy, it's far too time consuming for the work ahead of us (amazing, but we just can't).

[ysmood]

Sounds interesting, how about open a formal issue to discuss this?

[audstanley]

will do! I'm going to run some tests (on our project), but also... i really need to figure out how to run a subprocess in go, wait about 3 seconds, grab some text from both the stdin, and stderr pipes... regex out web-socket from the pipe [all while keeping the subprocess open during the duration of rod.New()]... then i think for sure I can get chromium-browser to launch as a subprocess, and have go-rod auto connect to the websocket [on the assumption go-rod is running on a pi]. For the most part, this should do the trick. I don't know if this is too "hacky" of a solution, but it should work (if nothing else, than for our use case). I'll open an issue soon, and try to make the details clear after also running some tests. I've forked go-rod, so I might also be able to figure out where this subprocess can be run during the rod.New() constructor. i would love to be able to contribute to this killer library. 🙂

[ysmood]

I think rod already supports this kind of customization well, check this example file https://github.com/go-rod/rod/blob/master/lib/launcher/example_test.go

[audstanley]

No way... I'll test this out rn.

Edit:
This worked perfectly for the pi 4 - and likely will work for other pies

[axetroy]

Here is a CLI tool for downloading video from the website and it uses rod for getting the cookie

https://github.com/iawia002/lux/blob/0c6b59388707bd386559261430c65db43da3d41e/cookier/cookier.go#L7-L22

[zakiego]

I use it to fill class attendance (requires authentication, so it can't only use http, must use a browser), and download data from Tableau

[danieldids]

Sustainability related Brazilian norms crawler (in progress).

I'm using go-colly and go-rod for this project. Temporary URL: https://normalis.mooo.com/

[shepherdjerred]

We're using go-rod with testcontainers to automate end-to-end tests for our software.

[veggiemonk]

There is around 700 projects that uses rod
https://github.com/search?q=path%3A**%2Fgo.mod+%22go-rod%2Frod%22&type=code

I mainly use it to login to website that don't have an API available.