Run Docker-Selenium as a Kamal Accessory
July 28, 2025
The task: To scrape a javascript-heavy web page you will need a web browser to load the dynamic page into. To automate the browser, you will need something like Puppeteer or Selenium.
We opted for the selenium-webdriver gem with Google-chrome running in headless mode.
It was useful to install the chrome dev package locally for developing and testing. However running this way in production wont cut it. The Rails App server will grind to a halt after some hours when it eventually runs out of memory.
...
Read more