Spidr - A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Loading Stats

LinkThumbnailer - Ruby gem that generates thumbnail images and videos from a given URL. Much like popular social website with link preview.
Kimurai - A modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites.
Mechanize - Mechanize is a ruby library that makes automated web interaction easy.
MetaInspector - Ruby gem for web scraping purposes.
Upton - A batteries-included framework for easy web-scraping.
Wombat - Web scraper with an elegant DSL that parses structured data from web pages.

Subscribe to get resources directly to your inbox. You won't receive any spam! ✌️

Subscribe to get resources directly to your inbox. You won't receive any spam! ✌️