ferret is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.  ferret allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language. It is extremely portable, extensible, and fast. It as the ability to scrape JS rendered pages, handle all page events and emulate user interactions. 
<BR><BR>
ferret uses Chrome/Chromium via Chrome Devtools Protocol to handle dynamically rendered web pages. It helps you to focus on the data you need using an easy to learn declarative language.

ferret is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.  ferret allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language. It is extremely portable, extensible, and fast. It as the ability to scrape JS rendered pages, handle all page events and emulate user interactions. 

ferret - Declarative web scraping

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Scrapy - Web crawling & scraping framework for Python

CasperJS is a navigation scripting & testing utility for PhantomJS and SlimerJS (still experimental). It eases the process of defining a full navigation scenario and provides useful high-level functions, methods & syntactic sugar for doing common tasks such as Filling forms, Clicking links, Capturing screenshots of a page, Downloading resources, even binary ones, Writing functional test suites, exporting results as JUnit XML (xUnit) and lot more.

Casperjs - Navigation scripting and testing utility for PhantomJS and SlimerJS

soup is a small web scraper package for Go, with its interface highly similar to that of BeautifulSoup. 

Soup - Web Scraper in Go, similar to BeautifulSoup

Discover open source projects across all platforms

Projects

ferret - Declarative web scraping

Scrapy - Web crawling & scraping framework for Python

Casperjs - Navigation scripting and testing utility for PhantomJS and SlimerJS

Soup - Web Scraper in Go, similar to BeautifulSoup

TechStack

Tagcloud

License

Suggested keywords:

Projects

ferret - Declarative web scraping

Scrapy - Web crawling & scraping framework for Python

Casperjs - Navigation scripting and testing utility for PhantomJS and SlimerJS

Soup - Web Scraper in Go, similar to BeautifulSoup

TechStack

Tagcloud

License