Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Scrapy - Web crawling & scraping framework for Python

Aperture is a Java framework for extracting and querying full-text content and metadata from various information systems. It could crawl and extract information from File system, Websites, Mail boxes and Mail servers. It supports various file formats like Office, PDF, Zip and lot more. Metadata information is extracted from image files. Aperture has a strong focus on semantics, metadata extracted could be mapped to predefined properties.

Aperture - Java framework for getting data and metadata

Discover open source projects across all platforms

Projects

Scrapy - Web crawling & scraping framework for Python

Aperture - Java framework for getting data and metadata

TechStack

Tagcloud

Suggested keywords:

Projects

Scrapy - Web crawling & scraping framework for Python

Aperture - Java framework for getting data and metadata

TechStack

Tagcloud