Elasticsearch is a distributed, RESTful search and analytics engine capable of solving a growing number of use cases. As the heart of the Elastic Stack, it centrally stores your data so you can discover the expected and uncover the unexpected. 
 
 Its feature include: 
 <ul>
	<li>Distributed and Highly Available Search Engine.
	<ul>
		<li>Each index is fully sharded with a configurable number of shards.</li>
		<li>Each shard can have one or more replicas.</li>
		<li>Read / Search operations performed on either one of the replica shard.</li>
	</ul></li>
	<li>Multi Tenant with Multi Types.
	<ul>
		<li>Support for more than one index.</li>
		<li>Support for more than one type per index.</li>
		<li>Index level configuration (number of shards, index storage, &#8230;).</li>
	</ul></li>
	<li>Various set of APIs
	<ul>
		<li>HTTP RESTful API</li>
		<li>Native Java API.</li>
		<li>All APIs perform automatic node operation rerouting.</li>
	</ul></li>
	<li>Document oriented
	<ul>
		<li>No need for upfront schema definition.</li>
		<li>Schema can be defined per type for customization of the indexing process.</li>
	</ul></li>
	<li>Reliable, Asynchronous Write Behind for long term persistency.</li>
	<li>(Near) Real Time Search.</li>
	<li>Built on top of Lucene
	<ul>
		<li>Each shard is a fully functional Lucene index</li>
		<li>All the power of Lucene easily exposed through simple configuration / plugins.</li>
	</ul></li>
	<li>Per operation consistency
	<ul>
		<li>Single document level operations are atomic, consistent, isolated and durable.</li>
	</ul></li>
</ul>

Elasticsearch is a distributed, RESTful search and analytics engine capable of solving a growing number of use cases. As the heart of the Elastic Stack, it centrally stores your data so you can discover the expected and uncover the unexpected. 

ElasticSearch - Distributed, RESTful search and analytics engine

Solr is the popular, blazing fast open source enterprise search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting, faceted search, dynamic clustering, database integration, and rich document (e.g., Word, PDF) handling. Solr is highly scalable, providing distributed search and index replication, and it powers the search and navigation features of many of the world's largest internet sites. Solr is written in Java and runs as a standalone full-text search server within a servlet container such as Tomcat. Solr uses the Lucene Java search library at its core for full-text indexing and search, and has REST-like HTTP/XML and JSON APIs that make it easy to use from virtually any programming language. Solr's powerful external configuration allows it to be tailored to almost any type of application without Java coding, and it has an extensive plugin architecture when more advanced customization is required. Its feature set include Rich Document Parsing and Indexing (PDF, Word, HTML, etc) using Apache Tika, An Administration Interface, Monitorable Logging, Fast Incremental Updates and Index Replication, Highly Scalable Distributed search with sharded index across multiple hosts, HTTP interface with configurable response formats (XML/XSLT, JSON, Python, Ruby, PHP, Velocity) Solrj is embedded solr. It provides Java based API and it takes care of constructing, parsing, sending and receiving HTTP request.

Solr is the popular, blazing fast open source enterprise search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting, faceted search, dynamic clustering, database integration, and rich document (e.g., Word, PDF) handling. Solr is highly scalable, providing distributed search and index replication, and it powers the search and navigation features of many of the world's largest internet sites. 

Solr - Blazing-fast, open source enterprise search platform

IndexTank search engine powers search in Reddit, Social bookmarking site. IndexTank is acquired by LinkedIn and released the project as open source. It includes features like Variables boosts, Facets, Faceted search, Snippeting, Custom scoring functions, Suggest, and Autocomplete. 
 Homepage: <A HREF="http://indextank.com/" target="_blank">http://indextank.com/</A>

IndexTank search engine powers search in Reddit, Social bookmarking site. IndexTank is acquired by LinkedIn and released the project as open source. It includes features like Variables boosts, Facets, Faceted search, Snippeting, Custom scoring functions, Suggest, and Autocomplete.

IndexTank - Search Engine powers Reddit

Lucene is most popular and java based searchengine library. It offers near real time search. Its features include Ranked search, many powerful query types: phrase queries, wildcard queries, proximity queries, range queries and more, fielded searching (e.g., title, author, contents), date-range searching, sorting by any field , multiple-index searching with merged results , allows simultaneous update and searching. 

Apache Lucene is a high-performance, full-featured text search engine library written entirely in Java. It is a technology suitable for nearly any application that requires full-text search, especially cross-platform.

Lucene - A high-performance, full-featured text search engine library

OpenSearch is a community-driven, open source search and analytics suite derived from Apache 2.0 licensed Elasticsearch 7.10.2 & Kibana 7.10.2. It consists of a search engine daemon, OpenSearch, and a visualization and user interface, OpenSearch Dashboards. OpenSearch enables people to easily ingest, secure, search, aggregate, view, and analyze data. These capabilities are popular for use cases such as application search, log analytics, and more.
 
Its features include: 
<ul><li>Log analytics</li><li> Real-time application monitoring</li><li> Clickstream analytics</li><li>Use SQL or a piped processing language to query your data</li><li>Automate index operations</li><li>Monitor and optimize your cluster</li><li>Run search requests in the background</li><li>KNN- Find “nearest neighbors” in your vector data</li><li>Authentication and access control for your cluster</li><li>Anomaly Detection</li></ul>

OpenSearch is a community-driven, open source search and analytics suite derived from Apache 2.0 licensed Elasticsearch 7.10.2 & Kibana 7.10.2. It consists of a search engine daemon, OpenSearch, and a visualization and user interface, OpenSearch Dashboards. OpenSearch enables people to easily ingest, secure, search, aggregate, view, and analyze data. These capabilities are popular for use cases such as application search, log analytics, and more.

OpenSearch - Open source distributed and RESTful search engine

Crate is an open source, highly scalable, shared-nothing distributed SQL database. Crate offers the scalability and performance of a modern No-SQL database with the power of Standard SQL. Crate’s distributed SQL query engine lets you use the same syntax that already exists in your applications or integrations, and have queries seamlessly executed across the crate cluster, including any aggregations, if needed.

Crate - The fast, scalable, easy to use SQL database with native full text search

Nutch is open source web-search software. It builds on Lucene Java, adding web-specifics, such as a crawler, a link-graph database, parsers for HTML and other document formats, etc. Its main feature include
 <UL>
	<LI>Fetching, parsing and indexation in parallel and distributed</LI>
	<LI>Plugin support</LI>
	<LI>Ontology</LI>
	<LI>Clustering</LI>
	<LI>Distributed filesystem (via Hadoop)</LI>
	<LI>Link-graph database</LI>
	<LI>NTLM authentication</LI>
	<LI>MapReduce</LI>
	<LI>Many formats: plain text, HTML, XML, ZIP, OpenDocument (OpenOffice.org), Microsoft Office (Word, Excel, Powerpoint), PDF, JavaScript, RSS, RTF, MP3 (ID3 tags)</LI>
 </UL>

Nutch is open source web-search software. It builds on Lucene Java, adding web-specifics, such as a crawler, a link-graph database, parsers for HTML and other document formats, etc.

Nutch - Highly extensible, highly scalable Web crawler

Sensei is a distributed data system that was built to support many product initiatives at LinkedIn, including the real-time faceted search in <A HREF="http://www.linkedin.com/signal/" target="_blank">LinkedIn Signal</A> and the news feed and tabs on the Homepage. Sensei is both a search engine and a database. It is designed to query and navigate through documents that consist of unstructured text and well-formed and structured metadata. 
 It supports Fast realtime updates, Complex query language and REST/JSON api, Hadoop integration and lot more.

Sensei is a distributed data system that was built to support many product initiatives at LinkedIn, including the real-time faceted search in LinkedIn Signal and the news feed and tabs on the Homepage. Sensei is both a search engine and a database. It is designed to query and navigate through documents that consist of unstructured text and  well-formed and structured metadata. Sensei is both a search engine and a database.

SenseiDB - Distributed, Realtime, Semi-Structured Database from LinkedIn

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Heritrix is designed to respect the robots.txt exclusion directives and META robots tags, and collect material at a measured, adaptive pace unlikely to disrupt normal website activity. It provides web interface for operator control and monitoring of crawls. It stores content to ARC or ISO WARC aggregate/transcript format.

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Heritrix is designed to respect the robots.txt exclusion directives and META robots tags, and collect material at a measured, adaptive pace unlikely to disrupt normal website activity.

Heritrix

Bobo Browse is an information retrieval technology that provides navigational browsing into a semi-structured dataset. Beyond the result set from queries and selections, Bobo Browse also provides the facets from this point of browsing. It provides support to sort documents on fields that have multiple values. It is stable and used by LinkedIn.

Bobo - Faceted search library based on Lucene

Katta is a scalable, failure tolerant, distributed, data storage for real time access. Katta serves large, replicated, indices as shards to serve high loads and very large data sets. These indices can be of different type. Currently implementations are available for Lucene and Hadoop mapfiles. Its features include:
 <ul>
	<li>Makes serving large or high load indices easy</li>
	<li>Serves very large Lucene or Hadoop Mapfile indices as index shards on many servers</li>
	<li>Replicate shards on different servers for performance and fault-tolerance</li>
	<li>Supports pluggable network topologies</li>
	<li>Master fail-over</li>
	<li>Fast, lightweight, easy to integrate</li>
	<li>Plays well with Hadoop clusters</li>
</ul>

Katta is a scalable, failure tolerant, distributed, data storage for real time access. Katta serves large, replicated, indices as shards to serve high loads and very large data sets. These indices can be of different type. Currently implementations are available for Lucene and Hadoop mapfiles.

Katta - Lucene and more in the cloud.

Discover open source projects across all platforms

Projects