Scalding is a Scala library that makes it easy to specify Hadoop MapReduce jobs. Scalding is built on top of Cascading, a Java library that abstracts away low-level Hadoop details. Scalding is comparable to Pig, but offers tight integration with Scala, bringing advantages of Scala to your MapReduce jobs.

Scalding - A Scala API for Cascading

Gatling is an open-source load testing framework based on Scala, Akka and Netty. 
 

Gatling -  Stress Testing Tool

The Akka HTTP modules implement a full server- and client-side HTTP stack on top of akka-actor and akka-stream. It's not a web-framework but rather a more general toolkit for providing and consuming HTTP-based services. While interaction with a browser is of course also in scope it is not the primary focus of Akka HTTP. 
 
Akka HTTP follows a rather open design and many times offers several different API levels for "doing the same thing". You get to pick the API level of abstraction that is most suitable for your application. This means that, if you have trouble achieving something using a high-level API, there's a good chance that you can get it done with a low-level API, which offers more flexibility but might require you to write more application code.

The Akka HTTP modules implement a full server- and client-side HTTP stack on top of akka-actor and akka-stream. It's not a web-framework but rather a more general toolkit for providing and consuming HTTP-based services. While interaction with a browser is of course also in scope it is not the primary focus of Akka HTTP. 

Akka HTTP - The Streaming-first HTTP server/module of Akka

Snowplow is an enterprise-strength marketing and product analytics platform. It identifies your users, and tracks the way they engage with your website or application. It stores your users' behavioural data in a scalable "event data warehouse" you control: in Amazon S3 and (optionally) Amazon Redshift or Postgres. Lets you leverage the biggest range of tools to analyze that data, including big data tools (e.g. Spark) via EMR or more traditional tools e.g. Looker, Mode, Superset, Re:dash to analyze that behavioural data.

Snowplow - Cloud-native web, mobile and event analytics, running on AWS and on-premise with Kafka

Sangria is a scala GraphQL library. I would also recommend you to check out http://try.sangria-graphql.org. It is an example of GraphQL server written with Play framework and Sangria. It also serves as a playground, where you can interactively execute GraphQL queries and play with some examples.

Sangria - Scala GraphQL implementation

Grid is the Guardian’s image management system, which provides a universal and fast experience accessing media that is organised and using it in an affordable way to produce high-quality content. The Grid works as the central repository for all media, accessible internationally via a modern web browser. Using the web as a medium also allows any screen to be shared with others using its URL.

Grid - The Guardian’s new image management system

GitBucket is Open Source Git platform on JVM. It support includes Easy installation, Intuitive UI, API compatibility with GitHub, GitLFS support, Repository viewer including an online file editor, LDAP integration, Activity timeline and email notifications and lot more.

Gitbucket - A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility

A tool for managing Apache Kafka. It manages multiple clusters, Inspection of cluster state (topics, consumers, offsets, brokers, replica distribution, partition distribution), Run preferred replica election, Add partitions to existing topic, Run reassignment of partition (based on generated assignments) and lot more.

Kafka Manager - A tool for managing Apache Kafka

The Alpakka project is an open source initiative to implement stream-aware, reactive, integration pipelines for Java and Scala. It is built on top of Akka Streams, and has been designed from the ground up to understand streaming natively and provide a DSL for reactive and stream-oriented programming, with built-in support for backpressure. Akka Streams is a Reactive Streams and JDK 9+ java.util.concurrent.Flow-compliant implementation and therefore fully interoperable with other implementations.

Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka

Apache Spark is an open source cluster computing system that aims to make data analytics fast — both fast to run and fast to write. To run programs faster, Spark offers a general execution model that can optimize arbitrary operator graphs, and supports in-memory computing, which lets it query data faster than disk-based engines like Hadoop.

Spark - Fast Cluster Computing

PredictionIO is an open source machine learning server for software developers to create predictive features, such as personalization, recommendation and content discovery. It helps to predict user behaviors. 

PredictionIO - Machine Learning Server

GeoMesa is an open-source, distributed, spatio-temporal database built on a number of distributed cloud data storage systems, including Accumulo, HBase, Cassandra, and Kafka. Leveraging a highly parallelized indexing strategy, GeoMesa aims to provide as much of the spatial querying and data manipulation to Accumulo as PostGIS does to Postgres.
 
Through GeoServer, GeoMesa facilitates integration with a wide range of existing mapping clients over standard OGC (Open Geospatial Consortium) APIs and protocols such as WFS and WMS. GeoMesa supports Apache Spark for custom distributed geospatial analytics.
 
Through a geographical information server such as GeoServer, GeoMesa facilitates integration with a wide range of existing mapping clients by enabling access to its databases and streaming capabilities over standard OGC (Open Geospatial Consortium) APIs and protocols such as WFS and WMS. These interfaces also let GeoMesa drive map user interfaces and serve up data for analytics such as queries, histograms, heat maps, and time series analyses.

GeoMesa is an open-source, distributed, spatio-temporal database built on a number of distributed cloud data storage systems, including Accumulo, HBase, Cassandra, and Kafka. Leveraging a highly parallelized indexing strategy, GeoMesa aims to provide as much of the spatial querying and data manipulation to Accumulo as PostGIS does to Postgres.

GeoMesa - Suite of tools for working with big geo-spatial data in a distributed fashion

Kamon is a reactive-friendly toolkit for monitoring applications that run on top of the JVM. It provides API to manually create metric recording instruments for any application running on the JVM. It provides bytecode instrumentation modules for Scala, Akka, Spray and Play. It supports several reporting backends like StatsD, Datadog and New Relic. It also allows to create custom reports.

Kamon - Tool for monitoring applications running on the JVM

Scrimage is a consistent, idiomatic, and immutable scala library for manipulating and processing of images. The aim of the this library is to provide a quick and easy way to do the kinds of image operations that are most common, such as scaling, rotating, converting between formats and applying filters. It is not intended to provide functionality that might be required by a more "serious" image processing application - such as face recognition or movement tracking.
 
A typical use case for this library would be creating thumbnails of images uploaded by users in a web app, or resizing a set of images to have a consistent size, or optimizing PNG uploads by users to apply maximum compression, or applying a grayscale filter in a print application.

Scrimage is a consistent, idiomatic, and immutable scala library for manipulating and processing of images. The aim of the this library is to provide a quick and easy way to do the kinds of image operations that are most common, such as scaling, rotating, converting between formats and applying filters. It is not intended to provide functionality that might be required by a more "serious" image processing application - such as face recognition or movement tracking.

Scrimage - Scala image processing library

Linkerd is a transparent service mesh, designed to make modern applications safe and sane by transparently adding service discovery, load balancing, failure handling, instrumentation, and routing to all inter-service communication.linkerd (pronouned "linker-DEE") acts as a transparent HTTP/gRPC/thrift/etc proxy, and can usually be dropped into existing applications with a minimum of configuration, regardless of what language they're written in. It works with many common protocols and service discovery backends, including scheduled environments like Mesos and Kubernetes.

linkerd - Resilient service mesh for cloud native apps

Discover open source projects across all platforms

Projects