GitHub - spotify/luigi: Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Akka: build concurrent, distributed, and resilient message-driven applications for Java and Scala

Build powerful reactive concurrent and distributed applications in java and scala

Welcome to Apache Avro!

Apache Curator –

Apache Karaf - The Modulith Runtime

Karaf provides modulith runtime for the enterprise running on premise or on cloud focus on your business code and applications apache karaf deals with the rest

Apache Thrift - Home

Apache ZooKeeper

The Chubby lock service for loosely-coupled distributed systems – Google Research

GitHub - Hydrospheredata/mist: Serverless proxy for Spark cluster

Serverless proxy for spark cluster contribute to hydrospheredata mist development by creating an account on git hub

Data

GitHub - mara/mara-pipelines: A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

A lightweight opinionated etl framework halfway between plain scripts and apache airflow git hub mara mara pipelines a lightweight opinionated etl framework halfway between plain scripts and

Open MPI: Open Source High Performance Computing

Serf by HashiCorp

Serf is a decentralized solution for cluster membership failure detection and orchestration lightweight and highly available

GitHub - spring-projects/spring-xd: Spring XD makes it easy to solve common big data problems such as data ingestion and export, real-time analytics, and batch workflow orchestration

Spring xd makes it easy to solve common big data problems such as data ingestion and export real time analytics and batch workflow orchestration git hub spring projects spring xd spring xd ma

GitHub - twitter/elephant-bird: Twitter’s collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

Twitter 39 s collection of lzo and protocol buffer related hadoop pig hive and h base code git hub twitter elephant bird twitter 39 s collection of lzo and protocol buffer related hadoop

Finagle