Skip to content

Clojure API bindings for Apache Spark

License

Notifications You must be signed in to change notification settings

amperity/sparkplug

Repository files navigation

Clojure Spark API

CircleCI codecov cljdoc

SparkPlug is a Clojure API for Apache Spark.

Installation

Library releases are published on Clojars. To use the latest version with Leiningen, add the following dependency to your project:

Clojars Project

This will pull in the omnibus package, which in turn depends on each subproject of the same version. You may instead depend on the subprojects directly if you wish to omit some functionality, such as Spark SQL or Machine Learning dependencies.

Usage

The sparkplug-core package provides functions for working with RDDs, broadcasts, and accumulators with the classic Spark context API. See the cljdoc for API docs.

License

Licensed under the Apache License, Version 2.0. See the LICENSE file for rights and restrictions.