Repositories list

• initialization-actions

  Public
  Run in all nodes of your cluster before the cluster starts - lets you customize your cluster

  google-cloud-dataproc

  Shell

  •

  Apache License 2.0

  •512•591•47•41•Updated Dec 26, 2024Dec 26, 2024

• hive-bigquery-connector

  Public
  A library enabling BigQuery as Hive storage handler

  Java

  •

  Apache License 2.0

  •15•9•13•6•Updated Dec 23, 2024Dec 23, 2024

• spark-bigquery-connector

  Public
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

  google-cloud-dataprocbigqueryspark+ 3google-cloudgoogle-bigquerybigquery-storage-api

  Java

  •

  Apache License 2.0

  •199•379•29•7•Updated Dec 22, 2024Dec 22, 2024

• spark-spanner-connector

  Public
  Cloud Spanner Connector for Apache Spark

  Java

  •

  Apache License 2.0

  •13•17•1•2•Updated Dec 21, 2024Dec 21, 2024

• dataproc-jupyter-plugin

  Public
  TypeScript

  •

  Apache License 2.0

  •11•7•5•8•Updated Dec 20, 2024Dec 20, 2024

• cloud-dataproc

  Public
  Cloud Dataproc: Samples and Utils

  google-cloud-dataproc

  Jupyter Notebook

  •

  Apache License 2.0

  •125•199•2•5•Updated Dec 19, 2024Dec 19, 2024

• flink-bigquery-connector

  Public
  BigQuery integration to Apache Flink's Table API

  Java

  •

  Apache License 2.0

  •14•25•5•2•Updated Dec 18, 2024Dec 18, 2024

• dataproc-spark-connect-python

  Public
  Python

  •

  Apache License 2.0

  •1•0•0•1•Updated Dec 17, 2024Dec 17, 2024

• hadoop-connectors

  Public
  Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.

  hadoop-filesystemhadoop-hcfsgoogle-cloud-dataproc+ 2bigqueryhadoop

  Java

  •

  Apache License 2.0

  •240•280•46•38•Updated Dec 16, 2024Dec 16, 2024

• custom-images

  Public
  Tools for creating Dataproc custom images

  google-cloud-dataproc

  Python

  •

  Apache License 2.0

  •62•32•5•9•Updated Dec 1, 2024Dec 1, 2024

• spark-bigtable-connector

  Public
  Scala

  •

  Apache License 2.0

  •7•3•2•5•Updated Oct 7, 2024Oct 7, 2024

• hive-bigquery-storage-handler

  Public
  Hive Storage Handler for interoperability between BigQuery and Apache Hive

  bigquerygooglehive+ 3hadoopgcpapache

  Java

  •

  Apache License 2.0

  •11•19•6•4•Updated Sep 25, 2024Sep 25, 2024

• .allstar

  Public
  3•1•0•0•Updated Dec 6, 2022Dec 6, 2022

• .github

  Public archive
  0•1•0•0•Updated Oct 26, 2022Oct 26, 2022

• jupyterhub-dataprocspawner

  Public
  google-cloud-dataproc

  Python

  •

  Apache License 2.0

  •11•14•5•2•Updated May 27, 2022May 27, 2022

• dataprocmagic

  Public
  Python

  •

  Apache License 2.0

  •5•3•0•1•Updated Sep 11, 2020Sep 11, 2020

• dataproc-jdbc-connector

  Public
  Java

  •

  Apache License 2.0

  •8•3•7•0•Updated Sep 10, 2020Sep 10, 2020

• bdutil

  Public archive
  [DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine

  Shell

  •

  Apache License 2.0

  •94•110•26•6•Updated Nov 15, 2019Nov 15, 2019