spark-connect is a Ruby client for Apache Spark Connect, the gRPC-based decoupled client-server protocol for Apache Spark. It provides a DataFrame API closely modeled on PySpark, including SQL, relational operators, column expressions, a comprehensive functions library, typed schemas, and Apache Arrow-based result decoding.

Required Ruby Version

>= 3.1.0

Authors

Hyukjin Kwon

Versions

  1. 0.3.0

    1. source

      1. 0.3.0 source June 15, 2026 (119 KB)
  2. 0.2.0

    1. source

      1. 0.2.0 source June 10, 2026 (118 KB)

Pushed by

gurwls223

SHA 256 checksum

← Previous version