Connectors for Spark SQL Query Engine

The Kyuubi Spark SQL Query Engine uses Spark DataSource APIs(V1/V2) to access data from different data sources.

By default, it provides accessibility to hive warehouses with various file formats supported, such as parquet, orc, json, etc.

Also，it can easily integrate with other third-party libraries, such as Hudi, Iceberg, Delta Lake, Kudu, Apache Paimon (Incubating), HBase，Cassandra, etc.

We also provide sample data sources like TDC-DS, TPC-H for testing and benchmarking purpose.

• Delta Lake

  • Delta Lake Integration
  • Delta Lake Operations

• Delta Lake with Microsoft Azure Blob Storage

  • Registration And Configuration
  • Deploy Spark
  • Deploy Kyuubi
  • Dealing Delta Lake Data By Using Kyuubi Examples

• Hudi

  • Hudi Integration
  • Hudi Operations

• Iceberg

  • Iceberg Integration
  • Iceberg Operations

• Kudu

  • What is Apache Kudu
  • Why Kyuubi on Kudu
  • Kudu Integration with Apache Spark
  • Kudu Integration with Kyuubi
  • References

• Hive

  • Hive Connector Integration
  • Hive Connector Operations

• Apache Paimon (Incubating)

  • Apache Paimon (Incubating) Integration
  • Apache Paimon (Incubating) Operations

• TiDB

  • TiDB Integration
  • TiDB Operations

• TPC-DS

  • TPC-DS Integration
  • TPC-DS Operations

• TPC-H

  • TPC-H Integration
  • TPC-H Operations