DataFusion CLI#

• Overview

• Installation

  • Install and run using Cargo
  • Install and run using Homebrew (on MacOS)
  • Run using Docker

• Usage

  • Apache Spark compatibility

  • Commands

  • Supported SQL

    • SHOW ALL [VERBOSE]
    • SHOW <OPTION>>
    • SET <OPTION> TO <VALUE>

  • Configuration Options

  • Functions

• Local Files / Directories

• Remote Files / Directories

• CREATE EXTERNAL TABLE

  • Reading from standard input

• Formats

  • Parquet

    • Parquet Specific Options

  • CSV

• Locations

  • HTTP(s)
  • S3
  • OSS
  • COS
  • GCS

• CLI Specific Functions

  • parquet_metadata
  • metadata_cache
  • statistics_cache
  • list_files_cache