DataFusion is an extensible query engine written in Rust that uses Apache Arrow as its in-memory format.



Apache DataFusion

# Spark Compatible Functions[#](https://datafusion.apache.org/library-user-guide/functions/spark.html#spark-compatible-functions "Link to this heading")

The [`datafusion-spark`](https://crates.io/crates/datafusion-spark) crate provides Apache Spark-compatible expressions for use with DataFusion.

Please see the documentation for the [`datafusion-spark` crate](https://docs.rs/datafusion-spark/latest/datafusion_spark/) for more details.

Spark Compatible Functions

KnowForge 新版本 2026.0.3 正式发布！！！

产品

资源

其他

Introduction

Example Usage

Features

Concepts, Readings, Events

Crate Configuration

Overview

Installation

Usage

Local Files / Directories

CLI Specific Functions

DataFusion CLI

DataFrame API

Gentle Arrow Introduction

Expression API

Data Types

Struct Type Coercion and Field Mapping

SELECT syntax

Subqueries

EXPLAIN

Information Schema

Operators and Literals

Aggregate Functions

Window Functions

Scalar Functions

Special Functions

Format Options

Prepared Statements

SQL Reference

Configuration Settings

Reading Explain Plans

Parquet Content-Defined Chunking

Metrics

Frequently Asked Questions

User Guide

DataFusion 56.0.0

DataFusion 55.0.0

DataFusion 54.0.0

DataFusion 53.0.0

DataFusion 52.0.0

DataFusion 51.0.0

DataFusion 50.0.0

DataFusion 49.0.0

DataFusion 48.0.1

DataFusion 48.0.0

DataFusion 47.0.0

DataFusion 46.0.0

Upgrade Guides

Extensions List

Using the SQL API

Extending SQL Syntax

Working with Exprs

Using the DataFrame API

Building Logical Plans

Catalogs, Schemas, and Tables

Adding User Defined Functions: Scalar/Window/Aggregate/Table Functions

Functions

Custom Table Provider

Table Constraint Enforcement

Extending Operators

Profiling Cookbook

Query Optimizer

Library User Guide

Reviewing Pull Requests

Community Communication

Development Environment

Architecture

Workspace Dependency Graph

Testing

API health policy

HOWTOs

Release Management

Roadmap and Improvement Proposals

Governance

Inviting New Committers and PMC Members

Invariants

Output field name semantics

Specifications

GSoC Application Guidelines (2025)

GSoC Project Ideas (2025)

Google Summer of Code (GSOC)

Contributor Guide

Spark Compatible Functions

Spark Compatible Functions#

评论