Skip to content

fix(datafusion): normalize Paimon column identifiers consistently - #634

Open
QuakeWang wants to merge 1 commit into
apache:mainfrom
QuakeWang:ident-normalization
Open

fix(datafusion): normalize Paimon column identifiers consistently#634
QuakeWang wants to merge 1 commit into
apache:mainfrom
QuakeWang:ident-normalization

Conversation

@QuakeWang

Copy link
Copy Markdown
Member

Purpose

Paimon-specific SQL handlers bypass DataFusion's logical planner and previously used raw parser identifiers. This caused DDL and DML column handling to behave inconsistently with DataFusion's identifier-normalization setting.

Brief change log

  • Apply consistent identifier normalization to Paimon DDL, partition operations, UPDATE, MERGE, and INSERT OVERWRITE.
  • Preserve quoted identifiers and reject unknown or duplicate normalized target columns.
  • Add regression tests for normalization-enabled and disabled behavior.

Tests

  • cargo fmt --all -- --check
  • cargo clippy --locked --all-targets --workspace --features fulltext,vortex -- -D warnings
  • DataFusion identifier-normalization integration tests

API and Format

Documentation

Updated docs/src/sql.md.

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant