Skip to content

feat(inspect): add system metadata tables - #876

Draft
manuzhang wants to merge 9 commits into
apache:mainfrom
manuzhang:agent/add-system-metadata-tables
Draft

feat(inspect): add system metadata tables#876
manuzhang wants to merge 9 commits into
apache:mainfrom
manuzhang:agent/add-system-metadata-tables

Conversation

@manuzhang

@manuzhang manuzhang commented Aug 6, 2026

Copy link
Copy Markdown
Member

Summary

Add streaming system metadata tables for branches, tags, files, partitions, and manifests.

Changes

  • expose typed metadata-table kinds and public table classes
  • add shared Arrow stream and metadata-table utilities
  • implement snapshot-aware files, partitions, and manifests scans
  • implement branch and tag reference scans
  • wire sources and tests into CMake and Meson
  • add coverage for schemas, values, partition evolution, and batching behavior

Why

This makes Iceberg system metadata available through the C++ metadata-table API, using bounded Arrow batches and behavior aligned with Apache Iceberg's reference implementation.

Impact

Consumers can inspect table references, live files, partition aggregates, and manifest metadata without implementing manifest traversal or Arrow materialization themselves.

Dependency

This branch is based on #801, which provides the metadata-table streaming APIs used here. Because this PR targets main, its diff includes that prerequisite history until #801 is merged.

WZhuo and others added 9 commits July 17, 2026 10:06
- Add Scan() virtual method and Scan() convenience overload to MetadataTable
- Add SnapshotSelection struct for time-travel snapshot resolution
- Add supports_time_travel() concrete method driven by kind()
- Implement SnapshotsTable::Scan() to materialize snapshot rows via ArrowRowBuilder
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants