Oss upstream#602

Draft

Davis-Zhang-Onehouse wants to merge 52 commits into

apache:mainfrom

vinishjail97:oss-upstream

Commits on Apr 10, 2026

initial patch
Davis Zhang
committed
align reader context
Davis Zhang
committed
align delete context
Davis Zhang
committed
align scheme handler & project column when read
Davis Zhang
committed

Commits on Apr 12, 2026

guard against key based buffer
Davis Zhang
committed
avro schema utils
Davis Zhang
committed
avro schema util
Davis Zhang
committed
clean up tests
Davis Zhang
committed

Commits on Apr 13, 2026

update claude.md
Davis Zhang
committed

Commits on May 7, 2026

add design spec for keyFilterOpt port from hudi-internal

Davis Zhang
and
claude
committed
update keyFilterOpt spec: kind() pattern-match accessors

Davis Zhang
and
claude
committed
add implementation plan for keyFilterOpt port

Davis Zhang
and
claude
committed
add empty module skeletons for expression + internal_schema

Davis Zhang
and
claude
committed
port Type trait + TypeID enum from internal.schema.Type.java

Davis Zhang
and
claude
committed
port primitive Types from internal.schema.Types.java

Davis Zhang
and
claude
committed
port nested Types (Field, RecordType, ArrayType, MapType)

Davis Zhang
and
claude
committed
port StructLike + ArrayData traits

Davis Zhang
and
claude
committed
fix Task 1.5: ArrayData should be a concrete struct, not a trait

Davis Zhang
and
claude
committed
port Expression trait + Operator enum + empty ExpressionKind

Davis Zhang
and
claude
committed
port LeafExpression trait + BinaryExpression helper struct

Davis Zhang
and
claude
committed
port Literal + LiteralValue + add ExpressionKind::Literal variant

Davis Zhang
and
claude
committed
port NameReference + add ExpressionKind::NameReference variant

Davis Zhang
and
claude
committed
port BoundReference + add ExpressionKind::BoundReference variant

Davis Zhang
and
claude
committed
port Predicate trait + PredicateKind skeleton; finalize ExpressionKind

Davis Zhang
and
claude
committed
port Predicates::TrueExpression + FalseExpression

Davis Zhang
and
claude
committed
port Predicates::And/Or/Not + 3 PredicateKind variants

Davis Zhang
and
claude
committed
port Predicates::{BinaryComparison,In,IsNull,IsNotNull,StringStartsWith*,StringContains} + factories

Davis Zhang
and
claude
committed
port Comparators

Davis Zhang
and
claude
committed
port ExpressionVisitor + BindVisitor + PartialBindVisitor (stubs)

Davis Zhang
and
claude
committed
phase 1: fix clippy bool_assert_comparison in array_data test

Davis Zhang
and
claude
committed
add KeySpec + create_key_spec for keyFilterOpt log-scan path

Davis Zhang
and
claude
committed
add key_filter_opt field to ReaderContext

Davis Zhang
and
claude
committed
scan_internal accepts Option<KeySpec>; buffer applies key-spec filter

Davis Zhang
and
claude
committed
wire create_key_spec into HoodieMergedLogRecordReader::perform_scan

Davis Zhang
and
claude
committed
apply keyFilterOpt as row filter on base parquet batches

Davis Zhang
and
claude
committed
phase 2 cross-check vs readerContext_callstack.md (appendix)

Davis Zhang
and
claude
committed
add e2e test helpers for keyFilterOpt phase 3 smoke test

Davis Zhang
and
claude
committed
add Phase 3 e2e smoke test for keyFilterOpt

Davis Zhang
and
claude
committed
phase 3: add key_filter_opt: None to FFI ReaderContext literals

Davis Zhang
and
claude
committed
phase 3: drop unused import in bound_reference test

Davis Zhang
and
claude
committed
add design spec for keyFilterOpt e2e coverage expansion

Davis Zhang
and
claude
committed
add implementation plan for keyFilterOpt e2e coverage expansion

Davis Zhang
and
claude
committed
add FilterAbResult helper + refactor keyFilterOpt e2e test 1

Davis Zhang
and
claude
committed
add e2e test fg_filter_in_base_only_key (isolates base-file filter)

Davis Zhang
and
claude
committed
add e2e test fg_filter_in_no_match (filter drops everything)

Davis Zhang
and
claude
committed
add e2e test fg_filter_starts_with_any_prefix (PrefixKeys path)

Davis Zhang
and
claude
committed
add e2e test fg_filter_unsupported_predicate_is_noop (regression guard)

Davis Zhang
and
claude
committed
add e2e test fg_filter_in_with_delete_block (delete-block path) +

Davis Zhang
and
claude
committed
add e2e test fg_filter_in_log_updated_key_nonpart

Davis Zhang
and
claude
committed
add e2e test fg_filter_in_log_only_filegroup (isolates log-scan filter)

Davis Zhang
and
claude
committed

Commits on May 8, 2026

chore: cargo fmt --all
Davis Zhang
committed
fix(cpp): align test_read_record_batch_column_projection with FFI projection contract
Davis Zhang
committed