Skip to content

[GLUTEN-6887][VL] Daily Update Velox Version (2026_07_16) #12527

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
FelixYBW merged 7 commits into from
Jul 19, 2026
+12 −13
Merged

[GLUTEN-6887][VL] Daily Update Velox Version (2026_07_16) #12527

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
8448e40
[GLUTEN-6887][VL] Daily Update Velox Version (dft-2026_07_16)
Jul 16, 2026
30c1d3e
Add support for existing deletion vectors in IcebergWriter
FelixYBW Jul 17, 2026
e5d54b7
Format parameters for IcebergInsertTableHandle constructor
FelixYBW Jul 17, 2026
33fe817
Update IcebergWriter.cc
FelixYBW Jul 17, 2026
2638cd6
Fix type in IcebergWriter for ExistingDeletionVector
FelixYBW Jul 17, 2026
98ef069
remove unused profile
marin-ma Jul 17, 2026
58a1831
Update VeloxWriterUtils.cc
FelixYBW Jul 18, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion cpp/velox/compute/iceberg/IcebergWriter.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -161,7 +161,15 @@ std::shared_ptr<IcebergInsertTableHandle> createIcebergInsertTableHandle(
const std::unordered_map<std::string, std::string> serdeParameters;
auto writeKind = connector::hive::iceberg::IcebergInsertTableHandle::WriteKind::kData;
return std::make_shared<connector::hive::iceberg::IcebergInsertTableHandle>(
columnHandles, locationHandle, fileFormat, spec, compressionKind, serdeParameters, writeKind, fileNameGenerator);
columnHandles,
locationHandle,
fileFormat,
spec,
compressionKind,
serdeParameters,
writeKind,
std::unordered_map<std::string, connector::hive::iceberg::IcebergInsertTableHandle::ExistingDeletionVector>{},
fileNameGenerator);
}

} // namespace
Expand Down
2 changes: 1 addition & 1 deletion cpp/velox/utils/VeloxWriterUtils.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,7 +88,7 @@ std::shared_ptr<facebook::velox::dwio::common::WriterOptions> makeParquetWriteOp
// please make sure `brotli` is enabled when compiling
throw GlutenException("Gluten+velox does not support write parquet using brotli.");
} else if (boost::iequals(compressionCodecStr, "lz4")) {
compressionCodec = CompressionKind::CompressionKind_LZ4;
compressionCodec = CompressionKind::CompressionKind_LZ4_HADOOP;
} else if (boost::iequals(compressionCodecStr, "zstd")) {
compressionCodec = CompressionKind::CompressionKind_ZSTD;
auto codecOptions = std::make_shared<parquet::arrow::util::CodecOptions>();
Expand Down
4 changes: 2 additions & 2 deletions ep/build-velox/src/get-velox.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,8 +18,8 @@ set -exu

CURRENT_DIR=$(cd "$(dirname "$BASH_SOURCE")"; pwd)
VELOX_REPO=https://github.com/IBM/velox.git
VELOX_BRANCH=dft-2026_07_10
VELOX_ENHANCED_BRANCH=ibm-2026_07_10
VELOX_BRANCH=dft-2026_07_16
VELOX_ENHANCED_BRANCH=ibm-2026_07_16
VELOX_HOME=""
RUN_SETUP_SCRIPT=ON
ENABLE_ENHANCED_FEATURES=OFF
Expand Down
9 changes: 0 additions & 9 deletions pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2307,14 +2307,5 @@
<os.full.name>${platform}_${arch}</os.full.name>
</properties>
</profile>
<profile>
<id>disaggregated-shuffle</id>
<activation>
<activeByDefault>false</activeByDefault>
</activation>
<modules>
<module>gluten-disaggregated-shuffle</module>
</modules>
</profile>
</profiles>
</project>
Loading