Search results

Current shuffle format has too much overhead with default batch size

area:shuffleShuffle (JVM and native)Shuffle (JVM and native)

bugSomething isn't workingSomething isn't working

performance

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

Status: Open.

#3882 In apache/datafusion-comet;

· andygrove opened on Apr 2, 2026

·  

0.15.0

Add ExistenceJoin support to Comet native execution

enhancementNew feature or requestNew feature or request

requires-triage

Status: Open.

#3881 In apache/datafusion-comet;

· Shekharrajak opened on Apr 2, 2026

Spark cannot reclaim memory from native operators (spill callback returns 0)

performance

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

Status: Open.

#3873 In apache/datafusion-comet;

· andygrove opened on Apr 1, 2026

·  

0.15.0

DPP fallback not working correct in awslabs TPC-DS benchmark

bugSomething isn't workingSomething isn't working

requires-triage

Status: Open.

#3870 In apache/datafusion-comet;

· andygrove opened on Apr 1, 2026

Reduce off-heap memory requirements TPC 1TB benchmarks

enhancementNew feature or requestNew feature or request

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

requires-triage

Status: Open.

#3868 In apache/datafusion-comet;

· andygrove opened on Apr 1, 2026

·  

0.15.0

Native scans cannot propagate JVM-side Spark accumulators

requires-triage

Status: Open.

#3867 In apache/datafusion-comet;

· andygrove opened on Apr 1, 2026

timestamp_ntz_to_timestamp panics on ambiguous or non-existent local times (DST transitions)

bugSomething isn't workingSomething isn't working

priority:criticalData corruption, silent wrong results, security issuesData corruption, silent wrong results, security issues

Status: Open.

#3864 In apache/datafusion-comet;

· matthewalex4 opened on Apr 1, 2026

clippy collapsible_match error on rust nightly (1.96.0)

bugSomething isn't workingSomething isn't working

requires-triage

Status: Open.

#3862 In apache/datafusion-comet;

· manuzhang opened on Apr 1, 2026

bug: native Iceberg reader errors on residual filter on column after nested type for migrated Parquet files

area:scanParquet scan / data readingParquet scan / data reading

crashNative engine crash/panic/segfaultNative engine crash/panic/segfault

priority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakage

Status: Open.

Bug

#3860 In apache/datafusion-comet;

· mbutrovich opened on Mar 31, 2026

Consider using single spill file for multiple partitions

area:shuffleShuffle (JVM and native)Shuffle (JVM and native)

enhancementNew feature or requestNew feature or request

performance

requires-triage

Status: Open.

#3859 In apache/datafusion-comet;

· andygrove opened on Mar 31, 2026

bug: native Iceberg reader can return wrong results for migrated Parquet files with INT96 timestamps

area:scanParquet scan / data readingParquet scan / data reading

bugSomething isn't workingSomething isn't working

priority:criticalData corruption, silent wrong results, security issuesData corruption, silent wrong results, security issues

Status: Open.

Bug

#3856 In apache/datafusion-comet;

· mbutrovich opened on Mar 31, 2026

Experiment: immediate-mode shuffle

enhancementNew feature or requestNew feature or request

requires-triage

Status: Open.

#3855 In apache/datafusion-comet;

· andygrove opened on Mar 31, 2026

·  

0.15.0