Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Jun 24, 2022

• [SPARK-39383][SQL] Support DEFAULT columns in ALTER TABLE ALTER COLUMNS to V2 data sources

  Show description for 3ed55ff
  

  dtenedor

  authored and

  gengliangwang

  committed
  3ed55ff

  Copy full SHA for 3ed55ff

• [SPARK-39572][PYTHON][TESTS] Fix `test_daemon.py` to support IPv6

  Show description for 5e79385
  dongjoon-hyun

  committed
  5e79385

  Copy full SHA for 5e79385

• [SPARK-39555][PYTHON] Make createTable and listTables in the python side support 3-layer-namespace

  Show description for b2d249b
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  b2d249b

  Copy full SHA for b2d249b

Commits on Jun 23, 2022

• [SPARK-39571][K8S] Add `net-tools` to Spark docker files

  Show description for e406628
  dongjoon-hyun

  committed
  e406628

  Copy full SHA for e406628

• [SPARK-39566][CORE][YARN] Improve YARN cluster mode to support IPv6

  Show description for a3fdf3b
  dongjoon-hyun

  committed
  a3fdf3b

  Copy full SHA for a3fdf3b

• [SPARK-39552][SQL] Unify v1 and v2 `DESCRIBE TABLE`

  Show description for b581b14
  MaxGekk

  committed
  b581b14

  Copy full SHA for b581b14

• [SPARK-39548][SQL] CreateView Command with a window clause query hit a wrong window definition not found issue

  Show description for 4718d59
  

  Rui Wang

  authored and

  cloud-fan

  committed
  4718d59

  Copy full SHA for 4718d59

• [SPARK-39547][SQL] V2SessionCatalog should not throw NoSuchDatabaseException in loadNamspaceMetadata

  Show description for 9513393
  

  Prashant Singh

  authored and

  cloud-fan

  committed
  9513393

  Copy full SHA for 9513393

• [SPARK-39543] The option of DataFrameWriterV2 should be passed to storage properties if fallback to v1

  Show description for e5b7fb8
  

  yikf

  authored and

  cloud-fan

  committed
  e5b7fb8

  Copy full SHA for e5b7fb8

• [SPARK-39563][CORE][TESTS] Use `localHostNameForURI` in `UISuite`

  Show description for 3d68ad8
  

  williamhyun

  authored and

  dongjoon-hyun

  committed
  3d68ad8

  Copy full SHA for 3d68ad8

• [SPARK-39562][SQL][TESTS] Make `hive-thriftserver` module unit tests pass in IPv6 env

  Show description for e6196bc
  dongjoon-hyun

  committed
  e6196bc

  Copy full SHA for e6196bc

• [SPARK-38614][SQL] Don't push down limit through window that's using percent_rank

  Show description for a63ce56
  

  bersprockets

  authored and

  wangyum

  committed
  a63ce56

  Copy full SHA for a63ce56

Commits on Jun 22, 2022

• [SPARK-39538][SQL] Avoid creating unnecessary SLF4J Logger

  Show description for 0658c55
  

  pan3793

  authored and

  srowen

  committed
  0658c55

  Copy full SHA for 0658c55

• [SPARK-39545][SQL] Override `concat` method for `ExpressionSet` in Scala 2.13 to improve the performance

  Show description for a4a83a3
  

  LuciferYang

  authored and

  srowen

  committed
  a4a83a3

  Copy full SHA for a4a83a3

• [SPARK-39559][CORE][WEBUI] Support IPv6 in WebUI

  Show description for b50d094
  dongjoon-hyun

  committed
  b50d094

  Copy full SHA for b50d094

• [SPARK-39561][CORE] Improve `SparkContext` to propagate`java.net.preferIPv6Addresses`

  Show description for 3cbbc0f
  dongjoon-hyun

  committed
  3cbbc0f

  Copy full SHA for 3cbbc0f

• [SPARK-39529][INFRA] Refactor and merge all related job selection logic into precondition

  Show description for 59eee98
  

  2 peopleauthored and

  dongjoon-hyun

  committed
  59eee98

  Copy full SHA for 59eee98

• [SPARK-39340][SQL] DS v2 agg pushdown should allow dots in the name of top-level columns

  Show description for 4567ed9
  cloud-fan

  committed
  4567ed9

  Copy full SHA for 4567ed9

• [SPARK-39551][SQL] Add AQE invalid plan check

  Show description for 58b91b1
  

  maryannxue

  authored and

  cloud-fan

  committed
  58b91b1

  Copy full SHA for 58b91b1

• [SPARK-39533][ML] Deprecate scoreLabelsWeight in BinaryClassificationMetrics

  Show description for 80c2878
  

  zhengruifeng

  authored and

  srowen

  committed
  80c2878

  Copy full SHA for 80c2878

• [SPARK-39195][SQL][FOLLOWUP] Remove flaky test of OutputCommitCoordinator

  Show description for 1e6fcba
  

  AngersZhuuuu

  authored and

  HyukjinKwon

  committed
  1e6fcba

  Copy full SHA for 1e6fcba

• [SPARK-39540][BUILD] Upgrade `mysql-connector-java` to 8.0.29

  Show description for 068809d
  

  bjornjorgensen

  authored and

  dongjoon-hyun

  committed
  068809d

  Copy full SHA for 068809d

Commits on Jun 21, 2022

• [SPARK-38647][SQL] Add SupportsReportOrdering mix in interface for Scan (DataSourceV2)

  Show description for b588d07
  

  EnricoMi

  authored and

  sunchao

  committed
  b588d07

  Copy full SHA for b588d07

• [SPARK-39383][SQL] Support DEFAULT columns in ALTER TABLE ADD COLUMNS to V2 data sources

  Show description for db0e972
  

  dtenedor

  authored and

  gengliangwang

  committed
  db0e972

  Copy full SHA for db0e972

• [SPARK-39542][YARN] Improve YARN client mode to support IPv6

  Show description for 678826e
  dongjoon-hyun

  committed
  678826e

  Copy full SHA for 678826e

• [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

  Show description for 29cf0c4
  

  AngersZhuuuu

  authored and

  cloud-fan

  committed
  29cf0c4

  Copy full SHA for 29cf0c4

• [SPARK-37888][SQL][TESTS] Unify v1 and v2 `DESCRIBE TABLE` tests

  Show description for 42d33e1
  MaxGekk

  committed
  42d33e1

  Copy full SHA for 42d33e1

• [MINOR][INFRA] Remove branch and types in GitHub Actions

  Show description for 40998da
  HyukjinKwon

  committed
  40998da

  Copy full SHA for 40998da

• [SPARK-39152][CORE] Deregistering disk persisted local blocks in case of IO related errors

  Show description for 282c7ae
  

  attilapiros

  authored and

  Ngone51

  committed
  282c7ae

  Copy full SHA for 282c7ae

• [SPARK-39263][SQL] Make GetTable, TableExists and DatabaseExists be compatible with 3 layer namespace

  Show description for ca5f7e6
  

  Rui Wang

  authored and

  cloud-fan

  committed
  ca5f7e6

  Copy full SHA for ca5f7e6

• [SPARK-39521][INFRA][FOLLOW-UP] Update step name to "Run / Check changes" to detect the workflow

  Show description for aeedf14
  HyukjinKwon

  committed
  aeedf14

  Copy full SHA for aeedf14

• [SPARK-39521][INFRA][FOLLOW-UP] Fix notify workload to detect the main build, and readme link

  Show description for c842b4b
  HyukjinKwon

  committed
  c842b4b

  Copy full SHA for c842b4b

Commits on Jun 20, 2022

• [SPARK-39534][PS] Series.argmax only needs single pass

  Show description for 95fba86
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  95fba86

  Copy full SHA for 95fba86

• [SPARK-39521][INFRA] Separate scheduled jobs to each workflow

  Show description for 9e468cf
  HyukjinKwon

  committed
  9e468cf

  Copy full SHA for 9e468cf

• [SPARK-38846][SQL] Add explicit data mapping between Teradata Numeric Type and Spark DecimalType

  Show description for e31d072
  

  Eugene-Mark

  authored and

  srowen

  committed
  e31d072

  Copy full SHA for e31d072