Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Jan 23, 2019

• [SPARK-22465][CORE][FOLLOWUP] Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

  Show description for 3da71f2
  

  Ngone51

  authored and

  cloud-fan

  committed
  3da71f2

  Copy full SHA for 3da71f2

• [SPARK-26228][MLLIB] OOM issue encountered when computing Gramian matrix

  Show description for 6dcad38
  srowen

  committed
  6dcad38

  Copy full SHA for 6dcad38

• [SPARK-24484][MLLIB] Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

  Show description for 0d35f9e
  

  shahidki31

  authored and

  srowen

  committed
  0d35f9e

  Copy full SHA for 0d35f9e

• [MINOR][DOC] Documentation on JVM options for SBT

  Show description for 9d2a115
  

  da-liii

  authored and

  srowen

  committed
  9d2a115

  Copy full SHA for 9d2a115

Commits on Jan 22, 2019

• [SPARK-26661][SQL] Show actual class name of the writing command in CTAS explain

  Show description for 02d8ae3
  

  rednaxelafx

  authored and

  dongjoon-hyun

  committed
  02d8ae3

  Copy full SHA for 02d8ae3

• [SPARK-26685][K8S] Correct placement of ARG declaration

  Show description for dc2da72
  

  rvesse

  authored and

  Marcelo Vanzin

  committed
  dc2da72

  Copy full SHA for dc2da72

• [SPARK-25887][K8S] Configurable K8S context support

  Show description for c542c24
  

  rvesse

  authored and

  Marcelo Vanzin

  committed
  c542c24

  Copy full SHA for c542c24

• [SPARK-26665][CORE] Fix a bug that BlockTransferService.fetchBlockSync may hang forever

  Show description for 66450bb
  zsxwing

  committed
  66450bb

  Copy full SHA for 66450bb

• [SPARK-26657][SQL] Use Proleptic Gregorian calendar in DayWeek and in WeekOfYear

  Show description for 64ce1c9
  

  MaxGekk

  authored and

  hvanhovell

  committed
  64ce1c9

  Copy full SHA for 64ce1c9

• [SPARK-16838][PYTHON] Add PMML export for ML KMeans in PySpark

  Show description for 06792af
  

  huaxingao

  authored and

  srowen

  committed
  06792af

  Copy full SHA for 06792af

• [SPARK-24938][CORE] Prevent Netty from using onheap memory for headers without regard for configuration

  Show description for 055bf8e
  

  2 peopleauthored and

  srowen

  committed
  055bf8e

  Copy full SHA for 055bf8e

• [SPARK-26463][CORE] Use ConfigEntry for hardcoded configs for scheduler categories.

  Show description for 7bf0794
  

  kiszk

  authored and

  srowen

  committed
  7bf0794

  Copy full SHA for 7bf0794

• [SPARK-26616][MLLIB] Expose document frequency in IDFModel

  Show description for d2e86cb
  

  purijatin

  authored and

  srowen

  committed
  d2e86cb

  Copy full SHA for d2e86cb

• [SPARK-25811][PYSPARK] Raise a proper error when unsafe cast is detected by PyArrow

  Show description for f92d276
  

  viirya

  authored and

  HyukjinKwon

  committed
  f92d276

  Copy full SHA for f92d276

Commits on Jan 21, 2019

• [SPARK-26520][SQL] data source v2 API refactor (micro-batch read)

  Show description for 098a2c4
  

  cloud-fan

  authored and

  gatorsmile

  committed
  098a2c4

  Copy full SHA for 098a2c4

• [SPARK-26676][PYTHON] Make HiveContextSQLTests.test_unbounded_frames test compatible with Python 2 and PyPy

  Show description for 75d8449
  

  HyukjinKwon

  authored and

  BryanCutler

  committed
  75d8449

  Copy full SHA for 75d8449

• [SPARK-26652][SQL] Remove fromJSON and fromString from Literal

  Show description for 4c1cd80
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  4c1cd80

  Copy full SHA for 4c1cd80

• [SPARK-26351][MLLIB] Update doc and minor correction in the mllib evaluation metrics

  Show description for 9a30e23
  

  shahidki31

  authored and

  srowen

  committed
  9a30e23

  Copy full SHA for 9a30e23

Commits on Jan 20, 2019

• [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

  Show description for 6c18d8d
  

  LucaCanali

  authored and

  Felix Cheung

  committed
  6c18d8d

  Copy full SHA for 6c18d8d

• [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

  Show description for 6d9c54b
  

  mgaido91

  authored and

  HyukjinKwon

  committed
  6d9c54b

  Copy full SHA for 6d9c54b

Commits on Jan 19, 2019

• [MINOR][TEST] Correct some unit test mistakes

  Show description for ace2364
  

  10110346

  authored and

  srowen

  committed
  ace2364

  Copy full SHA for ace2364

• [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

  Show description for 64cc9e5
  

  kiszk

  authored and

  dongjoon-hyun

  committed
  64cc9e5

  Copy full SHA for 64cc9e5

Commits on Jan 18, 2019

• [SPARK-26646][TEST][PYSPARK] Fix flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

  Show description for 8503aa3
  

  viirya

  authored and

  HyukjinKwon

  committed
  8503aa3

  Copy full SHA for 8503aa3

• [SPARK-26618][SQL] Make typed Timestamp/Date literals consistent to casting

  Show description for 34db5f5
  

  MaxGekk

  authored and

  hvanhovell

  committed
  34db5f5

  Copy full SHA for 34db5f5

• [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

  Show description for e341864
  

  rednaxelafx

  authored and

  gatorsmile

  committed
  e341864

  Copy full SHA for e341864

• [SPARK-26640][CORE][ML][SQL][STREAMING][PYSPARK] Code cleanup from lgtm.com analysis

  Show description for c2d0d70
  

  srowen

  and

  HyukjinKwon

  committed
  c2d0d70

  Copy full SHA for c2d0d70

Commits on Jan 17, 2019

• [SPARK-26638][PYSPARK][ML] Pyspark vector classes always return error for unary negation

  Show description for 0b3abef
  srowen

  committed
  0b3abef

  Copy full SHA for 0b3abef

• [SPARK-26622][SQL] Revise SQL Metrics labels

  Show description for ede35c8
  

  2 peopleauthored and

  gatorsmile

  committed
  ede35c8

  Copy full SHA for ede35c8

• [SPARK-26621][CORE] Use ConfigEntry for hardcoded configs for shuffle categories.

  Show description for 1b575ef
  

  10110346

  authored and

  srowen

  committed
  1b575ef

  Copy full SHA for 1b575ef

• [SPARK-26593][SQL] Use Proleptic Gregorian calendar in casting UTF8String to Date/TimestampType

  Show description for 6f8c0e5
  

  MaxGekk

  authored and

  hvanhovell

  committed
  6f8c0e5

  Copy full SHA for 6f8c0e5

• [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path

  Show description for c0632ce
  

  gengliangwang

  authored and

  cloud-fan

  committed
  c0632ce

  Copy full SHA for c0632ce

• [SPARK-26457] Show hadoop configurations in HistoryServer environment tab

  Show description for 650b879
  

  2 peopleauthored and

  srowen

  committed
  650b879

  Copy full SHA for 650b879

• [MINOR][BUILD] ensure call to translate_component has correct number of arguments

  Show description for 4915cb3
  

  wright

  authored and

  srowen

  committed
  4915cb3

  Copy full SHA for 4915cb3

• [SPARK-26466][CORE] Use ConfigEntry for hardcoded configs for submit categories.

  Show description for 38f0307
  

  HeartSaVioR

  authored and

  srowen

  committed
  38f0307

  Copy full SHA for 38f0307

• [SPARK-26600] Update spark-submit usage message

  Show description for 272428d
  

  LucaCanali

  authored and

  srowen

  committed
  272428d

  Copy full SHA for 272428d