Skip to content

[SPARK-50098][PYTHON][CONNECT][FOLLOWUP] Fix PySpark Connect _minimum_googleapis_common_protos_version to 1.65.0#49969

Closed
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-50098-3
Closed

[SPARK-50098][PYTHON][CONNECT][FOLLOWUP] Fix PySpark Connect _minimum_googleapis_common_protos_version to 1.65.0#49969
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-50098-3

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Feb 16, 2025

What changes were proposed in this pull request?

This is a follow-up of

`googleapis-common-protos` >=1.65.0 Required for Spark Connect

ARG CONNECT_PIP_PKGS="grpcio==1.67.0 grpcio-status==1.67.0 googleapis-common-protos==1.65.0 graphviz==0.20 protobuf"

Why are the changes needed?

To make it sure that PySpark Connect installation meets the minimum requirement correctly.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

…m_googleapis_common_protos_version` to 1.65.0
@dongjoon-hyun
Copy link
Member Author

cc @cloud-fan

@dongjoon-hyun
Copy link
Member Author

Thank you, @cloud-fan . Merged to master/4.0.

dongjoon-hyun added a commit that referenced this pull request Feb 16, 2025
…m_googleapis_common_protos_version` to 1.65.0

### What changes were proposed in this pull request?

This is a follow-up of
- #48638

https://github.com/apache/spark/blob/c36916f7a112dc6c6505c12d68c3f63c5aa31db2/python/docs/source/getting_started/install.rst?plain=1#L213

https://github.com/apache/spark/blob/c36916f7a112dc6c6505c12d68c3f63c5aa31db2/dev/spark-test-image/python-minimum/Dockerfile#L76

### Why are the changes needed?

To make it sure that PySpark Connect installation meets the minimum requirement correctly.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #49969 from dongjoon-hyun/SPARK-50098-3.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit b8d395e)
Signed-off-by: Dongjoon Hyun <[email protected]>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-50098-3 branch February 16, 2025 15:23
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 14, 2025
…m_googleapis_common_protos_version` to 1.65.0

### What changes were proposed in this pull request?

This is a follow-up of
- apache#48638

https://github.com/apache/spark/blob/acc254463533b863b8afe8dccad6565bbff9e35c/python/docs/source/getting_started/install.rst?plain=1#L213

https://github.com/apache/spark/blob/acc254463533b863b8afe8dccad6565bbff9e35c/dev/spark-test-image/python-minimum/Dockerfile#L76

### Why are the changes needed?

To make it sure that PySpark Connect installation meets the minimum requirement correctly.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#49969 from dongjoon-hyun/SPARK-50098-3.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 3aed35d)
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants