Skip to content

Run all flutter/flutter macOS tests using Xcode 26 and iOS 26 simulator#179810

Open
okorohelijah wants to merge 17 commits intoflutter:masterfrom
okorohelijah:upgrade_xcode_test
Open

Run all flutter/flutter macOS tests using Xcode 26 and iOS 26 simulator#179810
okorohelijah wants to merge 17 commits intoflutter:masterfrom
okorohelijah:upgrade_xcode_test

Conversation

@okorohelijah
Copy link
Contributor

Run all flutter/flutter macOS tests using Xcode 26 and iOS 26 simulator

Fixes #172855

If you had to change anything in the flutter/tests repo, include a link to the migration guide as per the breaking change policy.

Pre-launch Checklist

If you need help, consider asking for advice on the #hackers-new channel on Discord.

Note: The Flutter team is currently trialing the use of Gemini Code Assist for GitHub. Comments from the gemini-code-assist bot should not be taken as authoritative feedback from the Flutter team. If you find its comments useful you can update your code accordingly, but if you are unsure or disagree with the feedback, please feel free to wait for a Flutter team member's review for guidance on which automated comments should be addressed.

@flutter-dashboard
Copy link

It looks like this pull request may not have tests. Please make sure to add tests or get an explicit test exemption before merging.

If you are not sure if you need tests, consider this rule of thumb: the purpose of a test is to make sure someone doesn't accidentally revert the fix. Ask yourself, is there anything in your PR that you feel it is important we not accidentally revert back to how it was before your fix?

Reviewers: Read the Tree Hygiene page and make sure this patch meets those guidelines before LGTMing. If you believe this PR qualifies for a test exemption, contact "@test-exemption-reviewer" in the #hackers channel in Discord (don't just cc them here, they won't see it!). The test exemption team is a small volunteer group, so all reviewers should feel empowered to ask for tests, without delegating that responsibility entirely to the test exemption group.

@github-actions github-actions bot added the engine flutter/engine related. See also e: labels. label Dec 12, 2025
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

The code changes update CI configurations across multiple files to exclusively use Mac-15.7 as the operating system and 17a400 as the macOS SDK version for various build and test targets. The review comment acknowledges these updates but points out a maintainability concern: the os and sdk_version properties are duplicated in platform_properties and then re-declared in several targets, suggesting that these values should be centralized and inherited to adhere to the single source of truth principle.

Comment on lines +33 to +36
os: Mac-15.7
$flutter/osx_sdk : >-
{
"sdk_version": "16c5032a"
"sdk_version": "17a400"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

While os and sdk_version are defined here under platform_properties, these values are overridden or re-declared in several targets later in the file (e.g., for Mac mac_host_engine, Mac mac_ios_engine). This leads to duplication, which makes maintenance harder and goes against the style guide's principle of having a single source of truth.

To improve maintainability, it would be ideal if the targets could inherit these properties from platform_properties without repetition. If the CI system doesn't support inheritance in this way, it might be worth exploring if it can be improved. Centralizing these values would make future updates much easier.

References
  1. The style guide advises to 'Avoid duplicating state: Keep only one source of truth.' (line 30). The repetition of OS and SDK versions in different targets instead of inheriting them from a central definition is a form of duplicated state. (link)

@okorohelijah
Copy link
Contributor Author

okorohelijah commented Dec 15, 2025

[Mac mac_unopt] - https://ci.chromium.org/b/8695387054084377265
[Mac_arm64 module_test_ios] - https://ci.chromium.org/b/8695387406607044545
[Mac_arm64 build_tests_4_4] - https://ci.chromium.org/b/8695387089168137057
[Mac_x64 plugin_lint_mac] - https://ci.chromium.org/b/8695386998574856065

@jmagman
Copy link
Member

jmagman commented Dec 16, 2025

At least some of those failures are filed: #175905

@okorohelijah
Copy link
Contributor Author

i think some of the issues have been filed or are related. Please confirm @vashworth:

[Mac_arm64 build_tests_4_4]- #175905
[Mac_x64 plugin_lint_mac] - #170355

I added:
[Mac_arm64 module_test_ios] - #179936

@vashworth
Copy link
Contributor

@okorohelijah I filed #180141 for Mac unopt failure

@flutter-dashboard
Copy link

This pull request executed golden file tests, but it has not been updated in a while (20+ days). Test results from Gold expire after as many days, so this pull request will need to be updated with a fresh commit in order to get results from Gold.

For more guidance, visit Writing a golden file test for package:flutter.

Reviewers: Read the Tree Hygiene page and make sure this patch meets those guidelines before LGTMing.

@okorohelijah okorohelijah requested a review from a team as a code owner March 9, 2026 22:49
@github-actions github-actions bot added platform-ios iOS applications specifically team-ios Owned by iOS platform team labels Mar 9, 2026
@github-actions github-actions bot added the a: text input Entering text in a text field or keyboard related problems label Mar 10, 2026
@fluttergithubbot
Copy link
Contributor

An existing Git SHA, 2be6d5a5642f34659d6d83781482efd0f1cdd86f, was detected, and no actions were taken.

To re-trigger presubmits after closing or re-opeing a PR, or pushing a HEAD commit (i.e. with --force) that already was pushed before, push a blank commit (git commit --allow-empty -m "Trigger Build") or rebase to continue.

@github-actions github-actions bot removed a: text input Entering text in a text field or keyboard related problems platform-ios iOS applications specifically team-ios Owned by iOS platform team labels Mar 10, 2026
@okorohelijah okorohelijah added CICD Run CI/CD and removed CICD Run CI/CD labels Mar 16, 2026
@okorohelijah okorohelijah added CICD Run CI/CD and removed CICD Run CI/CD labels Mar 16, 2026
@github-actions github-actions bot added a: text input Entering text in a text field or keyboard related problems platform-ios iOS applications specifically team-ios Owned by iOS platform team labels Mar 16, 2026
@okorohelijah okorohelijah added CICD Run CI/CD and removed CICD Run CI/CD labels Mar 16, 2026
@github-actions github-actions bot removed the CICD Run CI/CD label Mar 17, 2026
@okorohelijah okorohelijah force-pushed the upgrade_xcode_test branch 2 times, most recently from aa48c7a to 307fa69 Compare March 17, 2026 10:39
@github-actions github-actions bot added a: text input Entering text in a text field or keyboard related problems platform-ios iOS applications specifically team-ios Owned by iOS platform team and removed a: text input Entering text in a text field or keyboard related problems platform-ios iOS applications specifically team-ios Owned by iOS platform team labels Mar 17, 2026
@github-actions github-actions bot removed a: text input Entering text in a text field or keyboard related problems platform-ios iOS applications specifically team-ios Owned by iOS platform team labels Mar 17, 2026
@github-actions github-actions bot added a: text input Entering text in a text field or keyboard related problems platform-ios iOS applications specifically team-ios Owned by iOS platform team labels Mar 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

a: text input Entering text in a text field or keyboard related problems engine flutter/engine related. See also e: labels. platform-ios iOS applications specifically team-ios Owned by iOS platform team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Run all flutter/flutter macOS tests using Xcode 26 and iOS 26 simulator

4 participants