Skip to content

Workaround fix for performance benchmarks dashboard with limited data#689

Merged
keyonghan merged 2 commits intoflutter:masterfrom
keyonghan:timeseries_history_branch_fix
Mar 17, 2020
Merged

Workaround fix for performance benchmarks dashboard with limited data#689
keyonghan merged 2 commits intoflutter:masterfrom
keyonghan:timeseries_history_branch_fix

Conversation

@keyonghan
Copy link
Contributor

This fixes: flutter/flutter#52692

// Queries for recent commits without considering branches.
// TODO(keyonghan): combine this function with the above `queryRecentCommits`,
// this needs to fix https://github.com/flutter/flutter/issues/52694.
Stream<Commit> queryRecentCommitsNoBranch({int limit = 100, int timestamp}) {
Copy link
Contributor

@liyuqian liyuqian Mar 16, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are 100 commits enough? I remember that @CaseyHillers or @digiter once extended the memcache from 3 months of commits to 6 months of commits to properly triage some performance issues. If there are 10 commits a day, that's a limit of 1800 commits.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's the default number for this function. The actual limit for history API is 6000.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see. LGTM!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To clarify, the issue @liyuqian : There was an update to the Datastore records to use a new index for the branching release strategy in Flutter. This an unintended side effect as Cocoon never saved previous records with a branch until the past few weeks. This adds a new query that doesn't use the branch field (at the moment there are very few timeseries datapoints that will impact the perf graphs).

The long term solution is going to be to update old timeseries data to have a master branch (as Cocoon only processed data on master before).

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @CaseyHillers for the explanation. And thank you @keyonghan for a quick fix!

Copy link
Contributor

@CaseyHillers CaseyHillers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks for the quick fix and adding a link to the GitHub issue so we remember to remove this once the branch field gets updated on older data.

@liyuqian
Copy link
Contributor

Shall I merge it now? Is there any extra step to get the fix deployed?

@CaseyHillers
Copy link
Contributor

@liyuqian there's some issues in Flutter dev that created issues for the Cocoon project where it can't be deployed. Keyong is working on resolving them first.

@keyonghan
Copy link
Contributor Author

@liyuqian Just deployed. You should be able to see the data now.

@keyonghan keyonghan merged commit 3f2238b into flutter:master Mar 17, 2020
@keyonghan keyonghan deleted the timeseries_history_branch_fix branch March 13, 2024 20:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

flutter-dashboard.appspot.com/benchmarks now only have 10 days of data

3 participants