Skip to content

Increase tolerance in test_timing() to avoid flaky tests.#498

Merged
leofang merged 1 commit intoNVIDIA:mainfrom
rwgk:fix_test_timing_flakiness
Mar 7, 2025
Merged

Increase tolerance in test_timing() to avoid flaky tests.#498
leofang merged 1 commit intoNVIDIA:mainfrom
rwgk:fix_test_timing_flakiness

Conversation

@rwgk
Copy link
Copy Markdown
Collaborator

@rwgk rwgk commented Mar 7, 2025

Observed failures:

>           assert delay_seconds * 1000 <= elapsed_time_ms < delay_seconds * 1000 + 2  # tolerance 2 ms
E           assert 503.1598205566406 < ((0.5 * 1000) + 2)
>           assert delay_seconds * 1000 <= elapsed_time_ms < delay_seconds * 1000 + 2  # tolerance 2 ms
E           assert 505.0583190917969 < ((0.5 * 1000) + 2)

Observed failures:

```
>           assert delay_seconds * 1000 <= elapsed_time_ms < delay_seconds * 1000 + 2  # tolerance 2 ms
E           assert 503.1598205566406 < ((0.5 * 1000) + 2)
```

```
>           assert delay_seconds * 1000 <= elapsed_time_ms < delay_seconds * 1000 + 2  # tolerance 2 ms
E           assert 505.0583190917969 < ((0.5 * 1000) + 2)
```
@copy-pr-bot
Copy link
Copy Markdown
Contributor

copy-pr-bot bot commented Mar 7, 2025

Auto-sync is disabled for ready for review pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@rwgk rwgk requested a review from leofang March 7, 2025 03:31
@rwgk
Copy link
Copy Markdown
Collaborator Author

rwgk commented Mar 7, 2025

This passed testing under #497. Could you please admin-merge, so we don't waste testing resources?

Copy link
Copy Markdown
Member

@leofang leofang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good, thanks Ralf!

@leofang leofang added P0 High priority - Must do! test Improvements or additions to tests cuda.core Everything related to the cuda.core module labels Mar 7, 2025
@leofang leofang added this to the cuda.core beta 3 milestone Mar 7, 2025
@leofang leofang merged commit 6897c26 into NVIDIA:main Mar 7, 2025
4 checks passed
@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 7, 2025

Doc Preview CI
Preview removed because the pull request was closed or merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cuda.core Everything related to the cuda.core module P0 High priority - Must do! test Improvements or additions to tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants