Skip to content

Fix dropout at inference#2889

Merged
Adel-Moumen merged 2 commits intodevelopfrom
fix_dropout_at_inference_attention
Apr 16, 2025
Merged

Fix dropout at inference#2889
Adel-Moumen merged 2 commits intodevelopfrom
fix_dropout_at_inference_attention

Conversation

@Adel-Moumen
Copy link
Copy Markdown
Collaborator

What does this PR do?

Fixes #2888

Before submitting
  • Did you read the contributor guideline?
  • Did you make sure your PR does only one thing, instead of bundling different changes together?
  • Did you make sure to update the documentation with your changes? (if necessary)
  • Did you write any new necessary tests? (not for typos and docs)
  • Did you verify new and existing tests pass locally with your changes?
  • Did you list all the breaking changes introduced by this pull request?
  • Does your code adhere to project-specific code style and conventions?

PR review

Reviewer checklist
  • Is this pull request ready for review? (if not, please submit in draft mode)
  • Check that all items from Before submitting are resolved
  • Make sure the title is self-explanatory and the description concisely explains the PR
  • Add labels and milestones (and optionally projects) to the PR so it can be classified
  • Confirm that the changes adhere to compatibility requirements (e.g., Python version, platform)
  • Review the self-review checklist to ensure the code is ready for review

@pplantinga
Copy link
Copy Markdown
Collaborator

We could maybe at the same time remove line 1255 which sets up dropout that is never used

@Adel-Moumen Adel-Moumen merged commit eb0532a into develop Apr 16, 2025
5 checks passed
@Adel-Moumen Adel-Moumen deleted the fix_dropout_at_inference_attention branch April 16, 2025 15:56
pplantinga added a commit to pplantinga/speechbrain that referenced this pull request Jun 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

RoPE MHA applies dropout at test time

2 participants