Skip to content

kernel: added causal, alibi, sliding window mask for attention#365

Merged
guocuimi merged 5 commits intomainfrom
attn_mask
Jan 9, 2025
Merged

kernel: added causal, alibi, sliding window mask for attention#365
guocuimi merged 5 commits intomainfrom
attn_mask

Conversation

@guocuimi
Copy link
Collaborator

@guocuimi guocuimi commented Jan 8, 2025

No description provided.

@guocuimi guocuimi merged commit 1b55038 into main Jan 9, 2025
@guocuimi guocuimi deleted the attn_mask branch January 24, 2025 03:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant