Skip to content

Conversation

DillionLowry
Copy link

  • Add optional scale and enable_gqa arguments to torch.nn.functional.scaled_dot_product_attention. Default values scale = null and enable_gqa = false match pytorch.

Breaking Change:

  • torch.nn.functional.scaled_dot_product_attention's function signature has been changed. The is_casual argument has been renamed to is_causal to match pytorch.

@DillionLowry
Copy link
Author

@dotnet-policy-service agree

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant