O(N·K) multi-head attention for PyTorch — a sparse drop-in replacement for dense scaled-dot-product attention.
By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).