RFA

Reimplementation of Random Feature Attention using PyTorch and customized CUDA kernels.

Documentation coming soon.

Citation

Please cite as:

@inproceedings{
    peng2021rfa,
    title={Random Feature Attention},
    author={Hao Peng and Nikolaos Pappas and Dani Yogatama and Roy Schwartz and Noah Smith and Lingpeng Kong},
    booktitle={International Conference on Learning Representations},
    year={2021},
}