Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)

[ICML 2024] Official implementation of "LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned Proportions."

HGConv: Holographic Global Convolutional Networks

Streamlined variant of Long-Range Arena with pinned dependencies, automated data downloads, and deterministic shuffling.

Benchmarking sequence-based models on CIFAR-10 for the LRA benchmark. Implemented and evaluated models like TrellisNet, LipschitzRNN, PiT, Nyströmformer, and FNet for image classification

The PyTorch implementation of Paramixer.