Customized Linformer Attention Layer
Linformer: multi-head linear attention with low-rank temporal projection.
You are now following this Submission
- You will see updates in your followed content feed
- You may receive emails, depending on your communication preferences
Multi-head linear attention (Linformer) layer for entire temporal window attention with temporal low-rank projection. The implementation presented here mainly refer to the paper reference.
Cite As
Chuguang Pan (2026). Customized Linformer Attention Layer (https://www.mathworks.com/matlabcentral/fileexchange/184394-customized-linformer-attention-layer), MATLAB Central File Exchange. Retrieved .
General Information
- Version 1.0.0 (6.87 KB)
MATLAB Release Compatibility
- Compatible with R2026a to R2026b
Platform Compatibility
- Windows
- macOS
- Linux
| Version | Published | Release Notes | Action |
|---|---|---|---|
| 1.0.0 |
