Adjorn van Engelenhoven, succesfully defended his Master thesis. CAST: Clustering self-Attention using Surrogate Tokens for Efficient Transformers. CAST: Clustering self-Attention using Surrogate Tokens for Efficient Transformers.

Engelenhoven, A. van (2023) CAST : Clustering Attention using Surrogate Tokens for Efficient Transformers. University of Twente, Enschede. 

More information: Thesis