Document Details

Clip: TheFreeTransformer François Fleuret 1 1 FAIR at Meta We propose an extension of the decoder Transformer that conditions its generative process on random latent variables which are learned without supervision thanks to a variational procedure. Experimental evaluations show that allowing such a conditioning translates into substantial improvements on downstream tasks. Date: Correspondence: 1 Since their invention, the Transformer (Vaswani et al.,), and more specifically the decoder-only Transformers used originally for the GPT series of models (Radford et al.,), have become the core components of AI systems.

Filename: 2510.17558v1.pdf

Notes: