Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws.

Thu, 01 May 2025 01:00:00 +0200

Hidetaka Kamigaito, Ying Zhang, Jingun Kwon, Katsuhiko Hayashi, Manabu Okumura, Taro Watanabe:
Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws. CoRR abs/2505.24009 (2025)