Abstract: Diverse Transformer models are being explored for Contextual and Generative AI. While matrix-matrix and matrixvector multiplication remain invariant core operators, non-linear activation ...