Transformer models have achieved great success in NLP domains and also gained significant interest and breakthroughs in other domains like computer vision/image, speech, audio, protein sequences, organic molecules, tabular data, and also multimodal. Including Tesla’s adoption of Transformer in…