It has been only a decade since AlexNet started a new era of AI-based image processing. Convolutional Neural Networks (CNNs) have since made their way from the consumer market into the industrial world. As we continue to explore the full potential of CNNs, the next wave of excitement is rolling towards us. Vision Transformers, sharing technological roots with famous large language models such as GPT, LlaMa, or BARD, offer their distinct opportunities and challenges worthy of discussion: How can we navigate the capabilities and intricacies of this new generation of models?