Vision Transformer Architectures

In the fifth episode we talk about Vision Transformer architectures. An approach for language translation and only recently applied to computer vision. This approach is more suitable for specific tasks as it takes context into account.

Terms mentioned:

Vision Transformer: https://theaisummer.com/vision-transformer/

Attention and Self Attention: https://vaclavkosar.com/ml/transformers-self-attention-mechanism-simplified

⁠Our sponsor is askui: Automate UI workflows on every platform!

Episode source