Мультимодальные LLM. 1. Introduction to Multimodality. Deep & Early Fusion
- 00:05Введение
- 02:26План курса
- 03:56План лекции
- 05:11Idea of Multimodality
- 07:00Static Benchmarks
- 20:16Dynamic Benchmarks
- 26:38Architectures
- 28:32CLIP
- 36:31Self-Attention vs Cross-Attention
- 49:48SC-DF: Standart Cross-Attention
- 54:25SC-DF: Open Flamingo (Nov 2022)
- 01:09:43CL-DF: Custom Layers
- 01:11:15CL-DF: MoE - LLaVA (Dec 2024)
- 01:22:18Early Fusion


