#75- Mixtral and Mixture of Experts.

Life with AI

English - January 18, 2024 09:37 - 10 minutes - 10 MB - ★★★★★ - 1 rating
Technology Homepage Download Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed

Previous Episode: #74- Named Entity Recognition and NLP with Sergei Bogdanov.

Next Episode: #76- Solving problems using AI.

Hey guys, in this episode I talk about Mixture Of Experts, more specifically about Mixtral, which is today the best open-source LLM available, and also better than ChatGPT 3.5 and Gemini Pro.

Mixtral paper: ⁠https://arxiv.org/pdf/2401.04088.pdf⁠

Mixtral model: ⁠https://huggingface.co/mistralai/Mixtral-8x7B-v0.1⁠

Mixtral YouTube: ⁠https://www.youtube.com/watch?v=mwO6v4BlgZQ⁠

Instagram: https://www.instagram.com/podcast.lifewithai

Linkedin: https://www.linkedin.com/company/life-with-ai