Guide to Building Python and LLM-Based Multimodal Chatbots

This course teaches modern chatbot development with generative AI. You’ll learn to build AI chatbots from scratch with Python, Llama, Gemini, and Whisper v3.

Beginner

15 Lessons

Certificate of Completion

This course teaches modern chatbot development with generative AI. You’ll learn to build AI chatbots from scratch with Python, Llama, Gemini, and Whisper v3.

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

38 Playgrounds

This course includes

38 Playgrounds

Course Overview

Since the dawn of generative AI, the world of chatbots has transformed. LLMs (large language models) now overshadow what was once considered cutting-edge. This course guides you through the exciting evolution of chatbot development, from foundational techniques to the latest advancements. You’ll answer fundamental questions like “What is a chatbot?”, “How does a chatbot work?” and most importantly, “How to create a chatbot.” You’ll begin by building a simple Python chatbot and enhancing it with Gradio for ...Show More

TAKEAWAY SKILLS

Generative Ai

Gemini

What You'll Learn

Deep understanding of core concepts of chatbot development, including how chatbots work, their different types, and the essential elements of conversational design

Familiarity with the Rasa Open Source framework for building ML-powered chatbots

The ability to incorporate small language models (SLMs) into chatbots with Ollama

Hands-on experience with Groq for accessing Llama 3 for text, Gemini for image processing, and Whisper v3 for accurate speech recognition

The ability to use retrieval-augmented generation (RAG) with LlamaIndex to enhance chatbot knowledge and responses

The ability to deploy chatbots to Hugging Face for accessibility and sharing

What You'll Learn

Deep understanding of core concepts of chatbot development, including how chatbots work, their different types, and the essential elements of conversational design

Course Content

Getting Started

Start your chatbot development journey with this chapter, which provides an overview of the course topics, prerequisites, and the target audience.

Course Overview

Introduction to Chatbots

This chapter explores the world of chatbots and conversational AI—different chatbot types, their basic anatomy, and how to build a simple chatbot with Rasa.

Chatbots and Conversational AI

Types of Chatbots Basic Anatomy of a Chatbot Building a Rasa Chatbot with Python

Building a Generative AI-Powered Chatbot

You’ll learn to build a chatbot with an SLM, then upgrade it to an LLM using Groq, and add image and speech recognition for a truly multimodal experience.

Building a Chatbot Using Small Language Model (SLM)Using Groq to Access LLMs Creating a Unimodal Chatbot with Llama 3 Adding Image Processing Capabilities to the Chatbot with Gemini Adding Speech Recognition to the Chatbot Using Whisper v3

Adding Advanced Capabilities to the Chatbot

You’ll explore RAG with LlamaIndex and empower the chatbot with knowledge retrieval to deploy it on Hugging Face, and challenge yourself by building a quiz bot.

Introduction to RAG with LlamaIndex Adding RAG Capabilities to Our Chatbot with LlamaIndex Deploying Our Chatbot to Hugging Face Challenge: Creating a Quiz Bot

Conclusion

You’ll reflect on the skills gained in building generative AI-powered chatbots and explore potential future directions for your chatbot development journey.

Wrapping Up

Trusted by 1.4 million developers working at companies

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Evan Dunbar

ML Engineer

Carlos Matias La Borde

Software Developer

Souvik Kundu

Front-end Developer

Vinay Krishnaiah

Software Developer

Eric Downs

Musician/Entrepeneur

Kenan Eyvazov

DevOps Engineer

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!