File:Retrieval-Augmented Generation chatbot, part 2 - LangChain, Hugging Face, OpenSearch, AWS.webm
| Uploaded by | Prototyperspective |
|---|---|
| Upload date | 2024-09-11T15:47:56Z |
| MIME type | video/webm |
| Dimensions | 1920 × 1080 px |
| File size | 71.0 MB |
Summary
| Description |
English: We'll walk you through the creation of a Retrieval-Augmented Generation (RAG) chatbot using open-source tools and AWS services like LangChain, Hugging Face, Amazon SageMaker, and Amazon OpenSearch Serverless.
Part 1: LangChain, Hugging Face, FAISS, Amazon SageMaker, and Amazon TextTract. ⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at https://julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️ We start by deploying Mistral 7B, a cutting-edge open-source LLM, onto a SageMaker endpoint. Following this, we work with the Reuters dataset, a Hugging Face dataset comprising 20,000 news articles. We break down these articles into smaller sections and apply bge-small, a compact open-source embedding model, to them. Next, we proceed to index these sections into an Amazon OpenSearch Serverless vector index, which we then query through LangChain. Additionally, aside from the RAG demonstration, we delve into some vital yet often overlooked steps related to authentication and security for OpenSearch Serverless. - Notebook: https://gitlab.com/juliensimon/huggingface-demos/-/tree/main/langchain/rag-demo-sagemaker-opensearch - LangChain: https://www.langchain.com/ - Amazon OpenSearch Serverless: https://docs.aws.amazon.com/opensearch-service/latest/developerguide/serverless.html - Embedding leaderboard: https://huggingface.co/spaces/mteb/leaderboard - Embedding model: https://huggingface.co/BAAI/bge-small-en-v1.5 - LLM: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 |
| Date | |
| Source | YouTube: Retrieval-Augmented Generation chatbot, part 2 - LangChain, Hugging Face, OpenSearch, AWS – View/save archived versions on archive.org |
| Author | Julien Simon |
Licensing
.svg){kind=icon}
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
|
This file, which was originally posted to an external website, has not yet been reviewed by an administrator or reviewer to confirm that the above license is valid. See Category:License review needed for further instructions.
|