AI Village Chatbot

Overview

A Generative AI-powered chatbot designed to provide automated information services for rural villages via Telegram. It integrates a Hybrid Retrieval-Augmented Generation (RAG) pipeline to ensure accurate, context-aware responses based on village data.

The Challenge

• Handling large amounts of unstructured text data efficiently.
• Ensuring data privacy and compliance with Thailand's PDPA regulations.
• Optimizing AI response times on limited network bandwidth in rural areas.

Implementation

• Implemented a Hybrid RAG Pipeline using LangChain.js to fetch precise contextual data before querying the LLM.
• Developed a 'PDPA Shield' layer that automatically anonymizes PII (Personally Identifiable Information) before data hits the language models.
• Utilized Groq for ultra-fast inference and Gemini for complex reasoning tasks, balancing speed and accuracy.

Outcomes