Provenance in AI: Why It Matters for AI Engineers
1. Introduction: Why AI Needs a Paper Trail Imagine debugging a complex AI pipeline without knowing which version of the dataset was used, how the features were...
Category: GenAI
LLMs for SMEs – 001: How Small Businesses Can Leverage AI Without Cloud Costs
1. Introduction Ravi runs a small auto parts shop in Navi Mumbai. His day starts at 8 AM, but even before he lifts the shutter, his phone is already buzzing. Cu...
LLM-Powered Chatbots: A Practical Guide to User Input Classification and Intent Handling
1. Introduction If you’ve ever built a chatbot that confidently answered the wrong question, you know the pain of poor intent detection. Imagine a user typing: ...
Reranking for RAG: Boosting Answer Quality in Retrieval-Augmented Generation
Retrieval-Augmented Generation (RAG) is one of the most effective techniques for making large language models (LLMs) answer accurately using external knowledge....
ChatML: The Structured Language Behind Conversational AI
If you’ve interacted with ChatGPT or built your own conversational AI, you might have wondered — how exactly does the AI know which parts of a message are from ...
Question Answer Chatbot using RAG, Llama and Qdrant
1. Introduction I have created this teaching chatbot that can answer questions from class IX, subject SST, on the topic “Democratic politics“. I hav...
On Emergent Abilities of Large Language Models
An ability is emergent if it is not present in smaller models but is present in larger models. [1] Scaling up language models has been shown to improve predicta...
Prompt Engineering
Prompt is a text set passed to the GenAI model as instructions. Given the prompt, the model responds with some generated text. A prompt can be questions, statem...
Text Clustering and Topic Modeling using Large Language Models (LLMs)
1. Introduction Text clustering is an unsupervised approach that helps in discovering patterns in data. Grouping similar texts according to their semantic conte...
Text Classification using Large Language Models (LLMs)
1. Introduction A common task in natural language processing (NLP) is text classification. Use cases of text classification include sentiment analysis, intent d...