The Difference Between an AI Model and an AI Product

Posted on Fri 01 October 2027 in GenAI • Tagged with GenAI, LLM, AI-product, startups, opinion

Why This Distinction Keeps Getting Blurred

People use "AI" to mean a lot of different things in the same breath — GPT-4 is "AI," ChatGPT is "AI," a company's customer support bot built on top of both is also "AI." But these are three genuinely different things, sitting at different layers …


Continue reading

Environment Variables in FastAPI — Managing Secrets the Right Way

Posted on Tue 28 September 2027 in Tutorial • Tagged with FastAPI, Python, environment-variables, security, pydantic-settings, deployment

Why This Matters

Almost every FastAPI app eventually needs something it shouldn't have hardcoded in the source code: a database URL, an LLM API key, a JWT secret, a third-party service token. When you're building GenAI apps, this shows up on day one, because you can't call an LLM API …


Continue reading

Why FastAPI Auto-Generates API Docs (And How to Customize Them)

Posted on Mon 27 September 2027 in Tutorial • Tagged with FastAPI, Python, API-docs, Swagger, OpenAPI

Why This Matters

If you've built even a basic FastAPI app, you've probably stumbled onto /docs and been pleasantly surprised — a fully interactive API documentation page, complete with every endpoint, request schema, and a "Try it out" button, without writing a single line of documentation yourself. This isn't a small …


Continue reading

Temperature and Top-p Explained: Why Your AI Sounds Different Each Time

Posted on Sun 18 April 2027 in Beginner Guide • Tagged with GenAI, LLM, temperature, top-p, sampling, beginner

The Question That Started This

I once asked the same question to the same model twice and got two noticeably different answers. My first thought was that something was broken. It wasn't. That variation is a feature, controlled by a couple of settings you've probably seen in every LLM API …


Continue reading

Function Calling Explained: How an LLM Actually "Uses" a Tool

Posted on Sun 04 April 2027 in Beginner Guide • Tagged with GenAI, LLM, function-calling, tool-use, AI-agents, Python

The Misconception I Had

When I first heard that an LLM can "call a function" or "use a tool," I pictured the model reaching out and running code: checking the weather, querying a database, sending an email. It sounded almost magical, and a little scary.

The reality is much simpler …


Continue reading

Human-in-the-Loop: When Should an Agent Ask for Permission?

Posted on Tue 17 November 2026 in Beginner Guide • Tagged with GenAI, AI-agent, human-in-the-loop, autonomy, production, safety

The Autonomy Problem

An AI agent that asks for permission at every step isn't useful. An agent that never asks for permission is dangerous. The interesting design question is where to draw the line — and most people building agents today are drawing it too far in one direction or the …


Continue reading

How Well Do LLMs Handle Tamil and Indian Languages?

Posted on Mon 16 November 2026 in Beginner Guide • Tagged with GenAI, LLM, Tamil, Indian-languages, multilingual, NLP

The Gap Nobody Talks About

Most benchmarks for LLMs are in English. Most demos are in English. Most tutorials, blog posts, and research papers are in English. But over a billion people in India speak languages that are not English — Hindi, Tamil, Telugu, Bengali, Kannada, Malayalam, and more. How well …


Continue reading

What Is an Embedding? Explained Without the Math

Posted on Sun 15 November 2026 in Beginner Guide • Tagged with GenAI, LLM, embeddings, vector-database, semantic-search, beginner

The Problem Computers Have With Meaning

Computers are good at exact matches. Search for "cat" and they'll find every document containing the word "cat." But they won't find documents about "kitten" or "feline" unless those exact words appear too. They have no concept that these words mean similar things.

Embeddings …


Continue reading

Logging and Observability for LLM Apps

Posted on Sat 14 November 2026 in Tutorial • Tagged with GenAI, LLM, logging, observability, production, Python, FastAPI

Why LLM Apps Need Different Observability

Traditional apps fail in predictable ways. A function throws an exception. A query times out. The error is binary: it worked or it didn't, and the stack trace points you to the line.

LLM apps fail softly. The API call succeeds. The response arrives …


Continue reading

Building a RAG API with FastAPI and a Vector Database: Step by Step

Posted on Fri 13 November 2026 in Tutorial • Tagged with GenAI, RAG, FastAPI, vector-database, Python, API, ChromaDB, production

What We're Building

Retrieval-Augmented Generation (RAG) is the pattern where an LLM answers questions using documents you provide, rather than relying only on what it learned during training. It's the foundation of most real-world AI apps: document Q&A, support bots, knowledge assistants.

This post builds a working RAG API …


Continue reading