The Difference Between an AI Model and an AI Product

Posted on Fri 01 October 2027 in GenAI • Tagged with GenAI, LLM, AI-product, startups, opinion

Why This Distinction Keeps Getting Blurred

People use "AI" to mean a lot of different things in the same breath — GPT-4 is "AI," ChatGPT is "AI," a company's customer support bot built on top of both is also "AI." But these are three genuinely different things, sitting at different layers …


Continue reading

Environment Variables in FastAPI — Managing Secrets the Right Way

Posted on Tue 28 September 2027 in Tutorial • Tagged with FastAPI, Python, environment-variables, security, pydantic-settings, deployment

Why This Matters

Almost every FastAPI app eventually needs something it shouldn't have hardcoded in the source code: a database URL, an LLM API key, a JWT secret, a third-party service token. When you're building GenAI apps, this shows up on day one, because you can't call an LLM API …


Continue reading

Why FastAPI Auto-Generates API Docs (And How to Customize Them)

Posted on Mon 27 September 2027 in Tutorial • Tagged with FastAPI, Python, API-docs, Swagger, OpenAPI

Why This Matters

If you've built even a basic FastAPI app, you've probably stumbled onto /docs and been pleasantly surprised — a fully interactive API documentation page, complete with every endpoint, request schema, and a "Try it out" button, without writing a single line of documentation yourself. This isn't a small …


Continue reading

How to Evaluate Your LLM App: Building a Simple Eval Set

Posted on Sun 25 October 2026 in Tutorial • Tagged with GenAI, LLM, evaluation, evals, testing, Python, prompt-engineering

The Question I Couldn't Answer

For a long time, my process for improving a prompt was embarrassingly simple: change the wording, try two or three inputs, decide it "feels better," and move on. Then one day someone asked me a basic question: "Is the new version actually better than the …


Continue reading

I Ran an LLM on My Own Laptop: Here's How (Ollama Setup for Beginners)

Posted on Sat 24 October 2026 in Tutorial • Tagged with Ollama, local-LLM, GenAI, FastAPI, Python, beginner

The Moment It Clicked

For a long time, "using an LLM" meant one thing for me: sign up, paste an API key, send a request to someone else's server, and watch the token counter tick up. Then I tried running a model on my own laptop, with the Wi-Fi turned …


Continue reading

Why Every AI Demo Looks Perfect (And Why That's a Red Flag)

Posted on Fri 23 October 2026 in GenAI • Tagged with GenAI, LLM, AI-demos, evaluation, AI-literacy, opinion

The Pattern I Keep Noticing

Watch any AI product demo and you'll see the same thing: the assistant understands everything on the first try, the agent finishes a ten-step task without a hiccup, and the answers are crisp, accurate, and perfectly formatted. Then you try the same product yourself and …


Continue reading

The "Lost in the Middle" Problem in RAG and How to Work Around It

Posted on Thu 22 October 2026 in GenAI • Tagged with GenAI, RAG, LLM, context-window, retrieval, reranking

Why This Matters

You build a RAG pipeline. Retrieval works: the right chunk is definitely in the top results. You send everything to the LLM, and it still gives a wrong or incomplete answer, as if it never saw the one piece of text that contained the answer.

Very often …


Continue reading

Why Small, Boring AI Features Win Over Flashy Ones

Posted on Wed 21 October 2026 in GenAI • Tagged with GenAI, LLM, product-design, AI-features, opinion

Why I'm Writing This

Every AI product launch seems to chase the same thing: the most impressive possible demo. A fully autonomous agent that books your entire trip. A chatbot that "does anything." A magic button that rewrites your whole workflow. These make for great launch videos. But when I …


Continue reading

Why "AI Literacy" Might Be the Most Underrated Skill Right Now

Posted on Sun 04 October 2026 in GenAI • Tagged with GenAI, LLM, AI-literacy, career, opinion

Why I'm Writing This

A lot of career advice around GenAI right now focuses on learning to build with AI — prompt engineering, RAG, agents, fine-tuning. That's valuable, and it's most of what this blog covers too. But I've started noticing a quieter, less talked-about skill gap that might matter even …


Continue reading

Dependency Injection in FastAPI — A Beginner's Breakdown

Posted on Sat 03 October 2026 in Tutorial • Tagged with FastAPI, Python, dependency-injection, beginner

Why This Confused Me at First

The first time I saw Depends() scattered through FastAPI route functions, it looked like unnecessary complexity for something simple. Why not just call a function directly inside the route? It took actually building a few endpoints that needed shared logic — authentication, database connections, settings …


Continue reading