Wall of love for The Gen Academy
โMost AI training creates spectators. This one creates builders.
I met the founders of The Gen Academy last week in San Francisco and their conviction is hard to argue with.
In 2025, they kept seeing the same thing: ambitious professionals surrounded by AI toolsโฆ who didn't know how to actually build with them. Tutorials taught syntax. Conferences sold inspiration. Almost no one taught the messy middle... how to design, ship, and trust real AI systems.
So they built the program they wished existed. For builders. Not spectators.
What struck me most:
-> Learn by building : every workshop ships a working project. Notes are nice, repos are better.
-> Uses cases and the ecosystem as the classroom : learners work with the real building blocks from different tech partners. No toy demos in a notebook.
-> A global community from day one : Cohort 1 sold out, with professionals from tech giants, financial institutions, consulting firms and retail leadersโฆ across more than ten countries.
And their take on go to market goes well beyond education:
"You don't sell to developers. You earn them."
What made this encounter particularly inspiring for me: rarely do you find coaching, mentoring, functional expertise and deep technical knowledge all in the same room. Most training programs offer one or the other.
Here, it's all of it and that very smart combination hits differently !
It changes the questions you ask. And the ones you bring back home.
In a world where AI tools shift every week, the real question is no longer "who has the best model" - it's who is actually training people to build with it.
Thank you Aishwarya Srinivasan and Arvind Narayanamurthy for the conversation. I wish the best to your GenAcademy ๐
For more info : lnkd.in/eEcj_TfB
*** Pour quelques jours, les Pauses IA passent ร l'anglais :) mรชme format, mรชme heure ou presque, autre langue. Une immersion de terrain, pour ramener l'essentiel aux รฉquipes et aux projets.***
#AI #AIEducation #GenAI #BuildersNotSpectators
โMost AI training creates spectators. This one creates builders.
I met the founders of The Gen Academy last week in San Francisco and their conviction is hard to argue with.
In 2025, they kept seeing the same thing: ambitious professionals surrounded by AI toolsโฆ who didn't know how to actually build with them. Tutorials taught syntax. Conferences sold inspiration. Almost no one taught the messy middle... how to design, ship, and trust real AI systems.
So they built the program they wished existed. For builders. Not spectators.
What struck me most:
-> Learn by building : every workshop ships a working project. Notes are nice, repos are better.
-> Uses cases and the ecosystem as the classroom : learners work with the real building blocks from different tech partners. No toy demos in a notebook.
-> A global community from day one : Cohort 1 sold out, with professionals from tech giants, financial institutions, consulting firms and retail leadersโฆ across more than ten countries.
And their take on go to market goes well beyond education:
"You don't sell to developers. You earn them."
What made this encounter particularly inspiring for me: rarely do you find coaching, mentoring, functional expertise and deep technical knowledge all in the same room. Most training programs offer one or the other.
Here, it's all of it and that very smart combination hits differently !
It changes the questions you ask. And the ones you bring back home.
In a world where AI tools shift every week, the real question is no longer "who has the best model" - it's who is actually training people to build with it.
Thank you Aishwarya Srinivasan and Arvind Narayanamurthy for the conversation. I wish the best to your GenAcademy ๐
For more info : lnkd.in/eEcj_TfB
*** Pour quelques jours, les Pauses IA passent ร l'anglais :) mรชme format, mรชme heure ou presque, autre langue. Une immersion de terrain, pour ramener l'essentiel aux รฉquipes et aux projets.***
#AI #AIEducation #GenAI #BuildersNotSpectators
I'll be honest โ I went into today's session 'How AI Changes Design: A Practical Look' thinking I already 'got' how AI fits into design.
I was wrong.
'How AI Changes Design: A Practical Look' with Aishwarya Srinivasan, Arvind Narayanamurthy and Aishwarya Rao reframed how I think about the AI products.
The part that hit hardest? Aishwarya Rao's point that AI isn't just a faster way to do the same job โ it changes what the job *is*. That's a different conversation than most people are having.
Whether you're in design, product, or engineering โ if AI touches your work in any way, the frameworks from this session are worth your time.
Huge appreciation for industry experts who bring genuine depth to the conversation โ this is the kind of session that actually shapes how you think and build. ๐ก ๐
I'll be honest โ I went into today's session 'How AI Changes Design: A Practical Look' thinking I already 'got' how AI fits into design.
I was wrong.
'How AI Changes Design: A Practical Look' with Aishwarya Srinivasan, Arvind Narayanamurthy and Aishwarya Rao reframed how I think about the AI products.
The part that hit hardest? Aishwarya Rao's point that AI isn't just a faster way to do the same job โ it changes what the job *is*. That's a different conversation than most people are having.
Whether you're in design, product, or engineering โ if AI touches your work in any way, the frameworks from this session are worth your time.
Huge appreciation for industry experts who bring genuine depth to the conversation โ this is the kind of session that actually shapes how you think and build. ๐ก ๐
Last weekend, I attended a session on ๐ ๐ฎ๐๐๐ฒ๐ฟ๐ถ๐ป๐ด ๐๐น๐ฎ๐๐ฑ๐ฒ ๐๐ผ๐๐ผ๐ฟ๐ธ hosted by Aishwarya Srinivasan and Arvind Narayanamurthy, and it shifted how I think about data exploration and problem-solving.
๐๐ฒ๐ ๐๐ฒ๐ฎ๐ฟ๐ป๐ถ๐ป๐ด๐:
โข ๐๐ป๐๐๐ฎ๐ป๐ ๐ก๐ ๐๐
๐ฝ๐น๐ผ๐ฟ๐ฎ๐๐ถ๐ผ๐ป - Natural language forces clearer problem definition before diving into implementation (No Sql)
โข ๐ฅ๐ฎ๐ฝ๐ถ๐ฑ & ๐๐๐ฉ๐ ๐ฃ๐ฟ๐ผ๐๐ผ๐๐๐ฝ๐ถ๐ป๐ด - Accelerated hypothesis testing that I'm now applying to my BI workflows
โข ๐๐ผ๐น๐น๐ฎ๐ฏ๐ผ๐ฟ๐ฎ๐๐ถ๐๐ฒ ๐๐ฎ๐๐ฎ ๐ ๐ผ๐ฑ๐ฒ๐น๐ถ๐ป๐ด - Breaking down schemas through conversation reveals insights I'd miss traditionally
โข ๐ฅ๐ฒ๐๐๐ฎ๐ฏ๐น๐ฒ ๐๐ฒ๐๐ถ๐ด๐ป ๐ฃ๐ฎ๐๐๐ฒ๐ฟ๐ป๐ - The markdown-based approach to documentation is game-changing
To validate these learnings, I built a FIFA 2022 analytics dashboard using Claude Cowork as a sandbox to test concepts before applying them to enterprise dashboards.
๐ ๐๐ฎ๐๐ต๐ฏ๐ผ๐ฎ๐ฟ๐ฑ: lnkd.in/g6m9PVzQ
๐ ๐๐ถ๐๐๐๐ฏ: lnkd.in/gteareCy
Are you experimenting with these shifts? Would love your thoughts.
Last weekend, I attended a session on ๐ ๐ฎ๐๐๐ฒ๐ฟ๐ถ๐ป๐ด ๐๐น๐ฎ๐๐ฑ๐ฒ ๐๐ผ๐๐ผ๐ฟ๐ธ hosted by Aishwarya Srinivasan and Arvind Narayanamurthy, and it shifted how I think about data exploration and problem-solving.
๐๐ฒ๐ ๐๐ฒ๐ฎ๐ฟ๐ป๐ถ๐ป๐ด๐:
โข ๐๐ป๐๐๐ฎ๐ป๐ ๐ก๐ ๐๐
๐ฝ๐น๐ผ๐ฟ๐ฎ๐๐ถ๐ผ๐ป - Natural language forces clearer problem definition before diving into implementation (No Sql)
โข ๐ฅ๐ฎ๐ฝ๐ถ๐ฑ & ๐๐๐ฉ๐ ๐ฃ๐ฟ๐ผ๐๐ผ๐๐๐ฝ๐ถ๐ป๐ด - Accelerated hypothesis testing that I'm now applying to my BI workflows
โข ๐๐ผ๐น๐น๐ฎ๐ฏ๐ผ๐ฟ๐ฎ๐๐ถ๐๐ฒ ๐๐ฎ๐๐ฎ ๐ ๐ผ๐ฑ๐ฒ๐น๐ถ๐ป๐ด - Breaking down schemas through conversation reveals insights I'd miss traditionally
โข ๐ฅ๐ฒ๐๐๐ฎ๐ฏ๐น๐ฒ ๐๐ฒ๐๐ถ๐ด๐ป ๐ฃ๐ฎ๐๐๐ฒ๐ฟ๐ป๐ - The markdown-based approach to documentation is game-changing
To validate these learnings, I built a FIFA 2022 analytics dashboard using Claude Cowork as a sandbox to test concepts before applying them to enterprise dashboards.
๐ ๐๐ฎ๐๐ต๐ฏ๐ผ๐ฎ๐ฟ๐ฑ: lnkd.in/g6m9PVzQ
๐ ๐๐ถ๐๐๐๐ฏ: lnkd.in/gteareCy
Are you experimenting with these shifts? Would love your thoughts.
From Text to SQL: How SQL AI Agents are Transforming Data Access
Wrapped up an incredible session on ๐ฆ๐ค๐ ๐๐ ๐๐ด๐ฒ๐ป๐๐ with Rami Krispin, where he shared his rich experience and production ready play-book.
Encapsulated - Top 5 pointers (provided AI generated image for illustration only)
//Context is King, Not the Model
You don't need the fanciest LLM to build powerful SQL agents. A thoughtfully engineered prompt with rich context (schema details, categorical values, business logic) can outperform expensive models. It's about ๐ฉ๐ฐ๐ธ you ask, not just ๐ธ๐ฉ๐ฐ you ask.
// The Agent Loop is Everything
It's not just LLM โ Output. Real agents iterate through reasoning โ tool calls โ observation โ refinement. This dynamic execution path is what separates true agents from simple API wrappers.
// Safety Guardrails Aren't Optional : They're Essential
Read-only access, query validation, row limits, logs and error handling aren't afterthoughts. They're foundational. One misconfigured query can bring down your entire database. Period.
// Memory Management Changes the Game
Adding conversation history transforms single-shot queries into meaningful dialogue. Users can ask follow-ups naturally. But manage it wisely, unbounded memory explodes your token costs.
// Evaluation & Fallback Strategies = Smart Cost Optimization
Test your models systematically. Sometimes GPT-4 mini outperforms GPT-4 Turbo at 1/4 the cost. Build intelligent fallback mechanisms; simple models for routine queries, powerful ones for edge cases.
A heartfelt thank you to Aishwarya Srinivasan, Arvind Narayanamurthy for setting up context/de-briefing about AI agent, and bringing in Rami Krispin (SME) for this Lightening session. Your generosity in sharing examples/use cases, live demos are highly appreciated.
I gained additional insights and I'm sure all the participants who attended "live" would have benefitted, and reach out to discord community for Q&A/follow-up.
#SQLAIAgents #AIEngineering #LLMs #DataAccess #ProductionAI #TechEducation #LinkedInLearning
From Text to SQL: How SQL AI Agents are Transforming Data Access
Wrapped up an incredible session on ๐ฆ๐ค๐ ๐๐ ๐๐ด๐ฒ๐ป๐๐ with Rami Krispin, where he shared his rich experience and production ready play-book.
Encapsulated - Top 5 pointers (provided AI generated image for illustration only)
//Context is King, Not the Model
You don't need the fanciest LLM to build powerful SQL agents. A thoughtfully engineered prompt with rich context (schema details, categorical values, business logic) can outperform expensive models. It's about ๐ฉ๐ฐ๐ธ you ask, not just ๐ธ๐ฉ๐ฐ you ask.
// The Agent Loop is Everything
It's not just LLM โ Output. Real agents iterate through reasoning โ tool calls โ observation โ refinement. This dynamic execution path is what separates true agents from simple API wrappers.
// Safety Guardrails Aren't Optional : They're Essential
Read-only access, query validation, row limits, logs and error handling aren't afterthoughts. They're foundational. One misconfigured query can bring down your entire database. Period.
// Memory Management Changes the Game
Adding conversation history transforms single-shot queries into meaningful dialogue. Users can ask follow-ups naturally. But manage it wisely, unbounded memory explodes your token costs.
// Evaluation & Fallback Strategies = Smart Cost Optimization
Test your models systematically. Sometimes GPT-4 mini outperforms GPT-4 Turbo at 1/4 the cost. Build intelligent fallback mechanisms; simple models for routine queries, powerful ones for edge cases.
A heartfelt thank you to Aishwarya Srinivasan, Arvind Narayanamurthy for setting up context/de-briefing about AI agent, and bringing in Rami Krispin (SME) for this Lightening session. Your generosity in sharing examples/use cases, live demos are highly appreciated.
I gained additional insights and I'm sure all the participants who attended "live" would have benefitted, and reach out to discord community for Q&A/follow-up.
#SQLAIAgents #AIEngineering #LLMs #DataAccess #ProductionAI #TechEducation #LinkedInLearning
Joined a free session today on Building SQL AI Agents and one thing was clear from the start.
Getting an LLM to write SQL is easy. Getting it production ready is a completely different game.
What actually separates a demo from a real system: autonomous context generation, SQL validation, safety checks , error handling and a debugger agent running in the background.
The prompt isn't something you write once either. In production it gets assembled dynamically from your database schema, domain skills, and user question every single time.
Shoutout to Aishwarya Srinivasan, Arvind Narayanamurthy, and Rami Krispin for keeping it brutally honest and technically sharp.
Joined a free session today on Building SQL AI Agents and one thing was clear from the start.
Getting an LLM to write SQL is easy. Getting it production ready is a completely different game.
What actually separates a demo from a real system: autonomous context generation, SQL validation, safety checks , error handling and a debugger agent running in the background.
The prompt isn't something you write once either. In production it gets assembled dynamically from your database schema, domain skills, and user question every single time.
Shoutout to Aishwarya Srinivasan, Arvind Narayanamurthy, and Rami Krispin for keeping it brutally honest and technically sharp.
Attended a session on Building SQL AI Agents at The Gen Academy today.
Honest take? Parts of it felt overwhelming.
As someone just starting to explore AI, I could follow the high-level ideas, but the deeper discussions around context, architecture, and guardrails made one thing clear:
Thereโs a lot to learn here.
And that was the most useful part.
Before writing a single line of code, the session broke down how agents actually work:
โข Agents donโt respond in one step, they run a loop: Think โ Act โ Observe until the goal is met
โข There are key levers you can control to shape that loop
โข Every agent is built from a set of core building blocks
โข Not every problem needs an agent, knowing when to use one matters
Understanding these fundamentals before building matters more than I expected.
Then it got more practical, what it takes to move from idea to something usable:
โข The gap between a polished demo and a production system is significant
โข Context is more than a prompt, it includes instructions, knowledge, and state
โข Guardrails and validation are what make these systems reliable
Instead of trying to learn everything upfront, Iโve decided to start building a simple SQL agent and learn through the process.
Thanks to Aishwarya Srinivasan, Arvind Narayanamurthy and
Rami Krispin for keeping it practical and grounded.
#AIAgents #GenAI #SQLAgent #DataEngineering #DataAnalytics
Attended a session on Building SQL AI Agents at The Gen Academy today.
Honest take? Parts of it felt overwhelming.
As someone just starting to explore AI, I could follow the high-level ideas, but the deeper discussions around context, architecture, and guardrails made one thing clear:
Thereโs a lot to learn here.
And that was the most useful part.
Before writing a single line of code, the session broke down how agents actually work:
โข Agents donโt respond in one step, they run a loop: Think โ Act โ Observe until the goal is met
โข There are key levers you can control to shape that loop
โข Every agent is built from a set of core building blocks
โข Not every problem needs an agent, knowing when to use one matters
Understanding these fundamentals before building matters more than I expected.
Then it got more practical, what it takes to move from idea to something usable:
โข The gap between a polished demo and a production system is significant
โข Context is more than a prompt, it includes instructions, knowledge, and state
โข Guardrails and validation are what make these systems reliable
Instead of trying to learn everything upfront, Iโve decided to start building a simple SQL agent and learn through the process.
Thanks to Aishwarya Srinivasan, Arvind Narayanamurthy and
Rami Krispin for keeping it practical and grounded.
#AIAgents #GenAI #SQLAgent #DataEngineering #DataAnalytics
๐ Spent my weekend diving into Building SQL AI Agents โ and it was genuinely one of the most practical AI sessions Iโve attended.
Really enjoyed learning how LLMs + agents are moving from demos to real production systems โ especially:
Natural language โ SQL in real-world use cases
Context engineering for reliable outputs
Agent workflows (tools, planning, memory)
Importance of guardrails & data access control
Loved how everything tied back to actual data + enterprise systems, not just theory.
Thank you Aishwarya Srinivasan Rami Krispin and Arvind Narayanamurthy!
Looking forward to diving deeper into this space and building something hands-on soon.
#AI #LLM #SQL #AIAgents #DataEngineering #RAG #TechLearning
๐ Spent my weekend diving into Building SQL AI Agents โ and it was genuinely one of the most practical AI sessions Iโve attended.
Really enjoyed learning how LLMs + agents are moving from demos to real production systems โ especially:
Natural language โ SQL in real-world use cases
Context engineering for reliable outputs
Agent workflows (tools, planning, memory)
Importance of guardrails & data access control
Loved how everything tied back to actual data + enterprise systems, not just theory.
Thank you Aishwarya Srinivasan Rami Krispin and Arvind Narayanamurthy!
Looking forward to diving deeper into this space and building something hands-on soon.
#AI #LLM #SQL #AIAgents #DataEngineering #RAG #TechLearning
Attended an incredible session on ๐๐๐ถ๐น๐ฑ๐ถ๐ป๐ด ๐ฆ๐ค๐ ๐๐ ๐๐ด๐ฒ๐ป๐๐ hosted by Aishwarya Srinivasan, Arvind Narayanamurthy, and Rami Krispin.
๐๐ณ ๐ฎ๐ด๐ฒ๐ป๐๐ ๐ฎ๐ฟ๐ฒ ๐๐ต๐ฒ ๐ฏ๐ฟ๐ฎ๐ถ๐ป ๐ผ๐ณ ๐๐ต๐ฒ ๐๐ ๐ฒ๐ฐ๐ผ๐๐๐๐๐ฒ๐บ, ๐๐ต๐ฒ๐ป ๐ฑ๐ฎ๐๐ฎ ๐ฎ๐ป๐ฑ ๐ฎ๐ป๐ฎ๐น๐๐๐ถ๐ฐ๐ ๐ฎ๐ฟ๐ฒ ๐๐ต๐ฒ ๐ณ๐๐ฒ๐น.
So I went ahead and built my own SQL AI Agent from scratch.
What I built:
โ
Natural language to SQL using Ollama (free, no API key)
โ
SQLite database with zero setup
โ
Streamlit UI with query history and CSV export
โ
Runs 100% locally, no cloud, no cost
Huge thanks to Aishwarya, Arvind, and Rami for making this so hands-on. Sessions like this push you to stop watching and start building.
Check out the repo here: ๐ lnkd.in/ebX4Dqix
#AI #SQLAgent #Ollama #LLM #DataScience #ArtificialIntelligence #DataEngineering #MachineLearning #Python #Canada
Attended an incredible session on ๐๐๐ถ๐น๐ฑ๐ถ๐ป๐ด ๐ฆ๐ค๐ ๐๐ ๐๐ด๐ฒ๐ป๐๐ hosted by Aishwarya Srinivasan, Arvind Narayanamurthy, and Rami Krispin.
๐๐ณ ๐ฎ๐ด๐ฒ๐ป๐๐ ๐ฎ๐ฟ๐ฒ ๐๐ต๐ฒ ๐ฏ๐ฟ๐ฎ๐ถ๐ป ๐ผ๐ณ ๐๐ต๐ฒ ๐๐ ๐ฒ๐ฐ๐ผ๐๐๐๐๐ฒ๐บ, ๐๐ต๐ฒ๐ป ๐ฑ๐ฎ๐๐ฎ ๐ฎ๐ป๐ฑ ๐ฎ๐ป๐ฎ๐น๐๐๐ถ๐ฐ๐ ๐ฎ๐ฟ๐ฒ ๐๐ต๐ฒ ๐ณ๐๐ฒ๐น.
So I went ahead and built my own SQL AI Agent from scratch.
What I built:
โ
Natural language to SQL using Ollama (free, no API key)
โ
SQLite database with zero setup
โ
Streamlit UI with query history and CSV export
โ
Runs 100% locally, no cloud, no cost
Huge thanks to Aishwarya, Arvind, and Rami for making this so hands-on. Sessions like this push you to stop watching and start building.
Check out the repo here: ๐ lnkd.in/ebX4Dqix
#AI #SQLAgent #Ollama #LLM #DataScience #ArtificialIntelligence #DataEngineering #MachineLearning #Python #Canada
Wow, just finished the "Vibe Coding: Code Smarter with AI" course by Aishwarya and Arvind, and I'm absolutely buzzing! This wasn't just another coding tutorial; it was a truly vibrant and insightful experience.
The way Aishwarya and Arvind broke down how to leverage AI tools like Replit AI and Cursor AI to build practical applications was fantastic. Seeing a sample portfolio app come to life with Replit AI and then diving into a financial portfolio web app using Cursor AI really solidified the concepts. It wasn't just theoretical; it was hands-on and immediately applicable. What truly set this course apart was the engaging and patient way Aishwarya and Arvind addressed everyone's questions. No matter how big or small, they took the time to provide clear and helpful answers. Even when a few of us were clearly in "vibe nap" mode between coding sessions (we've all been there!), Aishwarya and Arvind had a knack for bringing us back into the flow and ensuring we didn't miss crucial points. It speaks volumes about their teaching style that even in those moments, the explanations were clear enough to still grasp the core ideas and improve our skills. The course content was incredibly well-structured, and the pace felt just right. You could tell that Aishwarya and Arvind are not only experts in their field but also passionate about sharing their knowledge. Their enthusiasm was infectious!
And you know what? Forget complex algorithms and years of cryptic syntax! It turns out, channeling our inner Captain America, the secret weapon to building amazing applications with AI assistance boils down to one simple truth: "Whatever It Takes!" ...which, in this context, hilariously seems to mean just knowing plain English to tell the AI what you want. Who knew building the future could be this...linguistically straightforward? Thanks, Aishwarya and Arvind, for showing us the accessible path to code smarter!
Aishwarya Srinivasan Arvind Narayanamurthy
Deploying code failed and here is the pdf format of the vibe course portfolio that I built with the AI tool :)
Wow, just finished the "Vibe Coding: Code Smarter with AI" course by Aishwarya and Arvind, and I'm absolutely buzzing! This wasn't just another coding tutorial; it was a truly vibrant and insightful experience.
The way Aishwarya and Arvind broke down how to leverage AI tools like Replit AI and Cursor AI to build practical applications was fantastic. Seeing a sample portfolio app come to life with Replit AI and then diving into a financial portfolio web app using Cursor AI really solidified the concepts. It wasn't just theoretical; it was hands-on and immediately applicable. What truly set this course apart was the engaging and patient way Aishwarya and Arvind addressed everyone's questions. No matter how big or small, they took the time to provide clear and helpful answers. Even when a few of us were clearly in "vibe nap" mode between coding sessions (we've all been there!), Aishwarya and Arvind had a knack for bringing us back into the flow and ensuring we didn't miss crucial points. It speaks volumes about their teaching style that even in those moments, the explanations were clear enough to still grasp the core ideas and improve our skills. The course content was incredibly well-structured, and the pace felt just right. You could tell that Aishwarya and Arvind are not only experts in their field but also passionate about sharing their knowledge. Their enthusiasm was infectious!
And you know what? Forget complex algorithms and years of cryptic syntax! It turns out, channeling our inner Captain America, the secret weapon to building amazing applications with AI assistance boils down to one simple truth: "Whatever It Takes!" ...which, in this context, hilariously seems to mean just knowing plain English to tell the AI what you want. Who knew building the future could be this...linguistically straightforward? Thanks, Aishwarya and Arvind, for showing us the accessible path to code smarter!
Aishwarya Srinivasan Arvind Narayanamurthy
Deploying code failed and here is the pdf format of the vibe course portfolio that I built with the AI tool :)
RAG Workshop Takeaways โ Powered by Aishwarya Srinivasan & Arvind Narayanamurthy
Recently, I had the opportunity to attend an insightful online RAG workshop conducted by Aishwarya Srinivasan and Arvind Narayanamurthy on July 26 (11 PM) to July 27 (2 AM) SGT. Despite the late hours, it was absolutely worth staying up for โ the session was packed with conceptual, practical knowledge and real-world techniques!
Here are my key takeaways:
๐น RAG (Retrieval-Augmented Generation) Fundamentals
โ Deep dive into how RAG augments LLMs by injecting fresh, contextual data at runtime, overcoming static training limitations.
๐น Live Demo
โ A complete end-to-end RAG pipeline demo using LangChain and Pinecone โ from ingestion to generation.
๐น Hands-On: Building a Basic RAG Workflow
โ Pipeline Steps:
Data Extraction โ From a live website
Chunking โ Breaking down into manageable segments
Indexing โ Using ChromaDB and Google's Generative AI Embeddings
Retrieval โ Based on vector similarity
Generation โ Powered by Gemini 1.5 Flash
๐น Metadata-Aware RAG
โ Enhancing retrieval precision by extracting and indexing metadata alongside content for filtered, targeted queries.
๐น Hybrid RAG Architecture
โ Combining semantic search (vector-based) with lexical/keyword search for balanced relevance and coverage.
๐น Similarity Techniques
โ Leveraging cosine similarity to improve document-query matching effectiveness.
๐น Architecture Patterns & Debugging Tips
โ Field-tested practices and design examples for building production-grade RAG systems.
Thank you Aishwarya Srinivasan and Arvind Narayanamurthy for this power packed session, looking forward for more hands-on sessions ๐
#RAG #AI #LLM
RAG Workshop Takeaways โ Powered by Aishwarya Srinivasan & Arvind Narayanamurthy
Recently, I had the opportunity to attend an insightful online RAG workshop conducted by Aishwarya Srinivasan and Arvind Narayanamurthy on July 26 (11 PM) to July 27 (2 AM) SGT. Despite the late hours, it was absolutely worth staying up for โ the session was packed with conceptual, practical knowledge and real-world techniques!
Here are my key takeaways:
๐น RAG (Retrieval-Augmented Generation) Fundamentals
โ Deep dive into how RAG augments LLMs by injecting fresh, contextual data at runtime, overcoming static training limitations.
๐น Live Demo
โ A complete end-to-end RAG pipeline demo using LangChain and Pinecone โ from ingestion to generation.
๐น Hands-On: Building a Basic RAG Workflow
โ Pipeline Steps:
Data Extraction โ From a live website
Chunking โ Breaking down into manageable segments
Indexing โ Using ChromaDB and Google's Generative AI Embeddings
Retrieval โ Based on vector similarity
Generation โ Powered by Gemini 1.5 Flash
๐น Metadata-Aware RAG
โ Enhancing retrieval precision by extracting and indexing metadata alongside content for filtered, targeted queries.
๐น Hybrid RAG Architecture
โ Combining semantic search (vector-based) with lexical/keyword search for balanced relevance and coverage.
๐น Similarity Techniques
โ Leveraging cosine similarity to improve document-query matching effectiveness.
๐น Architecture Patterns & Debugging Tips
โ Field-tested practices and design examples for building production-grade RAG systems.
Thank you Aishwarya Srinivasan and Arvind Narayanamurthy for this power packed session, looking forward for more hands-on sessions ๐
#RAG #AI #LLM
I spent my Saturday at the Context Engineering Workshop with The Gen Academy, and hereโs the thing. Some sessions simply teach you something. This one actually shifted how I think.
It was all about Prompt Engineering until I heard about Context Engineering.
So what is it ?? Context engineering sits at the heart of building reliable AI systems, but very few people break it down in a way thatโs practical, structured, and immediately usable. This workshop did exactly that.
Huge thank you to Aishwarya Srinivasan, Arvind Narayanamurthy, and the entire Gen Academy team for creating a space where learning feels both rigorous and accessible. I walked away with frameworks I can apply right away, along with a sharper mental model for how to design context in a way that elevates performance, clarity, and trust.
For anyone exploring agentic workflows, retrieval, or prompt engineering at a deeper level, the teaching and the materials are an amazing source for both technical and non-technical folks.
Grateful to have been part of this one and excited to keep sharpening this skillset.
#ai #contextengineering #machinelearning #agents #llms #genai #community #learning #sanfrancisco #sftech
I spent my Saturday at the Context Engineering Workshop with The Gen Academy, and hereโs the thing. Some sessions simply teach you something. This one actually shifted how I think.
It was all about Prompt Engineering until I heard about Context Engineering.
So what is it ?? Context engineering sits at the heart of building reliable AI systems, but very few people break it down in a way thatโs practical, structured, and immediately usable. This workshop did exactly that.
Huge thank you to Aishwarya Srinivasan, Arvind Narayanamurthy, and the entire Gen Academy team for creating a space where learning feels both rigorous and accessible. I walked away with frameworks I can apply right away, along with a sharper mental model for how to design context in a way that elevates performance, clarity, and trust.
For anyone exploring agentic workflows, retrieval, or prompt engineering at a deeper level, the teaching and the materials are an amazing source for both technical and non-technical folks.
Grateful to have been part of this one and excited to keep sharpening this skillset.
#ai #contextengineering #machinelearning #agents #llms #genai #community #learning #sanfrancisco #sftech
LI
Attended an incredible RAG Workshop over the weekend!
The trainers, Aishwarya Srinivasan and Arvind Narayanamurthy did a fantastic job explaining the concepts clearly and breaking down complex ideas in such an accessible way.
The workshop was thoughtfully structured, with a perfect balance of theory and hands-on practice, which made the learning experience so much more effective.
If youโre interested in Retrieval-Augmented Generation (RAG) and building real world AI applications, this is something to checkout. Part 2 and Part 3 are coming up soon I believe.
Attended an incredible RAG Workshop over the weekend!
The trainers, Aishwarya Srinivasan and Arvind Narayanamurthy did a fantastic job explaining the concepts clearly and breaking down complex ideas in such an accessible way.
The workshop was thoughtfully structured, with a perfect balance of theory and hands-on practice, which made the learning experience so much more effective.
If youโre interested in Retrieval-Augmented Generation (RAG) and building real world AI applications, this is something to checkout. Part 2 and Part 3 are coming up soon I believe.
I attended a hands-on workshop over the weekend on LangChain and LangGraph led by Aishwarya Srinivasan and Arvind Narayanamurthy, and it was an incredibly valuable learning experience.
The session was well structured, starting with foundational concepts and gradually moving into practical, real-world implementations of LangChain and LangGraph, clearly explaining how and when to use each.
LangGraph is a framework for building stateful, controllable, graph-based AI workflows.
โข It lets you design LLM applications as graphs with nodes, edges, and shared state, enabling:
โข Memory across steps for long, multi-step workflows
โข Precise control over how an agent thinks and acts
โข Safe, structured tool calls inside workflows
LangChain, on the other hand, focuses on building production-ready LLM applications by providing:
โข Components for prompts, models, chains, tools
โข Simplified orchestration of LLM logic and memory
โข Standardized patterns for real-world use cases
A practical, hands-on session that seamlessly connected concepts with implementation. Huge thanks to Aishwarya and Arvind for delivering such an engaging and well-executed workshop.
#LangChain #LangGraph #LLM #AIEngineering #AgenticAI #Learning
#AI #workshop
I attended a hands-on workshop over the weekend on LangChain and LangGraph led by Aishwarya Srinivasan and Arvind Narayanamurthy, and it was an incredibly valuable learning experience.
The session was well structured, starting with foundational concepts and gradually moving into practical, real-world implementations of LangChain and LangGraph, clearly explaining how and when to use each.
LangGraph is a framework for building stateful, controllable, graph-based AI workflows.
โข It lets you design LLM applications as graphs with nodes, edges, and shared state, enabling:
โข Memory across steps for long, multi-step workflows
โข Precise control over how an agent thinks and acts
โข Safe, structured tool calls inside workflows
LangChain, on the other hand, focuses on building production-ready LLM applications by providing:
โข Components for prompts, models, chains, tools
โข Simplified orchestration of LLM logic and memory
โข Standardized patterns for real-world use cases
A practical, hands-on session that seamlessly connected concepts with implementation. Huge thanks to Aishwarya and Arvind for delivering such an engaging and well-executed workshop.
#LangChain #LangGraph #LLM #AIEngineering #AgenticAI #Learning
#AI #workshop
Just a few days ago, I spent nearly 5 hours in an incredible hands-on workshop on ๐๐ด๐ฒ๐ป๐๐ถ๐ฐ ๐๐ ๐ช๐ผ๐ฟ๐ธ๐ณ๐น๐ผ๐๐ ๐ฎ๐ป๐ฑ ๐ ๐ผ๐ฑ๐ฒ๐น ๐๐ผ๐ป๐๐ฒ๐
๐ ๐ฃ๐ฟ๐ผ๐๐ผ๐ฐ๐ผ๐น (๐ ๐๐ฃ) implementation!
Led by the brilliant Aishwarya Srinivasan and Arvind Narayanamurthy, this session was honestly one of the clearest explanations of this topic I've ever seen so far.
We dove deep into:
- ๐ ๐๐ฃ: What Model Context Protocol (MCP) is, distinguishing its role in standardizing AI agent interactions from traditional function calling. We also covered the nuances of its transport layers: stdio (for co-located client-server) vs. sse (for pre-hosted server connections).
- ๐๐ฎ๐ป๐ด๐๐ฟ๐ฎ๐ฝ๐ต ๐๐. ๐๐ฎ๐ป๐ด๐๐ต๐ฎ๐ถ๐ป: Explored their distinct advantages, particularly how LangGraph facilitates building more stateful, non-linear workflows using Agentic patterns like ReAct (Reason + Act) and Reflection, which is crucial for complex, adaptive agents.
- ๐ฅ๐๐: Explanation and common misconceptions around Retrieval-Augmented Generation (RAG), emphasizing that it's distinct from large context windows and function calling. We saw how RAG ensures factual integrity and contextual grounding by integrating external knowledge stores.
- ๐๐ด๐ฒ๐ป๐๐ถ๐ฐ ๐ฃ๐ฎ๐๐๐ฒ๐ฟ๐ป๐ & ๐๐
๐ฒ๐ฐ๐๐๐ถ๐ผ๐ป: A deep dive into patterns like ReAct and Reflection, empowering agents to autonomously plan and execute multi-step actions.
- ๐ฃ๐ฟ๐ฎ๐ฐ๐๐ถ๐ฐ๐ฎ๐น ๐๐บ๐ฝ๐น๐ฒ๐บ๐ฒ๐ป๐๐ฎ๐๐ถ๐ผ๐ป: Live coding sessions, including building an MCP server from scratch and a sample product support agent using Gemini models.
- ๐ฆ๐ฒ๐ฐ๐๐ฟ๐ถ๐๐ & ๐ข๐ฏ๐๐ฒ๐ฟ๐๐ฎ๐ฏ๐ถ๐น๐ถ๐๐: Discussed critical aspects of agent safety, from preventing prompt injection to implementing human-in-the-loop approvals, and touched upon tools for LLM observability in production environments.
If you have a technical background and want to deep dive on these concepts, I recommend checking out the workshop recording. It's available for a very reasonable price here: lnkd.in/dAU7VvCU
Huge thanks again to Aishwarya Srinivasan and Arvind Narayanamurthy for such an impactful session!
#AgenticAI #LangGraph #Langsmith #ZapierAI #MCP #RAG #ReActPattern #ReflectionPattern
Just a few days ago, I spent nearly 5 hours in an incredible hands-on workshop on ๐๐ด๐ฒ๐ป๐๐ถ๐ฐ ๐๐ ๐ช๐ผ๐ฟ๐ธ๐ณ๐น๐ผ๐๐ ๐ฎ๐ป๐ฑ ๐ ๐ผ๐ฑ๐ฒ๐น ๐๐ผ๐ป๐๐ฒ๐
๐ ๐ฃ๐ฟ๐ผ๐๐ผ๐ฐ๐ผ๐น (๐ ๐๐ฃ) implementation!
Led by the brilliant Aishwarya Srinivasan and Arvind Narayanamurthy, this session was honestly one of the clearest explanations of this topic I've ever seen so far.
We dove deep into:
- ๐ ๐๐ฃ: What Model Context Protocol (MCP) is, distinguishing its role in standardizing AI agent interactions from traditional function calling. We also covered the nuances of its transport layers: stdio (for co-located client-server) vs. sse (for pre-hosted server connections).
- ๐๐ฎ๐ป๐ด๐๐ฟ๐ฎ๐ฝ๐ต ๐๐. ๐๐ฎ๐ป๐ด๐๐ต๐ฎ๐ถ๐ป: Explored their distinct advantages, particularly how LangGraph facilitates building more stateful, non-linear workflows using Agentic patterns like ReAct (Reason + Act) and Reflection, which is crucial for complex, adaptive agents.
- ๐ฅ๐๐: Explanation and common misconceptions around Retrieval-Augmented Generation (RAG), emphasizing that it's distinct from large context windows and function calling. We saw how RAG ensures factual integrity and contextual grounding by integrating external knowledge stores.
- ๐๐ด๐ฒ๐ป๐๐ถ๐ฐ ๐ฃ๐ฎ๐๐๐ฒ๐ฟ๐ป๐ & ๐๐
๐ฒ๐ฐ๐๐๐ถ๐ผ๐ป: A deep dive into patterns like ReAct and Reflection, empowering agents to autonomously plan and execute multi-step actions.
- ๐ฃ๐ฟ๐ฎ๐ฐ๐๐ถ๐ฐ๐ฎ๐น ๐๐บ๐ฝ๐น๐ฒ๐บ๐ฒ๐ป๐๐ฎ๐๐ถ๐ผ๐ป: Live coding sessions, including building an MCP server from scratch and a sample product support agent using Gemini models.
- ๐ฆ๐ฒ๐ฐ๐๐ฟ๐ถ๐๐ & ๐ข๐ฏ๐๐ฒ๐ฟ๐๐ฎ๐ฏ๐ถ๐น๐ถ๐๐: Discussed critical aspects of agent safety, from preventing prompt injection to implementing human-in-the-loop approvals, and touched upon tools for LLM observability in production environments.
If you have a technical background and want to deep dive on these concepts, I recommend checking out the workshop recording. It's available for a very reasonable price here: lnkd.in/dAU7VvCU
Huge thanks again to Aishwarya Srinivasan and Arvind Narayanamurthy for such an impactful session!
#AgenticAI #LangGraph #Langsmith #ZapierAI #MCP #RAG #ReActPattern #ReflectionPattern
โจ I attended an incredible hands-on workshop over the weekend on Agentic AI Workflows and Model Context Protocol (MCP) implementation led by Aishwarya Srinivasan and Arvind Narayanamurthy! It was such a valuable and enriching learning experience.
This session was a deep dive into MCP and Agentic AI systems. We started from the basics and worked our way up to building an MCP server live, creating AI agents from scratch. ๐คโ๏ธ
I took away so much from this session, but here are some of the key things I have learned:
โ
What MCP is and how it is different from function calling, enabling AI agent interactions.
โ
The transport layers in MCP - understanding when to use stdio (when the client spawns the server making them both in the same location) vs. sse (when the MCP server is already hosted and the client connects to it). ๐๐
โ
Differences and use cases of LangGraph vs. LangChain, and how LangGraph allows building more stateful workflows using Agentic patterns like ReAct (Reason + Act) and Reflection. ๐๐ง
โ
Understanding the trade-off between autonomy and control in AI systems and how to design for the right balance depending on the use case. โ๏ธ๐ค
โ
Building an MCP server from scratch ๐ ๏ธ
โ
Practical implementation of a real-world agent use case using LangGraph and ReAct Pattern ๐๐ก
What stood out to me personally was how the session cleared up common misconceptions around RAG, function-calling, context windows, and how MCP fits into the bigger picture. The live coding part was a game-changer ๐ป๐ โ seeing things in action made the concepts click and has given me much more confidence in using these tools in the future.
Huge thanks to Aishwarya and Arvind, for driving this fantastic initiative and delivering such an engaging and practical session ๐๐. I truly enjoyed the energy, the depth of content, and the clarity you both brought to complex topics.
Itโs always exciting to keep learning in this fast-evolving field ๐๐.
#AgenticAI #LangGraph #LangChain #MCP #AIagents #ReActPattern #ReflectionPattern #AIworkflows #RAG #AutonomousAgents #AgenticPatterns
โจ I attended an incredible hands-on workshop over the weekend on Agentic AI Workflows and Model Context Protocol (MCP) implementation led by Aishwarya Srinivasan and Arvind Narayanamurthy! It was such a valuable and enriching learning experience.
This session was a deep dive into MCP and Agentic AI systems. We started from the basics and worked our way up to building an MCP server live, creating AI agents from scratch. ๐คโ๏ธ
I took away so much from this session, but here are some of the key things I have learned:
โ
What MCP is and how it is different from function calling, enabling AI agent interactions.
โ
The transport layers in MCP - understanding when to use stdio (when the client spawns the server making them both in the same location) vs. sse (when the MCP server is already hosted and the client connects to it). ๐๐
โ
Differences and use cases of LangGraph vs. LangChain, and how LangGraph allows building more stateful workflows using Agentic patterns like ReAct (Reason + Act) and Reflection. ๐๐ง
โ
Understanding the trade-off between autonomy and control in AI systems and how to design for the right balance depending on the use case. โ๏ธ๐ค
โ
Building an MCP server from scratch ๐ ๏ธ
โ
Practical implementation of a real-world agent use case using LangGraph and ReAct Pattern ๐๐ก
What stood out to me personally was how the session cleared up common misconceptions around RAG, function-calling, context windows, and how MCP fits into the bigger picture. The live coding part was a game-changer ๐ป๐ โ seeing things in action made the concepts click and has given me much more confidence in using these tools in the future.
Huge thanks to Aishwarya and Arvind, for driving this fantastic initiative and delivering such an engaging and practical session ๐๐. I truly enjoyed the energy, the depth of content, and the clarity you both brought to complex topics.
Itโs always exciting to keep learning in this fast-evolving field ๐๐.
#AgenticAI #LangGraph #LangChain #MCP #AIagents #ReActPattern #ReflectionPattern #AIworkflows #RAG #AutonomousAgents #AgenticPatterns
๐ Just attended a mind-blowing workshop on Agentic AI Workflows and Model Context Protocol (MCP) implementation with the incredible Aishwarya Srinivasan and Arvind Narayanamurthy. Truly one of the most insightful and energising sessions Iโve been part of!
It was a deep dive into the evolving world of #LLMs, #RAG, and #AgenticAI.
I asked Perplexity to summarise some notes I took down during the workshop for generic consumption and here's what stood out:
๐น LangChain vs LangGraph
LangChain offers a powerful abstraction layer to build AI apps quickly.
LangGraph enables stateful workflows and is ideal for unstructured data and nested/non-linear logic โ perfect for building complex agents!
๐น RAG (Retrieval-Augmented Generation) decoded:
Components: Query processing, Embedding, Vector Store, Context Integration, Response
โWhy RAG? To ensure factual integrity, contextual grounding, and for complete ownership on knowledge store.
Misconception: A large context window โ RAG. Nor is function calling the same as RAG!
๐น MCP (Model Context Protocol) in action:
Standardizes communication between LLMs and external tools via a server-client architecture.
โAn MCP server can be connected to a single tool or package multiple tools together (e.g., Gmail, Slack, Google Drive). The client makes requests and knows which server/tool to use.
โTransport layers: stdio (client-spawned, co-located) and sse (pre-hosted, accessible remotely).
โ
Crucial: Sanitize outputs, use trusted servers, enforce OAuth/API key-based access.
๐น Agentic Patterns & Execution
We explored the ReAct (Reason + Act) pattern and the Reflection pattern.
These patterns empower agents to autonomously plan and take multi-step actions. LangGraph makes these patterns stateful, solving a major limitation of stateless LLMs.
๐น Using Prebuilt Agents for building typical ReAct patterns -
from langgraph.prebuilt import create_react_agent
from langchain_google_genai import ChatGoogleGenerativeAI
Built a sample Product support agent to with reasoning support using Gemini models. (gemini-2.5-flash-preview-04-17)
๐น Security & Observability
Agent safety isnโt just a buzzword: From preventing prompt injection to human-in-the-loop approvals โ it's foundational.
๐ง Wondering: What are some other tools like LangSmith that help with LLM observability in production environments?
๐ ๏ธ Langchain-MCP adapters enable tool compatibility across ecosystems.
๐ Fine-tuning, prompt design, function calling โ each has a role in aligning model behavior to business needs.
Last but not the least, thoroughly enjoyed the engaging conversations with fellow enthusiasts and learners from across the world! Cheers!
#AI #MachineLearning #LLM #LangChain #LangGraph #MCP #AgenticAI #RAG #Gemini #PromptEngineering #FunctionCalling #AutonomousAgents #AIWorkflows #EnterpriseAI #VectorSearch #OpenAI #Anthropic #ZapierAI #Langsmith #Observability #SecureAI #DataAndAI
๐ Just attended a mind-blowing workshop on Agentic AI Workflows and Model Context Protocol (MCP) implementation with the incredible Aishwarya Srinivasan and Arvind Narayanamurthy. Truly one of the most insightful and energising sessions Iโve been part of!
It was a deep dive into the evolving world of #LLMs, #RAG, and #AgenticAI.
I asked Perplexity to summarise some notes I took down during the workshop for generic consumption and here's what stood out:
๐น LangChain vs LangGraph
LangChain offers a powerful abstraction layer to build AI apps quickly.
LangGraph enables stateful workflows and is ideal for unstructured data and nested/non-linear logic โ perfect for building complex agents!
๐น RAG (Retrieval-Augmented Generation) decoded:
Components: Query processing, Embedding, Vector Store, Context Integration, Response
โWhy RAG? To ensure factual integrity, contextual grounding, and for complete ownership on knowledge store.
Misconception: A large context window โ RAG. Nor is function calling the same as RAG!
๐น MCP (Model Context Protocol) in action:
Standardizes communication between LLMs and external tools via a server-client architecture.
โAn MCP server can be connected to a single tool or package multiple tools together (e.g., Gmail, Slack, Google Drive). The client makes requests and knows which server/tool to use.
โTransport layers: stdio (client-spawned, co-located) and sse (pre-hosted, accessible remotely).
โ
Crucial: Sanitize outputs, use trusted servers, enforce OAuth/API key-based access.
๐น Agentic Patterns & Execution
We explored the ReAct (Reason + Act) pattern and the Reflection pattern.
These patterns empower agents to autonomously plan and take multi-step actions. LangGraph makes these patterns stateful, solving a major limitation of stateless LLMs.
๐น Using Prebuilt Agents for building typical ReAct patterns -
from langgraph.prebuilt import create_react_agent
from langchain_google_genai import ChatGoogleGenerativeAI
Built a sample Product support agent to with reasoning support using Gemini models. (gemini-2.5-flash-preview-04-17)
๐น Security & Observability
Agent safety isnโt just a buzzword: From preventing prompt injection to human-in-the-loop approvals โ it's foundational.
๐ง Wondering: What are some other tools like LangSmith that help with LLM observability in production environments?
๐ ๏ธ Langchain-MCP adapters enable tool compatibility across ecosystems.
๐ Fine-tuning, prompt design, function calling โ each has a role in aligning model behavior to business needs.
Last but not the least, thoroughly enjoyed the engaging conversations with fellow enthusiasts and learners from across the world! Cheers!
#AI #MachineLearning #LLM #LangChain #LangGraph #MCP #AgenticAI #RAG #Gemini #PromptEngineering #FunctionCalling #AutonomousAgents #AIWorkflows #EnterpriseAI #VectorSearch #OpenAI #Anthropic #ZapierAI #Langsmith #Observability #SecureAI #DataAndAI
SP
Midnight coding hits differently, and itโs been a while. This Saturday, I felt that vibe again. :)
I attended a Vibe coding workshop hosted by Aishwarya and Arvind in partnership with Replit. Using Replit and Cursor, I built a UI and spun up a Streamlit project.
From my experience, scaling anything successfully requires:
- A framework to streamline
- Patterns and best practices to drive reusability, efficiency, and adoption
- Techniques to operationalize through automation and orchestration, enabling measurable and observable outcomes
I came out with a few takeaways in each of these areas.
#vibecoding #learning #streamlit
Midnight coding hits differently, and itโs been a while. This Saturday, I felt that vibe again. :)
I attended a Vibe coding workshop hosted by Aishwarya and Arvind in partnership with Replit. Using Replit and Cursor, I built a UI and spun up a Streamlit project.
From my experience, scaling anything successfully requires:
- A framework to streamline
- Patterns and best practices to drive reusability, efficiency, and adoption
- Techniques to operationalize through automation and orchestration, enabling measurable and observable outcomes
I came out with a few takeaways in each of these areas.
#vibecoding #learning #streamlit
AI isnโt the problem anymore.
Context is.
Yesterday night I attended the 1st Lightning Lesson on Retrieval-Augmented Generation (RAG) by Aishwarya Srinivasan and Arvind Narayanamurthy (Maven ร The Gen Academy ).
And it completely changed how I think about building AI systems.
Instead of relying on static training data, RAG enables systems to retrieve relevant information in real time, producing responses grounded in actual, verifiable data.
What stood out wasnโt just the concept, but the system design behind it:
1. How embeddings capture semantic meaning.
2. How chunking improves retrieval quality.
3. How vector databases power fast similarity search.
It made one thing clear:
The future of AI isnโt just about bigger models.
Itโs about building systems that combine retrieval, context, and reasoning effectively.
Lately, Iโve been diving deeper into how these architectures work under the hood, and the more I explore, the more compelling this space becomes. Iโm currently exploring this further and planning to build something around it soon ๐
Question for my Network: For those working with LLMs, what vector databases are you using in production?
#GenerativeAI #RAG #VectorDatabases #AIProductManagement #BuildInPublic #MCA #TechInnovation #SNPSU #BeyondAcademics
AI isnโt the problem anymore.
Context is.
Yesterday night I attended the 1st Lightning Lesson on Retrieval-Augmented Generation (RAG) by Aishwarya Srinivasan and Arvind Narayanamurthy (Maven ร The Gen Academy ).
And it completely changed how I think about building AI systems.
Instead of relying on static training data, RAG enables systems to retrieve relevant information in real time, producing responses grounded in actual, verifiable data.
What stood out wasnโt just the concept, but the system design behind it:
1. How embeddings capture semantic meaning.
2. How chunking improves retrieval quality.
3. How vector databases power fast similarity search.
It made one thing clear:
The future of AI isnโt just about bigger models.
Itโs about building systems that combine retrieval, context, and reasoning effectively.
Lately, Iโve been diving deeper into how these architectures work under the hood, and the more I explore, the more compelling this space becomes. Iโm currently exploring this further and planning to build something around it soon ๐
Question for my Network: For those working with LLMs, what vector databases are you using in production?
#GenerativeAI #RAG #VectorDatabases #AIProductManagement #BuildInPublic #MCA #TechInnovation #SNPSU #BeyondAcademics
๐ Huge thanks to Aishwarya Srinivasan and Arvind Narayanamurthy for an outstanding workshop on RAG (Retrieval Augmented Generation).
The depth of insights you both shared was incredible โ moving beyond the basics into real design patterns and enterprise-grade architectures:
๐ Simple & Branched RAG for foundational retrieval
๐ค HyDE & Corrective RAG for reasoning and self-checks
๐ง Agentic RAG with master/sub-agent orchestration & RBAC
๐จ Multimodal RAG handling text, images, audio, video at scale
๐ธ Graph RAG enabling multi-hop reasoning & auditability through knowledge graphs
I especially valued the deep dives into:
๐งฉ Memory hierarchies (short-term, session, long-term)
โ๏ธ Compliance & traceability (audit trails, citations, observability tools)
๐ฐ Cost trade-offs across multimodal patterns
๐ Tools in action โ Neo4j, LangChain, ChromaDB, OpenAI, OpenCLIP
โจ Key Takeaways:
โข RAG is not just about chatbots โ itโs about building scalable, explainable, and compliant systems.
โข Design patterns matter โ Simple, Corrective, Agentic, Multimodal, and Graph RAG each unlock different capabilities.
โข Memory hierarchies (short-term, session, long-term) are essential to balance cost, speed, and persistence.
โข Compliance & auditability (via LangFuse, cloud-native tracing, or Graph provenance) must be built-in, not bolted on.
โข Cost trade-offs are huge in multimodal RAG โ the right design pattern can mean 10x efficiency.
๐ก Questions Iโm still reflecting on:
โข How do we best balance deterministic workflows with LLM-driven non-determinism in enterprise systems?
โข In large-scale multimodal setups, how can we keep context fresh and relevant without overspending on tokens?
โข Will Graph RAG (reasoning + provenance) or Agentic RAG (orchestration + sub-agents) dominate enterprise adoption next?
Thank you both once again for expanding our thinking โ this workshop was a true masterclass. ๐
#RAG #GenAI #GraphRAG #MultimodalAI #AgenticAI #LLMs #AIEngineering
๐ Huge thanks to Aishwarya Srinivasan and Arvind Narayanamurthy for an outstanding workshop on RAG (Retrieval Augmented Generation).
The depth of insights you both shared was incredible โ moving beyond the basics into real design patterns and enterprise-grade architectures:
๐ Simple & Branched RAG for foundational retrieval
๐ค HyDE & Corrective RAG for reasoning and self-checks
๐ง Agentic RAG with master/sub-agent orchestration & RBAC
๐จ Multimodal RAG handling text, images, audio, video at scale
๐ธ Graph RAG enabling multi-hop reasoning & auditability through knowledge graphs
I especially valued the deep dives into:
๐งฉ Memory hierarchies (short-term, session, long-term)
โ๏ธ Compliance & traceability (audit trails, citations, observability tools)
๐ฐ Cost trade-offs across multimodal patterns
๐ Tools in action โ Neo4j, LangChain, ChromaDB, OpenAI, OpenCLIP
โจ Key Takeaways:
โข RAG is not just about chatbots โ itโs about building scalable, explainable, and compliant systems.
โข Design patterns matter โ Simple, Corrective, Agentic, Multimodal, and Graph RAG each unlock different capabilities.
โข Memory hierarchies (short-term, session, long-term) are essential to balance cost, speed, and persistence.
โข Compliance & auditability (via LangFuse, cloud-native tracing, or Graph provenance) must be built-in, not bolted on.
โข Cost trade-offs are huge in multimodal RAG โ the right design pattern can mean 10x efficiency.
๐ก Questions Iโm still reflecting on:
โข How do we best balance deterministic workflows with LLM-driven non-determinism in enterprise systems?
โข In large-scale multimodal setups, how can we keep context fresh and relevant without overspending on tokens?
โข Will Graph RAG (reasoning + provenance) or Agentic RAG (orchestration + sub-agents) dominate enterprise adoption next?
Thank you both once again for expanding our thinking โ this workshop was a true masterclass. ๐
#RAG #GenAI #GraphRAG #MultimodalAI #AgenticAI #LLMs #AIEngineering
Two weeks ago, I came across a post by Aishwarya Srinivasan
One idea from that post stayed with me: donโt just learn AI โ build something real.
It made me reflect on how I had been learning. Like many students, I was stuck in a loop of watching tutorials, taking courses, and saving posts, but not actually building anything meaningful.
So I decided to change that.
Instead of consuming more content, I picked a problem and started building from scratch. No perfect roadmap, no detailed plan โ just learning by doing and figuring things out along the way.
Thatโs how I ended up building a Finance Agent powered by RAG (Retrieval-Augmented Generation):
GitHub: lnkd.in/gz8_qJJP
Live Demo: lnkd.in/gcQdPn7t
The goal was to move beyond a simple chatbot and build something closer to a real AI system โ one that connects to actual financial data, retrieves relevant information, and generates grounded, contextual responses.
While building this, I also explored something I hadnโt focused on before โ observability in AI systems.
Using LangSmith, I started tracking how the system actually behaves: response accuracy, latency, and failure cases. Instead of just checking if the output โlooks right,โ I could now measure how well the system was performing.
I even ran multiple experiments comparing factual accuracy and latency, which helped me identify where the system was failing and improve it iteratively.
This completely changed how I approached building.
Instead of guessing, I could now iterate based on real data โ making the system not just functional, but more reliable.
This experience made one thing very clear to me.
Getting an AI model to work at a basic level is not that hard anymore. But building something that is reliable, useful, and closer to real-world applications โ thatโs where the real challenge (and learning) begins.
The industry is clearly moving in this direction. Itโs no longer just about how powerful your model is, but about how well your system performs in real scenarios โ whether it can deliver value, scale, and be trusted.
For me, this is just the beginning.
If you're learning AI/ML right now, my biggest takeaway would be this: donโt wait to feel ready. Start building. Youโll learn much faster by doing than by just consuming content.
Would love to hear your thoughts or feedback on the project โ and curious to know, what are you building these days?
#AI #GenAI #RAG #AgenticAI #MachineLearning #BuildInPublic #LearningInPublic
Two weeks ago, I came across a post by Aishwarya Srinivasan
One idea from that post stayed with me: donโt just learn AI โ build something real.
It made me reflect on how I had been learning. Like many students, I was stuck in a loop of watching tutorials, taking courses, and saving posts, but not actually building anything meaningful.
So I decided to change that.
Instead of consuming more content, I picked a problem and started building from scratch. No perfect roadmap, no detailed plan โ just learning by doing and figuring things out along the way.
Thatโs how I ended up building a Finance Agent powered by RAG (Retrieval-Augmented Generation):
GitHub: lnkd.in/gz8_qJJP
Live Demo: lnkd.in/gcQdPn7t
The goal was to move beyond a simple chatbot and build something closer to a real AI system โ one that connects to actual financial data, retrieves relevant information, and generates grounded, contextual responses.
While building this, I also explored something I hadnโt focused on before โ observability in AI systems.
Using LangSmith, I started tracking how the system actually behaves: response accuracy, latency, and failure cases. Instead of just checking if the output โlooks right,โ I could now measure how well the system was performing.
I even ran multiple experiments comparing factual accuracy and latency, which helped me identify where the system was failing and improve it iteratively.
This completely changed how I approached building.
Instead of guessing, I could now iterate based on real data โ making the system not just functional, but more reliable.
This experience made one thing very clear to me.
Getting an AI model to work at a basic level is not that hard anymore. But building something that is reliable, useful, and closer to real-world applications โ thatโs where the real challenge (and learning) begins.
The industry is clearly moving in this direction. Itโs no longer just about how powerful your model is, but about how well your system performs in real scenarios โ whether it can deliver value, scale, and be trusted.
For me, this is just the beginning.
If you're learning AI/ML right now, my biggest takeaway would be this: donโt wait to feel ready. Start building. Youโll learn much faster by doing than by just consuming content.
Would love to hear your thoughts or feedback on the project โ and curious to know, what are you building these days?
#AI #GenAI #RAG #AgenticAI #MachineLearning #BuildInPublic #LearningInPublic
RAG worksโฆ until you realize you have no idea what it's doing. ๐ง โ ๏ธ
You can build a RAG pipeline, plug in embeddings, connect an LLM, and it works, but you have no idea what's actually happening inside. ๐ถ
Why is a query slow?
What exactly got retrieved?
Why did the model give a bad answer?
Where do you even start improving?
Everything just feels like a black box.
While exploring this, I came across Verba (7.6k โญ ), a really solid open-source RAG built on Weaviate. It already had real users, which made it the perfect system to build observability on top of.
Github Link : lnkd.in/g7eNSVni
I set up a reverse proxy in front of Verba and intercepted its WebSocket stream. That lets me track latency, capture retrieved chunks, cache responses, and log everything, all without modifying the actual RAG application.
And this is where things got interesting.
It's not just about measuring latency or errors. The metrics that actually matter are different:
p90, p95 latencies (what users actually feel),
slow queries (the ones that break trust),
cache hit rate (cost + speed),
and most importantly, thumbs down feedback.
Because a system can be fast, have zero errors, and still give a completely wrong answer. Only the user tells you that.
This made me realize, RAG isn't just about building pipelines. Itโs about making them observable, debuggable, and improvable.
There's still one blind spot though the pre-retrieval phase (embeddings + search decisions). Thatโs what I'm planning to dig into next.
Also, small reality check, I did use Claude to help initiallyโฆ and it completely broke halfway ๐
.Ended up debugging a lot of weird edge cases myself, which turned out to be the most valuable part.
Thanks to Aishwarya Srinivasan for planting the seed for this idea.๐
๐ GitHub: lnkd.in/gq8iscZ2
If you are working with RAG, you will probably hit this wall sooner or later.๐ญ
#RAG #LLM #AIEngineering #AIObservability #OpenSource #SystemDesign #BuildInPublic #AIProjects
RAG worksโฆ until you realize you have no idea what it's doing. ๐ง โ ๏ธ
You can build a RAG pipeline, plug in embeddings, connect an LLM, and it works, but you have no idea what's actually happening inside. ๐ถ
Why is a query slow?
What exactly got retrieved?
Why did the model give a bad answer?
Where do you even start improving?
Everything just feels like a black box.
While exploring this, I came across Verba (7.6k โญ ), a really solid open-source RAG built on Weaviate. It already had real users, which made it the perfect system to build observability on top of.
Github Link : lnkd.in/g7eNSVni
I set up a reverse proxy in front of Verba and intercepted its WebSocket stream. That lets me track latency, capture retrieved chunks, cache responses, and log everything, all without modifying the actual RAG application.
And this is where things got interesting.
It's not just about measuring latency or errors. The metrics that actually matter are different:
p90, p95 latencies (what users actually feel),
slow queries (the ones that break trust),
cache hit rate (cost + speed),
and most importantly, thumbs down feedback.
Because a system can be fast, have zero errors, and still give a completely wrong answer. Only the user tells you that.
This made me realize, RAG isn't just about building pipelines. Itโs about making them observable, debuggable, and improvable.
There's still one blind spot though the pre-retrieval phase (embeddings + search decisions). Thatโs what I'm planning to dig into next.
Also, small reality check, I did use Claude to help initiallyโฆ and it completely broke halfway ๐
.Ended up debugging a lot of weird edge cases myself, which turned out to be the most valuable part.
Thanks to Aishwarya Srinivasan for planting the seed for this idea.๐
๐ GitHub: lnkd.in/gq8iscZ2
If you are working with RAG, you will probably hit this wall sooner or later.๐ญ
#RAG #LLM #AIEngineering #AIObservability #OpenSource #SystemDesign #BuildInPublic #AIProjects
I was on my usual evening YouTube scavenging session today when I accidentally stumbled across a video by Aishwarya Srinivasan explaining the fundamentals on RAG.
I had no idea what RAG even was before watching it. It always seemed like a far fetched concept that would never make sense to someone so young in the industry as me. Nevertheless, I began scouring the web to get a hold of the basics, and unexpectedly, the concept clicked. I recently got back into spamming Blitz games at Chess.com, so I figured building a chess chatbot was the perfect way to learn by doing.
RAG stands for Retrieval-Augmented Generation. Instead of just asking an AI a question and hoping it knows the answer, you first retrieve relevant passages from your own documents and then ask the model to answer using those. As a result, you usually receive more grounded and foundationally correct answers from the model.
I used three chess PDFs covering openings, middlegames, and endgames as the knowledge base for this, and built the full pipeline from scratch.
As usual, Groq came to my rescue as the LLM for the project with the Llama-3.3-70B-Versatile model. ChromaDB was the perfect choice for vector databases for first-timers like me.
And well, it turns out chunk size actually matters more than I thought it did. My chunks were too small and kept splitting context mid-thought, so I doubled the size to 1000 characters with 200-character overlap and retrieval got a lot cleaner.
Not all embedding models are the same. Swapping from all-MiniLM-L6-v2 to all-mpnet-base-v2 gave me better semantic search and suddenly the chatbot could find stuff it was completely missing before.
Querying only n=3 chunks was too stingy. Bumping it to n=10 gave the LLM way more context to work with. With 3 retrieved chunks, it acted as if I asked it about pickleball and not chess.
Printing chunk sources and metadata during debugging was a game changer. The model's final answer alone tells you nothing about what actually went wrong in the retrieval step. Doing this sped up my debug game by a mile.
It is a naive RAG system by design. I have not implemented any reranking, memory or agents for the sake of simplicity so that I could fully focus on understanding what was happening under the hood. This is pretty much the same reason I repudiated the suggestion of using Streamlit to build a UI and stuck to a CLI (Command Line Interface), which is easier to debug around.
Honestly one of the most satisfying 5-hour builds I have done. If you are curious about RAG and do not know where to start, go watch Aishwarya's video.
#RAG #LLM #GenerativeAI #MachineLearning #LearningInPublic #Chess #AIProjects #BuildInPublic #NLP #VectorDatabase
I was on my usual evening YouTube scavenging session today when I accidentally stumbled across a video by Aishwarya Srinivasan explaining the fundamentals on RAG.
I had no idea what RAG even was before watching it. It always seemed like a far fetched concept that would never make sense to someone so young in the industry as me. Nevertheless, I began scouring the web to get a hold of the basics, and unexpectedly, the concept clicked. I recently got back into spamming Blitz games at Chess.com, so I figured building a chess chatbot was the perfect way to learn by doing.
RAG stands for Retrieval-Augmented Generation. Instead of just asking an AI a question and hoping it knows the answer, you first retrieve relevant passages from your own documents and then ask the model to answer using those. As a result, you usually receive more grounded and foundationally correct answers from the model.
I used three chess PDFs covering openings, middlegames, and endgames as the knowledge base for this, and built the full pipeline from scratch.
As usual, Groq came to my rescue as the LLM for the project with the Llama-3.3-70B-Versatile model. ChromaDB was the perfect choice for vector databases for first-timers like me.
And well, it turns out chunk size actually matters more than I thought it did. My chunks were too small and kept splitting context mid-thought, so I doubled the size to 1000 characters with 200-character overlap and retrieval got a lot cleaner.
Not all embedding models are the same. Swapping from all-MiniLM-L6-v2 to all-mpnet-base-v2 gave me better semantic search and suddenly the chatbot could find stuff it was completely missing before.
Querying only n=3 chunks was too stingy. Bumping it to n=10 gave the LLM way more context to work with. With 3 retrieved chunks, it acted as if I asked it about pickleball and not chess.
Printing chunk sources and metadata during debugging was a game changer. The model's final answer alone tells you nothing about what actually went wrong in the retrieval step. Doing this sped up my debug game by a mile.
It is a naive RAG system by design. I have not implemented any reranking, memory or agents for the sake of simplicity so that I could fully focus on understanding what was happening under the hood. This is pretty much the same reason I repudiated the suggestion of using Streamlit to build a UI and stuck to a CLI (Command Line Interface), which is easier to debug around.
Honestly one of the most satisfying 5-hour builds I have done. If you are curious about RAG and do not know where to start, go watch Aishwarya's video.
#RAG #LLM #GenerativeAI #MachineLearning #LearningInPublic #Chess #AIProjects #BuildInPublic #NLP #VectorDatabase
Just wrapped up an incredibly insightful session on **LLM Fine-Tuning** with the amazing **Aishwarya** and **Arvind** on Topmate โ and I'm still processing how much ground we covered! ๐
From LoRA & QLoRA to Supervised Fine-Tuning, RAG optimization, and hands-on tooling with Unsloth and Hugging Face โ it was a masterclass in making large language models actually work for real-world use cases.
But here's the thing that hit me hardest during the session:
Looking at the forward pass diagram โ inputs, weights, weighted sums, activation functions โ I was reminded that **the fundamentals never go out of style.** In the age of agents and LLMs, it's easy to forget that everything still traces back to classical ML intuition. The math hasn't changed. The thinking hasn't changed. Only the scale has.
๐ The engineers who truly thrive in the agentic era won't be the ones who only prompt โ they'll be the ones who understand *why* the model behaves the way it does.
Thank you **Aishwarya Srinivasan** and **Arvind Narayanamurthy** for not just teaching tools, but for reinforcing that deep understanding. Sessions like these are rare.
If you haven't explored fine-tuning yet, now is the time. ๐
#LLMs #FineTuning #MachineLearning #AI #DeepLearning #LoRA #Topmate #ContinuousLearning
Just wrapped up an incredibly insightful session on **LLM Fine-Tuning** with the amazing **Aishwarya** and **Arvind** on Topmate โ and I'm still processing how much ground we covered! ๐
From LoRA & QLoRA to Supervised Fine-Tuning, RAG optimization, and hands-on tooling with Unsloth and Hugging Face โ it was a masterclass in making large language models actually work for real-world use cases.
But here's the thing that hit me hardest during the session:
Looking at the forward pass diagram โ inputs, weights, weighted sums, activation functions โ I was reminded that **the fundamentals never go out of style.** In the age of agents and LLMs, it's easy to forget that everything still traces back to classical ML intuition. The math hasn't changed. The thinking hasn't changed. Only the scale has.
๐ The engineers who truly thrive in the agentic era won't be the ones who only prompt โ they'll be the ones who understand *why* the model behaves the way it does.
Thank you **Aishwarya Srinivasan** and **Arvind Narayanamurthy** for not just teaching tools, but for reinforcing that deep understanding. Sessions like these are rare.
If you haven't explored fine-tuning yet, now is the time. ๐
#LLMs #FineTuning #MachineLearning #AI #DeepLearning #LoRA #Topmate #ContinuousLearning
I demo AI features to prospects almost every day.
The reactions are genuinely exciting > "this is exactly what we need", "can we go live next month?", "our board has been asking for this".
Then they go live.
And two weeks later the feedback starts trickling in. Friction here. Unexpected behavior there. "It worked differently in the demo".
Nothing broke. But nothing quite held either.
I thought this was just my org figuring things out. Then I read this from Aishwarya Srinivasan.
"The era of vibe-coding has brought us incredible speed, but it has also introduced a dangerous precedent in production: Vibe-based Evaluation. Vibing your way to production is the fastest path to architectural debt and user churn".
That hit uncomfortably close to home.
The demo works because we control everything. Production doesn't give us that courtesy.
The shift I made: treat demo-readiness and production-readiness as parallel tracks, not sequential phases. The demo gets you in the door. Production discipline is what keeps you there.
Shipping fast still matters. But shipping trustworthy is the actual moat.
#ProductManagement #AIPM #EnterpriseAI #AIStrategy
I demo AI features to prospects almost every day.
The reactions are genuinely exciting > "this is exactly what we need", "can we go live next month?", "our board has been asking for this".
Then they go live.
And two weeks later the feedback starts trickling in. Friction here. Unexpected behavior there. "It worked differently in the demo".
Nothing broke. But nothing quite held either.
I thought this was just my org figuring things out. Then I read this from Aishwarya Srinivasan.
"The era of vibe-coding has brought us incredible speed, but it has also introduced a dangerous precedent in production: Vibe-based Evaluation. Vibing your way to production is the fastest path to architectural debt and user churn".
That hit uncomfortably close to home.
The demo works because we control everything. Production doesn't give us that courtesy.
The shift I made: treat demo-readiness and production-readiness as parallel tracks, not sequential phases. The demo gets you in the door. Production discipline is what keeps you there.
Shipping fast still matters. But shipping trustworthy is the actual moat.
#ProductManagement #AIPM #EnterpriseAI #AIStrategy
LLMs have always had this aura of mystery around them. Last Saturday, I tried to demystify at least one piece of it.
Attended a workshop on fine-tuning LLMs with The Gen Academy, presented by Aishwarya Srinivasan and Arvind Narayanamurthy. I've read about fine-tuning in Chip Huyen's AI Engineering book, but it's such a complex topic that it's genuinely tough to wrap my head around. The workshop helped!!
One of the key things I remembered from this workshop was LoRA architecture - instead of retraining a model from scratch, you freeze the original weights and add small trainable layers on top. Same outcome, way less compute.
We also did a hands-on supervised fine-tuning lab where we fine-tuned Llama 3.2 on a doctor appointment booking chatbot. The task was intent classification: given a user message, can the model correctly identify what the person wants to do - book, cancel, list appointments. Coming from an ML background, the concept felt familiar but looking at it through an LLM lens was a different exercise - you're not training for fixed, predictable inputs. You're training for anything a user might say.
Still have a long way to go with this topic. But Saturday was a good few hours of making it a little less opaque.
#AI #LLMs #FineTuning
LLMs have always had this aura of mystery around them. Last Saturday, I tried to demystify at least one piece of it.
Attended a workshop on fine-tuning LLMs with The Gen Academy, presented by Aishwarya Srinivasan and Arvind Narayanamurthy. I've read about fine-tuning in Chip Huyen's AI Engineering book, but it's such a complex topic that it's genuinely tough to wrap my head around. The workshop helped!!
One of the key things I remembered from this workshop was LoRA architecture - instead of retraining a model from scratch, you freeze the original weights and add small trainable layers on top. Same outcome, way less compute.
We also did a hands-on supervised fine-tuning lab where we fine-tuned Llama 3.2 on a doctor appointment booking chatbot. The task was intent classification: given a user message, can the model correctly identify what the person wants to do - book, cancel, list appointments. Coming from an ML background, the concept felt familiar but looking at it through an LLM lens was a different exercise - you're not training for fixed, predictable inputs. You're training for anything a user might say.
Still have a long way to go with this topic. But Saturday was a good few hours of making it a little less opaque.
#AI #LLMs #FineTuning
๐ Attended an insightful session on Retrieval-Augmented Generation (RAG)
Had the opportunity to attend a session focused on RAG, one of the most powerful approaches in modern AI systems.
It was great to understand how combining retrieval mechanisms with LLMs can significantly improve accuracy and reduce hallucinations.
Looking forward to exploring and implementing RAG in real-world use cases, especially in DevOps and AI-driven systems.
## @Aishwarya Srinivasan
๐ Attended an insightful session on Retrieval-Augmented Generation (RAG)
Had the opportunity to attend a session focused on RAG, one of the most powerful approaches in modern AI systems.
It was great to understand how combining retrieval mechanisms with LLMs can significantly improve accuracy and reduce hallucinations.
Looking forward to exploring and implementing RAG in real-world use cases, especially in DevOps and AI-driven systems.
## @Aishwarya Srinivasan
๐ What happens when your AI confidently gives you the WRONG answer?
.
.
.
That's exactly what I uncovered today at the RAG Fundamentals lightning session by Aishwarya and Arvind.
And it's not an LLM (ChatGPT, Gemini, Claude) problem. It's a RAG problem because they're trained on internet data, not your organization's internal docs, policies, or real-time databases.
So when you ask ChatGPT "Can I share a file with our logistics vendor?" - Without thinking as per the rules, it not just gives you an affirmation but also tells you how to do it, and it violates the actual company policy. Classic hallucination ๐ต
This is exactly the gap RAG fills. โ
Here's what I walked away understanding:
๐ก What RAG actually does - It connects your LLM to knowledge it was never trained on and makes it cite its sources. You get a "grounded answer".
๐งฑ How it works (generic architecture) - Documents > Chunks > Embeddings > Vector DB & the importance of Metadata, how numbers capture meaning, chunking strategies, re-ranking, etc.
โก Some myths around RAG - like Bigger context windows replace RAG, RAG only works on PDFs, Fine-tuning is better - is it ๐ค
๐ ๏ธ The hands-on demo - Covering a live RAG chatbot demo built on n8n using just one PDF as the knowledge source. The bot retrieved chunks from Vector DB, passed them through embeddings and answered questions with full source traceability. Watching the pipeline actually execute in real-time made every concept clear ๐ฅ
๐ And yes, RAG isn't magic:
โข It's not fully real-time (there's a lag)
โข Access control (RBAC) needs to be built on top - when we go deeper in complex RAG pipelines
โข Garbage in = garbage out - your docs need to be good
That was a jam-packed learning session and I can tell that every minute was worth it, Aishwarya and Arvind made sure of that ๐ฏ
More to come as I continue this journey into Agentic AI ๐
#RAG #GenerativeAI #AgenticAI #LLM #AIEngineering #MachineLearning #TheGenAcademy #AI #VectorDB #LangChain
๐ What happens when your AI confidently gives you the WRONG answer?
.
.
.
That's exactly what I uncovered today at the RAG Fundamentals lightning session by Aishwarya and Arvind.
And it's not an LLM (ChatGPT, Gemini, Claude) problem. It's a RAG problem because they're trained on internet data, not your organization's internal docs, policies, or real-time databases.
So when you ask ChatGPT "Can I share a file with our logistics vendor?" - Without thinking as per the rules, it not just gives you an affirmation but also tells you how to do it, and it violates the actual company policy. Classic hallucination ๐ต
This is exactly the gap RAG fills. โ
Here's what I walked away understanding:
๐ก What RAG actually does - It connects your LLM to knowledge it was never trained on and makes it cite its sources. You get a "grounded answer".
๐งฑ How it works (generic architecture) - Documents > Chunks > Embeddings > Vector DB & the importance of Metadata, how numbers capture meaning, chunking strategies, re-ranking, etc.
โก Some myths around RAG - like Bigger context windows replace RAG, RAG only works on PDFs, Fine-tuning is better - is it ๐ค
๐ ๏ธ The hands-on demo - Covering a live RAG chatbot demo built on n8n using just one PDF as the knowledge source. The bot retrieved chunks from Vector DB, passed them through embeddings and answered questions with full source traceability. Watching the pipeline actually execute in real-time made every concept clear ๐ฅ
๐ And yes, RAG isn't magic:
โข It's not fully real-time (there's a lag)
โข Access control (RBAC) needs to be built on top - when we go deeper in complex RAG pipelines
โข Garbage in = garbage out - your docs need to be good
That was a jam-packed learning session and I can tell that every minute was worth it, Aishwarya and Arvind made sure of that ๐ฏ
More to come as I continue this journey into Agentic AI ๐
#RAG #GenerativeAI #AgenticAI #LLM #AIEngineering #MachineLearning #TheGenAcademy #AI #VectorDB #LangChain
๐ช๐ต๐ ๐๐ ๐๐ฎ๐น๐น๐๐ฐ๐ถ๐ป๐ฎ๐๐ฒ๐ ๐ฎ๐ป๐ฑ ๐๐ผ๐ ๐ฅ๐๐ ๐๐ผ๐ฟ๐ฐ๐ฒ๐ ๐ง๐ฟ๐๐๐ต?
Attended ๐ฅ๐๐ ๐๐
๐ฝ๐น๐ฎ๐ถ๐ป๐ฒ๐ฑ: ๐ง๐ต๐ฒ ๐๐ฟ๐ฐ๐ต๐ถ๐๐ฒ๐ฐ๐๐๐ฟ๐ฒ ๐๐ฒ๐ต๐ถ๐ป๐ฑ ๐๐ด๐ฒ๐ป๐๐ถ๐ฐ ๐๐ ๐ฆ๐๐๐๐ฒ๐บ๐ lightening session hosted by Aishwarya and Arvind packed with practical use cases, architecture insights, and scalable design patterns for Agentic AI.
๐ง๐ต๐ฒ ๐๐ฎ๐ฟ๐ฑ ๐ง๐ฟ๐๐๐ต:,Your LLM will confidently sabotage you unless you anchor it reality.
๐ฅ๐ฒ๐ฎ๐น-๐ช๐ผ๐ฟ๐น๐ฑ ๐๐
๐ฎ๐บ๐ฝ๐น๐ฒ:
Ask "๐๐ข๐ฏ ๐ ๐ด๐ฉ๐ข๐ณ๐ฆ ๐ท๐ฆ๐ฏ๐ฅ๐ฐ๐ณ ๐ง๐ช๐ญ๐ฆ๐ด?"โ ChatGPT says "๐ ๐ฆ๐ด, ๐ฉ๐ฆ๐ณ๐ฆ'๐ด ๐ฉ๐ฐ๐ธ"
Your Policy: "๐๐ฐ ๐ฆ๐น๐ต๐ฆ๐ณ๐ฏ๐ข๐ญ ๐ด๐ฉ๐ข๐ณ๐ช๐ฏ๐จ ๐ธ๐ช๐ต๐ฉ๐ฐ๐ถ๐ต ๐ข๐ฑ๐ฑ๐ณ๐ฐ๐ท๐ข๐ญ"
The Gap: Internet-trained LLMs don't know your rules.
๐๐ฆ๐ฎ๐ช๐ฏ๐ช-generated session summary image from my notes along with
Key Takeaways:
๐ ๐๐๐ต ๐๐๐๐๐ฒ๐ฑ: Bigger context windows don't replace retrieval
๐๐ถ๐๐ฒ ๐ฃ๐ฟ๐ผ๐ผ๐ณ: n8n demo turned a PDF into a cited chatbot instantly
๐ฅ๐ฒ๐ฎ๐น๐ถ๐๐ ๐๐ต๐ฒ๐ฐ๐ธ: Lag exists, RBAC needs work, data quality rules all
๐๐ผ๐๐๐ผ๐บ ๐๐ถ๐ป๐ฒ: Stop playing with consumer AI. Build retrieval pipelines that cite your truth or bet your business on fabricated answers.
Big thanks to Aishwarya and Arvind for an highly informative session with live demo and Q&A.
P.S: Personal views.
#EnterpriseAI #RAG #AgenticAI #AIGovernance #AI #SharingInPublic #LearningMindset
๐ช๐ต๐ ๐๐ ๐๐ฎ๐น๐น๐๐ฐ๐ถ๐ป๐ฎ๐๐ฒ๐ ๐ฎ๐ป๐ฑ ๐๐ผ๐ ๐ฅ๐๐ ๐๐ผ๐ฟ๐ฐ๐ฒ๐ ๐ง๐ฟ๐๐๐ต?
Attended ๐ฅ๐๐ ๐๐
๐ฝ๐น๐ฎ๐ถ๐ป๐ฒ๐ฑ: ๐ง๐ต๐ฒ ๐๐ฟ๐ฐ๐ต๐ถ๐๐ฒ๐ฐ๐๐๐ฟ๐ฒ ๐๐ฒ๐ต๐ถ๐ป๐ฑ ๐๐ด๐ฒ๐ป๐๐ถ๐ฐ ๐๐ ๐ฆ๐๐๐๐ฒ๐บ๐ lightening session hosted by Aishwarya and Arvind packed with practical use cases, architecture insights, and scalable design patterns for Agentic AI.
๐ง๐ต๐ฒ ๐๐ฎ๐ฟ๐ฑ ๐ง๐ฟ๐๐๐ต:,Your LLM will confidently sabotage you unless you anchor it reality.
๐ฅ๐ฒ๐ฎ๐น-๐ช๐ผ๐ฟ๐น๐ฑ ๐๐
๐ฎ๐บ๐ฝ๐น๐ฒ:
Ask "๐๐ข๐ฏ ๐ ๐ด๐ฉ๐ข๐ณ๐ฆ ๐ท๐ฆ๐ฏ๐ฅ๐ฐ๐ณ ๐ง๐ช๐ญ๐ฆ๐ด?"โ ChatGPT says "๐ ๐ฆ๐ด, ๐ฉ๐ฆ๐ณ๐ฆ'๐ด ๐ฉ๐ฐ๐ธ"
Your Policy: "๐๐ฐ ๐ฆ๐น๐ต๐ฆ๐ณ๐ฏ๐ข๐ญ ๐ด๐ฉ๐ข๐ณ๐ช๐ฏ๐จ ๐ธ๐ช๐ต๐ฉ๐ฐ๐ถ๐ต ๐ข๐ฑ๐ฑ๐ณ๐ฐ๐ท๐ข๐ญ"
The Gap: Internet-trained LLMs don't know your rules.
๐๐ฆ๐ฎ๐ช๐ฏ๐ช-generated session summary image from my notes along with
Key Takeaways:
๐ ๐๐๐ต ๐๐๐๐๐ฒ๐ฑ: Bigger context windows don't replace retrieval
๐๐ถ๐๐ฒ ๐ฃ๐ฟ๐ผ๐ผ๐ณ: n8n demo turned a PDF into a cited chatbot instantly
๐ฅ๐ฒ๐ฎ๐น๐ถ๐๐ ๐๐ต๐ฒ๐ฐ๐ธ: Lag exists, RBAC needs work, data quality rules all
๐๐ผ๐๐๐ผ๐บ ๐๐ถ๐ป๐ฒ: Stop playing with consumer AI. Build retrieval pipelines that cite your truth or bet your business on fabricated answers.
Big thanks to Aishwarya and Arvind for an highly informative session with live demo and Q&A.
P.S: Personal views.
#EnterpriseAI #RAG #AgenticAI #AIGovernance #AI #SharingInPublic #LearningMindset
RB
RAG is Dead!! Content window eliminates RAG!!
Yesterday I attended the session โRAG Explained: The Architecture Behind Agentic AI Systemsโ on Maven, by Aishwarya Srinivasan & Arvind Narayanamurthy, that demystified so many myths about RAG, like the ones above ๐
It was very insightful to learn LLMs alone are not enough.
They are powerful reasoning engines, but they do not know your company data, internal documents, or real-time systems.
Thatโs where RAG changes everything.
Instead of asking the model to guess, a RAG system:
1๏ธโฃ Retrieves relevant information
2๏ธโฃ Injects it into the prompt
3๏ธโฃ Lets the model reason over actual data
In simple terms:
LLM = ๐ง Brain
RAG = ๐ Memory
Agents = ๐ค Workers
Put them together and you get modern AI systems that can actually operate in the real world.
๐ Huge thanks to the authors for making a complex topic clear, practical, and accessible.
#ArtificialIntelligence #RAG #AgenticAI #AIArchitecture #GenerativeAI #LLM #AIEngineering
RAG is Dead!! Content window eliminates RAG!!
Yesterday I attended the session โRAG Explained: The Architecture Behind Agentic AI Systemsโ on Maven, by Aishwarya Srinivasan & Arvind Narayanamurthy, that demystified so many myths about RAG, like the ones above ๐
It was very insightful to learn LLMs alone are not enough.
They are powerful reasoning engines, but they do not know your company data, internal documents, or real-time systems.
Thatโs where RAG changes everything.
Instead of asking the model to guess, a RAG system:
1๏ธโฃ Retrieves relevant information
2๏ธโฃ Injects it into the prompt
3๏ธโฃ Lets the model reason over actual data
In simple terms:
LLM = ๐ง Brain
RAG = ๐ Memory
Agents = ๐ค Workers
Put them together and you get modern AI systems that can actually operate in the real world.
๐ Huge thanks to the authors for making a complex topic clear, practical, and accessible.
#ArtificialIntelligence #RAG #AgenticAI #AIArchitecture #GenerativeAI #LLM #AIEngineering
This weekend, I attended a RAG workshop by Aishwarya and Arvind - and I'm still thinking about it.
Honestly, I went in expecting dense concepts, jargon, and that familiar feeling of nodding along while quietly being lost.
What I got instead was clarity.
What stood out wasn't just the content - it was how it was delivered. Complex ideas broken down with analogies that just *clicked*. The kind of teaching where you stop and think, "wait, that actually makes so much sense."
RAG (Retrieval-Augmented Generation) is one of those topics that sounds intimidating until someone takes the time to meet you where you are. Aishwarya and Arvind did exactly that.
Genuinely one of the best learning experiences I've had in a while.Also excited for upcoming workshops by The Gen Academy
Thank you Aishwarya Srinivasan and Arvind Narayanamurthy for making something powerful feel accessible. That's a rare skill.
#RAG #MachineLearning #AI #LearningAndDevelopment #Workshop
This weekend, I attended a RAG workshop by Aishwarya and Arvind - and I'm still thinking about it.
Honestly, I went in expecting dense concepts, jargon, and that familiar feeling of nodding along while quietly being lost.
What I got instead was clarity.
What stood out wasn't just the content - it was how it was delivered. Complex ideas broken down with analogies that just *clicked*. The kind of teaching where you stop and think, "wait, that actually makes so much sense."
RAG (Retrieval-Augmented Generation) is one of those topics that sounds intimidating until someone takes the time to meet you where you are. Aishwarya and Arvind did exactly that.
Genuinely one of the best learning experiences I've had in a while.Also excited for upcoming workshops by The Gen Academy
Thank you Aishwarya Srinivasan and Arvind Narayanamurthy for making something powerful feel accessible. That's a rare skill.
#RAG #MachineLearning #AI #LearningAndDevelopment #Workshop
Grateful for an incredibly insightful session on Claude Cowork and Claude Code! ๐
A big thank you to Aishwarya Srinivasan, Arvind Narayanamurthy, and the entire team at The Gen Academy for putting together such a well-structured and engaging session.
The depth of knowledge, practical insights, and clarity in explaining real-world applications made the learning experience truly valuable. Itโs sessions like these that help bridge the gap between concepts and implementation.
Looking forward to applying these learnings and exploring more in this space!
#AI #Claude #Learning #TechCommunity #GenAcademy #DeveloperGrowth
Grateful for an incredibly insightful session on Claude Cowork and Claude Code! ๐
A big thank you to Aishwarya Srinivasan, Arvind Narayanamurthy, and the entire team at The Gen Academy for putting together such a well-structured and engaging session.
The depth of knowledge, practical insights, and clarity in explaining real-world applications made the learning experience truly valuable. Itโs sessions like these that help bridge the gap between concepts and implementation.
Looking forward to applying these learnings and exploring more in this space!
#AI #Claude #Learning #TechCommunity #GenAcademy #DeveloperGrowth
Y
This Saturday had a different kind of energy. No plans. Just curiosity - and a session I had been waiting for all week. "The AI PM Playbook: Building AI Products at Scale" by MAVEN. And honestly? It delivered more than I expected. What hit me the most wasn't just the content. It was watching Aishwarya Srinivasan walk through her entire AI stack live - Claude for PRDs and stakeholder narratives, Claude Code for prototyping agents, Lovable for building full apps from prompts without a dev bottleneck. That last one sat with me. No dev bottleneck. As someone who works in a product-based company and has spent time deeply understanding how products are built, tested, and shipped - this felt like a signal I couldn't ignore. The gap between "having product intuition" and "building something with it" is getting smaller every single day. And the people who figure out how to combine product thinking with AI agent workflows? They're going to move at a speed that's just different. I left the session with 3 pages of notes, 2 new tools to try, and 1 very clear thought: The next thing I build won't just use AI. It'll be powered by agents that think, act, and ship alongside me. Massive thank you to Aishwarya Srinivasan, Arvind Narayanamurthy, and Shyamala Prayaga for putting together something real. No fluff. Just depth. If you missed it , keep an eye on MAVEN. Worth every Saturday๐
#AIProductManagement #BuildingWithAI #AIAgents #ProductThinking #MAVENlearning #ClaudeAI #GenAI #AIWorkflow #WeekendLearning #FutureOfProduct#AIProductManagement #BuildingWithAI #AIAgents #ProductThinking #MAVENlearning #ClaudeAI #GenAI #AIWorkflow #WeekendLearning #FutureOfProduct
This Saturday had a different kind of energy. No plans. Just curiosity - and a session I had been waiting for all week. "The AI PM Playbook: Building AI Products at Scale" by MAVEN. And honestly? It delivered more than I expected. What hit me the most wasn't just the content. It was watching Aishwarya Srinivasan walk through her entire AI stack live - Claude for PRDs and stakeholder narratives, Claude Code for prototyping agents, Lovable for building full apps from prompts without a dev bottleneck. That last one sat with me. No dev bottleneck. As someone who works in a product-based company and has spent time deeply understanding how products are built, tested, and shipped - this felt like a signal I couldn't ignore. The gap between "having product intuition" and "building something with it" is getting smaller every single day. And the people who figure out how to combine product thinking with AI agent workflows? They're going to move at a speed that's just different. I left the session with 3 pages of notes, 2 new tools to try, and 1 very clear thought: The next thing I build won't just use AI. It'll be powered by agents that think, act, and ship alongside me. Massive thank you to Aishwarya Srinivasan, Arvind Narayanamurthy, and Shyamala Prayaga for putting together something real. No fluff. Just depth. If you missed it , keep an eye on MAVEN. Worth every Saturday๐
#AIProductManagement #BuildingWithAI #AIAgents #ProductThinking #MAVENlearning #ClaudeAI #GenAI #AIWorkflow #WeekendLearning #FutureOfProduct#AIProductManagement #BuildingWithAI #AIAgents #ProductThinking #MAVENlearning #ClaudeAI #GenAI #AIWorkflow #WeekendLearning #FutureOfProduct
Thank you so much Aishwarya Srinivasan and Arvind Narayanamurthy for hosting Session on Building AI Products at Scale. Appreciate the effort you put out to brought the knowledge from core of its industry to the people.Looking for more such sessions.
Honored to learn some perspective from its core.Shyamala Prayaga you were just amazing throughout the session.The explanation you gave for all the questions is quite understandable in simple words.
AI is not thread itself it depends on how we engage it with products we builtโจโจ
#AI
#Agentic
#Saturdaylearning
#Products
Thank you so much Aishwarya Srinivasan and Arvind Narayanamurthy for hosting Session on Building AI Products at Scale. Appreciate the effort you put out to brought the knowledge from core of its industry to the people.Looking for more such sessions.
Honored to learn some perspective from its core.Shyamala Prayaga you were just amazing throughout the session.The explanation you gave for all the questions is quite understandable in simple words.
AI is not thread itself it depends on how we engage it with products we builtโจโจ
#AI
#Agentic
#Saturdaylearning
#Products
I spent 3 months building a multi-agent system that does 2-4 hours of AE work in ~4 minutes.
4 LangGraph agents. Cited sales strategy. Production-grade.
3 things production taught me:
-> NAIVE RAG FAILS HARD
"GNC toolboxes" returned zero semantic similarity to "Sensor Fusion and Tracking Toolbox." Vector-only search = wrong products in front of customers.
Fixed it with Hybrid RAG (thanks Aishwarya Srinivasan): BM25 + vector + cross-encoder reranking. Retrieval quality is the ceilingโeverything downstream inherits its failures.
-> YOU CAN'T TUNE WITHOUT EVALS
Like adjusting PID gains without feedback means you're flying blind.
Built Claude-as-judge with 4 metrics + 9 deterministic checks. Went from 3.0 to 4.2 quality score across 3 iterations.
-> LLM COST IS A ROUTING PROBLEM
Ollama ($0) โ Groq 8B โ Groq 70B dispatched by task complexity. Prompt caching cuts 90% of token costs.
MIT licensed. If any of this saves you a debugging session, fork it, build on it.
Repo Link in comments.
#AgenticAI #LangGraph #RAG
I spent 3 months building a multi-agent system that does 2-4 hours of AE work in ~4 minutes.
4 LangGraph agents. Cited sales strategy. Production-grade.
3 things production taught me:
-> NAIVE RAG FAILS HARD
"GNC toolboxes" returned zero semantic similarity to "Sensor Fusion and Tracking Toolbox." Vector-only search = wrong products in front of customers.
Fixed it with Hybrid RAG (thanks Aishwarya Srinivasan): BM25 + vector + cross-encoder reranking. Retrieval quality is the ceilingโeverything downstream inherits its failures.
-> YOU CAN'T TUNE WITHOUT EVALS
Like adjusting PID gains without feedback means you're flying blind.
Built Claude-as-judge with 4 metrics + 9 deterministic checks. Went from 3.0 to 4.2 quality score across 3 iterations.
-> LLM COST IS A ROUTING PROBLEM
Ollama ($0) โ Groq 8B โ Groq 70B dispatched by task complexity. Prompt caching cuts 90% of token costs.
MIT licensed. If any of this saves you a debugging session, fork it, build on it.
Repo Link in comments.
#AgenticAI #LangGraph #RAG
Most AI answers ๐ด๐ฐ๐ถ๐ฏ๐ฅ ๐ณ๐ช๐จ๐ฉ๐ตโฆ but are they actually correct?
One of the challenges with LLMs becomes very clear in enterprise settings.
LLMs like ChatGPT, Gemini, or Claude are trained on ๐ถ๐ป๐๐ฒ๐ฟ๐ป๐ฒ๐ ๐ฑ๐ฎ๐๐ฎ, not your companyโs internal policies, processes, or documents.
So when someone asks:
โ๐๐ข๐ฏ ๐ ๐ด๐ฉ๐ข๐ณ๐ฆ ๐ข ๐ค๐ญ๐ช๐ฆ๐ฏ๐ต ๐ง๐ช๐ญ๐ฆ ๐ธ๐ช๐ต๐ฉ ๐ข ๐ท๐ฆ๐ฏ๐ฅ๐ฐ๐ณ?โ
The response may sound confident and logicalโฆ
but it could still be ๐บ๐ถ๐๐ฎ๐น๐ถ๐ด๐ป๐ฒ๐ฑ ๐๐ถ๐๐ต ๐ฒ๐ป๐๐ฒ๐ฟ๐ฝ๐ฟ๐ถ๐๐ฒ ๐ฝ๐ผ๐น๐ถ๐ฐ๐.
๐ง๐ต๐ถ๐ ๐ถ๐ ๐๐ต๐ฒ๐ฟ๐ฒ ๐ฅ๐๐ (๐ฅ๐ฒ๐๐ฟ๐ถ๐ฒ๐๐ฎ๐น ๐๐๐ด๐บ๐ฒ๐ป๐๐ฒ๐ฑ ๐๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐๐ถ๐ผ๐ป) ๐ฐ๐ผ๐บ๐ฒ๐ ๐ถ๐ป
RAG connects LLMs to ๐ฒ๐ป๐๐ฒ๐ฟ๐ฝ๐ฟ๐ถ๐๐ฒ ๐ธ๐ป๐ผ๐๐น๐ฒ๐ฑ๐ด๐ฒ ๐๐ต๐ฒ๐ ๐๐ฒ๐ฟ๐ฒ ๐ป๐ฒ๐๐ฒ๐ฟ ๐๐ฟ๐ฎ๐ถ๐ป๐ฒ๐ฑ ๐ผ๐ป.
Instead of relying only on pre-trained knowledge, it:
1. Breaks documents into ๐ฐ๐ต๐๐ป๐ธ๐
2. Converts them into ๐ฒ๐บ๐ฏ๐ฒ๐ฑ๐ฑ๐ถ๐ป๐ด๐ (numerical representations of text)
3. Stores them in a ๐๐ฒ๐ฐ๐๐ผ๐ฟ ๐ฑ๐ฎ๐๐ฎ๐ฏ๐ฎ๐๐ฒ
4. Uses ๐ฐ๐ผ๐๐ถ๐ป๐ฒ ๐๐ถ๐บ๐ถ๐น๐ฎ๐ฟ๐ถ๐๐(=0.97) to retrieve the most relevant context
5. Feeds that context to the LLM to generate grounded responses
๐๐ต๐๐ป๐ธ๐ถ๐ป๐ด ๐ถ๐ ๐บ๐ผ๐ฟ๐ฒ ๐ถ๐บ๐ฝ๐ผ๐ฟ๐๐ฎ๐ป๐ ๐๐ต๐ฎ๐ป ๐ถ๐ ๐น๐ผ๐ผ๐ธ๐
The way you split data directly impacts the quality of retrieval.
Common chunking strategies include:
โข Fixed-length chunking
โข Sentence-based chunking
โข Paragraph-based chunking
โข Sliding window chunking
โข Semantic chunking
โข Recursive chunking
Better chunking โ Better retrieval โ Better answers
And more importantly:
๐๐ฒ๐๐๐ฒ๐ฟ ๐ฎ๐ป๐๐๐ฒ๐ฟ๐ ๐๐ถ๐๐ต ๐ฐ๐ถ๐๐ฎ๐๐ถ๐ผ๐ป๐
Which means the response is not just helpful, but ๐๐ฟ๐ฎ๐ฐ๐ฒ๐ฎ๐ฏ๐น๐ฒ:
โข You can see where the answer came from
โข You can refer back to the exact company document
โข The answer has real grounding, not just confidence
Thatโs what gives AI ๐ฐ๐ฟ๐ฒ๐ฑ๐ถ๐ฏ๐ถ๐น๐ถ๐๐ ๐ถ๐ป ๐ฒ๐ป๐๐ฒ๐ฟ๐ฝ๐ฟ๐ถ๐๐ฒ ๐๐๐ฒ.
โ๏ธ๐ฅ๐๐ ๐๐ ๐๐ถ๐ป๐ฒ-๐๐๐ป๐ถ๐ป๐ด
๐๐ถ๐ป๐ฒ-๐๐๐ป๐ถ๐ป๐ด โ Good for behavior, structure, and low latency
๐ฅ๐๐ โ Better for dynamic, real-time, and private enterprise data
For most enterprise use cases, RAG is the most effective starting point for improving LLM responses.
๐ ๐ ๐๐ฎ๐ธ๐ฒ๐ฎ๐๐ฎ๐
AI is not just about generating answers.
Itโs about:
โข Retrieving the right context
โข Grounding responses in real data
โข Making answers ๐๐ฒ๐ฟ๐ถ๐ณ๐ถ๐ฎ๐ฏ๐น๐ฒ, ๐ป๐ผ๐ ๐ท๐๐๐ ๐ฐ๐ผ๐ป๐๐ถ๐ป๐ฐ๐ถ๐ป๐ด
A quick shoutout to Arvind Narayanamurthy & Aishwarya Srinivasan from The Gen Academy for this weekend learning.
Most AI answers ๐ด๐ฐ๐ถ๐ฏ๐ฅ ๐ณ๐ช๐จ๐ฉ๐ตโฆ but are they actually correct?
One of the challenges with LLMs becomes very clear in enterprise settings.
LLMs like ChatGPT, Gemini, or Claude are trained on ๐ถ๐ป๐๐ฒ๐ฟ๐ป๐ฒ๐ ๐ฑ๐ฎ๐๐ฎ, not your companyโs internal policies, processes, or documents.
So when someone asks:
โ๐๐ข๐ฏ ๐ ๐ด๐ฉ๐ข๐ณ๐ฆ ๐ข ๐ค๐ญ๐ช๐ฆ๐ฏ๐ต ๐ง๐ช๐ญ๐ฆ ๐ธ๐ช๐ต๐ฉ ๐ข ๐ท๐ฆ๐ฏ๐ฅ๐ฐ๐ณ?โ
The response may sound confident and logicalโฆ
but it could still be ๐บ๐ถ๐๐ฎ๐น๐ถ๐ด๐ป๐ฒ๐ฑ ๐๐ถ๐๐ต ๐ฒ๐ป๐๐ฒ๐ฟ๐ฝ๐ฟ๐ถ๐๐ฒ ๐ฝ๐ผ๐น๐ถ๐ฐ๐.
๐ง๐ต๐ถ๐ ๐ถ๐ ๐๐ต๐ฒ๐ฟ๐ฒ ๐ฅ๐๐ (๐ฅ๐ฒ๐๐ฟ๐ถ๐ฒ๐๐ฎ๐น ๐๐๐ด๐บ๐ฒ๐ป๐๐ฒ๐ฑ ๐๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐๐ถ๐ผ๐ป) ๐ฐ๐ผ๐บ๐ฒ๐ ๐ถ๐ป
RAG connects LLMs to ๐ฒ๐ป๐๐ฒ๐ฟ๐ฝ๐ฟ๐ถ๐๐ฒ ๐ธ๐ป๐ผ๐๐น๐ฒ๐ฑ๐ด๐ฒ ๐๐ต๐ฒ๐ ๐๐ฒ๐ฟ๐ฒ ๐ป๐ฒ๐๐ฒ๐ฟ ๐๐ฟ๐ฎ๐ถ๐ป๐ฒ๐ฑ ๐ผ๐ป.
Instead of relying only on pre-trained knowledge, it:
1. Breaks documents into ๐ฐ๐ต๐๐ป๐ธ๐
2. Converts them into ๐ฒ๐บ๐ฏ๐ฒ๐ฑ๐ฑ๐ถ๐ป๐ด๐ (numerical representations of text)
3. Stores them in a ๐๐ฒ๐ฐ๐๐ผ๐ฟ ๐ฑ๐ฎ๐๐ฎ๐ฏ๐ฎ๐๐ฒ
4. Uses ๐ฐ๐ผ๐๐ถ๐ป๐ฒ ๐๐ถ๐บ๐ถ๐น๐ฎ๐ฟ๐ถ๐๐(=0.97) to retrieve the most relevant context
5. Feeds that context to the LLM to generate grounded responses
๐๐ต๐๐ป๐ธ๐ถ๐ป๐ด ๐ถ๐ ๐บ๐ผ๐ฟ๐ฒ ๐ถ๐บ๐ฝ๐ผ๐ฟ๐๐ฎ๐ป๐ ๐๐ต๐ฎ๐ป ๐ถ๐ ๐น๐ผ๐ผ๐ธ๐
The way you split data directly impacts the quality of retrieval.
Common chunking strategies include:
โข Fixed-length chunking
โข Sentence-based chunking
โข Paragraph-based chunking
โข Sliding window chunking
โข Semantic chunking
โข Recursive chunking
Better chunking โ Better retrieval โ Better answers
And more importantly:
๐๐ฒ๐๐๐ฒ๐ฟ ๐ฎ๐ป๐๐๐ฒ๐ฟ๐ ๐๐ถ๐๐ต ๐ฐ๐ถ๐๐ฎ๐๐ถ๐ผ๐ป๐
Which means the response is not just helpful, but ๐๐ฟ๐ฎ๐ฐ๐ฒ๐ฎ๐ฏ๐น๐ฒ:
โข You can see where the answer came from
โข You can refer back to the exact company document
โข The answer has real grounding, not just confidence
Thatโs what gives AI ๐ฐ๐ฟ๐ฒ๐ฑ๐ถ๐ฏ๐ถ๐น๐ถ๐๐ ๐ถ๐ป ๐ฒ๐ป๐๐ฒ๐ฟ๐ฝ๐ฟ๐ถ๐๐ฒ ๐๐๐ฒ.
โ๏ธ๐ฅ๐๐ ๐๐ ๐๐ถ๐ป๐ฒ-๐๐๐ป๐ถ๐ป๐ด
๐๐ถ๐ป๐ฒ-๐๐๐ป๐ถ๐ป๐ด โ Good for behavior, structure, and low latency
๐ฅ๐๐ โ Better for dynamic, real-time, and private enterprise data
For most enterprise use cases, RAG is the most effective starting point for improving LLM responses.
๐ ๐ ๐๐ฎ๐ธ๐ฒ๐ฎ๐๐ฎ๐
AI is not just about generating answers.
Itโs about:
โข Retrieving the right context
โข Grounding responses in real data
โข Making answers ๐๐ฒ๐ฟ๐ถ๐ณ๐ถ๐ฎ๐ฏ๐น๐ฒ, ๐ป๐ผ๐ ๐ท๐๐๐ ๐ฐ๐ผ๐ป๐๐ถ๐ป๐ฐ๐ถ๐ป๐ด
A quick shoutout to Arvind Narayanamurthy & Aishwarya Srinivasan from The Gen Academy for this weekend learning.
I ran 7 RAG architectures side by side on the same questions to see what actually matters.
The setup comes from a deep dive by a friend of mine, Vidhyakshaya Kannan, on The Gen Academy which breaks down these RAG architectures and their tradeoffs.
A few things that stood out:
- Most architectures land in a similar accuracy range
- Agentic RAG performs best, but costs ~4.8ร more per correct answer
- Self-RAG underperforms Naive RAG. More complexity, worse results
It is easy to over-engineer RAG systems. Running them side by side makes that tradeoff very clear. Iโll drop the blog post and code in the comments.
How are you deciding between RAG architectures in practice? Optimizing for accuracy, cost, or something else?
#MachineLearning #ArtificialIntelligence #DellTech #DellProPrecision #NVIDIA
I ran 7 RAG architectures side by side on the same questions to see what actually matters.
The setup comes from a deep dive by a friend of mine, Vidhyakshaya Kannan, on The Gen Academy which breaks down these RAG architectures and their tradeoffs.
A few things that stood out:
- Most architectures land in a similar accuracy range
- Agentic RAG performs best, but costs ~4.8ร more per correct answer
- Self-RAG underperforms Naive RAG. More complexity, worse results
It is easy to over-engineer RAG systems. Running them side by side makes that tradeoff very clear. Iโll drop the blog post and code in the comments.
How are you deciding between RAG architectures in practice? Optimizing for accuracy, cost, or something else?
#MachineLearning #ArtificialIntelligence #DellTech #DellProPrecision #NVIDIA
Most AI PMs are managing probabilistic systems with deterministic tools.
That's why AI products quietly rot after launch.
In traditional software: a button either works or it doesn't. Bugs are reproducible. If it passes staging, it passes prod.
In AI: the "same" input produces different outputs. A prompt that works on 10 examples fails on the 11th. Features don't ship as "works / doesn't work", they ship with a distribution of quality.
And most PMs have no idea how to measure that distribution.
I mapped out the full AI PM tooling stack for 2026, the 6 layers every AI PM needs to know, the category leaders in each, and the judgment calls that actually matter:
โ Evaluation (where quality is defined)
โ Observability (seeing what actually shipped)
โ Prompt management (governing changes safely)
โ Prototyping (Bolt, Lovable, v0, Cursor)
โ Experimentation (shipping to users safely)
โ Customer feedback (keeping evals honest)
The biggest mistake AI PMs make? Adopting an eval tool and never building a real dataset. Treating the tool as the deliverable instead of the scaffolding.
Inspired by the Lightning Session on The AI PM Playbook by The Gen Academy, hosted by Aishwarya Srinivasan and Arvind Narayanamurthy, with guest speaker Shyamala Prayaga.
Full breakdown on Substack, link in comments ๐
Most AI PMs are managing probabilistic systems with deterministic tools.
That's why AI products quietly rot after launch.
In traditional software: a button either works or it doesn't. Bugs are reproducible. If it passes staging, it passes prod.
In AI: the "same" input produces different outputs. A prompt that works on 10 examples fails on the 11th. Features don't ship as "works / doesn't work", they ship with a distribution of quality.
And most PMs have no idea how to measure that distribution.
I mapped out the full AI PM tooling stack for 2026, the 6 layers every AI PM needs to know, the category leaders in each, and the judgment calls that actually matter:
โ Evaluation (where quality is defined)
โ Observability (seeing what actually shipped)
โ Prompt management (governing changes safely)
โ Prototyping (Bolt, Lovable, v0, Cursor)
โ Experimentation (shipping to users safely)
โ Customer feedback (keeping evals honest)
The biggest mistake AI PMs make? Adopting an eval tool and never building a real dataset. Treating the tool as the deliverable instead of the scaffolding.
Inspired by the Lightning Session on The AI PM Playbook by The Gen Academy, hosted by Aishwarya Srinivasan and Arvind Narayanamurthy, with guest speaker Shyamala Prayaga.
Full breakdown on Substack, link in comments ๐
Yesterday, I attended the AI PM Playbook by The Gen Academy, featuring Shyamala Prayaga (Senior AI Product Manager at NVIDIA).
You might wonder, whatโs a software engineer doing in an AI PM session?
Because Iโve seen how often we jump straight into buildingโฆ and only later realize we shouldโve asked better questions first. Working closely with PMs, Iโve started valuing that thought process more, how ideas are shaped before they become features. Thatโs what pulled me into this session.
One line from the session that really stayed with me:
๐ Donโt fall for the โshiny object syndromeโ in AI.
Itโs tempting to add AI everywhere, but the real focus should be on:
โข Solving the right problem (not just using AI for the sake of it)
โข Defining metrics & evals upfront - โbuild evals before building featuresโ
โข Thinking about adoption - token economics, context, and real user value
A good reminder that building AI products, at any level, needs clarity, intent, and responsibility, not just hype.
#AI #ProductManagement #SoftwareEngineering #GenAI #Learning
Yesterday, I attended the AI PM Playbook by The Gen Academy, featuring Shyamala Prayaga (Senior AI Product Manager at NVIDIA).
You might wonder, whatโs a software engineer doing in an AI PM session?
Because Iโve seen how often we jump straight into buildingโฆ and only later realize we shouldโve asked better questions first. Working closely with PMs, Iโve started valuing that thought process more, how ideas are shaped before they become features. Thatโs what pulled me into this session.
One line from the session that really stayed with me:
๐ Donโt fall for the โshiny object syndromeโ in AI.
Itโs tempting to add AI everywhere, but the real focus should be on:
โข Solving the right problem (not just using AI for the sake of it)
โข Defining metrics & evals upfront - โbuild evals before building featuresโ
โข Thinking about adoption - token economics, context, and real user value
A good reminder that building AI products, at any level, needs clarity, intent, and responsibility, not just hype.
#AI #ProductManagement #SoftwareEngineering #GenAI #Learning
AI products donโt fail because of bad models.
They fail because of bad decisions.
Over the weekend, I attended the Lightning Lesson on The AI PM Playbook, hosted by Aishwarya Srinivasan and Arvind Narayanamurthy (Maven ร The Gen Academy), with Shyamala Prayaga (NVIDIA).
It exposed a gap in how I was thinking about AI systems. I was focused on capabilities. This shifted me toward accountability.
The MAP Framework (Model โ Augment โ Program) stood outโnot just as a technique, but as a decision filter:
1. When should AI generate?
2. When should it assist?
3. And when should it stay out entirely?
This matters because AI is non-deterministic.
Treat it like traditional software, and you end up with "silent failures"โsystems that appear correct until they break user trust.
The shift for me:
As someone with a technical background, I used to ask: โWhat can this model do?โ Now, as an aspiring AI PM, I ask: โWhat should the system be responsible for?โ
Iโm now applying this product-first mindset to my own projectsโmoving beyond demos toward reliable systems at scale.
For AI builders: whatโs one decision that becomes harder when moving from demo to production?
#ArtificialIntelligence #NVIDIA #AIProductManagement #GenerativeAI #SystemDesign #BuildInPublic #AIEngineering #MachineLearning #ProductStrategy #TheGenAcademy
AI products donโt fail because of bad models.
They fail because of bad decisions.
Over the weekend, I attended the Lightning Lesson on The AI PM Playbook, hosted by Aishwarya Srinivasan and Arvind Narayanamurthy (Maven ร The Gen Academy), with Shyamala Prayaga (NVIDIA).
It exposed a gap in how I was thinking about AI systems. I was focused on capabilities. This shifted me toward accountability.
The MAP Framework (Model โ Augment โ Program) stood outโnot just as a technique, but as a decision filter:
1. When should AI generate?
2. When should it assist?
3. And when should it stay out entirely?
This matters because AI is non-deterministic.
Treat it like traditional software, and you end up with "silent failures"โsystems that appear correct until they break user trust.
The shift for me:
As someone with a technical background, I used to ask: โWhat can this model do?โ Now, as an aspiring AI PM, I ask: โWhat should the system be responsible for?โ
Iโm now applying this product-first mindset to my own projectsโmoving beyond demos toward reliable systems at scale.
For AI builders: whatโs one decision that becomes harder when moving from demo to production?
#ArtificialIntelligence #NVIDIA #AIProductManagement #GenerativeAI #SystemDesign #BuildInPublic #AIEngineering #MachineLearning #ProductStrategy #TheGenAcademy
