Issue № 03Agentic AI

Lead-Qualification Agent

An AI home-advisor for real estate that qualifies buyers, scores its own confidence, and escalates hot leads over WhatsApp — tuned by a three-layer evaluation suite.

At a glance: Ethereal built an AI home-buying assistant for a property developer drowning in inquiries. It chats with each buyer, figures out their budget and how serious they are, and hands the hottest ones straight to the sales team over WhatsApp — and it was fine-tuned by rehearsing against fifteen different types of buyer.

03
Client
Confidential real-estate developer
Industry
Real estateLead qualification · Conversational AI
Year
2025
Services
Agentic AIConfidence ScoringEscalation WorkflowEvaluation SuiteAdmin Dashboard
4-levelconfidence scoring
15personas in the eval suite
3-layerevaluation loop
01

The Problem

A property developer was flooded with unqualified inquiries. Sales couldn't prioritize, hot buyers slipped away, and every conversation started from zero.

Volume

A single launch buries the sales team in inquiries, most of which will never transact.

Priority

With no way to rank intent, hot buyers wait in the same queue as tyre-kickers.

Cold starts

Every conversation restarts from zero — nothing the buyer already said is remembered or scored.

02

The Solution

We built an AI home-advisor that qualifies buyers in three phases — passive extraction, active probing, pre-handoff confirmation — scores its own confidence (LOW / MEDIUM / HIGH / ESCALATE), and detects intent (own-use, investment, NRI, gift, custom-build). Hot leads escalate to sales over WhatsApp. The agent is tuned by a three-layer evaluation suite: analytics, an LLM judge, and a 15-persona simulation.

How it works
01Phase

Passive Extraction

The agent infers budget, intent, and timeline from what the buyer volunteers — without interrogating.

02Phase

Active Probing

Gaps are filled with targeted questions, but only when confidence is too low to decide.

03Phase

Pre-Handoff Confirm

Before escalating, the agent confirms the qualified picture back to the buyer.

04Core

Confidence Engine

Every turn is scored LOW / MEDIUM / HIGH / ESCALATE — the score decides what happens next.

Qualification flow
Extractpassive intent
Probetargeted questions
ScoreLOW → ESCALATE
EscalateWhatsApp to sales
Latency budget
15

buyer personas in the eval loop

Intent detection

Own-use, investment, NRI, gift, and custom-build buyers are routed differently from the first message.

Self-improving evaluation suite
Analytics Layer

Real conversation metrics surface where the agent hesitates or misreads intent.

LLM Judge

A second model grades each transcript against the qualification rubric.

15 Personas

A simulated panel of fifteen buyer personas stress-tests the agent before anything ships.

Confidence Scoring

Four-level scoring makes every qualify-or-escalate decision inspectable.

WhatsApp Escalation

Hot leads hand off to a human over WhatsApp with full context attached.

03

The Outcome

Automated buyer qualification and escalation — and a system that keeps improving itself through its own evaluation loop.

Built with

07 technologies
01FastAPIAgent API layer
02Claude (Sonnet + Haiku)Tiered reasoning
03FAISSKnowledge retrieval
04PostgreSQLLead & score store
05RedisSession memory
06StreamlitEval & admin dashboard
07DockerDeployment
Next issue — yours?

Have an agentic ai problem like this?

Tell us what you're building — we'll tell you exactly how we'd ship it.

Keep reading

From the archive

All 15 case studies →