besthvacaeo.agency Directory

Glossary

Prompt variation

Asking the same need in different words and getting different companies. A measurement using one phrasing is measuring one phrasing.

Checkable · the test is below

What it means

Homeowners do not converge on a standard form of words. Best, cheapest, most reliable, who can come today and who will not rip me off are five different questions about one job, and they return different names.

Why it matters for an HVAC company

Your agency's prompt set may be measuring a phrasing nobody uses. Worse, it may be measuring the phrasing you happen to win. Variation is what stops a measurement flattering whoever chose the words.

What would settle it

Write five phrasings of one need, run each ten times, and compare. If your appearance rate swings widely across phrasings, your visibility is narrower than a single-phrasing report suggests.

A worked example

One contractor appears in 7 of 10 runs for "best HVAC company", 4 of 10 for "most reliable AC repair", and 0 of 10 for "cheapest furnace replacement". A report built on the first phrasing alone would read as 70% visibility. Across all three it is 37%.

Prompt set Non-determinism Citation rate Seen in practice: ChatGPT visibility