Prompt bank for testing AI models
Chapter 5
Continued from Consensus rate
The prompt bank is the fixed set of questions real buyers ask about a market, worded once and run unchanged on every model at every test.
Defined in Chapter 5: The Test Test Test Method of LLM Mastery: How AI Recommends Brands for LLM Domination.
What is a prompt bank?
The prompt bank is the fixed set of questions real buyers ask about a market, worded once and run unchanged on every model at every test.
The closing section puts building it at an evening's work and the monthly run at an hour.
Related terms: Test Test Test method, The five datasets, Fan-out queries and Monthly interrogation.
Where does the book define a prompt bank?
Chapter 5, The Test Test Test Method, defines it:
Write the questions your real buyers ask: category questions, best-of questions, comparison questions, review questions, worth-it questions, and the specific phrasings of your market. Fix the wording. The bank is your instrument, and instruments only measure when they stay constant.
Which other chapters use a prompt bank?
Chapter 6: Campaign Research: The Five Datasets That Decide GEO and AEO Strategy, Chapter 13: Measuring LLM Domination, Chapter 14: The Domination Playbook and Take Action use a prompt bank too.