I’ve spent 12 years in the SEO trenches. I’ve been the in-house growth lead responsible for taking a mid-market brand across 11 European markets, and I’ve sat on the other side of the desk, listening to agencies pitch their "proprietary frameworks" with varying degrees of enthusiasm. I’ve hired firms in London, Paris, Madrid, and Warsaw. I have seen migrations go beautifully and I have seen them become boardroom nightmares.
If there is one thing I’ve learned, it’s this: The quality of your SEO performance is directly proportional to the quality of the questions you ask during the discovery call. Most stakeholders walk into these calls wanting to know "How much?" and "When will I rank #1?" That’s the wrong approach. If you aren't digging deeper, you aren't vetting a partner; you're just picking a vendor to blame when the traffic doesn't move.
Here is my framework for vetting an SEO agency, designed to save you from the empty promises and the "AI-SEO" snake oil.
Stop Relying on "Top 10" Lists
First, a warning. If you found your shortlist on a site called "Top 10 SEO Agencies in [City]," close the tab. Those lists are almost universally pay-to-play. They aren't rankings; they are advertisements.
When you’re doing your own discovery, look for evidence-based ranking. I look for agencies that treat their own site like a laboratory. If an agency like Technivorz is talking about technical infrastructure or advanced automation, I go to their site and look for the implementation. If they are touting a client success story, I want to see numbers. If they say "improved rankings" without stating the baseline, the delta, or the timeframe, I dismiss them. If their case studies have a logo wall but no named contact or specific KPI context, that’s a red flag. Real experts have nothing to hide.
The Five-Pillar Evaluation Framework
When you are on that first call, stop the agency’s sales pitch if it’s too vague. Force them into the "Five-Pillar Framework." If they can’t speak confidently to these five areas, you aren't hiring an agency; you're hiring a guestimate machine.
Pillar The "Vet" Question Why it Matters Technical SEO "How do you handle log file analysis at scale for our specific tech stack?" Generic crawls aren't enough for enterprise sites. Content Strategy "Do you use a topic cluster model, and how do you measure content decay?" Content isn't just volume; it's maintenance. Authority/PR "Where is your outreach team based, and can I see a sample of your recent link placements?" Quality of links matters more than the volume of guest posts. AI Visibility/SGE "How are you auditing our presence in LLM-driven search results?" The landscape is changing; are they adapting or just doing 2015-era SEO? Reporting & Accountability "Who is the named lead on the account, and what is your stack for client transparency?" I want to know the person, not the sales rep.The "Who is Doing the Work?" Question
One of my biggest pet peeves is the "bait and switch." You meet the brilliant, high-level strategist on the sales call, but then you’re handed off to a junior account manager who hasn't seen the back-end of a CMS in months. Always ask: "Who is the named lead on this account, and what is their current capacity?"
I want to know the name, the LinkedIn profile, and the level of direct access I have to them. If the agency is hesitant to put their best people in front of you, they aren't confident in the outcome.
Agency Differentiation: Specialization Matters
Not all agencies are created equal. Some excel at the heavy-duty technical architecture required for global e-commerce migrations, while others are content-first creative shops. You need to identify what you actually need.
- The Global Specialist: Agencies like Webranking have proven their ability to handle international complexities, which is vital if you are dealing with hreflang tags, multi-currency setups, and localized search intent. The Performance Engine: Firms like Impression have a reputation for data-backed growth and integrating SEO with broader digital marketing efforts. The Technical Niche: If your site is a technical nightmare or a high-traffic SaaS platform, you need a firm that treats technical SEO as a software engineering problem, not a plugin-configuration task.
When you’re vetting, ask them: "What is the one thing your agency refuses to do?" A good agency knows its boundaries. If they say "we do everything for everyone," run.
The New Frontier: AI Visibility and GEO
If an agency promises "AI SEO" without a monitoring method, they are lying. AI visibility is not just about keyword rankings anymore. It’s about how your brand appears in Gemini, ChatGPT, and Claude. Ask them specifically about Generative Engine Optimization (GEO).
I look for agencies that use specialized tools to track this. I want to see how they integrate something like FAII.ai to measure brand sentiment and information Find out more retrieval within LLMs. If they are still obsessing over the "10 blue links," they are optimizing for a world that is shrinking.
Reporting: Transparency is Non-Negotiable
I’ve been burned by agencies that send "vanity metric" reports—PDFs that show a nice upward line but don't translate to revenue or business impact. My expectation is total visibility. I want to see my data in real-time. Whether they use a platform like Reportz.io or a custom dashboard, the data must be connected directly to the source of truth, not manually massaged in a spreadsheet.
Questions to spot red flags:
"What is your 'proof' process?" I want to know how they verify their own wins. If they can’t show me their internal testing process, they aren't testing—they're guessing. "How do you handle algorithm volatility?" If they blame every traffic dip on "Google updates," they aren't proactive. They’re reactive. "Can you walk me through a failed project?" If they can't admit to a failure and what they learned from it, they are either lying or inexperienced. I trust a partner who can articulate their failures more than one who only talks about wins.The 10-Minute Verification Checklist
Before I sign a contract, I conduct a "10-minute verify." It’s my litmus test for any agency:
- Search the Lead’s Name: Does the lead strategist publish thought leadership? Do they write code? Do they actually participate in the SEO community? Verify the Case Studies: I pick one metric from their case study and ask: "How exactly did you isolate this performance gain from organic seasonality?" If they can’t explain the attribution, it’s fluff. Check the Reporting Transparency: I ask to see a dummy version of the reporting dashboard they intend to use for me. If I see "Keyword Rankings" as the primary KPI instead of "Conversion Value" or "Contribution to Bottom Line," I know we aren't aligned.
Conclusion
Hiring an SEO agency shouldn't feel like a leap of faith. It should feel like a business investment with measurable inputs and outputs. You are looking for a partner who understands the nuance of your market, the complexity of your stack, and the reality of the evolving AI search environment.
If they can't answer who the lead is, if their case studies are vague, or if they promise "guaranteed" results, thank them for their time and hang up. There are plenty of agencies that prioritize integrity and data over empty buzzwords. Find the ones that treat your growth like it’s their own money—because, in a way, it is.