Competitor SEO Content Audit
Scrapes top-ranking competitor URLs for your keywords, compares them against your brand identity using Gemini.
What it does
You instantly uncover content gaps by scraping top-ranking competitor URLs and comparing their text against your brand identity with Gemini. This process automatically generates a structured action plan and saves it directly to your master Google Sheet for your marketing team.
Step by step
- Configure a Google Sheets row trigger to initiate the workflow when new keywords are added.
- Use Decodo to scrape the top five URLs for each target keyword and extract raw HTML text.
- Map the extracted competitor content into a structured JSON payload containing URL, title, and body text.
- Append the final audit results including gap analysis scores back to the designated Google Sheet columns.
Where the LLM does the work
- Prompt Gemini with the brand identity guidelines to evaluate competitor content for tone and value alignment.
- Generate specific content gaps by comparing competitor coverage against your unique selling propositions.
- Draft actionable recommendations for each gap that adhere to the specified marketing voice and style.
Watch out for
Decodo scraping can fail on anti-bot protected sites so implement a retry mechanism with varied user agents.
Gemini context windows may truncate long articles so split large texts into chunks before sending for analysis.
Competitor URLs might return 403 errors if they detect automated traffic so configure fallback proxies or manual review steps.
Tools that fit
Google Gemini Chat Model LLM Strategic gap analysis and action plan generation
The agent brief
Everything your agent needs, including the gotchas. Copy it and go.
You are helping me build the following AI agent workflow. ## Goal Competitor SEO Content Audit: Scrapes top-ranking competitor URLs for your keywords, compares them against your brand identity using Gemini. ## Specification - What it does: You instantly uncover content gaps by scraping top-ranking competitor URLs and comparing their text against your brand identity with Gemini. This process automatically generates a structured action plan and saves it directly to your master Google Sheet for your marketing team. - Trigger: Run manually (Manual or Scheduled) - Autonomy: Fully hands-off - Expected setup effort: about an afternoon - Tools/services involved: - Decodo: Web scraping and SERP itemization - Google Sheets: Brand identity storage and reporting dashboard - Google Gemini Chat Model: Strategic gap analysis and action plan generation ## Known pitfalls, handle each one explicitly in your implementation 1. Decodo scraping can fail on anti-bot protected sites so implement a retry mechanism with varied user agents. 2. Gemini context windows may truncate long articles so split large texts into chunks before sending for analysis. 3. Competitor URLs might return 403 errors if they detect automated traffic so configure fallback proxies or manual review steps. ## Reference implementation https://n8n.io/workflows/13817 (workflow template) Fetch and inspect this before building. If it matches my stack, adapt it; if not, rebuild the pattern with my tools. ## Process requirements 1. Before building: ask me which of the listed tools I actually use and what my platform is (n8n / Make / code / other). Do not assume. 2. Adapt the pattern to my answers; do not force the reference stack. 3. Address every pitfall above; tell me how you handled each. 4. Provide a test plan I can run before letting this touch real data. 5. Ask before any step that sends messages, modifies data, or spends money. Source: https://usecasesforagents.com/use-case/competitor-seo-content-audit/ via usecasesforagents.com
Frequently asked questions
Can I use a different Web Scraping than Decodo?
Yes. Decodo is only the example web scraping in this recipe. The same flow works with Airtop, Apify, Bright Data and Firecrawl. Swap the web scraping connection and keep the rest of the setup as written.
Want this running in your business?
This is what I do. I design and build AI agents like this one, and keep them running. If you want it set up for your team instead of doing it yourself, get in touch.
Who it's for
Built for marketers who'd rather brief an agent than start from a blank doc.