Date: 2026-09-22
Scope: public documentation at https://mskazemi.com/idkmesh/
Machine-readable map: config/seo-topics-v1.json
Make IDKMesh easy to discover for the most important questions around AI-agent verification, multi-agent orchestration, coding-agent review, evaluator reliability, provenance, governance, interoperability, and verification-first agentic software engineering.
This is an eligibility and authority-building plan, not a ranking guarantee. Search engines and answer engines choose what to crawl, index, rank, quote, or cite. The repository can make pages technically eligible, useful, specific, well-linked, current, and easy to attribute; it cannot force a top result.
The target map contains exactly 100 unique query intents in ten semantic clusters. Closely related phrasings map to one useful canonical topic page.
That avoids doorway pages and keyword stuffing. Each target page:
The target phrases are retained in config/seo-topics-v1.json for measurement,
not dumped onto public pages as a keyword list.
The public hub is docs/topics/index.md, published at
https://mskazemi.com/idkmesh/topics/.
Keep pages indexable, crawlable, useful to humans, internally linked, and consistent about titles, descriptions, canonical URLs, and structured data. Google’s current generative-search guidance says the same core Search indexing and quality systems remain the foundation for generative features.
Primary references:
Keep the XML sitemap complete, use truthful per-page lastmod, maintain
crawlability, and use IndexNow for faster notification when important content
changes. Bing explicitly recommends sitemaps plus IndexNow for AI-powered search
freshness.
Primary references:
The domain-root crawler policy must continue to allow OAI-SearchBot. OpenAI
states that any public website can appear in ChatGPT search and recommends
allowing that crawler so content can be discovered, summarized, cited, and
linked.
Primary reference:
The domain-root crawler policy must continue to allow Claude-SearchBot and
Claude-User when search/retrieval visibility is desired. Anthropic documents
those separately from ClaudeBot, which is used for model-development
crawling.
Primary reference:
Keep the same pages public, server-rendered, indexable, citation-friendly, and
reachable through ordinary links and the sitemap. The 2026-09-20 repository
audit already verified that the domain-root robots policy allowed
PerplexityBot and that the homepage returned full static content to crawler
user agents.
docs/llms.txt is retained as a supplemental machine-readable navigation
surface. It is not treated as a substitute for normal crawling, indexing,
sitemaps, internal links, or useful page content.
Each topic page uses a retrieval-friendly structure:
clear title
-> one-sentence direct answer
-> practical model / lifecycle
-> limitations and evidence boundary
-> 5 common questions with concise answers
-> links to canonical technical evidence
The goal is to make a useful passage independently understandable when a search or answer engine retrieves only part of the page.
homepage
-> /topics/
-> 10 pillar pages
-> related pillar pages
-> canonical repo contracts/evidence
llms.txt
-> /topics/
-> 10 pillar pages
-> core docs/evidence
docs/README.md
-> /topics/
Every new pillar is also present in the XML sitemap.
Once sufficient impressions exist, replace semantic priority guesses with observed data.
Measure at least:
Do not optimize raw impressions alone. The useful outcome is qualified discovery that leads readers to inspect evidence, run the tool, reproduce work, or contribute.
config/seo-topics-v1.json;llms.txt link the topic hub;