Crawl Foundry Docs
Documentation sitemap
Browse every guide by topic. Find the right page for your next step, from your first workspace to keyword research and site audits.
54 pages ยท 13 topics
API & MCP
Back to topicsGetting Started
Back to topicsIntroduction
Guides for Crawl Foundry: set up a workspace, organize and enrich keywords, audit sites, track rankings and compare competitors with costs shown upfront.
Quick Start
Go from an empty workspace to a keyword shortlist your team can explain: add a focused set, request Essentials data, review it and plan the next step.
First Workspace
Set up Crawl Foundry workspaces with clear boundaries for clients, markets, domains, access and billing, so data and costs stay separated and easy to explain.
Keyword Database
Back to topicsOverview
Store, organize and enrich keywords in one shared database: lists, tags, views, metrics, SERP data and tracking. Organizing is free, data only on request.
Keywords, Lists & Tags
Keep a large keyword inventory usable: when to use manual lists, rule-based smart lists, hybrid lists and tags, and how to build a set others can reproduce.
Views
Choose the right keyword view: List for exact rows, Matrix to compare difficulty and potential, Kanban for workflow status, and when to switch tools.
Filters & Presets
Build a keyword working set others can reproduce: search, structured filters, quick presets, saved views, columns, tags and safe bulk selection explained.
Metrics
What search volume, keyword difficulty, CPC, intent, trends, Data Health, SERP Dynamics and visibility measure in Crawl Foundry, and where each metric stops.
SERP & Tracking
When to request a SERP snapshot, review competitor domains or set up rank tracking in Crawl Foundry, how delivery modes and schedules work, and what each costs.
Import & Export
Import keywords from CSV, TSV, XLSX, pasted tables or other SEO tools with column mapping and duplicate checks, and export a defined scope with full context.
Balance & Refreshes
How Crawl Foundry charges for SEO data: cost estimates before each action, balance reservation, settlement on actual cost, refresh timing and failed runs.
Dashboard
Back to topicsDashboard
How the Crawl Foundry Home dashboard works: domain band, site health, recommendations, ranking movers and competitors, and which tool owns each signal.
Workspace Briefing
Understand the Home briefing before the metrics: active workspace and host, loading stages, fresh-workspace onboarding, the balance card and the workflow strip.
Metrics & Tools
Read the metrics on the Crawl Foundry Home screen: keyword movers, ranking trends, competitor rows, the Site Audit card, unknown values and display limits.
Priorities & Activity
How the What to do now recommendations on Home are chosen and ordered, where each row leads, why an empty queue is not all clear, and where to find job history.
Domain Overview
Back to topicsDomain Overview
Analyze any domain's authority, organic traffic, rankings, competitors, top pages, keyword gaps and backlinks for one market, with dated and sourced evidence.
Snapshots & Context
How domain analyses are priced, stored and kept: runs versus the Domain profile, module states, fetching only missing data, retention tiers and safe deletion.
Authority & Metrics
What Authority, estimated organic traffic, organic keywords, traffic value, backlinks and referring domains mean in Crawl Foundry and how trends are built.
Rankings & Competitors
Read a domain's ranking distribution, page one share and organic competitors: position buckets, shared keywords, logarithmic maps and competitor momentum.
Keywords, Pages & Gap
Trace a domain's ranking keywords to their URLs, see which pages carry the traffic, find keywords a competitor ranks for that you don't, and import them.
Backlinks & Growth
Read a domain's backlinks, referring domains, anchors, most linked pages and follow ratio, and its monthly organic growth history in Crawl Foundry.
Position Tracking
Back to topicsPosition Tracking
Track keyword rankings for your domain by market, language, device and depth: set up a tracker, read visibility and trends, and review every run and its cost.
Rankings & Trends
Read tracked keyword rankings correctly: current and previous positions, winners and losers, history charts, ranking URLs, visibility and estimated traffic.
Pages & Cannibalization
See which pages rank for your tracked keywords, which pages rise or fall, and tell real keyword cannibalization apart from a simple URL switch.
SERP Features & Competitors
Track which SERP features appear for your keywords, who owns Featured Snippets and AI Overviews, which competitors share your rankings and your share of voice.
Schedules & Costs
Plan rank tracking schedules in Crawl Foundry: fixed or list-based keywords, cadence, devices, depth, cost estimates, budget caps, manual runs and run logs.
Keyword Research
Back to topicsKeyword Research
Find new keyword ideas from seeds, saved lists or competitor domains, see the cost before you start, review candidates and import only what you approve.
Setup and cost
Set up a keyword research run: choose Quick, Deep or Competitors, enter seeds or domains, pick the market, read the quote and follow the run to completion.
Results and filters
Filter keyword research results with match modes, metric ranges and term groups, handle missing values, select candidates and export a CSV shortlist.
Import and history
Import approved research candidates into your Keyword Database or a manual list, understand inserted, restored and skipped rows, and reuse or rerun research.
Competitive Research
Back to topicsCompetitive Research
Compare your domain with up to 20 SEO competitors: traffic, keywords, authority, backlinks, history, keyword gaps and top pages, with costs shown upfront.
Setup and head-to-head
Create a competitor comparison in Crawl Foundry: pick domains and market, choose Summary or Deep, understand reuse and per module pricing, read the results.
Signals and history
Read competitor history, the tracked keyword market map, momentum, ranking, intent and link lenses, share of voice and the comparison verdict correctly.
Competitors and gaps
Find the keywords and pages your competitors win, review the competitor catalog, run a full keyword analysis and import selected terms into your database.
Action Center
Back to topicsAction Center
Turn keyword, ranking, competitor, crawl and content evidence into a prioritized list of SEO actions with goals, business fit and verification built in.
Priorities & Evidence
Why one SEO action ranks above another in Crawl Foundry: priority tiers, weighted dimensions, rankability, evidence records, data needs and verification.
Site Audit
Back to topicsSite Audit
Run a technical SEO audit in Crawl Foundry: crawl a site, trace issues to URLs and templates, prioritize fixes and prove them with a comparable re-crawl.
Sites & Crawl Setup
Add a website to Site Audit, verify ownership by meta tag, HTML file or DNS, choose a full crawl or Quick check, set limits and start your first crawl.
Overview & Statistics
How the Site Audit health score is weighted, what coverage means, and how to read click depth, response times, indexability and segment statistics.
Issues, Pages & Links
Trace technical SEO issues to exact URLs, filter pages with Page Explorer and saved views, and review internal links with anchors, placement and targets.
Crawl History & Compare
Compare two crawls to see added and removed URLs, changed titles, canonicals and status codes, and new, fixed or regressed issues, including migration checks.
Automation & Alerts
Schedule recurring crawls, set run and budget caps, create alerts for broken links, noindex, canonical or health drops, and send digests to the right people.
Settings & Verification
Set URL limits, crawl depth, include and exclude paths, rendering and robots.txt behavior, verify domain ownership, and keep crawls comparable after changes.
URL Detail
Inspect one crawled URL in Site Audit: issues, crawl path, inbound and outbound links, assets, structured data, changes between crawls and performance evidence.
Structured Data
Validate JSON-LD, Microdata and RDFa across your site against Schema.org and Google rich result profiles, find blocking errors and track markup over time.
Activity
Back to topicsActivity
See every recorded SEO operation in one place: 30 and 90 day dashboards, a yearly calendar, costs, contributors, filters, timeline and export in Crawl Foundry.
Events & Status
Read the Activity timeline correctly: operation statuses, counters, merged records, billing traces, the 100 row limit and what the CSV export contains.
Notifications & Troubleshooting
Diagnose failed, partial or missing SEO operations: the Attention panel, coverage states, support codes, cost visibility and the owning tool's evidence.
Administration
Back to topicsOrganization & Team
Invite people to your Crawl Foundry organization, choose roles, assign workspaces and projects, manage pending invitations and keep ownership safe.
Billing
Understand Crawl Foundry billing: prepaid EUR balance, plans with monthly credit, top-ups, metered usage, transaction history, invoices and receipts.
Settings
Configure Crawl Foundry at the right level: account language, organization, workspace domain and access mode, defaults, tracked domains and research seeds.
Troubleshooting
Diagnose empty screens, missing data, stuck or partial runs, permissions, billing, import and export problems in Crawl Foundry before you retry anything.