Crawl Foundry Docs
Documentation sitemap
Browse every guide by topic. Find the right page for your next step, from your first workspace to keyword research and site audits.
53 pages · 12 topics
Getting Started
Back to topicsIntroduction
Learn how to set up Crawl Foundry, organize keyword evidence, request paid data deliberately, investigate domains and competitors, run Site Audit, and understand account controls.
Quick Start
Set up a workspace, add a focused keyword set, request Essentials data, review the result, and prepare a shortlist without buying every available dataset.
First Workspace
Choose a durable workspace boundary for data, markets, domains, people, balance, and activity before you import keywords or start paid operations.
Keyword Database
Back to topicsOverview
Understand how Crawl Foundry stores and organizes keyword records, lists, tags, views, metrics, SERP evidence, tracking context, imports, exports, and paid data actions.
Keywords, Lists & Tags
Learn how normalized keyword records, manual lists, smart lists, hybrid lists, tags, selections, and saved table setups define scope in Crawl Foundry.
Views
Understand when to use List, Matrix, or Kanban in the Keyword Database and when to continue in Action Center, Competitive Research, Keyword Research, Position Tracking, or Activity.
Filters & Presets
Use keyword search, structured filters, quick presets, saved views, columns, tags, and controlled selection without confusing table setup with list membership.
Metrics
Understand the source, scope, date, units, unknown states, and decision limits behind every metric shown in the Crawl Foundry Keyword Database.
SERP & Tracking
Learn how one-time SERP requests, competitor dossiers, own-domain positions, tracking schedules, costs, run states, and history remain distinct in Crawl Foundry.
Import & Export
Import keyword sets with deliberate mapping and duplicate handling, then export a defined scope with visible row, schema, date, and truncation boundaries.
Balance & Refreshes
Understand organization balance, cost estimates, reservations, settlement, data freshness, paid keyword and SERP actions, recurring tracking, failures, and usage records.
Dashboard
Back to topicsDashboard
Understand the current Crawl Foundry Home screen, its mixed evidence sources, permissions, dates, limits, recommendation rules, setup states, and links to the owning tools.
Workspace Briefing
Read active organization, workspace, host, permissions, staged loading, fresh-workspace onboarding, optional balance, mixed domain-band sources, and workflow proof correctly.
Metrics & Tools
Interpret selected-list keyword movement, active-schedule rankings, bounded competitor rows, the primary Site Audit run, Site Health, unknown values, limits, and the current Activity-only footer state.
Priorities & Activity
Understand the three-row recommendation queue, incomparable impact units, row destinations, selected-list movers, newest-schedule rankings, the Activity-only footer link, and a verifiable handoff.
Domain Overview
Back to topicsDomain Overview
Understand paid analysis runs, the latest-known Domain profile, module provenance, states, limits, seven evidence tabs, handoffs, retention, and decision boundaries.
Snapshots & Context
Interpret workspace and market identity, the profile and run selector, evidence clocks, paid quotes, module states, selective repair, retention, and safe deletion.
Authority & Metrics
Interpret the Authority transform, ETV, ranking breadth, movement counters, Traffic Value, link totals, missing values, provider-history deltas, and profile source dates.
Rankings & Competitors
Interpret exact position buckets, page-one denominator, bounded competitor rows, logarithmic maps, ETV comparison, overlap, movement counters, and research handoffs.
Keywords, Pages & Gap
Interpret ranked-keyword fields, persisted intent aggregates, bounded Top Pages, stored-set concentration, Site Audit intersections, directed gaps, and explicit handoffs.
Backlinks & Growth
Interpret summary and detail sources, bounded link ledgers, follow denominators, target health, provider ranking months, derived ratios, and stored-analysis backlink history.
Position Tracking
Back to topicsPosition Tracking
Define the domain, fixed or dynamic keyword cohort, market, device, SERP depth, cadence, cost path, evidence window, and review rules behind every repeated ranking comparison.
Rankings & Trends
Interpret snapshot-backed positions, previous measured-day deltas, exact cohort filters, bounded charts, paginated rows, current demand fields, URLs, stored SERP handoffs, and missing states.
Pages & Cannibalization
Interpret current-URL grouping, page-level averages and estimates, bounded Site Audit inventory matches, URL switching, concurrent own-domain URLs, legacy unknowns, and ownership decisions.
SERP Features & Competitors
Interpret 13 stored SERP features, measured denominators, limited ownership attribution, discovered candidates, active competitors, bounded comparisons, map dimensions, and closed-set Share of Voice.
Schedules & Costs
Configure fixed or dynamic membership, data kind, cadence, SERP context, packages, estimates, caps, balance admission, lifecycle, retries, and terminal run review.
Keyword Research
Back to topicsKeyword Research
Run Quick, Deep, or competitor-led research with explicit inputs, market, quote, execution evidence, bounded result views, deliberate selection, and manual database handoff.
Setup and cost
Choose among the three current modes, normalize seeds or domains, confirm market and safety limits, read the current quote, and follow the claim into worker execution and settlement.
Results and filters
Interpret run state, stored candidate evidence, lexical match rules, missing-value behavior, bounded scans, term groups, current appended intelligence, selection, and CSV limits.
Import and history
Use resumable chunked imports, live database deduplication, manual-list targets, explicit post-import boundaries, saved runs, and reviewed reruns without repeating paid work blindly.
Competitive Research
Back to topicsCompetitive Research
Separate saved paid comparisons from the live competitor catalog, preserve market, dates, module coverage, cost boundaries, and human approval across every handoff.
Setup and head-to-head
Choose domains, market, Summary or Deep, understand reuse and per-module pricing, prove worker completion, and read headline metrics with coverage.
Signals and history
Separate provider history from current Position Tracking, understand sampled Deep profiles, derived statistics, deterministic verdicts, and CSV limits.
Competitors and gaps
Read bounded Deep gaps, local SERP scores, catalog states, mixed-source detail tabs, paid full analysis, imports, and downstream boundaries.
Action Center
Back to topicsAction Center
Use a goal-scoped, evidence-linked Action Center guide across keyword, ranking, competitor, crawl, link, content, search-performance, and business-context signals.
Priorities & Evidence
Interpret Action Center admission, tiers, dimensions, utility, goal fit, rankability, evidence records, limitations, data needs, work-item snapshots, and verification.
Site Audit
Back to topicsSite Audit
Crawl a verified property, investigate technical SEO evidence across views, prioritize work, and verify the result over time.
Sites & Crawl Setup
Add and verify a property, choose a full crawl or public Quick check, understand limits and costs, and start a bounded run safely.
Overview & Statistics
Read health, confidence, coverage, issue pressure, URL distributions, site segments, content facts, and crawl timing without losing run context.
Issues, Pages & Links
Trace technical rules from severity and affected scope to exact URLs, saved views, path groups, source-target relationships, anchors, and remediation evidence.
Crawl History & Compare
Review crawl admission, collection, report publication, failures, retained history, and bounded evidence changes between comparable runs.
Automation & Alerts
Configure recurring crawls, budget and run caps, alert rules, suppression, recipients, delivery state, and an accountable response workflow.
Settings & Verification
Control URL limits, depth, path rules, rendering, robots behavior, authorization, verification challenges, and the comparison impact of scope changes.
URL Detail
Inspect one crawled URL across its summary, findings, links, assets, structured data, changes, performance evidence, and retained technical facts.
Structured Data
Understand how Crawl Foundry captures JSON-LD, Microdata, and RDFa, applies versioned Schema.org and Google-profile checks, retains bounded evidence, and reports trends.
Activity
Back to topicsActivity
Understand the 30-day and 90-day dashboard, twelve-month calendar, source coverage, filters, costs, contributors, timeline, export, and owning-product handoff.
Events & Status
Read the rolling window, newest-first 100-row timeline, normalized fields, lifecycle, deduplication, cost-only rows, billing trace, and scoped CSV export.
Notifications & Troubleshooting
Use the Attention panel, full returned timeline, Coverage states, support codes, cost boundaries, calendar state, and owning-product evidence to diagnose operations.
Administration
Back to topicsOrganization & Team
Manage organization members, seven-day invitations, roles, workspace assignments, client boundaries, ownership, and identity synchronization without treating a role label as the whole permission model.
Billing
Understand Crawl Foundry's organization-scoped prepaid EUR balance, plans, top-ups, metered usage, bounded history, provider invoices and receipts, and billing permissions.
Settings
Configure account language, organization identity and deletion, active-workspace identity, access mode, content defaults, tracked domains, research seeds, and crawler exclusions.
Troubleshooting
Troubleshoot wrong scope, loading and empty states, stale or partial evidence, background runs, permissions, billing, imports, exports, and support escalation across Crawl Foundry.