New AI Agent can now build your knowledge base, connect channels and invite agents — all by chat Try it now
Help homeProductPricingBlog
Start freeLog in

Sync website content

Crawl public pages and refresh knowledge after the website changes.

Updated 2026-07-17

Walk through the demoDemo data
Knowledge baseDocuments · 3Processing 1Search by title or tag…Test knowledgeNew documentDemo data
DocumentsFAQ pairs
DocumentSizeTagsUpdatedStatusActions
Brazil shipping timelinesCompiled 12 FAQ pairsshippingbrazilUpdated Jun 3, 2026, 4:00 PMSearchable
EU customs & dutiesshippingeuUpdated Jun 4, 2026, 2:30 PMIndexing
30-day refund policyCompiled 9 FAQ pairsreturnsrefundUpdated Jun 2, 2026, 8:00 PMSearchable
Page 1 · 3 documents
Step 1 / 4
Crawl a site

Click New document and switch to Crawl website: enter the URL, optionally with subpages, depth and page limit.

Website sync is intended for public, stable, crawlable help content. Authenticated pages, live order data, and customer data require proper integrations instead.

Add a website source#

  1. Open the knowledge base and choose a website source.
  2. Enter an allowed starting URL.
  3. Review the discovered page scope.
  4. Start the sync and wait for processing.
  5. Test important page questions in the Playground.

After the website changes, resync it. The previous successful version should remain available until a new version succeeds; a failed refresh must not erase working knowledge.

If content is missing, check public access, the URL, crawl restrictions, and whether the page renders content only through browser scripts. Website sync cannot replace an authenticated store-data tool.

Didn't find your answer?

Start free and try the real product, or reach out — humans are as online as the AI.