It reads your website for you. Every page, kept current.
Paste your address. SiteMind finds your pages, reads them and turns them into answers, then keeps them up to date.
What the crawler does. So you don’t have to.
Finds your pages. It starts from your sitemaps and the links on each page, and follows the rules in your robots.txt.
Reads only the content. Menus, footers and blocks repeated on every page are removed, so answers come from what each page actually says.
Handles JavaScript sites. When a page comes back empty, it is opened in a real browser, so content drawn by React, Vue and similar frameworks still gets read.
Picks up FAQs and facts. Question headings and the structured data on your pages (JSON-LD) are read as well.
Stores each page once. The same content under two addresses is kept once, so it can’t crowd out other answers.
Stays current. Recrawl daily, weekly or monthly, or on demand. Unchanged pages are skipped, and pages you removed drop out.
How it works. Three steps.
Paste your address
Add your website in the dashboard. There is no sitemap to upload and nothing to install first.
SiteMind reads it
Pages are fetched a few at a time, cleaned and split into passages.
It starts answering
The passages are indexed for search, and the widget answers from them straight away.
Compared with a typical chatbot. Where it shows.
| Many chatbots | SiteMind | |
|---|---|---|
| When your site changes | Re-upload files or rebuild the bot by hand. | Scheduled recrawls pick up changes and skip pages that haven’t changed. |
| JavaScript-heavy pages | Pages come back empty because the content is drawn in the browser. | Empty pages are read again in a real browser. |
| Menus and footers | Navigation text ends up mixed into answers. | Blocks repeated on every page are stripped out first. |
Website crawling. Questions, answered plainly.
Something we didn’t cover? Ask us and we’ll answer it.
Ask a questionYes. The crawler reads your robots.txt, skips the paths it disallows and uses the sitemaps it lists.
As often as you choose: daily, weekly or monthly, or whenever you press recrawl. Pages that haven’t changed since the last visit are skipped.
It depends on your plan’s knowledge limit, which counts passages rather than pages. A typical page makes about three. Starter holds 200 passages, Growth 1,500 and Pro 6,000.
Yes. If a page returns no readable content, SiteMind opens it in a real browser and reads what renders.
Try it on your own website. Free for 3 days, no card needed.
2-minute setupWorks on any websiteCancel anytime