Two ways in: follow links, or paste a list
Spider mode starts from one URL, respects robots.txt and seeds from the XML sitemaps it finds. List mode takes URLs you paste or import. Either way the pages are rendered in a hidden Chromium on your Mac.
- Threads, delay, URL budget and depth are set per crawl in Configure
- External links are checked, not just collected
- Custom extractors pull your own fields from each page






