Version 1.0.1
Beaty Help. Beaty is a web scraper that grabs content from your website and returns the data as a JavaScript object, JSON or CSV.
Getting Started
Beaty is for small to medium websites. There's a limit of 70 pages, and English is the only language supported.
Common Problems
Beaty can't hope to crawl every website, but at present we're running at around a 96% success rate. We have noticed a few common issues you should avoid if possible.
Show your URLs
Sometimes Beaty can't find links from your website because they're hidden, possibly behind jQuery or similar. Beaty looks for anchor tags. Google looks for the same.
Use absolute rather than relative URLs
A relative URL is a URL that doesn't explicitly contain the protocol and domain.
Relative URLs are perfectly valid, but can be confusing for search engines and Beaty. Google recommends, where possible, absolute rather than relative URLs. You can use relative URLs, but they should have an unambiguous path.
Beaty supports the Open Graph protocol and grabs the image url from the og:image property.