Technical SEO

If you’re crawling a particularly large website, consider enabling a crawl limit. You can use this to check for duplicate content issues which may not be picked up otherwise. Then, when you’re making recommendations and implementing them, you are making full use of your developer or resource, as you’ve got a comprehensive view on all the issues. Once this is complete, it should be easier to re-crawl the website and repeat the process to see if there are any more duplicate issues remaining.

Thank you Sandy Lee for all of your great tips on how to best use APIs! You can watch the full Tea Time SEO talk here:

Secondly, you need to make sure you’ve got the entire logs. With CDNs, load balancers and other complex hosting setups, it’s very easy to forget about a server hidden somewhere.