Bots now generate more web traffic than humans, but what’s more interesting is the type of bot driving these interactions. In addition, studying what those bots do when landing on your site is a worthwhile pursuit.
The typical AI traffic discourse centers on crawlers scraping your content to train a model, which costs you resources. However, there’s a second category: AI agents that visit on a person’s behalf to read your site and interact on it as a customer would. This has revenue potential, but the current tech, without tweaking, stops both types of bots rather than only the resource hogs.
<kinsta-auto-toc
Click here to continue reading this article.