While working on SEO optimization, I noticed that AI crawler traffic was higher than expected. After checking CloudFlare's analytics data, I found that approximately 20GB of data transfer occurred in a short period, with the same pages being crawled repeatedly and instantaneously in succession. The number of concurrent connections per second is estimated to be around 10-20.
Is this kind of duplicate crawling really necessary...?
You are opening a page outside Sakura Exchange. We do not control the destination content, safety, or privacy practices. Please review the URL before continuing.
Destination URL
Be careful with suspicious login pages, wallet connection requests, payment requests, or personal information forms.
