Hello, every few days/weeks, my site crashes because many bots are indexing it and site reaches my otherwise very good and expensive hosting limits. For example, today there were approximately 61,860 requests made to the website.
website is karaonline.si
All these calls are directed at various filter combinations in the online store (e.g., filter_brand, filter_color), suggesting automated bot or scraper activity. Such requests do not represent genuine visitors but cause unnecessary server resource strain, as each call reprocesses the database and generates a dynamic page.
The most resource-intensive examples include:
/women/ankle-boots/?filter_brand=imac&filter_color=…
/women/ankle-boots/?filter_brand=guess,tamaris
/men/?filter_brand=tbs&filter_color=white
I blocked the ip this time, but tomorrow there will be another ip.
I’m using cloudflare and have this page rule set up.
https://share.cleanshot.com/3KGnw6jz
But does not seem to help.
I also had this security rule
https://share.cleanshot.com/FlK5XB41
but I disabled it, because filters do not work if enabled.
any suggestions what I need to do to get rid of bots targeting filters?