Hi all. I am using Ezoic's integration with Cloudflare for my site. I don't have a cloudflare account.
I need to prevent certain bots from crawling my site, as it is causing me issues with my webhost.
How do I do this via Ezoic's menu system?
Hi all. I am using Ezoic's integration with Cloudflare for my site. I don't have a cloudflare account.
I need to prevent certain bots from crawling my site, as it is causing me issues with my webhost.
How do I do this via Ezoic's menu system?
It depends on what kind of bots you are referring to. You'll want to refer to this guide: https://support.ezoic.com/kb/article/what-is-invalidbot-traffic-and-how-can-i-prevent-it-from-coming-to-my-website
If there is other bot traffic that you want to restrict, e.g. certain AI-related bots, you could also update your robots.txt file.
From your link, it says "For added protection, publishers can download the Cloudflare app under the 'Settings' tab of the Ezoic Dashboard."
I cannot find the cloudflare app in Ezoic settings. Where is it? Thanks!
It looks like you already got that set up.
https://pubdash.ezoic.com/settings/connection/cloudflare
https://pubdash.ezoic.com/settings/dns/dnsrecords
I am trying to use CloudFlare's WAF Access Rules and set several ones that block the crawling bots
https://developers.cloudflare.com/waf/tools/ip-access-rules/
I can't figure out how to do this via Ezoic, because Ezoic, if I understand correctly, manages Cloudflare on my behalf.
Please advise, this is a critical issue with my host and they are going to take my site offline unless I block the crawling bots.
Can you provide us with a bit more detail so we can help properly?
What particular bots are they seeing causing the issue?
Who is the Host of the site?
How are they identifying the crawlers?
I want to set rules set to block the following bots: AhrefsBot, MJ12bot, BLEXbox, SemrushBot, Barkrowler, DotBot. THey are causing too many php executions with my host.
I need to set the rules somehow. It can be done via cloudflare directly, but I don't know how to do it via ezoic/cloudflare.
Should I just turn off ezoic cloudflare, and use cloudflare directly with my site?
please advise, thank you.
Wouldn't you just update your robots.txt file to exclude their user agents?
It looks like at least some of those companies even have instructions for that directly on their website.
https://help.ahrefs.com/en/articles/78158-how-do-i-control-your-bot-s-crawling-behaviour
Hi HazyAZ40 HazyAZ40 just stepping in as we have enough experience with this.
You are saying you don't have a cloudflare account. But it seems you need to have one, otherwise you cannot integrate Cloudflare with Ezoic. If you don't remember your credentials just go to "Forget password" at cloudflare.com
Robots.txt gets ignored by most of the bots nowadays hence the WAF Rules by Cloudflare are the right way.
First Login to your Cloudflare account.
After this you set up the WAF rules by doing this via Cloudflare > Security > WAF > Create Rule
Then choose "User Agent" "Contains" "User Agent Name of the bot you want to block" - then "Or" if you want to add more bots to block.
Looks like this:
Hi worlddiscover - you are awesome! Thank you!
I removed Ezoic as my CDN and added my site to my cloudflare account directly. Now I can manage the WAF rules. Thanks again for the screenshot and taking the time to help me... truly appreciate it.
@HazyAZ40 Pleasure. You're welcome.