I cut off Robots.txt.
For those of you that don't know what I am talking about, every crawling bot in the world is supposed to adhear to a file in your directory called "robots.txt" which will allow you to tell all the indexers what to access, and what not to access.
I cut them all off. No Search engine may now index my website at all. Of course I'll get less hits. But it should be a good experiment to see just how much traffic to my website 500-600+ hits a day) is search engine generated traffic.
Subscribe to:
Post Comments (Atom)
-
Without going off the deep-end here and discussing every single Snort rule keyword, I just wanted to touch on a few modifiers that people so... -
Let me start off by saying I'm not bashing the writer of this article, and I'm trying not to be super critical. I don't want to...
-
Let's say you're like me, an avid Omnifocus user, but you've been hearing great things about Reminders on MacOS/iOS/iPadOS, and ...
No comments:
Post a Comment