YaBB Community and Support Forum
YaBB Home About YaBB Download YaBB YaBB Support Customize Your Forum Development Contribute to the Project
  Welcome, Guest. Please Login or Register


 
Pages: 1 2 
Topic Tools
 
Google bot (Read 2,260 times)
 Oct 31st, 2010 at 5:24am
There are no actions to perform.  

mod-two 
YaBB Newbie
*
Offline
Posts: 3


None
Google bot
How can I stop google bot from filling my eror log.

It makes it difficult to see our members who may be having log in problems.
 
 
IP Logged  
 Reply #1 - Oct 31st, 2010 at 3:47pm
There are no actions to perform.  
Captain John 
Ex Member


None
Re: Google bot
mod-two wrote on Oct 31st, 2010 at 5:24am:
How can I stop google bot from filling my eror log.


Why is the Google bot causing errors ?
 
 
IP Logged  
 Reply #2 - Nov 1st, 2010 at 3:28am
There are no actions to perform.  

mod-two 
YaBB Newbie
*
Offline
Posts: 3


None
Re: Google bot
I have my error log set to 50 results.

Almost twice a day googlebot fills 80% of it with attempts to access our information.

I lke to view our members who may have trouble logging in so I can help.

And also track three constant forum sabatuers that were banned.

I find the constant goglebot intrusions makes my monitoring duties more time consuming.
 
 
IP Logged  
 Reply #3 - Nov 1st, 2010 at 3:45am
There are no actions to perform.  
Captain John 
Ex Member


None
Re: Google bot
mmmmm I have 9 forums running ... with not 1 error caused by any search engine spider.
 
 
IP Logged  
 Reply #4 - Nov 17th, 2010 at 5:51pm
There are no actions to perform.  

RonS2 
Full Member
Beta Testers
***
Offline
Posts: 447


YaBB 2.5
Re: Google bot
I asked the same question a few months ago and got the same response.

My error log is really useless.
 
 
IP Logged  
 Reply #5 - Nov 18th, 2010 at 12:48am
There are no actions to perform.  
Captain John 
Ex Member


None
Re: Google bot
Maybe why you both got the same answer is that search engines don't cause errors.
 And maybe like mod-two, RonS2 didn't answer questions asked.
 
 
IP Logged  
 Reply #6 - Nov 18th, 2010 at 2:20am
There are no actions to perform.  

RonS2 
Full Member
Beta Testers
***
Offline
Posts: 447


YaBB 2.5
Re: Google bot
Quote:
Why is the Google bot causing errors ?


If I knew why I wouldn't need to ask.

Quote:
Maybe why you both got the same answer is that search engines don't cause errors.




« Last Edit: Nov 18th, 2010 at 2:28am by RonS2 »  
 
IP Logged  
 Reply #7 - Nov 18th, 2010 at 2:22am
There are no actions to perform.  

RonS2 
Full Member
Beta Testers
***
Offline
Posts: 447


YaBB 2.5
Re: Google bot
and more
 
 
IP Logged  
 Reply #8 - Nov 18th, 2010 at 2:25am
There are no actions to perform.  

RonS2 
Full Member
Beta Testers
***
Offline
Posts: 447


YaBB 2.5
Re: Google bot
And finally
 
ScreenHunter_010.jpg (32 KB | 53 )
ScreenHunter_010.jpg
 
IP Logged  
 Reply #9 - Nov 18th, 2010 at 4:20pm
There are no actions to perform.  
Captain John 
Ex Member


None
Re: Google bot
mmm These access reports are not errors.  They are simply reporting actions and these particular are as you know from a bot.
 These were added to the error log just for knowledge of what is not being reported/found/indexed by these spiders.  This sometimes help admins know why and what is being index or not indexed for rankings on the web.
 
 
IP Logged  
 Reply #10 - Nov 18th, 2010 at 10:23pm
There are no actions to perform.  

RonS2 
Full Member
Beta Testers
***
Offline
Posts: 447


YaBB 2.5
Re: Google bot
If you re-read this thread John, you will find that you are the only one who ever said these were errors. The problem still remains that google-bot has rendered the error log useless.
« Last Edit: Nov 18th, 2010 at 10:24pm by RonS2 »  
 
IP Logged  
 Reply #11 - Nov 19th, 2010 at 12:29am
There are no actions to perform.  
Captain John 
Ex Member


None
Re: Google bot
RonS2 wrote on Nov 18th, 2010 at 10:23pm:
google-bot has rendered the error log useless.

Quote:
help admins know why and what is being index or not indexed for rankings on the web.

 Not useless .......  The error.log can be increased to show more .. if one search engine returns to many access entries and of course the more private a forum is the more access restrictions that will be reported, verifying that data is secure.
 
 
IP Logged  
 Reply #12 - Nov 19th, 2010 at 1:19am
There are no actions to perform.  
Carsten 
Ex Member


None
Re: Google bot
Guess it makes some sense if you only want "actual" errors in the error log. You could exclude search bot activity from the error log. Never really had that problem on any of my boards, but i think something like this might help:

In Subs.pl find
Code (Perl)Select All
sub fatal_error_logging {
 

and add after
Code (Perl)Select All
	my $user_host = (gethostbyaddr(pack("C4", split(/\./, $user_ip)), 2))[0];
	if (-e "$vardir/bots.hosts") {
		fopen(BOTS, "$vardir/bots.hosts") || &fatal_error("cannot_open","$vardir/bots.hosts", 1);
		my @botlist = <BOTS>;
		fclose (BOTS);
		chomp(@botlist);
		foreach (@botlist) {
			$_ =~ /(.*?)\|(.*)/;
			$bot_name = $1;
			$bothost = qq~$user_host#$ENV{'HTTP_USER_AGENT'}~;
			if($bothost =~ /$bot_name/i) { return 1; }
		}
	} 


As mentioned i could not test it - so no guaranties.
 
 
IP Logged  
 Reply #13 - Nov 20th, 2010 at 12:31am
There are no actions to perform.  

RonS2 
Full Member
Beta Testers
***
Offline
Posts: 447


YaBB 2.5
Re: Google bot
Thanks Carsten

I'll give it a try and get back to you.

Will this run on 2.4?
 
 
IP Logged  
 Reply #14 - Nov 20th, 2010 at 12:04pm
There are no actions to perform.  
Carsten 
Ex Member


None
Re: Google bot
RonS2 wrote on Nov 20th, 2010 at 12:31am:
I'll give it a try and get back to you.

Looking forward to your feedback Smiley

RonS2 wrote on Nov 20th, 2010 at 12:31am:
Will this run on 2.4?

Yep - should make no difference.
 
 
IP Logged  
Pages: 1 2 
Topic Tools
 

Get Yet another Bulletin Board at SourceForge.net. Fast, secure and Free Open Source software downloads Support This Project BoardMod - YaBB features and templates YaBB Codex - support on installation and usage YaBB Toolbar for your browser

YaBB Facebook Group Page

Vulnerability Scanner

Valid RSS Valid XHTML Valid CSS Powered by Perl
YaBB Chat and Support Community » Powered by YaBB 3.0 Beta!
YaBB Forum Software © 2000-2011. All Rights Reserved.