Portal Home > Knowledgebase > Articles Database > Apache Error logs show Google?

Apache Error logs show Google?

Posted by badhat, 07-30-2012, 12:32 PM

I tested something to see what might happen and it brought unusual results in the error log. Domain A is redirected to Domain B. I noticed some anomalies so I typed in the following: domaina.com/blahblah.php It redirected to a 404 error page of domainb.com as it was supposed to. I found that it caused in error in the Apache Error Log for blahblah.php not found and unable to stat. But not only did it create that for me but also for a Google crawlbot. How did Google follow my surfing path and then try to find this fake file? Something is going on here and this is not coincidental.

---

Posted by kevincheri, 07-31-2012, 09:49 AM

Do you have robot.txt file with crawling enabled on your site?

---

Add to Favourites    Print this Article

Any Good Resellers here offering HELM? (Views: 652)

Configure one domain on multiple servers (Views: 510)

can't rm -rf afterward (Views: 554)

Stupid whois question.... (Views: 560)

zcat and more zcat (Views: 532)