Bot name ?
|
04-17-2011, 12:36 AM
Post: #1
|
|||
|
|||
Bot name ?
Have you a bot name like w3c_validator or googlebot ?
Some sites must make two redirects to check some ability with javascript and write internal vars in php. you detect this and follow, but you should do not - that was only for real users. Bots like $config['bots']=array('w3c_validator','googlebot','msnbot','slurp','gigabot','scrubby','robozila','nutch','ia_archiver','baiduspider','yahoo-mmcrawler','psbot','asterias','yahoo-blogs','SeitenReport'); are disabled automatically for redirects and so it was a good idea to set your name is this method. |
|||
« Next Oldest | Next Newest »
|
Messages In This Thread |
Bot name ? - piratos - 04-17-2011 12:36 AM
RE: Bot name ? - piratos - 04-17-2011, 03:46 AM
RE: Bot name ? - pmeenan - 04-18-2011, 12:34 AM
|
User(s) browsing this thread: 1 Guest(s)