In case you hadn’t heard, a few things changed south of the boarder today (something about a new president I think, not really sure…), and along the way the White House website relaunched (even if it does opt to use ASP in favour of PHP)
Of interest to coders is a comparison of the old robots.txt file to the new one. As if the case with many of the comparisons between the outgoing president, and incoming one, the old robots.txt file is pretty exclusionary having over 2,400 lines hiding specific content pages or folders from search engines while the new one has only two lines of standard exclusion rules. (via sherrett on twitter)
Posted by Steve Mynett
Tags: coding, election, obama, production, robots.txt, white house
