Michael Olivero
The official blog of Michael Olivero, Software Architect & Humble Entrepreneur

Facebook vs. Google it's a brutal war...

Wednesday, 16 May 2012 20:11 by Michael Olivero

Web sites have a simple way to tell search engines how to index their site.  This consists of a file called robots.txt the web site places on the root of their site specifying the rules on how the "robots" can come in a traverse their site.  It was first established in 1994 around the time when search engines were being born.

It recently resurfaced in the news not too long ago when Rupert Murdock was creating waves in the media about how search engines steal and reuse their content -- particularly their news and aggregating them such as news.google.com.  Google's shameless response, to Murdock's embarrassment too, was simply "place a robots.txt file and let us know not go there".  For the record, Murdock's news sites didn't do this and the story ended there.

Now with the Facebook IPO only a fews days away, I was curious to see the contents of facebook's robots.txt file.  In a nutshell, most search engines (explicitly) are told to not index many of the main pages like photos, feeds, etc. So here is Facebook collecting tons of information on people, pictures, preferences, etc. and yet google can't even touch it -- ouch.  That's like going to a fight with your best weapon -- just that you're weapon doesn't work.

You can see it here http://www.facebook.com/robots.txt


Google's plus.google.com robots file looks like this and can be viewed directly here plus.google.com/robots.txt

Categories:   Software
Actions:   E-mail | del.icio.us | Permalink | Comments (0) | Comment RSSRSS comment feed

Cross Multiply Mental Calculation iPhone App Ver 1.1

Saturday, 12 May 2012 17:33 by Michael Olivero



This is the latest update to the original cross multiplication application released a few weeks ago -- original posting here

Version 1.1 of the app allowed me to practice with threading as well as state.  The app has an interactive timer which is not intrusive by starting/stopping automatically.  Your best error-free scores are saved so you can challenge yourself to beat it over and over.