Poke that Facebook code
By Davey Winder in Editorial
Facebook likes to push the mantra that it is making the world a more open and connected place through the medium of dance. Sorry, through the medium of social networking I mean. It also likes to let slip every now and then that the software it uses to build the site and service is pretty much all open source stuff.
Now Facebook has taken that final step into the lovey dovey world of openness and is releasing that code which it has developed into the wild, so that the open source community can do with it what it will. Well, apart from producing a Facebook clone one assumes.
The process gets under way immediately as Facebook releases the Scribe cold. This critical piece of infrastructure is used to collect large amounts of data from a large number of servers, data which is then used to do stuff like track database memory consumption when delivering relationship stories directly into the News Feed. Or, as Facebook puts it “Scribe is a server for aggregating log data streamed in real time from a large number of servers. It is designed to be scalable, extensible without client-side modification, and robust to failure of the network or any specific machine.”
Facebook ended up building its own system because all the open source, and proprietary ones for that matter, which it tried to perform the same task just could not cope with the massive amounts of data being generated by Facebook members. Massive as in tens of billions of pieces of information being moved around every single day.
The Scribe source can be found here.
Rated: 100% (1 votes)
Loading ...Comment by - October 18, 2009 on 1:58 am
It was a very nice idea! Just wanna say thank you for the information you have shared. Just continue writing this kind of post. I will be your loyal reader. Thanks again.
Trackback by - February 9, 2012 on 8:21 am
will smith and jada divorce 2011…
[…]gentle Lennox right after he heard 3 varying and absolutely different statements from 3 […]…
Make a comment
Tag cloud
Archives
- June 2010
- May 2010
- April 2010
- March 2010
- February 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- May 2009
- April 2009
- March 2009
- February 2009
- January 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
- July 2007
- June 2007
- May 2007
- April 2007
- March 2007
- February 2007
- January 2007
- December 2006
- November 2006
- October 2006
- September 2006
- August 2006
Most commented posts
- 80 percent of viruses love Windows 7
165 comments
- Has Microsoft gone mental?
- Has the US Army declared war on Windows 7?
- Cuil frozen out: market share drops to next to nothing
- Xbox 360 FAIL
- The 24GB RAM Desktop is born
- Use old version of Windows instead of Linux, says teacher
- Microsoft reveals time-based licensing model
- How Marblecake Hacked Time
- Nexus Two - The Next Generation
Highest Rated Blog Posts
- Why ecommerce fails (100%)
- Google Chrome stands alone at PWN2OWN (100%)
- Betting on Hubdub technology (100%)
- Has Google gone insane as GMail goes back to beta? (100%)
- Chinese whispers as government implicated in UK hack attacks (100%)
- Crimeware toolkit targets 10,000 trusted sites (100%)
- Black Hat risk to migrating VMs (100%)
- Tough on cyber crime, tough on the causes of cyber crime (100%)
- Firefox 3, Beta 4, Enhancements 900, Tested 5 (100%)
- Has the US Army declared war on Windows 7? (100%)
