Hive – A Petabyte Scale Data Warehouse using Hadoop
Jun 10, 2009 · When we started at Facebook in 2007 all of the data processing infrastructure was built around a data warehouse built using a commercial RDBMS. The data that we were generating was …
TAO: The power of the graph - Engineering at Meta
Jun 25, 2013 · In 2007, a few Facebook engineers set out to define new data storage abstractions that would fit the needs of all but the most demanding features of the site while hiding most of the …
Facebook Chat - Engineering at Meta
May 13, 2008 · Since going open source a year ago (we had the gall to release it on April Fool’s Day, 2007), the Thrift project has steadily grown and improved (with multiple iterations on the Erlang …
Stay focused and keep hacking - Engineering at Meta
May 23, 2012 · At my first hackathon in 2007, about 20 people showed up. At our most recent hack, last Thursday night, more than 500 employees came together to hack on apps for non-profits, new …
Under the Hood: Building and open-sourcing fbthrift
Feb 20, 2014 · After using Thrift for a year internally, we open-sourced it in 2007. Since then, as we continued to gain experience running Thrift infrastructure inside Facebook, we found two things: 1) …
Intro to Facebook Search - Engineering at Meta
Mar 16, 2010 · In July 2007 we explained the complexities of serving one of the largest user bases in the world and the reasons for building our own in-house search service. Serving more than 150 million …
Rapid release at massive scale - Engineering at Meta
Aug 31, 2017 · This system scaled well, starting with a handful of engineers in 2007 to thousands today. The good news is that as we added more engineers, we got more done — the rate of code delivery …
Scaling the Facebook data warehouse to 300 PB
Apr 10, 2014 · Visit the post for more.At Facebook, we have unique storage scalability challenges when it comes to our data warehouse. Our warehouse stores upwards of 300 PB of Hive data, with an …
Web performance: Cache efficiency exercise - Engineering at Meta
Apr 13, 2015 · Look at how Internet delivery and webpage size have changed between 2007 and today. In 2007, we had 2.5Mbps cable modems (at home), and the Yahoo homepage weighed in at 168.1KB.
How Project Triforce Prepared our Software Stack for Prineville
May 16, 2011 · As the site grew, we added a second region of data centers in Virginia in 2007, and this year, we launched our third region in Prineville, Oregon. Our new facility in Prineville marks a shift in …