Storing hundreds of millions of simple key-value pairs in Redis

At Instagram, they’re using Redis (comparable to Memcached, but with more options) to map photoIds to userIds. After tweaking their setup — by using Redis hashes (dictionaries that are can be encoded in memory very efficiently) — in Redis, they’ve brought memory usage down from 70MB to 16MB to store 1,000,000 records. While prototyping this …

Sharding & IDs at Instagram

With more than 25 photos & 90 likes every second, we store a lot of data here at Instagram. To make sure all of our important data fits into memory and is available quickly for our users, we’ve begun to shard our data—in other words, place the data in many smaller buckets, each holding a …

Instagram v2.0

Today, we’re excited to announce the release of one of the largest revamps to the Instagram app since it launched nearly a year ago. Live filters Four new filters Instant tilt-shift High-resolution photos – 10x larger than before Borders now optional One-click rotation Great additions to an already great app! Read all details in Introducing …

Tweet Nest and Instagr.am, sitting in a tree …

Last month I’ve set up Tweet Nest, a browsable, searchable and easily customizable archive and backup for your tweets, at https://www.bram.us/tweets/ in order to have a local archive of all (*) my tweets. More recently I’ve started using Instagr.am, an instant photos sharing app for the iPhone (with Twitter, Facebook & Flickr integration). Now, what …