Storing hundreds of millions of simple key-value pairs in Redis

At Instagram, they’re using Redis (comparable to Memcached, but with more options) to map photoIds to userIds. After tweaking their setup — by using Redis hashes (dictionaries that are can be encoded in memory very efficiently) — in Redis, they’ve brought memory usage down from 70MB to 16MB to store 1,000,000 records. While prototyping this […]

Tweet Nest and, sitting in a tree …

Last month I’ve set up Tweet Nest, a browsable, searchable and easily customizable archive and backup for your tweets, at in order to have a local archive of all (*) my tweets. More recently I’ve started using, an instant photos sharing app for the iPhone (with Twitter, Facebook & Flickr integration). Now, what […]