Fast, easy, realtime metrics using Redis bitmaps

"At Spool, we calculate our key metrics in real time. Traditionally, metrics are performed by a batch job (running hourly, daily, etc.). Redis backed bitmaps allow us to perform such calculations in realtime and are extremely space efficient. In a simulation of 128 million users, a typical metric such as “daily unique users” takes less than 50 ms on a MacBook Pro and only takes 16 MB of memory. Spool doesn’t have 128 million users yet but it’s nice to know our approach will scale. We thought we’d share how we do it, in case other startups find our approach useful..."

http://blog.getspool.com/2011/11/29/fast-easy-realtime-metrics-using-redis-bitmaps 
https://github.com/antirez/redis/commit/9ee55e8e583a139b35628c47ef8d2c9f1e65936b

Permalink | Leave a comment  »

Leave a comment