Performance

Want to know more about streaming protocols and how they work for live broadcasting? We cover everything you need to know about streaming protocols in 2024

Learn how to provide a shared access signature to clients who shouldn't be trusted with your storage account key when you want to delegate access to certain storage account resources.

There are many reasons why Netflix cares about the popularity of our TV shows and movies. On the Open Connect Content Delivery team, we predict content popularity to maximize our infrastructure…

Facebook Timeline is audacious in scope. It wants to compile a complete scrollable version of your life story from photos, locations, videos, status updates, and everything you do. That could be many decades of data (hopefully) that must stored and made quickly available at any point in time. A huge technical challenge, even for Facebook, which we know are experts in handing big data. And they built it all in 6 months. Facebook's Ryan Mack shares quite a bit of Timeline's own implementation sto

Beside presenting the overall Facebook architecture and scaling solutions used, Aditya Agarwal talks about the iterative process of constantly improving the site, making sure to avoid over-engineering

Visit the post for more.

Ever wonder how Netflix serves a great streaming experience with high-quality video and minimal playback interruptions? Thank the team of engineers and data scientists who constantly A/B test their…

We relate the Netflix Prize to the broader recommendation challenge, outline the external components of our personalized service, and highlight how our task evolved with the business.

We will give more insight into our broader personalization technology, and will discuss some of our current models, data, and the approaches we follow to lead innovation and research in this space.

Update 2: Sorting 1 PB with MapReduce. PB is not peanut-butter-and-jelly misspelled. It's 1 petabyte or 1000 terabytes or 1,000,000 gigabytes. It took six hours and two minutes to sort 1PB (10 trillion 100-byte records) on 4,000 computers and the results were replicated thrice on 48,000 disks. Update: Greg Linden points to a new Google article MapReduce: simplified data processing on large clusters. Some interesting stats: 100k MapReduce jobs are executed each day; more than 20 petabytes of data

Update 6: Some interesting changes from Twitter's Evan Weaver: everything in RAM now, database is a backup; peaks at 300 tweets/second; every tweet followed by average 126 people; vector cache of tweet IDs; row cache; fragment cache; page cache; keep separate caches; GC makes Ruby optimization resistant so went with Scala; Thrift and HTTP are used internally; 100s internal requests for every external request; rewrote MQ but kept interface the same; 3 queues are used to load balance requests; ext

Raffi Krikorian explains the architecture used by Twitter to deal with thousands of events per sec - tweets, social graph mutations, and direct messages-.

Pinterest has been riding an exponential growth curve, doubling every month and half. They’ve gone from 0 to 10s of billions of page views a month in two years, from 2 founders and one engineer to over 40 engineers, from one little MySQL server to 180 Web Engines, 240 API Engines, 88 MySQL DBs (cc2.8xlarge) + 1 slave each, 110 Redis Instances, and 200 Memcache Instances. Stunning growth. So what’s Pinterest's story? To tell their story we have our bards, Pinterest’s Yashwanth Nelapati and Marty

LinkedIn started in 2003 with the goal of connecting to your network for better job opportunities. It had only 2,700 members the first week. Fast forward many years, and LinkedIn’s product portfolio, member base, and server load has grown tremendously. Today, LinkedIn operates globally with more tha

How a viral URL lengthener racked up 1M+ Vercel Edge Requests in days. A deep dive into unique URLs, caching pitfalls, interstitial pages, and how small multipliers explode costs under virality.

Both stories are true. Scaling still works. OpenAI et al. still have oversold their promises.

Learn how Bunny Shield’s global rate limiting stops modern threats with real-time, edge-wide enforcement—keeping your services fast, secure, and resilient.

Compare the pros and cons of various caching strategies to choose the best one for your use case.

Create a sticky session, also known as session affinity, to bind a user's session to a specific application.