Dagger | Substitute YAML with Nouns and Verbs in CI/CD Pipelines
Build powerful software environments and containerized operations from modular components and simple functions. Perfect for complex software delivery and AI agents. Built by the creators of Docker.
Netflix on AWS: Case Studies, Videos, Innovator Stories
Netflix is a video on demand streaming service with over 280 million members in more than 190 countries.
Using Amazon Web Services (AWS), Netflix innovates with speed and delivers best-in-class entertainment consistently. AWS provides Netflix with compute, storage, and infrastructure that allow the company to scale quickly, operate securely, and meet capacity needs anywhere in the world. Moreover, as a content producer, Netflix built a virtual studio in the AWS cloud, enabling engagement with artistic talent anywhere in the world without technological or geographical barriers.
Pricing details for Amazon CloudFront's global content delivery network (CDN), including the AWS Free Tier. There are no upfront payments or fixed platform fees, no long-term commitments, no premiums for dynamic content, and no requirements for professional services to get started.
Instagram Architecture: 14 Million users, Terabytes of Photos, 100s of Instances, Dozens of Technologies - High Scalability -
Instagram is a free photo sharing and social networking service for your iPhone that has been an instant success. Growing to 14 million users in just over a year, they reached 150 million photos in August while amassing several terabytes of photos, and they did this with just 3 Instaneers, all on the Amazon stack.
The Instagram team has written up what can be considered the canonical description of an early stage startup in this era: What Powers Instagram: Hundreds of Instances, Dozens of Techn
The Architecture Twitter Uses to Deal with 150M Active Users, 300K QPS, a 22 MB/S Firehose, and Send Tweets in Under 5 Seconds - High Scalability -
Toy solutions solving Twitter’s “problems” are a favorite scalability trope. Everybody has this idea that Twitter is easy. With a little architectural hand waving we have a scalable Twitter, just that simple. Well, it’s not that simple as Raffi Krikorian, VP of Engineering at Twitter, describes in his superb and very detailed presentation on Timelines at Scale. If you want to know how Twitter works - then start here.
It happened gradually so you may have missed it, but Twitter has grown up. It
Update: Flickr hits 2 Billion photos served. That's a lot of hamburgers.
Flickr is both my favorite bird and the web's leading photo sharing site. Flickr has an amazing challenge, they must handle a vast sea of ever expanding new content, ever increasing legions of users, and a constant stream of new features, all while providing excellent performance. How do they do it?
Site: http://www.flickr.com
Information Sources
Flickr and PHP (an early document)
Capacity Planning for LAMP
Fede
Cloud 101: A No-Fluff Guide to AWS Concepts That Matter
Discover the core concepts of AWS cloud, including key benefits, foundational services, and others. A no-fluff guide perfect for beginners and tech professionals exploring cloud fundamentals.
The Illustrated Children’s Guide to Kubernetes | CNCF
Brought to you by… Written by: Matt Butcher and Karen Chu Illustrated by: Bailey Beougher Illustration of Goldie is based on the Go Gopher designed by Renee…
Getting back to the EU: from Google Cloud to Self-Hosted EU Infrastructure
A detailed walkthrough of migrating a web service from Google Cloud to OVH, covering PostgreSQL database migration, CI/CD pipeline setup on Github Actions, and significant cost savings by migrating from Cloud to a self hosted solution. This migration represents a first step toward reducing dependency on US cloud providers while maintaining service quality.
How NGINX design handles concurrent million connections ?
Discover how NGINX's event-driven non-blocking I/O architecture enables handling millions of concurrent connections while maximizing CPU and memory efficiency.
Lambda is an excellent option for deploying lower-traffic web services when you don't want to maintain another server and you want easy access to all of AWS's other services. In this article, Godwin Ekuma shows us step-by-step how to deploy our Rails apps to AWS Lambda.
This page describes the lifecycle of a Pod. Pods follow a defined lifecycle, starting in the Pending phase, moving through Running if at least one of its primary containers starts OK, and then through either the Succeeded or Failed phases depending on whether any container in the Pod terminated in failure.
Like individual application containers, Pods are considered to be relatively ephemeral (rather than durable) entities. Pods are created, assigned a unique ID (UID), and scheduled to run on nodes where they remain until termination (according to restart policy) or deletion.
SkyPilot uses the venerable SQLite for state management. SQLite can handle millions of QPS, and terabytes of data. However, our efforts to scale our Managed Jobs feature ran up against the one downfall of SQLite: many concurrent writers. Since SkyPilot typically runs as a CLI on your laptop, we wanted to stick with SQLite, so we decided to figure out how we can make it work. We were very surprised with some of our findings.