Backend#8: How Atlassian leverages declarative metadata-driven system architecture in their data platform & a look at DuckDB
Atlassian's internal first-generation data lake grows by 85 terabytes a day. Since it's a data lake, it contains data from varied sources and with varied degrees of documentation, metadata, lineage, quality checks, and observability, acting as a centralized repository for storing vast amounts of raw, unprocessed data.