Napa represents the next generation of planet-scale data warehousing at Google, following Mesa. A key system for analytics workloads, Napa stores enormous datasets for various tenants within Google. The extensive authorship of the paper presented at VLDB 2021 underscores the collaborative effort behind its creation. Paper Link Work in progress!
This paper from Google was presented at Eurosys 2020. It has a lot of statistics. However, it represents one of the most important concepts in cloud computing - autoscaling - and hence it is important to explore those concepts in system design. Paper Link Recommended Read : Paper Insights - Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center where I introduced cluster computing and resource allocation. Borg Borg , a cluster manager developed at Google, is a prominent example of a cluster orchestrator . It is important to note that the design of Kubernetes was significantly influenced by Borg. Jobs and Tasks A Borg cluster consists of roughly 100 to 10,000 physical machines connected through a high-speed network fabric. Users submit jobs for execution on these machines, and these jobs are categorized into several types: Services : These are long-duration jobs that frequently constitute components of larger systems, such as those employing a microservices ...