publication
2024

PreSight: A Vision for an Instantaneous Web

Contributors

isaac-khor, Suleman Ahmad, Avani Wildani

Details

Proceedings of the 3rd Workshop on Practical Adoption Challenges of ML for Systems, November 4–6, 2024, Austin, TX, USA

Abstract

We present the position that the time for general, scalable, privacy-preserving web cache speculation is at hand. At its core, web speculation is about predicting what resources users will want. Machine learning (ML) seems like a natural fit for this predictive task. We show, however, that ML is not fundamentally necessary to achieve a ∼10% performance improvement worldwide across a diverse set of sites. We also present a set of constraints that large-scale CDNs are subject to, how these constraints limit the possibilities of using ML, what we did instead to achieve our performance results, and a discussion on the place of ML in large, Internet-scale, systems.