| ERODS |  |
Conference papers
OFC: an opportunistic caching system for FaaS platforms
Abstract : Cloud applications based on the "Functions as a Service" (FaaS) paradigm have become very popular. Yet, due to their stateless nature, they must frequently interact with an external data store, which limits their performance. To mitigate this issue, we introduce OFC, a transparent, vertically and horizontally elastic in-memory caching system for FaaS platforms, distributed over the worker nodes. OFC provides these benefits cost-effectively by exploiting two common sources of resource waste: (i) most cloud tenants overprovision the memory resources reserved for their functions because their footprint is non-trivially input-dependent and (ii) FaaS providers keep function sandboxes alive for several minutes to avoid cold starts. Using machine learning models adjusted for typical function input data categories (e.g., multimedia formats), OFC estimates the actual memory resources required by each function invocation and hoards the remaining capacity to feed the cache. We build our OFC prototype based on enhancements to the OpenWhisk FaaS platform, the Swift persistent object store, and the RAM-Cloud in-memory store. Using a diverse set of workloads, we show that OFC improves by up to 82 % and 60 % respectively the execution time of single-stage and pipelined functions.
https://hal.archives-ouvertes.fr/hal-03211416
Contributor : Renaud Lachaize Connect in order to contact the contributor
Submitted on : Wednesday, April 28, 2021 - 4:51:36 PM
Last modification on : Thursday, May 12, 2022 - 5:08:02 PM
Long-term archiving on: : Thursday, July 29, 2021 - 7:05:37 PM
Contributor : Renaud Lachaize Connect in order to contact the contributor
Submitted on : Wednesday, April 28, 2021 - 4:51:36 PM
Last modification on : Thursday, May 12, 2022 - 5:08:02 PM
Long-term archiving on: : Thursday, July 29, 2021 - 7:05:37 PM
File
main.pdf
Files produced by the author(s)