Virtines: Virtualization at Function Call Granularity

04/14/2021
by   Nicholas Wanninger, et al.
0

Virtual execution environments provide strong isolation, on-demand infrastructure, simplified device models, and many other benefits for systems and application programmers. However, these environments are often perceived as heavyweight and rife with performance pitfalls for fine-grained or low-latency tasks. While others have shown that a virtual environment's footprint can be drastically reduced by paring down the guest and host software stacks, in this paper we take a different approach. We probe the limits of fine-grained, virtual execution by investigating the viability of hardware virtualized environments at function call granularity. We introduce a new abstraction called a virtine, or virtualized subroutine, and present the design of a new microhypervisor called Wasp that enables them. Through a series of examples we show that Wasp can enable virtines with start-up latencies as low as 100 μs. We also provide two convenient programming interfaces to virtines, using the Rust language and using extensions to C. Using these extensions we implement a simple HTTP server and integrate virtines into an off-the-shelf implementation of OpenSSL.

READ FULL TEXT
research
02/14/2022

Short-lived Datacenter

Serverless platforms have attracted attention due to their promise of el...
research
06/07/2021

Fine-grained Out-of-Distribution Detection with Mixup Outlier Exposure

Enabling out-of-distribution (OOD) detection for DNNs is critical for th...
research
08/26/2015

A Software-only Mechanism for Device Passthrough and Sharing

Network processing elements in virtual machines, also known as Network F...
research
12/21/2019

Measuring Dataset Granularity

Despite the increasing visibility of fine-grained recognition in our fie...
research
12/20/2022

Towards Heterogeneous Multi-core Accelerators Exploiting Fine-grained Scheduling of Layer-Fused Deep Neural Networks

To keep up with the ever-growing performance demand of neural networks, ...
research
07/10/2020

Hypothetical Reasoning via Provenance Abstraction

Data analytics often involves hypothetical reasoning: repeatedly modifyi...
research
09/27/2021

How Low Can You Go? Practical cold-start performance limits in FaaS

Function-as-a-Service (FaaS) has recently emerged as a new cloud computi...

Please sign up or login with your details

Forgot password? Click here to reset