LibVF.IO: Add GPU Virtual Machine (GVM) Support

Arthur Rasmusson | COO, Arc Compute
August 24, 2022
Connect with us
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

The Arc Stack

The ultimate software stack for AI and Machine Learning
Reserve GPUs

Introduction

OpenMdev is committed to making GPU virtualization accessible to a wider audience by building support through GPL licensed tools that work for the widest range of users and devices possible. In short we're trying our best to bring GPU virtualization to everyone. To this end we created LibVF.IO to make GPU virtualization easier than ever on a wide range of devices (desktops, laptops, embedded, and servers). Today we're announcing support for GPU Virtual Machine (GVM) in LibVF.IO.

The GPU Virtual Machine (GVM) project logo.


GPU Virtual Machine (GVM) builds upon our prior work and extends user control further into the GPU by supporting the user's ability to create mediated GPU types (vGPUs) exactly matching their specified GVM configuration.

Read the updated setup guide
https://arccompute.com/blog/libvfio-commodity-gpu-multiplexing/

A section of the LibVF.IO install guide detailing virtual GPU (vGPU) configuration in GVM.


Next Steps

Packaging

Currently installation of GVM for Nvidia GPUs is handled through LibVF.IO. Due to an XML signature which normally prevents the user from making changes to mediated device configuration we are not able to package GVM's components and install them in place under an existing driver.

Packaging of GVM components will require that we remove this signature in-place rather than ahead of time by installing drivers next to GVM. Packaging work is ongoing so that installation scripts will no longer be necessary.

While this limitation remains to make it easy for users of other management stacks (like Libvirt) we also added ./scripts/install-standalone-gvm-components.sh so the user may install exclusively the components needed to interact with GVM through Libvirt & Mdevctl without bringing LibVF.IO along with it.


Improved Support For Devices

To see a full list of supported devices visit the GPU Support page on OpenMdev.

At this time GPU Virtual Machine provides public support for Nvidia GPUs. With Intel's forthcoming Xe products comes the opportunity to build widely available open source support for SR-IOV for GPUs with widespread installation both through it's soon to be released Arctic Sound and Xe devices.

We look forward to announcing public support for a wider range of devices in the near future.


Community

If you would like to ask questions about LibVF.IO or GVM you can join our friendly community. We'd love to help you troubleshoot your setup or work together to improve our open sources.


Discord
https://discord.gg/Rb9K9DYxKK
IRC
#gvm & #gvm-devel on oftc.net

Looking to learn more about Arc Compute?
Read our latest white papers and case studies.
Arc Compute GPU Cloud Infrastructure

Arc Compute - Company Summary

Arc Compute's customers have one thing in common; they are all large consumers of GPUs who are tired of the current cloud business models and are looking for better, transparent pricing and better performance and security.
Download Now
Arc Compute GPU Cloud Infrastructure

Arc Compute Powers GPU Cloud Offering with Liqid

"Arc Compute, the only cloud service provider to offer Liqid’s revolutionary composable disaggregated infrastructure (CDI) as a service, proposed a GPU cloud option that offered the immersive video company a far more flexible and cost-effective solution".
Download Now
Arc Compute GPU Cloud Infrastructure

Hyperborea - Superior GPU Cloud Performance

As you will see in the following benchmarks, by utilizing Arc’s exclusive software via The Arc Cloud, your workloads can train up to 80% faster. This software is currently used in Arc’s GPU cloud service, with on-premise licensing available soon.
Download Now
Connect with us
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

The Arc Stack

The ultimate software stack for AI and Machine Learning
Reserve GPUs

The Arc Blog

Arc Compute: a custom GPU cloud provider
August 23, 2022
Read More
Arc Blog - LibVF.IO: Add GPU Virtual Machine Support

Arc Blog - LibVF.IO: Add GPU Virtual Machine Support

Arthur Rasmusson | COO, Arc Compute
August 24, 2022
LibVF.IO (vGPU & SR-IOV on Consumer GPUs) has added support for GPU Virtual Machine (GVM).
Read More
Arc Blog - Experience Better GPU Performance in the Arc Cloud

Arc Blog - Experience Better GPU Performance in the Arc Cloud

Erik Kimmerer | Sales & Marketing Specialist, Arc Compute
August 23, 2022
Learn how Arc's GPU hypervisor, Hyperborea, increases GPU performance through exclusive configurations made possible thanks to Simultaneous Multi-Virtual GPU
Read More
Arc Blog - The Web Browser Landscape

Arc Blog - The Web Browser Landscape

Arthur Rasmusson | COO, Arc Compute
June 4, 2021
As I’m sure many people have heard over the course of the last few days Chrome’s developers have chosen to change the way Chrome’s advertising, JavaScript, XHR connection, CSS, and iframe...
Read More
Arc Blog - Closed Investment Round with OPN & Supporters Fund

Arc Blog - Closed Investment Round with OPN & Supporters Fund

Justin Ritchie | CEO, Arc Compute
June 5, 2021
Typically, when a GPU cloud consumer is utilizing their provider’s GPU compute, the provider must either run single physical devices per user or instead use expensive multi-user sharing...
Read More
Arc Blog - Why Augmented Reality is Not Ready

Arc Blog - Why Augmented Reality is Not Ready

Arthur Rasmusson | COO, Arc Compute
June 24, 2021
What enabled VR to become functionally capable of inducing reliable "presence" (the qualitative threshold for experiences that convince all the cognitive systems that make up your conscious...
Read More
Arc Blog - Learning from OpenBSD to Make Computers Better

Arc Blog - Learning from OpenBSD to Make Computers Better

Arthur Rasmusson & Louis Castricato
December 5, 2019
This is an attempt to consolidate down a number of threads spanning separate discussions from around the 'net I have been having on the subject of operating system development models and...
Read More
Looking to learn more about Arc Compute?
Read our latest white papers and case studies.
Arc Compute GPU Cloud Infrastructure

Arc Compute - Company Summary

Arc Compute's customers have one thing in common; they are all large consumers of GPUs who are tired of the current cloud business models and are looking for better, transparent pricing and better performance and security.
Download Now
Arc Compute GPU Cloud Infrastructure

Arc Compute Powers GPU Cloud Offering with Liqid

"Arc Compute, the only cloud service provider to offer Liqid’s revolutionary composable disaggregated infrastructure (CDI) as a service, proposed a GPU cloud option that offered the immersive video company a far more flexible and cost-effective solution".
Download Now
Arc Compute GPU Cloud Infrastructure

Hyperborea - Superior GPU Cloud Performance

As you will see in the following benchmarks, by utilizing Arc’s exclusive software via The Arc Cloud, your workloads can train up to 80% faster. This software is currently used in Arc’s GPU cloud service, with on-premise licensing available soon.
Download Now