Why You'll Experience Better GPU Performance in the Arc Cloud

Erik Kimmerer | Sales & Marketing Specialist, Arc Compute
August 23, 2022
Connect with us
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

The Arc Stack

The ultimate software stack for AI and Machine Learning
Reserve GPUs

The Short Answer:

Hyperborea & Simultaneous Multi-Virtual GPU (Only Non-Vendor GPU Hypervisor)

Hyperborea, Arc's GPU hypervisor, has an exclusive feature called Simultaneous Multi-Virtual GPU (SMVGPU). SMVGPU enables the virtualization of multiple multiplexed virtual GPUs into a single virtual machine, something that no other hypervisor can do. This, along with Hyperborea's superior ability to allocate GPU memory at run-time* (more on this at the end of the post), means that when you're utilizing virtual GPUs in the Arc cloud you'll always be allocated the amount of resources you signed up for, but you're often allocated even more. To illustrate this let's take a look at an example.

 

Example:

Let's say you need access to 2 A100 40 GB GPUs to train an important neural network model. The standard way to do this is to reserve a cloud instance (VM) with 2 full A100 GPUs passed into it. This configuration is shown in Configuration 1 below. You'll get this type of configuration with an other cloud provider.

 

 

Configuration 1

 

 

If you were to require 2 A100 40 GB GPUs in the Arc cloud, you wouldn't be allocated just two graphics cards. Instead, you would be allocated 4 half GPUs (half a multiplexed virtual GPU). This configuration is illustrated in Configuration 2.

 

 Configuration 2

 

You're allocated the exact same amount of resources in both situations (the equivalent of 2 A100 40 GB GPUs), but you're limited to just the resources of those two cards in Configuration 1. This isn't the case for Configuration 2. Thanks to Hyperborea's ability to allocate GPU resources at run-time, assuming the other halves of the 4 cards you’re using aren’t being utilized (or are being underutilized) by someone else's workloads, you'll actually be allocated some of the resources of those halves as well. Due to the staggered nature of workloads (especially across different time zones), you'll be allocated more resources than you signed up for 99% of the time, which increases performance and reduces the time it takes for your workload to run.

 

An added bonus of this performance boost in the Arc cloud is that you can often get away with using fewer GPU resources than you're used to. In the above example of needing 2 A100 40 GB GPUs to train your workloads, you would likely only need 1 A100 40 GB GPU in the Arc cloud (AKA 2 half virtualized GPUs) (assuming someone else's workloads aren't fully utilizing the other halves of those GPUs). 

*Hyperborea’s allocation of GPU resources at run-time is more advanced than other hypervisors due to its ability to virtualize GPUs into more complex configurations. With multiple multiplexed virtual GPUs passed through into a single VM, that instance will benefit from the load-balanced resources across all GPUs that it’s utilizing (including any part of the GPUs that it’s not technically allocated)

Looking to learn more about Arc Compute?
Read our latest white papers and case studies.
Arc Compute GPU Cloud Infrastructure

Arc Compute's High Performance GPU Cloud

Arc Compute's customers have one thing in common; they are all large consumers of GPUs who are tired of the current cloud business models and are looking for better, transparent pricing and better performance and security.
Download Now
Arc Compute GPU Cloud Infrastructure

Arc Compute Powers GPU Cloud Offering with Liqid

"Arc Compute, the only cloud service provider to offer Liqid’s revolutionary composable disaggregated infrastructure (CDI) as a service, proposed a GPU cloud option that offered the immersive video company a far more flexible and cost-effective solution".
Download Now
Arc Compute GPU Cloud Infrastructure

Superior GPU Cloud Performance With Hyperborea

As you will see in the following benchmarks, by utilizing Arc’s exclusive software via The Arc Cloud, your workloads can train up to 80% faster. This software is currently used in Arc’s GPU cloud service, with on-premise licensing available soon.
Download Now
Connect with us
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

The Arc Stack

The ultimate software stack for AI and Machine Learning
Reserve GPUs

The Arc Blog

Arc Compute: a custom GPU cloud provider

Why You'll Experience Better GPU Performance in the Arc Cloud

August 23, 2022
Read More
LibVF.IO: Add GPU Virtual Machine (GVM) Support

LibVF.IO: Add GPU Virtual Machine (GVM) Support

Arthur Rasmusson | COO, Arc Compute
August 24, 2022
LibVF.IO (vGPU & SR-IOV on Consumer GPUs) has added support for GPU Virtual Machine (GVM).
Read More
Why You'll Experience Better GPU Performance in the Arc Cloud

Why You'll Experience Better GPU Performance in the Arc Cloud

Erik Kimmerer | Sales & Marketing Specialist, Arc Compute
August 23, 2022
Learn how Arc's GPU hypervisor, Hyperborea, increases GPU performance through exclusive configurations made possible thanks to Simultaneous Multi-Virtual GPU
Read More
LibVF.IO: Commodity GPU Multiplexing Driven By VFIO & YAML

LibVF.IO: Commodity GPU Multiplexing Driven By VFIO & YAML

Arthur Rasmusson | COO, Arc Compute
September 27, 2021
Learn all about why we developed LibVF.IO and what problems it solves. Take a deep dive into the rationale behind the software and follow along with this step-by-step installation guide...
Read More
Thoughts on the Web Browser Landscape

Thoughts on the Web Browser Landscape

Arthur Rasmusson | COO, Arc Compute
June 4, 2021
As I’m sure many people have heard over the course of the last few days Chrome’s developers have chosen to change the way Chrome’s advertising, JavaScript, XHR connection, CSS, and iframe...
Read More
Arc closes latest investment round: OPN & Supporters Fund

Arc closes latest investment round: OPN & Supporters Fund

Justin Ritchie | CEO, Arc Compute
June 5, 2021
Typically, when a GPU cloud consumer is utilizing their provider’s GPU compute, the provider must either run single physical devices per user or instead use expensive multi-user sharing...
Read More
Why Augmented Reality is Not Ready

Why Augmented Reality is Not Ready

Arthur Rasmusson | COO, Arc Compute
June 24, 2021
What enabled VR to become functionally capable of inducing reliable "presence" (the qualitative threshold for experiences that convince all the cognitive systems that make up your conscious...
Read More
Why Computers Suck and How Learning from OpenBSD Can Make Them Marginally Less Horrible

Why Computers Suck and How Learning from OpenBSD Can Make Them Marginally Less Horrible

Arthur Rasmusson & Louis Castricato
December 5, 2019
This is an attempt to consolidate down a number of threads spanning separate discussions from around the 'net I have been having on the subject of operating system development models and...
Read More
Looking to learn more about Arc Compute?
Read our latest white papers and case studies.
Arc Compute GPU Cloud Infrastructure

Arc Compute's High Performance GPU Cloud

Arc Compute's customers have one thing in common; they are all large consumers of GPUs who are tired of the current cloud business models and are looking for better, transparent pricing and better performance and security.
Download Now
Arc Compute GPU Cloud Infrastructure

Arc Compute Powers GPU Cloud Offering with Liqid

"Arc Compute, the only cloud service provider to offer Liqid’s revolutionary composable disaggregated infrastructure (CDI) as a service, proposed a GPU cloud option that offered the immersive video company a far more flexible and cost-effective solution".
Download Now
Arc Compute GPU Cloud Infrastructure

Superior GPU Cloud Performance With Hyperborea

As you will see in the following benchmarks, by utilizing Arc’s exclusive software via The Arc Cloud, your workloads can train up to 80% faster. This software is currently used in Arc’s GPU cloud service, with on-premise licensing available soon.
Download Now