GPU Sharing
GPUs are often Trapped Inside Servers, Limiting Utilization and Flexibility
Underutilized GPUs needlessly waste energy and drive up operating costs.
The following chart from towardsdatascience.com depicts the average GPU utilization by user. Which shows a decrease in GPU utilization across a majority of those users.
“Nearly a third of our users are averaging less than 15% utilization. Average GPU memory usage is quite similar. Our users tend to be experienced deep learning practitioners and GPUs are an expensive resource so I was surprised to see such low average usage.” – via towardsdatascience.com
Enter GigaIO’s FabreX environment:Â FabreX Memory Fabric breaks the through the server chassis barrier and disaggregates rack components into pools of resources, allowing for an increase in GPU utilization.