Get off my GPU! Better sharing of AI accelerators in OpenStack with Blazar reservations (English)
This presentation was provided at OpenInfra Day France 2024
GPU devices are essential infrastructure components for artificial intelligence and machine learning workloads. Their cost and limited availability make them highly contended resources in OpenStack clouds. In private clouds where price-based mechanisms are not in place to regulate access, users often resort to allocating GPU instances for extended durations, leading to resource underutilization and inefficiency.
Blazar provides a reservation service to OpenStack users, allowing them to better share cloud resources by reserving them in advance. This talk will present the OpenStack Blazar project and describe enhancements that StackHPC is developing with the upstream community to better support the reservation of AI-optimised flavors, improving access to accelerators such as GPUs and other performance optimizations such as CPU pinning.
By:
Pierre Riteau – StackHPC
Connect with us:
OpenInfra Twitter: https://twitter.com/openinfradev
Mastodon: https://social.openinfra.dev/@OpenInfra
OpenInfra LinkedIn: https://www.linkedin.com/company/openinfra-foundation
OpenInfra Facebook: https://www.facebook.com/openinfradev
OpenInfra Website: https://openinfra.dev/
by OpenInfra Foundation
openstack
