Sharing your GPU

So far we've gone to great lengths about virtualising all of our computers' resources, except the GPU. After building my own cloud infrastructure a couple of years ago and dealing with different GPU pass-through approaches, recently, with all the hardware shortages and crazy GPU pricing, I decided it was time to tackle this problem once again, so it's time that I share my findings.There's something in this talk for everybody, AI researchers, Gamers, Software Developers, DevOps, Entrepreneurs, etc...