I wanted to run AI locally on Fedora using an Nvidia GPU I had sitting in my Dell PowerEdge R730 — and an hour and a half later, I actually got it working. Here’s what the road looked like.
Brian Smith and I talk with Cedric Clyburn and the Podman Desktop team about the AI Lab extension, which downloads, serves, and builds with LLMs on your own laptop.