TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Run AI Models with Ollama in CI with GitHub Actions

2 pointsby alexellisukabout 1 year ago

1 comment

alexellisukabout 1 year ago
Hi, I&#x27;m the founder of actuated and have been creating a bunch of materials on learning Firecracker for the community over the past couple of years. In this tutorial I wanted to show how you can use GPUs mounted via VFIO for CI - for AI use-cases including e2e testing and training&#x2F;embedding with acceleration.<p>If you&#x27;ve not used ollama before, it also gives you a quick guide to try it out on a CPU or GPU locally.<p>We&#x27;re looking for folks who could use GPU acceleration in GitHub Actions or GitLab CI - feel free to reach out to me via the form on the pricing page if that&#x27;s of interest.<p>If not, hope you learned something.