• 5 Posts
  • 56 Comments
Joined 8 months ago
cake
Cake day: June 11th, 2024

help-circle




  • I. Build a PC for video editing because it was becoming impossible to do on the laptop. I realized that I can use the GPU also to run large language models myself.

    So this week I’ve been setting up ollama and Open WebUI to be able to move some of my queries I ask ChatGPT and ask them on my computer, even if I’m away.

    This way I don’t need to send sensitive data to the USA and China. It works quite well but I only can use smaller models up to 14B because of the 12 GB VRAM my graphics card only has.