It’s Sunday somewhere already so why wait?

Let us know what you set up lately, what kind of problems you currently think about or are running into, what new device you added to your homelab or what interesting service or article you found.

I’ll post my ongoing things later/tomorrow but I didn’t want to forget the post again.

  • Jeena@piefed.jeena.netEnglish
    8·
    5 days ago

    I. Build a PC for video editing because it was becoming impossible to do on the laptop. I realized that I can use the GPU also to run large language models myself.

    So this week I’ve been setting up ollama and Open WebUI to be able to move some of my queries I ask ChatGPT and ask them on my computer, even if I’m away.

    This way I don’t need to send sensitive data to the USA and China. It works quite well but I only can use smaller models up to 14B because of the 12 GB VRAM my graphics card only has.