• 0 Posts
  • 17 Comments
Joined 1 year ago
cake
Cake day: August 4th, 2023

help-circle



  • No, Ollama is running on an old PC with a GeForce 1060 and 16gig of ram…

    Yes, it’s a “webserver” running in the background exposing an API.

    However, if I “top” my system, without chatting, it sits at 0% usage; it’s only when asking that the system peeks at around 55-70% CPU.

    You have to understand there is 2 things here: the server and the model. The server is always running, but requires next to nothing in terms of resources.

    The model is what computing your questions, this is the heavy part. It’s started on use, then after a delay, it’s closing.

    TL;DR To answer your real question, you could use Ollama on the same system that you are using.


  • During that time, you can easily install Ollama on an old computer.

    With a client like Oatmeal, you can save your session/ reload/delete as you wish; so your model remembers what you want.

    I am running llama3.1:8b, it’s good enough for the day-to-day operations.

    • Need for a spyware: 0
    • Need to take screenshots of my desktop: 0
    • Need to buy another computer for the hype chipset: 0
    • Need of Microsoft bullshit: 0

    My old computer is apparently “not good enough” for windows 11, but it’s surely good enough for my personal AI running on Linux though!













  • I always thought of passkeys as a convenient way to authenticate.

    I am password-less on multiple services.

    I have an authentication app on my phone that authenticate me when I am away of my computers. I have passkeys on my personal computer and another set of passkeys on my work laptop.

    If I have to authenticate from your computer I simply use my auth app, click on “it’s a public computer” and I am good to go.

    The dude discovered a butter knife and he tries to replace his spoon with it just to realize it doesn’t work well for eating a soup.