Website Github GPG keys

I write code, that’s about all I’m rn

  • 9 Posts
  • 101 Comments
Joined 2 years ago
cake
Cake day: July 3rd, 2023

help-circle
  • I’m working on self-hosting my own LLMs.

    I realized there are things I wanna talk about and research but I don’t want to send it to open AI. Frankly I feel gross about how much I’ve sent to open AI. My desktop is a beefy gaming rig that I don’t use for gaming much. I have a 20thread core, 64gb ram, an Nvidia gtx 3060 and 5 spare TB so why not.

    • I keep a few ollama models downloaded and I’m slowly getting to know them and what they can do. Gemma seems to answer the fastest so I’ve been using that. Deepseek is like the reasoning button on chatgpt.
    • I use openai-whisper to transcribe meetings I record using OBS. It’s really slow so I have a cronjob transcribe all my meetings for that day overnight.
    • Open Web UI is a fantastic LLM frontend. It provides tools, rags, web searching, and model ranking all as a simple to use UI.
    • My desktop has a Wireguard server which makes it easy to use my OpenWebUI on my phone.

    Now I want to work on giving the LLM access to my Google calendar so it can create reminders for me. I’m sick of forgetting to think about remembering to do things so I hope if I can just ramble at the LLM about what I’m doing or what’s on my mind it can organize my thoughts. What else are these LLM actually for?















  • Ok peace love and fuck google but serious replies only

    Why do we devs need Android?

    Most apps I build just display shit. They show prompts to the user to guide them through what I want them too.

    I can’t remember ever needing to implement some high frequency data processing onboard and even so. Webassembly and PWAs are getting better pretty dang fast (isn’t figma a 100% wasm-pwa?) so if I actually needed those I could have those.

    The last remnants of what a program could do on bare metal is like LLMs and visual processing. I’d also rather have those in a standalone app but soon we’re gonna get some sort of WebNPU standard and (well) I might as well process images in webassembly (ノಠ益ಠ)ノ

    Like imo browsers are becoming virtual machines with (what amounts to) an undefinably infinite app store.

    When I freelance as an app developer I always encourage my clients to go the PWA route and then I wrap a PWA runner for the app stores because they only want to be on the app stores for marketing purposes and bc users are used to it.

    Because that’s all that these OSs are, just UI’s wrapping a browser (in my humble opinion).


  • I’ve been experiencing something like this too…

    I’m really insomniac due to mental health stressors and chemical imbalances. I honestly might die if I don’t use meds to put myself to sleep for 2 weeks straight.

    That being said my meds are correcting the chemical imbalances. And I get to notice as I try to fall asleep after a high stress day I’ll ruminate too hard and I’ll stay awake after the “put-down” pill wears off, (then I gotta decide to give up on sleep all together or damage myself more with another pill).

    I’m not a doctor (just traumatized). Ruminations come from anxiety sometimes, try to recognize what you’re actually actually doing to prevent yourself from sleeping.