while(true){💩};

  • 0 Posts
  • 34 Comments
Joined 3 years ago
cake
Cake day: June 11th, 2023

help-circle
  • Do you think it runs at 1000w continuously? On any decent GPU, the responses are nearly instantaneous to maybe a few seconds of runtime at maybe max GPU consumption.

    Compare that to playing a few hours of cyberpunk 2077 with raytracing and maxed out settings at 4k.

    Don’t get me wrong, there’s a lot to hate about AI/LLMs, but running one locally without data harvesting engines is pretty minimal. The creation of the larger models is where the consumption primarily comes in, and then the data centers that run them are servicing millions of inquiries a minute making the concentration of consumption at a single point significantly higher (plus they retrain the model there on current and user-fed data, including prompts, whereas your computer hosting ollama would not.)



















  • Been slowly chipping away at those for the last decade (could have gone way faster but I’m lazy), and I’m almost completely google-free. I dont use any microsoft products at home (work forces me to), and Apple can eat my ass. My phone is a completely de-googled GrapheneOS device (I don’t have an issue relying on companies for hardware, just software), and hopefully in the future a Liberux or Pinephone linux phone.

    I self-host my own movies, music, and cloud storage. I also host my own chat service for friends and family, built on top of XMPP. The services i do use are generally very privacy respecting like Signal for people outside of my social sphere, or freedom respecting like Lemmy (mostly weaned off of reddit).