It abstracts away llama.cpp in a way that, frankly, leaves a lot of performance and quality on the table.

OP, do you have any telemetry you can show us comparing the performance difference between what you setup on this guide and an Ollama setup? Otherwise, at face value, I’m going to assume this is another thing on the internet i have to assume is uncorroborated bullshit. Apologies for sounding rude.

I don’t like some things about the devs. I won’t rant, but I especially don’t like the hint they’re cooking up something commercial.

This concerns me. Please provide links for us to read here about this. I would like any excuse to uninstall Ollama. Thank you!

deleted by creator

I’m self hosting Vaultwarden and my home server got killed by the hurricane, yet I can still access my passwords just fine on the app because it stores them locally encrypted on my phone from the last time it synced. I just can’t update or change anything until I can bring everything back on.

So, host your own shit you cowards, it’ll be fine.

Yeah, either secure copy (SCP) or rsync are the ways to do this securely.

Why not use this and select whatever LLM to leverage as a RAG? It literally allows you to self host the model and select any model for both chat and RAG analysis. I have it set to Hermes3 8B for chat and a 1.3B Llama3 as the RAG.

This art looks cool, and the premise sounds interesting.

Why is Dora the Explorer intensely breaking the fourth wall from behind the shoulder of the girl with the white shirt?

What is the point of this when the OG Jellyfin has an android app?

Toss OpenWRT into the trash and install OPNSense instead.

Most of the entire internet cannot run without Cloudflare for a reason. Just buy directly from the source.

I use Cloudflare WARP

Something that was once free and adequate, is now enshittified with “improvements” to entice me to pay.

Corollary: https://thin.computer/index.php/2024/03/21/using-termux-on-android-for-self-hosting-yes-really/