exu

Get a cheap VPS and set up a VPN of your choice.

I don’t know of any project that already supports that AI processor. You’d still be using the CPU and GPU at the moment.

I can really recommend XCP-ng. For me it strikes a pretty good balance of features and ease of use.

Using whatever works better for the current project is doing Hybrid Cloud. Now your boss can brag about how modern the infrastructure is.

And 2d, who self host on a server/VPS they rented somewhere.

deleted by creator

You can install Wireguard or another VPN to encrypt your traffic to the VPS.

You’ll want to install a reverse proxy of your choice on the VPS. Have clients access it over ipv4 and configure it to proxy pass it to your ipv6 address. Nginx at least is capable of doing ipv4 & ipv6 -> ipv4, I think the inverse should also be possible.

You can use OpenCL instead of ROCm for GPU offloading. In my tests with llama.cpp that improved performance massively.

Definitely do benchmarks for how many layers you can offload to the GPU. You’ll see when it’s too many, as performance will crater.

By launching llama.cpp as a server you’ll actually be able to continue to use openwebui as you currently have.

It’s probably still more efficient to keep a 192k opus and a 320k mp3 around than one flac.

Yeah, they’re more power hungry, but they’re also way more performant than a pi 4.

VAAPI is the “standard” interface for hardware en-/decoding on Linux. It should work with any GPU using the open source drivers and mesa.

I don’t know how QSV can be installed; AMF, the AMD equivalent, is limited to their proprietary driver.

Heh, same. I didn’t really find it that amazing though.

After installing Lineage, I root the phone and install Neo Backup.
Then I just make an up to date backup on my old phone, copy that over (easiest with KDE Connect), and restore. That deals with about 60% of the apps and their data. The rest are mostly apps where I have to log in again and some special cases like WhatsApp or Signal where using their own backups is required.

I made a list when I changed my phone last year of working/non-working apps from my phone at that point.

Permissions don’t carry over and have to be regranted to every app.

I started with Porkbun, but I also have some domains on Gandi because they offer a CC TLD I wanted.

I’m pretty happy with Authentik. Bitwarden at least has no issues with auto-filling the username and password fields when I want to log in.

It is also a very complete solution offering basically any current authentication protocol and integration with other providers.

For hard drives Toshiba, though SeaGate would be my second pick. Fuck WD.

On SSDs I go on Wikipedia and look at a list of flash + controller manufacturers and pick one of those. (Samsung, Kioxia (I think), Sandisk)

I’m pretty happy with XCP-ng with their XenOrchestra management interface. XenOrchestra has a free and enterprise version, but you can also compile it from source to get all the enterprise features. I’d recommend this script: https://github.com/ronivay/XenOrchestraInstallerUpdater

I’d say it’s a slightly more advanced ESXi with vCenter and less confusing UI than Proxmox.

If you do go down the VLAN route, make sure to define enforce the networks on the Proxmox and firewall side. If you set the VLAN ID on the client instead, an attacker could change it to a different network.

Not sure how exactly Proxmox works for this, but generally you’d distinguish between tagged and untagged ports.
You’d use untagged ports for client/vm access. Any packet gets the VLAN tag set to what you define.
A tagged port would be used to connect Proxmox to the router. This keeps the VLAN tags in packets intact for the routing you’ll need to do.

I previously used WikiJS, but since about a year ago I switched to Grav.

The really nice thing is not having an additional database anymore. It’s really just markdown pages, config files and php plugins.

By default it looks like a blogging platform, but with the learn2 theme it also works pretty well as a documentation website. The official docs are written using that theme.

I wasn’t completely happy with the defaults though so I did some modifications for my own wiki. Some limited knowledge in HTML, CSS is required and PHP or Javascript don’t hurt either.

You can find the theme, plugins and pages in my repo as well if you’d want to use any of it.