Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.
- 0 Posts
- 3 Comments
Joined 1 year ago
Cake day: June 15th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
You are limited by bandwidth not compute with llm, so accelerator won’t change the interferance tp/s
llama.cpp works on windows too (or any os for that matter), though linux will vive you better performances