Ace: aceofspadeshq at gee mail.com
Buck: buck.throckmorton at protonmail.com
CBD: cbd at cutjibnewsletter.com
joe mannix: mannix2024 at proton.me
MisHum: petmorons at gee mail.com
J.J. Sefton: sefton at cutjibnewsletter.com
A site for members of the Horde to post their stories seeking beta readers, editing help, brainstorming, and story ideas. Also to share links to potential publishing outlets, writing help sites, and videos posting tips to get published.
Contact OrangeEnt for info: maildrop62 at proton dot me
For everyday tasks they make no difference, and for gaming the money is far better spent on a AMD Ryzen X3D CPU, or if you have an Intel system, on wishing you had an AMD system. The expanded cache on AMD's X3D CPUs makes memory speed largely irrelevant for most users, even gamers intent on wringing every last drop of performance out of their systems.
Intel will be shipping its own X3D equivalent later this year with its Nova Lake processors, which include up to 288MB of cache, though most users will do fine with half that much.
Native Qwen 27B uses 16-bit floating point, so it needs 54GB of VRAM to run unrestricted. And 54GB of VRAM is quite expensive in the current market.
What the Bonsai process does is to prune it down to ternary or binary with scaling factors per group. In ternary form it fits in 5.9GB of VRAM, while retaining more than 90% of the capabilities of the full model.