Ace: aceofspadeshq at gee mail.com
Buck: buck.throckmorton at protonmail.com
CBD: cbd at cutjibnewsletter.com
joe mannix: mannix2024 at proton.me
MisHum: petmorons at gee mail.com
J.J. Sefton: sefton at cutjibnewsletter.com
A site for members of the Horde to post their stories seeking beta readers, editing help, brainstorming, and story ideas. Also to share links to potential publishing outlets, writing help sites, and videos posting tips to get published.
Contact OrangeEnt for info: maildrop62 at proton dot me
Which... Well, so what? You can download it. Countless thousands of people have. I have. Anyone who wanted to put in the effort to pick it apart could have done so.
Anthropic left a debug option set it one release and that made all the source files visible, but that just made it easier.
The real brains - Anthropic's AI models like Sonnet and Opus - run safely on their servers and haven't leaked anywhere.
Because the 1.7 billion parameter model runs in 240MB of memory - yes, M, not G - and churns through 130 tokens per second on an iPhone 17.
Which uses noticeably less power than a rack full of high-end graphics cards.
Bonsai 8B uses 1.15GB of RAM.
While it doesn't lead in test scores, it's being tested against 16GB models, which require an entirely different class of hardware. It would be interesting to see how a 70 billion parameter model would perform on the same tests if it's possible to perform the same trick - quantising the model down from half-precision (16 bits) per parameter to 1 bit with error correction.
The interesting part is that this will be manufactured at the Rapidus plant in Hokkaido. With Rapidus ramping up production Japan has leapt directly from 40nm chip fabrication to 2nm, largely catching up with Taiwan, Korea, and the United States, and leaving China trailing behind.
Just two problems: First, it costs $1899, and the Minisforum model I bought around Christmas cost about $600. Sure, the integrated graphics on that model are a lot slower than Panther Lake, but not that much slower. (This site suggests the difference is around 25%.)
Second, it's out of stock.
Musical Interlude
Disclaimer: Musical interlude has been replaced with potato salad at the last minute and at great expense.