Intermarkets' Privacy Policy
Support


Donate to Ace of Spades HQ!


Contact
Ace:
aceofspadeshq at gee mail.com
Buck:
buck.throckmorton at protonmail.com
CBD:
cbd at cutjibnewsletter.com
joe mannix:
mannix2024 at proton.me
MisHum:
petmorons at gee mail.com
J.J. Sefton:
sefton at cutjibnewsletter.com


Recent Entries
Absent Friends
Bandersnatch 2024
GnuBreed 2024
Captain Hate 2023
moon_over_vermont 2023
westminsterdogshow 2023
Ann Wilson(Empire1) 2022
Dave In Texas 2022
Jesse in D.C. 2022
OregonMuse 2022
redc1c4 2021
Tami 2021
Chavez the Hugo 2020
Ibguy 2020
Rickl 2019
Joffen 2014
AoSHQ Writers Group
A site for members of the Horde to post their stories seeking beta readers, editing help, brainstorming, and story ideas. Also to share links to potential publishing outlets, writing help sites, and videos posting tips to get published. Contact OrangeEnt for info:
maildrop62 at proton dot me
Cutting The Cord And Email Security
Moron Meet-Ups






















« Sunday Overnight Open Thread - December 22, 2024 [Doof] | Main | The Morning Report — 12/23/24 »
December 23, 2024

Daily Tech News 23 December 2024

Top Story

  • OpenAI's next generation model, GPT-5, is ahead of schedule and coming in under budget. (WSJ / MSN)

    Sorry, just kidding. GPT-5 is not working, may never work as planned, and each training run takes six months and costs half a billion dollars.
    OpenAI has conducted at least two large training runs, each of which entails months of crunching huge amounts of data, with the goal of making Orion smarter. Each time, new problems arose and the software fell short of the results researchers were hoping for, people close to the project say.
    Also there's the tiny problem that with GPT-4, OpenAI already looted the entire public internet. GPT-5 needs a lot more data for its training, and there isn't more data.
    OpenAI's solution was to create data from scratch.

    It is hiring people to write fresh software code or solve math problems for Orion to learn from. The workers, some of whom are software engineers and mathematicians, also share explanations for their work with Orion.

    But, you say, the internet contains all human knowledge. Won't trying to expand that significantly take a long time? Won't it cost a huge amount of money?

    Yes.
    The process is painfully slow. GPT-4 was trained on an estimated 13 trillion tokens. A thousand people writing 5,000 words a day would take months to produce a billion tokens.
    What about using AI to train your new AI?
    OpenAI also started developing what is called synthetic data, or data created by AI, to help train Orion. The feedback loop of AI creating data for AI can often cause malfunctions or result in nonsensical answers, research has shown.


    Scientists at OpenAI think they can avoid those problems by using data generated by another of its AI models, called o1, people familiar with the matter said.
    Scientists at OpenAI are paid to think that. They are paid a lot to think that.

    In short, your job is safe for now.


Tech News



Disclaimer: Mostly dead is still partly alive.
digg this
posted by Pixy Misa at 04:00 AM

| Access Comments




Recent Comments
AltonJackson: " JJ is nood ..."

callsign claymore: "Good morning JJ, Horde ..."

AltonJackson: " ESPONJA!!1!!1111!!! ..."

Hadrian the Seventh: " Biden gives life in prison to 37 of 40 federal d ..."

No One of Consequence: "88 I'm giving #1 son a domain name for Christmas. ..."

Thanatopsis: "Hola ..."

Village Idiot's Apprentice: "I see that Dylann Roof did not get his sentence co ..."

Mister Scott (Formerly GWS): "first. ..."

Arthur Carlson: "[i]"A terrifying video showed drones part of a Chr ..."

sock_rat_eez: "G'mornin' everyone! ..."

Ciampino but, but the governor said the subway us safe!: "A new video emerges of the lady who was set on fir ..."

vmom deport deport deport: "60 Per the NY Post: "Biden commutes death sente ..."

Recent Entries
Search


Polls! Polls! Polls!
Frequently Asked Questions
The (Almost) Complete Paul Anka Integrity Kick
Top Top Tens
Greatest Hitjobs

The Ace of Spades HQ Sex-for-Money Skankathon
A D&D Guide to the Democratic Candidates
Margaret Cho: Just Not Funny
More Margaret Cho Abuse
Margaret Cho: Still Not Funny
Iraqi Prisoner Claims He Was Raped... By Woman
Wonkette Announces "Morning Zoo" Format
John Kerry's "Plan" Causes Surrender of Moqtada al-Sadr's Militia
World Muslim Leaders Apologize for Nick Berg's Beheading
Michael Moore Goes on Lunchtime Manhattan Death-Spree
Milestone: Oliver Willis Posts 400th "Fake News Article" Referencing Britney Spears
Liberal Economists Rue a "New Decade of Greed"
Artificial Insouciance: Maureen Dowd's Word Processor Revolts Against Her Numbing Imbecility
Intelligence Officials Eye Blogs for Tips
They Done Found Us Out, Cletus: Intrepid Internet Detective Figures Out Our Master Plan
Shock: Josh Marshall Almost Mentions Sarin Discovery in Iraq
Leather-Clad Biker Freaks Terrorize Australian Town
When Clinton Was President, Torture Was Cool
What Wonkette Means When She Explains What Tina Brown Means
Wonkette's Stand-Up Act
Wankette HQ Gay-Rumors Du Jour
Here's What's Bugging Me: Goose and Slider
My Own Micah Wright Style Confession of Dishonesty
Outraged "Conservatives" React to the FMA
An On-Line Impression of Dennis Miller Having Sex with a Kodiak Bear
The Story the Rightwing Media Refuses to Report!
Our Lunch with David "Glengarry Glen Ross" Mamet
The House of Love: Paul Krugman
A Michael Moore Mystery (TM)
The Dowd-O-Matic!
Liberal Consistency and Other Myths
Kepler's Laws of Liberal Media Bias
John Kerry-- The Splunge! Candidate
"Divisive" Politics & "Attacks on Patriotism" (very long)
The Donkey ("The Raven" parody)
Powered by
Movable Type 2.64