Forget AGI—Sam Altman celebrates ChatGPT finally following em dash formatting rules

Forget AGI—Sam Altman celebrates ChatGPT finally following em dash formatting rules

As an Amazon Associate I earn from qualifying purchases.

Woodworking Plans Banner



Next stop: superintelligence

Continuous battles with AI design instruction-following program that real human-level AI still a methods off.

Em dashes have actually become what lots of think to be a dead giveaway of AI-generated text over the previous couple of years. The punctuation mark appears often in outputs from ChatGPT and other AI chatbots, often to the point where readers think they can determine AI composing by its overuse alone– although individuals can overuse it, too.

On Thursday night, OpenAI CEO Sam Altman published on X that ChatGPT has actually begun following customized guidelines to prevent utilizing em dashes.”Small-but-happy win: If you inform ChatGPT not to utilize em-dashes in your customized directions, it lastly does what it’s expected to do!”he composed.

The post, which came 2 days after the release of OpenAI’s brand-new GPT-5.1 AI design, got blended responses from users who have actually struggled for many years with getting the chatbot to follow particular format choices. And this “little win” raises a huge concern: If the world’s most important AI business has actually had problem with managing something as basic as punctuation usage after years of attempting, possibly what individuals call synthetic basic intelligence (AGI) is further off than some in the market claim.

A screenshot of Sam Altman’s post about em dashes on X.


Credit: X

“The truth that it’s been 3 years considering that ChatGPT very first introduced, and you’ve only simply now handled to make it follow this basic requirement, states a lot about how little control you have more than it, and your understanding of its inner operations,”composed one X user in a reply. “Not a great indication for the future.”

While Altman likes to openly discuss AGI(a theoretical innovation equivalent to people in basic knowing capability), superintelligence (an ambiguous idea for AI that is far beyond human intelligence), and “magic intelligence in the sky” (his term for AI cloud computing?) while raising funds for OpenAI, it’s clear that we still do not have reputable expert system here today in the world.

Wait, what is an em dash anyhow, and why does it matter so much?

AI designs like em dashes due to the fact that we do

Unlike a hyphen, which is a brief punctuation mark utilized to link words or parts of words, that deals with a devoted secret on your keyboard (-), an em dash is a long dash signified by an unique character (–) that authors utilize to trigger parenthetical details, suggest an unexpected modification in idea, or present a summary or description.

Even before the age of AI language designs, some authors often complained the overuse of the em dash in contemporary writing. In a 2011 Slate post, author Noreen Malone argued that authors utilized the em dash “in lieu of correctly crafting sentences” which overreliance on it “dissuades genuinely effective writing.” Different Reddit threads published prior to ChatGPT’s launch included authors either battling over the rules of correct em dash usage or confessing to their regular usage as a guilty satisfaction.

In 2021, one author in the r/FanFiction subreddit composed, “For the longest time, I’ve been addicted to Em Dashes. They discover their method into every paragraph I compose. I like the crisp straight line that offers me the reason to push information or ideas into an otherwise organized paragraph. Even after returning to compose after like 2 years of author’s block, I instantly pack as lots of em dashes as I can.”

Due to the fact that of the propensity for AI chatbots to overuse them, detection tools and human readers have actually discovered to identify em dash usage as a pattern, developing an issue for the little subset of authors who naturally prefer the punctuation mark in their work. As an outcome, some reporters are grumbling that AI is “eliminating” the em dash.

Nobody understands exactly why LLMs tend to overuse em dashes. We’ve seen a large range of speculation online that tries to discuss the phenomenon, from seeing that em dashes were more popular in 19th-century books utilized as training information (according to a 2018 research study, rush usage in the English language peaked around 1860 before decreasing through the mid-20th century) or maybe AI designs obtained the routine from automated em-dash character conversion on the blogging website Medium.

Something we understand for sure is that LLMs tend to output regularly seen patterns in their training information (fed in throughout the preliminary training procedure) and from a subsequent support finding out procedure that typically depends on human choices. As an outcome, AI language designs feed you a sort of “ravelled” typical design of whatever you inquire to offer, moderated by whatever they are conditioned to produce through user feedback.

The most possible description is still that demands for professional-style composing from an AI design trained on large numbers of examples from the Internet will lean greatly towards the dominating design in the training information, where em dashes appear often in official writing, news posts, and editorial material. It’s likewise possible that throughout training through human feedback (called RLHF), actions with em dashes, for whatever factor, got greater scores. Possibly it’s since those outputs appeared more advanced or interesting to critics, however that’s simply speculation.

From em dashes to AGI?

To comprehend what Altman’s “win” truly indicates, and what it states about the roadway to AGI, we require to comprehend how ChatGPT’s customized guidelines in fact work. They permit users to set consistent choices that use throughout all discussions by adding composed directions to the timely that is fed into the design prior to the chat starts. Users can define tone, format, and design requirements without requiring to duplicate those demands by hand in every brand-new chat.

The function has not constantly worked dependably due to the fact that LLMs do not work dependably (even OpenAI and Anthropic easily confess this). An LLM takes an input and produces an output, spitting out a statistically possible extension of a timely (a system timely, the custom-made directions, and your chat history), and it does not actually “comprehend” what you are asking. With AI language design outputs, there is constantly some luck associated with getting them to do what you desire.

In our casual screening of GPT-5.1 with custom-made directions, ChatGPT did appear to follow our demand not to produce em dashes. In spite of Altman’s claim, the reaction from X users appears to reveal that experiences with the function continue to differ, at least when the demand is not put in custom-made directions.

If LLMs are analytical text-generation boxes, what does “guideline following” even imply? That’s crucial to unloading the theoretical course from LLMs to AGI. The idea of following guidelines for an LLM is essentially various from how we usually consider following guidelines as human beings with basic intelligence, and even a conventional computer system program.

In standard computing, direction following is deterministic. You inform a program “do not consist of character X,” and it will not consist of that character. The program performs guidelines precisely as composed. With LLMs, “guideline following” is actually about moving analytical possibilities. When you inform ChatGPT “do not utilize em dashes,” you’re not producing a difficult guideline. You’re including text to the timely that makes tokens related to em dashes less most likely to be picked throughout the generation procedure. “less most likely” isn’t “difficult.”

Every token the design produces is chosen from a likelihood circulation. Your customized direction affects that circulation, however it’s taking on the design’s training information (where em dashes appeared regularly in particular contexts) and whatever else in the timely. Unlike code with conditional reasoning, there’s no different system validating outputs versus your requirements. The guideline is simply more text that affects the analytical forecast procedure.

When Altman commemorates lastly getting GPT to prevent em dashes, he’s actually commemorating that OpenAI has actually tuned the most recent variation of GPT-5.1 (most likely through support knowing or fine-tuning) to weight customized guidelines more greatly in its likelihood computations.

There’s a paradox about control here: Given the probabilistic nature of the concern, there’s no assurance the problem will remain repaired. OpenAI constantly updates its designs behind the scenes, even within the very same variation number, changing outputs based upon user feedback and brand-new training runs. Each upgrade gets here with various output qualities that can reverse previous behavioral tuning, a phenomenon scientists call the “positioning tax.”

Specifically tuning a neural network’s habits is not yet a specific science. Considering that all ideas encoded in the network are adjoined by worths called weights, changing one habits can modify others in unexpected methods. Repair em dash overuse today, and tomorrow’s upgrade (focused on enhancing, state, coding abilities) may unintentionally bring them back, not due to the fact that OpenAI desires them there, however since that’s the nature of attempting to guide an analytical system with countless completing impacts.

This gets to a suggested concern we pointed out previously. If managing punctuation usage is still a battle that might pop back up at any time, how far are we from AGI? We can’t understand for sure, however it appears significantly most likely that it will not emerge from a big language design alone. That’s due to the fact that AGI, an innovation that would duplicate human basic knowing capability, would likely need real understanding and self-reflective deliberate action, not analytical pattern matching that often lines up with guidelines if you occur to get fortunate.

And speaking of getting fortunate, some users still aren’t having luck with managing em dash usage beyond the “custom-made guidelines” function. Upon being informed in-chat to not utilize em dashes within a chat, ChatGPT upgraded a conserved memory and responded to one X user, “Got it– I’ll stick strictly to brief hyphens from now on.”

Benj Edwards is Ars Technica’s Senior AI Reporter and creator of the website’s devoted AI beat in 2022. He’s likewise a tech historian with practically 20 years of experience. In his leisure time, he composes and tape-records music, gathers classic computer systems, and delights in nature. He resides in Raleigh, NC.

122 Comments

  1. Listing image for first story in Most Read: US spy satellites built by SpaceX send signals in the “wrong direction”

Find out more

As an Amazon Associate I earn from qualifying purchases.

You May Also Like

About the Author: tech