1219. This week, we talk to Daniel Heuman and Chris Ryder from Intelligent Editing about the errors hiding in AI writing that looks flawless. We look at why it invents its own rules when you ask for Chicago or AP style, why it goes wrong in the middle of a document rather than at the ends, and why an AI that over-edits is harder to clean up than one that under-edits.
1219. This week, we talk to Daniel Heuman and Chris Ryder from Intelligent Editing about the errors hiding in AI writing that looks flawless. We look at why it invents its own rules when you ask for Chicago or AP style, why it goes wrong in the middle of a document rather than at the ends, and why an AI that over-edits is harder to clean up than one that under-edits.
Find Daniel and Chris on LinkedIn, and find more about their projects at Perfectit.com.
Save the date for Grammarpalooza — The Game Show: Thursday, September 24 at 5 p.m. PT / 8 p.m. ET.
A hearty thank-you to our Keepers of the Commas and one Immortal on Patreon. We appreciate your support!
🔗 Share your familect recording in Speakpipe or by leaving a voicemail at 833-214-GIRL (833-214-4475)
🔗 Watch my LinkedIn Learning writing courses.
🔗 Subscribe to the newsletter.
🔗 Find an edited transcript.
🔗 Get Grammar Girl books.
| HOST: Mignon Fogarty
| Grammar Girl is part of the Quick and Dirty Tips podcast network.
| Theme music by Catherine Rannus.
| Grammar Girl Social Media: YouTube. TikTok. Facebook. Threads. Instagram. LinkedIn. Mastodon. Bluesky.
[Computer-generated transcript]
Mignon Fogarty: Grammar Girl here. I'm Mignon Fogarty, and today I am here with Daniel Heuman and Chris Ryder from Intelligent Editing. Guys, welcome to the Grammar Girl Podcast.
Daniel Heuman: So good to be here. Thank you, Mignon.
Chris Ryder: Lovely to be here.
Mignon: You bet. Daniel, I've known you for years and I saw this great post you did on LinkedIn, which is why both of you are here today to talk about your work on um editing software products and sort of... You know, I like that you're so connected with the world of editors, so you stay. You know what is going on with editors so much that I always love talking with you. And you had this blog post about AI. And, you know, I think that we all, you know, recognize that raw AI writing style and a lot of people feel like they can pick it out. We don't like it. But I think of AI as producing pretty much mechanically perfect writing, so much so that, horrors, I see people talking about introducing errors to their writing to make it seem more human. Like, that's how much we all think it's, quote-unquote, "perfect." But your blog post pointed out that there are all sorts of ways in which it is not perfect, and it was sort of revelatory for me. So I would love to go through these errors that you have identified that it can still make.
Daniel: Amazing. Thank you. And first off, I feel really bad that I wrote the article in this commercial way. I was rereading it today, and it's selling our product, "PerfectIt." And I'm really grateful that you read past that and saw that underneath there was an important argument that we're trying to make. And I may have to go back and delete some of the commercial lines because I appreciate this.
Mignon: And I want to point out, like this is not a sponsor. We will talk about your products, but this is not a sponsored post or anything. I just think that your work is interesting. So let's talk about—first, one was US, UK spellings and inconsistencies.
Daniel: I mean, this one for me is always going to stand out because I can't do this at all, right? I am half British and half American. The accent for your more American audience is, you know, the best I can do to sound British, but I am 50/50, and my spelling is all over the place. I've spent time in the US, I've spent time in the UK, and I can't keep track of what is what. So I have spent more time thinking about those things, so I really notice if the AI produces that same mix that I'm afraid to say I produce. And it comes up especially because there is no true definition of what is UK English, what is US English. Someone has told the AI, "use a UK English set," so spell words like connection C-O-N-N-E-X-I-O-N, which is extremely rare in this country. Chris is a PhD in linguistics. He can maybe chime in on what could be my false impression. But my understanding is that if someone says, "Produce this in British English," you wouldn't normally do that. But if you want to do a list of words that are accepted that a spellcheck will not flag, well, that is an accepted British variation that you wouldn't see so often in the US. So it does these ... It doesn't do that all the time either. It'll do these things sometimes, and it really stands out when you start seeing these spellings that don't quite fit. It goes even more wrong when you hit Oxford spelling. I've not seen the AI yet that can get that right, that mix of we're going to have I-Z-E endings with UK spelling. Most people when they do British spelling do an I-S-E ending on things. So the variation that comes in all our language is, I suppose, reflected in the variation that the AI produces, but it's not consistent. It's not doing it in a way that makes sense with what we expect or what we instruct, and that's why it just strikes me every time why it was the number one on my list, why I really struggle with, yes, most of it does seem completely correct, but these certain elements jump out.
Mignon: And it'll go back and forth. It won't always be consistent, is that right?
Daniel: That's right. I mean, it more often when it's doing British spelling will do the I-S-E. But if you tell it to do Oxford spelling, I mean, it gets very confused. Oh, sorry, today, the 19th of August, as I say these words, it gets very confused. By the time this airs, it's quite possible that it will be fixed.
Mignon: It's changing really fast. Chris, you're the linguist who is doing work on all these software products at Intelligent Editing. Is British English versus American English a big challenge for you? How do you distinguish what that even means when you're trying to set down rules?
Chris: Yeah, it's not easy for the reasons Daniel said. You know, there are sort of these prescriptive rules of "this is British" and "this is American," but it's really not that simple. Like you say "connection" with an X, no one spells it with an X. "Jail" spelled G-A-O-L, I mean, unless you're writing a 19th century novel, no, it's J-A-I-L in British English as well. We all spell it that way. And so it really does depend a lot on usage, not these sort of prescriptive rules, and usage always changes. So it's not that easy to pin down. And then I also think as well, we're talking about UK and US spelling. Canadian spelling, I would say forget it, because it's such a hybrid anyway. I think Canadian users must have a terrible time trying to get AI to do what they want it to do.
Mignon: Yeah, absolutely. Okay, so the next problem you found was with table headings.
Daniel: I mean, no one gets these right. No one gets this right at all, so why would we expect an AI to do any better than we can? Well, you would expect it to do better because you think machines are programmed a certain way that they will be consistent. But large language models aren't programmed that way. That's not the mechanism behind modern AI. So it is not consistent when you get to things like table headings — not table headings, the top row of a table, the top column of a table. I guess we can call that the heading. The heading row as opposed to the heading label.
Mignon: Ah, yes.
Daniel: So when it does those, it's really hard for people to keep track of, "Well, this is a heading, am I capitalizing every term?" And similarly, it's one that the AI will just go wrong on. As I say it, I'm questioning my own words that I wrote in that article because it doesn't seem like it could be true, yet I wrote that because I was editing a lot of AI texts and I found these things that it was definitely getting wrong, and I can't explain that, but I certainly found it.
Mignon: They get it wrong because we get it wrong so often, and it's trained on human writing?
Daniel: I think it has to be something like that. If you train these models on an enormous amount of human writing, you're training them on an enormous amount of human errors, and people really struggle on that capitalization of table headings in different ways. So if we're not getting it right, and it's trained on this data that isn't right, how is it going to get it right? Is my understanding of how AI works. But it is remarkably strange.
Mignon: Yeah, I struggle with that too. I cleaned up a spreadsheet the other day, and I noticed that all my headings were erratic. Some were capitalized, some weren't. I couldn't decide what I wanted. Yeah, it's hard. It is hard. And what about—and I guess also the same is for title capitalization. You know, like "The Chicago Manual of Style" title capitalization rules are really complicated, and they change. And so I think you notice that not only is it not current, necessarily, when AI tries to write "The Chicago Manual of Style" headlines, essentially, it just — again, it also struggles as much as we do because those are complicated and ever-changing.
Daniel: I think that's the story. I can't speak for "The Chicago Manual," but it seems to me that one of the reasons why they might have changed their rules between the 17th and 18th edition is that the rules were really complicated. The rule that we learned in school for headings is the words that are less than three letters or four letters use lowercase, but that is not the actual rule, and I'm going to have to give way to Chris to fill us in on exactly how you break it down in terms of parts of speech, because I will struggle. But in Chicago 17th, I think words like "under" and "underneath" are treated the same way because they have the same meaning. Are we on prepositions here? I may just have made a fool of myself. But because, if that is a preposition, then it doesn't matter that it was long. Whereas Chicago 18th switched the rule so that when it's the short version, it can be lowercase, but the longer one is capitalized. I'm struggling. People struggle. The AI cannot, today, August 2026, cannot get it right. That notion of which would it follow anyway? Unless you specifically tell it exactly what rule we're following in exactly what way, then it may do better. But if you just tell it be consistent on title capitalization or follow "The Chicago Manual of Style" rules on title capitalization, it will really struggle.
Mignon: Yeah, and this is something—one of the other problems you found is that it just can't follow Chicago style or AP style. And, you know, I made a little video for the Associated Press. It might not be out yet by the time this airs, but again, I had noticed that you cannot say to it, "Put this in AP style," because the "AP Stylebook" is behind a paywall. The AI at least shouldn't be able to access that. And same with Chicago, same with anything that's behind a paywall. It should not have that in its training data. So if you say, "Follow this style," it's going to go out and grab what it can find about that. There are blog posts about it. My website has blog posts about it. But some of them go back to 2005, for example, and styles change. So it might have the old version. It might just make something up if it's not there at all. So that was—
Daniel: That's the funniest one to me. That one cracks me up every time, and it's absolutely true. The notion that you give it an instruction and because it thinks it's following a rule, and a rule is important—I don't know why it does it, but it decides to make up its own rules. And to make it even harder, if you're editing a document, it's very rare that it would do that at the beginning. It's very rare that it will do that at the end. But the way its context works means that right in the middle, as you're just stopping paying attention, as you think it's got it, is when it will start making up its own rules and things like that.
Mignon: That's so interesting. So it's more likely to be wrong in the middle of a document? Fascinating. Okay. And then the last one is erratic hyphenation. When I give webinars about style, the most questions I always get are about hyphens, like, "What do I do about this hyphen? What do I do about that hyphen?" And it sounds like AI struggles with hyphens, again, just as much as we do.
Daniel: Again, I was reading back over the article just before this session, and I couldn't believe that I'd written that. It's so surprising to me that it would be inconsistent on hyphenation, and yet I know I wrote that because I was editing AI after AI after AI and clearly was finding the mistake. It doesn't seem like the kind of thing a machine would get wrong, and yet it can. It's particularly made worse when it's not just the machine, right? Workflow is not usually "let the AI do it for me." It might be “I've done a piece that the AI then edits.” It might be that “the AI does something, then a person does something, then it goes to a third person.” What you get is a complete mixing of styles. A mistake that starts with the AI can be compounded by a person, corrected by a person. There might be no mistake in it, and then a person writes their own way and writes something inconsistently. So absolutely it's easy for us to sit here and go, "I don't understand why the AI is doing this." But in real life, what happens is more complicated. It's that we've got a workflow that involves multiple documents, people mixing with AI, and where exactly the mistake comes in or where the inconsistency comes in—because it's not a mistake, it's an inconsistency—is really hard to trace. What we do know is that there's no reason why a person would write the exact same thing the way the AI does, especially if it's a gray area in English. So that's why I think we see the mistake. As I read back on it, I want to attribute that error to a person because it makes no sense to me that the AI on its own would do it, but yet, I've watched it, witnessed it, and tried editing it, and absolutely these slightly obscure, very difficult mistakes are where the AI seems to go wrong today.
Mignon: Yeah. I mean, I think that we've grown up thinking about computers in a certain way, that they are very rules-based, and we're having to change the way we think about it because these systems aren't the same. They aren't based on programmed-in rules. They're more probabilistic, and it's really a whole new way of thinking about what computers are doing for us. Um.
Daniel: Precisely. It goes back to your previous question, because the notion of telling it to follow a rule is what it can't do. The thing that makes large language models so incredible is this generative capability. They will not produce the same thing twice. But if you want it to follow a rule—that's kind of the definition of a rule, right?—you want it to follow the same thing twice, and it won't.
Mignon: And Chris, you had said that you had noticed other mistakes that only AI can do, not the kind where it's doing the same kind of mistakes that we do, but mistakes that sort of only it does. What were some of those that you saw?
Chris: Yeah, there's been a couple of bizarre things. The main one off the top of my head that really blew my mind was I was happily chatting to AI, and it was giving me a nice long response, and then there was just one single word in the middle of a sentence—I can't remember the word—just one word in Russian. I don't know why that was. And I've seen it a couple of times. Arabic sometimes as well. Just a single word in the middle of an English sentence, and I just don't know why it does that when it's probabilistic, why it thinks a Russian word is going to occur in the middle of this English sentence. But yeah, I just thought that no human would ever do that. You would just never make that mistake. So it's a dead giveaway that it's AI, and just a very bizarre thing.
Mignon: I've seen that too. I've seen Chinese.
Chris: Yes.
Mignon: Yeah. And I guess those are better because they jump right out at you, right? They're not the kind of thing that you're going to miss when you're reviewing a document, so maybe they aren't quite as dangerous in some ways as inconsistent hyphenation. Gosh, I don’t even know.
Daniel: It's a really hard one. We can't even say it right, never mind write it correctly. There’s no chance.
Mignon: Yeah. So given that the text that comes out, when it doesn't have Russian or Chinese inserted into it, it comes out looking really polished and perfect, I think. You know, I had a friend who got a job at this new company, and she said at first, "I was so impressed that all the young people at this business wrote so much better than I'm used to. I was really impressed." And then she realized they were all using AI, and it just came out looking really polished, but it had problems underneath. So it comes out looking, at first glance, really great, and then it has all these problems with it. So what does that mean for the editors especially? Your products serve editors, and you're really tied into the world of editors, so that's kind of what we're talking about today. So what does this mean for editors that things look so perfect but maybe aren't?
Daniel: I don't know what you've seen, Mignon, but I see complaint after complaint after complaint. The one that I always go back to was an editor who wrote, "If you really want to pay me to fix the mistakes that an AI makes, then I will take your money, but I would much rather work with people." And I think that really sort of epitomizes it. It's a very difficult edit to do, working past the kind of things we're all used to doing and then having to check whether a document is coherent in entirely different ways.
To have to look for those kind of mistakes is a completely different way of thinking about your edit, and I just think that's a great deal harder on top of the normal mistakes that it can make. And then there's an entire extra layer to that because it's not just that an editor is working with an author who is using AI. Sometimes an editor is working after a document has been edited with AI, or an editor's using an AI to edit. But that's where a whole separate category of mistakes can come in because probably the majority of the complaints I see editors make online, aside from all of the issues about copyright, is that the AI will over-edit things, right? If they have to go in and fix a mistake that an AI introduced, that is a much much harder thing to do than working with a person who makes an error. You have to kind of undo what was there or see past what is written. When you're an editor, there are so many amazing things about the editing community, but one is that sort of humble approach that most editors take. The cliché of an editor is them just sitting with a red pen and fixing things. It's not true at all, right? The reality is editors are really humble and try not to change an author's word and to respect what's on the page. But how do you respect what's on the page if you're dealing with an AI introducing errors that have already diminished the author's work? That is really tough, and I don't know that people have got an answer to that even.
Mignon: Chris, from the standpoint of a linguist, is there a way… do you think of the editing that people have to do on AI work, from a language perspective, how is it different from the work that people are doing on just purely human-written work?
Chris: Yeah, I think there probably is a difference because like you say, it appears so polished. I think this is a point you make in the article, Daniel, that when it's human-written, you know when you're looking at a first draft or a rough draft, and so you know that you're looking for certain things. When you sort of get the AI thing, it's so polished, it lulls you into a false sense of security, I guess. So you're maybe not as alert. You think, "Oh, okay, this job has already been done. I don't need to look for these things." But you sort of do. You sort of need to be as alert as if it's a human-written thing and a rough draft, but it doesn't put you in that mindset, you know?
Mignon: Yeah. I mean, I'm thinking about parts of linguistics are about the cues we get from things that are there, the intentionality or the implication behind writing that we know was written by a human. Like if it's written a certain way, there must be a reason it was written that way, what the author intends, for example, and you can't necessarily rely on that when you're reading something that's machine-generated.
Chris: Yeah, and I think there's an issue maybe with ambiguities, where the human might read it and they know that they mean this thing rather than that thing, but the AI could misinterpret that, change the meaning, and then it goes off to a new author or a new editor who doesn't know that this has been changed, and then nobody spots the error.
Mignon: Yeah, so now we're going to take what will probably be an unexpected shift in the conversation because we've been sort of trashing AI for the last 20 minutes, and now we're going to say, Daniel, your company is producing an AI editing product. So tell us about First Edit.
Daniel: Fortunately, it's not a complete shift in the conversation because First Edit tries to pick up on some of these problems. We start from a premise that we occupy a really special place in the editing community in the world. For 95, 99% of the population, feeding a document to an AI and telling it to edit it might be right. Our audience is not that group. Our people who come to us are looking for the absolute highest, best possible version of a document. And because of that, we need to find a way to pick up on these mistakes that an AI is making or provide tooling that enables our audience to hit that highest level. That was the idea behind First Edit. It's like, okay, if we know that the audience wants to hit that very, very top level, what would that look like in theory? And the next thing I say is going to sound probably so obvious to you, Mignon, but I don't think you will have heard it before, but it's this: if you want to hit that highest level and you want to have an automated editing function, so where the AI does something without human checking, the AI must work before the human works. I know it's kind of obvious and so plain, but when you break that down, that's not what everyone else is saying. People are saying, "Oh, you replace a human being with an edit, or you run this AI at the end just to make sure." No, the very best result will come definitely if the automated function is first and then the human being is working. That's how you've got to get around that.
Mignon: I actually got a little shiver when you said, like, have AI go last. No, that would be very bad.
Daniel: Right? But if you think about agentic workflows and things like that, that's how they're running. It must be a person at the end who is checking things if you want to get the very best result.
Mignon: Right. So First Edit is the name is pretty descriptive. It's a first pass that people run a document through to get sort of, you catch the big errors, and then you go back and do the more fine-tuning?
Daniel: Sort of, but yeah, the name speaks for itself. It is that idea of a first pass. And then what sort of followed for us is that if you're going to do a first pass like that, and you know these errors that machines make, the first pass should never over-edit, right? The two mistakes are not equal. If an AI under-edits, you've still got the human at the end who's going to find mistakes. If the AI over-edits, you've just made the job harder for that person at the end. And as we really just discussed, that is the hardest kind of error for a person to deal with if the AI has introduced it and the AI is wrong, and somehow they need to trace it back and figure out where this has gone wrong and why—that's really difficult. But if the AI leaves something, then you're no worse off, right? You had a human doing it to begin with, and the AI has maybe done half, or maybe it's done three-quarters, or maybe it's done a quarter, whatever it is, it has not done the full thing. It's done an under-edit, never an over-edit. And that's where I think we've found a—hopefully, we haven't released this product yet, but hopefully got a very different place in the market that is not what everyone else is doing. Because no one… sorry 99% of the population does not want to buy a tool that under-edits. By its design, that sounds like a terrible product, and who would want to have anything to do with this? Well, the only people that would want this are the people following a workflow that actually gets to the very best, but it does so by having a person at the end.
Mignon: That's funny. And as an editor, as I was reading about it, the thing that also seemed very important to me is that it's using tracked changes so you can see every change it has made.
Daniel: Yeah, absolutely. I think that is becoming more common. We've gone through three years now, coming up to four of ChatGPT and all these other models. Doing things without track changes is just a complete non-starter. I think if you use different versions now, there are ways to get tracked changes. But certainly if you want to hit that very best version, you have to be able to see what the tool has done, even if it's just to gain the confidence that it's not over-editing. You must be able to go back and look and see and do an audit log, because otherwise you can't get to that point. You run the risk of the AI introducing mistakes, which is never going to be the best version.
Mignon: Well, thank you. This is so interesting. I mean, there's just so many new things for editors to consider about what we're dealing with in the text that we're receiving from writers and how our workflows are working, and just changing the way we think about what computer products are and what they do. There's just really so much to think about. And the other thing is it's changing so fast. I'm sure this is an episode I will never rerun because it'll be obsolete in six months, but it's a fascinating conversation, and I really appreciate you being here today to sort of talk us through these new ideas.
Daniel: Thank you. I hope that it's interesting. We have gone way, way deep on some extreme language geekery, but I love that you make that possible.
Mignon: Thank you. And for the, for our Grammarpaloozians, our wonderful supporters over on Patreon, we have a bonus segment like we always do with our guests. We're going to talk about two free tools that the company puts out, Intelligent Editing: StyleWorks, and a book called "Brave New Words" filled with puns, very fun. We're going to talk about those and get both Daniel and Chris's book recommendations in the bonus segment. For the rest of you, that's all. Thanks for listening.