I tried to organize vocab by difficulty level for an English language-learning app once.
It shocked me how there is absolutely no "right" answer.
If you are teaching English for travel, then you're prioritizing a lot of stuff around bathrooms, transportation, menu items, etc.
If it's for understanding TV, it's a lot of words like "murder", etc. Depending on which TV shows you want to understand.
If it's for reading the newspaper, you don't ever need to know "bathroom", but you sure do need to know words like "congressman".
While if you are living somewhere, it's really important to know a lot of basic supermarket items that you wouldn't prioritize for other usages.
Also, while it's easy to calculate word frequencies for stuff like newspaper articles, there aren't any good statistics (last I checked) around just normal everyday conversation. Because that stuff isn't getting recorded and transcribed. And the substitutes -- transcribed speech from TV, radio, podcasts, etc. -- is not the same context as the random stuff you say at home and during an average day.
> Also, while it's easy to calculate word frequencies for stuff like newspaper articles, there aren't any good statistics (last I checked) around just normal everyday conversation. Because that stuff isn't getting recorded and transcribed.
Linguists have resorted to spying on people in parks and shops and restaurants, to get "natural" language unperturbed by observer effects, audience tailoring, the filter of writing, etc. (In most cases that would not be considered ethical today!)
The gold standard is something like: get acculturated to the language community you wish to study, make some acquaintances and friends, somehow finagle an invite to their homes or workplaces or social venues, and then with their permission, record their conversations as unobtrusively as you can.
There is so little data on how language is really used it is quite bedevilling. As soon as people know you are listening they change how they speak.
> Linguists have resorted to spying on people in parks and shops and restaurants, to get "natural" language unperturbed by observer effects, audience tailoring, the filter of writing, etc.
Hence the common phrase, found in most language phrasebooks: “is that a linguist hiding behind that bush?”
That’s what makes ethnolinguistics fascinating. As a native French speaker, I started getting interested by linguistics when I learned Italian, and now I keep noting things I never thought about when I talk with other native French speakers. As someone said, “You don’t know your language until you know another one”.
There is also a whole different language used to talk to toddlers and small children that native speakers know but very few adult learners ever pick up. And slang used among teenagers and young adults that often times not even their parents understand fully.
The problem with adding slang to any organised education program is two-fold: some of it changes much more quickly than you course materials can, and much of it is quite localised.
Beware though that only learning words may leave you confused as in my experience Americans tend to overload the same word with a different meaning depending on the context. They also often resort to idioms and cultural references.
For reasons unknown to me, instead of using the word with the meaning they probably are trying to convey, they rather use vague analogies or metaphors.
It always made me question if Americans in contrast to the British are a bit afraid to be precise.
When I started dating someone whose second language was English, I found that the idioms were a giant hurdle. We really do speak in idioms and metaphors and this makes it very difficult for people who understand the words but not the cultural context. While my (now spouse) adapted, I also adapted by learning how to speak far more literally, especially around people of mixed levels of English.
I don't think there is a fear of being imprecise. If anything, it is a fear of speaking plainly as boring.
> Americans tend to overload the same word with a different meaning depending on the context. They also often resort to idioms and cultural references.
This is not specific to "Americans". Learn any language and you will have the same impression, and experience the same gulf between textbook usage and everyday usage.
Interesting perspective, I'm used to seeing the exact opposite observation, that British people are famous for saying things meant as insults that sound positive at a surface level and that people are often unsure if they're being mocked/ridiculed or not.
Of course, American corporate-speak is unique from normal conversations, and people intentionally use vagueness to make sure there's general agreement before saying something concretely that might be contentious or cause problems.
Different context. One social register is extreme understatement, which may be laden with passive aggression, but could also be approving. "That's not a bad idea" is likely to mean "Good idea, let's do it, or at least consider it seriously." But "Interesting idea" is likely to mean "You're an idiot."
This is more corporate/middle class.
There's also a working class register which is very direct and sweary, and extreme insults are actually meant affectionately.
Even more confusingly, the two can overlap, and the same people will switch between them - sometimes in the same setting - with relative equals.
Americans don't seem to do understatement. "My business died" becomes "My incredible journey." Relationships are cross-bred with hustle, so you can be friends with someone and they'll ask you to invest in their MLM scheme.
Instead of using understatement US corporate speaks uses noise to act out hierarchy, to gaslight and to misdirect.
I was talking to someone today who was asked to produce a report. They sent it on time, and then the team lead called a meeting to ask why it hadn't arrived.
The report was literally sitting in their inbox unread. Everyone could see it, but they all went through the motions of pretending it wasn't there and developing an action plan for future delivery.
It's all very David Graeber. So far as I can tell the US seems to specialise in situations where corporate insanity is happening but the sharp edges have been filed off, so it looks like productive activity higher up the pyramid.
Seems like an extremely reductive and negative take on what is "American". Perhaps you've only experienced America via LinkedIn and a specific shitty company?
Brits say this all the time because they assume we talk like people in movies and interviews do (or they interpret corporate-speak as how Americans actually talk). We use understatement plenty. In fact, the "interesting idea" understatement? I wouldn't even clock it as British because we use that in the US, too. I would say it is a classic example we use here of how you politely call an idea stupid. "Hm, interesting." We don't usually say "that's a stupid idea." That would be extremely rude.
I encounter this same attitude vis a vis Brits and sarcasm. "Oh, Americans don't get sarcasm." We absolutely do get sarcasm (insert claim Brits are being sarcastic when they say we don't get it). Britain is not special in this regard. It boggles the mind why Brits think we don't understand it. The languages are not so far gone.
I tell ya what, "understatement of the year" was not a phrase coined to describe something a Brit said.
I would go so far as to say that the hedges famous to American English opinion sharing is an example of understatement. "I feel like XYZ" is an Americanism, and it's understatement to the point of re-catorizing a fact as an opinion in order to soften your speech.
I can't tell you the number of times I've heard a Texan describe extremely hot weather as "a bit warm."
Examples abound.
(We also bust balls with our friends, and it lines up with class the same way you describe, including code switching between two registers.)
> They sent it on time, and then the team lead called a meeting to ask why it hadn't arrived. The report was literally sitting in their inbox unread. Everyone could see it, but they all went through the motions of pretending it wasn't there and developing an action plan for future delivery.
I always hear a phase that goes like “we have a word for it in Language, …”. You almost never hear it said where English is that language. We just don’t have many words or don’t like adding new ones very frequently, it seems.
> you almost never hear it said where English is that language
I'm willing to bet it's a combination of two factors:
1. you are consuming these things in English, and English natives are less likely to say "English has this word that those other people don't" because they fully understand English so it doesn't seem inscrutable, but some other language is kind of "magical an mysterious" to them. See, e.g., the urban legend that the Chinese word for crisis is "danger" and "opportunity." https://en.wikipedia.org/wiki/Chinese_word_for_crisis There's a whole cottage industry around "that foreign language is so cool compared to English"
2. "this language can say X but another language cannot" is invariably wrong
I wonder if despite our large vocabulary, English speakers tend to use a small subsection of it because there are so many non-native speakers. It seems to me from reading and watching people from decades ago that the language was more complex. (I don't mean this as any knock on people who speak English as a second language.)
We don't use most of them because no one could learn them all. There's more than 100,000 hanzi recorded in Chinese. Some quick googling suggests educated Chinese people know 8,000, and the average Chinese person knows around 3,500.
So 3–8%.
Nothing to do with pretention and everything to do with impossibility :D
English tends to just borrow/steal words from other languages if they're useful enough. It could also be something to do with the lack of consistency of english rules so it's not so easy to create new words.
I think a lot about this. It's funny how there are certain domains of language, familiar to all native speakers, but that you are simply not likely to learn as an adult language learner, at least not without diligent and focused study.
I live and work in a foreign country, and have a modest but functional grasp of the language here. Which is to say, I know how to say 'sustainability', 'union-negotiated collective agreement', and 'offensive conduct in the workplace'.... but if you asked me the words for 'cedar', 'robin', 'pond', or 'linen' I would be struck dumb. And yet presumably every ten year old I walk past in the street would know those words as comfortably as I knew them in English as a ten year old in England.
It's kinda funny. My life switched to English when I was around 18 and, while my family still speaks my native language exclusively, everything I've learned since then I don't know how to say it in my native language.
Just earlier I was talking to them, trying to say "when life gives you lemons" and being unable to find an equivalent phrase. I hope they understood my lemons reference regardless.
Words like cedar/robin/linen come from either the physical or cultral environment that I (as a Chinese) wasn't exposed to when I was a child. Cedar and robin are all species native to Europe, and I guess they also appear in many Western fairy tales or historical stories.
Also, both because of the familiarity and how English form words, English assign very specific non-compound words to them (rather than "xxx tree/bird"), making it more difficult for people from a completely different language family to learn them.
But of course this is not only English. In Chinese a child is taught to act 孝 (filial piety, respect and obedience to parents) and know how your uncles 舅 (mother's brother) 伯 (father's elder brother) 叔 (father's younger brother) relate to your parents. I'm sure it's OK for a foreign learner not to master them.
Cedars, fwiw, are not found in most of Europe either. Small parts of the Mediterranean (also parts of the Himalayas, bizarrely; closer than you think!)
They likely show up in Western works a lot because they’re mentioned in the bible a good bit.
> if you asked me the words for 'cedar', 'robin', 'pond', or 'linen' I would be struck dumb. And yet presumably every ten year old I walk past in the street would know those words as comfortably as I knew them in English as a ten year old in England.
Indeed. I'm American but my family has spoken German in the USA uninterrupted for 200 years. I speak German with my kids. But there's a children's song called Alle Vögel sind schon da and another called die Vogelhochzeit that I listen to with my kids, and it's just a litany of bird species I do not know but, being in a kid's song, I assume means they are common words for German kids.
When I look them up, the English words are ones I've heard and know from context are birds, but I couldn't tell you what they are like, and I would never use the word in English when asked about birds. My go-tos would be mockingbird, cardinal, hummingbird...ones I see in my backyard and have seen my entire life.
When you're a foreigner learning a language your experience is mostly from reading. There are words, however, that are much more common at home and in spoken language. So you'll probably never learn the words that a 10 year old kid knows.
One subtle issue in learning words from reading is that with languages like English where there's ambiguity in how to pronounce a given spelling, sometimes you might not guess the correct pronunciation for words you learned. This isn't specific to learning non-native languages either; growing up I read a lot and learned most of my advanced vocabulary that way, so as a teenager I would often find out that I didn't pronounce a word correctly because I had only ever seen it written down before.
There's a quote I've come across before, never make fun of someone mispronouncing a word in English, because it's a sign they are a reader.
I was in my 30s when I learned "ennui" was pronounced "on wee" rather than N-U-I. I did not know it was from French. No shame. I never spoke the word aloud, but used it in writing. A teenager I knew was studying for a vocab test and had to learn the word, and I overheard him flash carding. Pronounced it "on-wee" and my brain exploded.
I started learning english around 1984, when I began to learn programming. Back then most books were, by very far, in english. I also spent some time in the US (about one year altogether).
Copying lyrics from my favorite songs of the 80s was helpful. And then later on TV series and movies in english.
I've watched Friends, HIMYM and Californication* more than once (it's probably the reason I swear so much) and those really helped.
Now I raised my kid in english: from the beginning she was only ever allowed to watch TV shows in english. And she's always been to international schools, in english too.
The other day she taught me a simply word which, surprisingly enough, I didn't know: a "coaster" (a drink coaster).
My absolute favorite is when she uses english grammar and applies it to french: the rules about where adjectives do go vary between french and english and she regularly messes it up in french (supposedly her "native" language but at this point I wonder whether english ain't a first language, and french second).
And one thing she has that I'll never have is a beautiful, proper, english accent. Mine shall forever be a strong french one.
My wife kept up her english via friends. And I am always surprised how much US cultural exports help people learn the language.
A French accent in English is easy to mock but it actually sounds pretty good. My American accent in Spanish sounds atrocious and sadly our bilingual kids have pretty American accents too. But honestly who cares?
Speaking another language is the best effort I have ever made (I am lucky not to do it out of necessity). Totally changed my world view and how I think, speak, read and dream. Though please do not make me listen to a recording of my own voice…
It is changing. A bulk of learners now get their vocabularies from youtube, netflix and podcasts. Watching kids shows is common recommendation (I disagree with it somewhat, but that does not make it not common), so I think people will learn also those 10 years old world words.
After years of reading technical and scientific materials, listening to lectures and youtube tutorials and learning English exclusively through them I hit a wall when I watched a cooking youtube video for the first time.
I was pretty confident in my English but I couldn't understand half of the sentences since I didn't know any of the vocabulary related to cooking. From tools (spatula) to ingredients (parsley) or even actions (frying). My delusions of proficiency shattered as I found out my everyday vocabulary is smaller than an elementary schooler.
Working with ESL people makes it clear that grammar isn't so important. One of my friends would say, instead of "go shopping", would say "make some shoppings". Instead of "it's time to go", he'd say "time for go". All words that started with 's' were pronounced 'ehs', as in "gas ehstation".
The other people at work soon picked those lines up, and we used them regularly amongst ourselves. I still use them decades later!
> This is good news - you can be proficient in a foreign language by learning only 2,000 words!
Depends what you mean by "proficient". I currently know ~6k Spanish words and would hesitate to self-apply that word. Others might, but damn languages are hard.
Please someone tell me where to get those 1 million words in decreasing order of difficulty or ascending order of usage along with their meanings and insinuations
I tried to teach 'magicE vocab', sorting them by difficulty level for an English language plan, and got them easily arranged. For example, sham/shame and slide/slid are for hard to learn level, while ate, pale, kite, are for the easy level.
> While if you are living somewhere, it's really important to know a lot of basic supermarket items that you wouldn't prioritize for other usages.
Why? Having spent a good amount of time living in Shanghai, I found it important to be able to understand menus. But there's no pressure to know the words for supermarket items; you can just go to the supermarket and look for the item.
Otherwise your point is correct; all semantic words are equally difficult and which ones you know depends on the things you like to talk about. Grammatical words are more difficult, and more important, but this is so widely understood that language-learning material already treats them as an entirely separate class of things to learn.
> Also, while it's easy to calculate word frequencies for stuff like newspaper articles, there aren't any good statistics (last I checked) around just normal everyday conversation. Because that stuff isn't getting recorded and transcribed.
(1) You seem to want COCA, which includes a bunch of transcribed telephone calls.
(2) Word frequencies are still the wrong concept. If you want to understand a particular document, you need to understand almost all of the words that appear in that document. (You'll be able to learn some of them from their use in the document.) If you decide to learn a list of "frequent" words, you're unlikely to be able to understand more than a couple of isolated sentences in any given document.
> The “Social-Communicative” level barely changed in size. But nearly a quarter of the words in the 1953 list are gone, and 39% of the 2023 words are new. Humble, loyalty, fellowship, generous, polite, and companionship gave way to community, identity, organization, ethnic, gender, and narrative. ...It offers fewer words for the people directly around you, but more for belonging at a distance.
I would blame inequality on this one. In a more unequal world tribalization is a survival strategy and language follows.
When you see everybody else as your equals then focusing on describing that individual person, instead of their group, makes more sense.
Economic inequality affects deeply how we think about others.
I don't follow your reasoning at all. It's a shift and what people talk about and write about. It can't be anything more than that, by construction.
What I see is shifting from a focus on individuals and close personal relationships to a focus on the functioning of society and, well, identity.
It seems like a swing of the pendulum to me. Encouraging people to create their own identities, creating vocabulary to describe one's identity, and advocating for a restructuring around society that is relatively collectivized economically, but culturally celebrates individual diversity. I'm not a professional historian, but I think that's somewhat of a new phenomenon historically.
And it's clearly a reaction to the perception that the ideals of equality and being uniformly kind to each other we're not enough to bring about a just and equitable society, and if anything were abused in order to suppress diversity. We still have to be kind to each other at a basic level, but it's not enough anymore.
So maybe now there's too much focus on that stuff and not enough focus on the part where you should actually just be nice to your neighbors and be humble and all that. Or, maybe people are disproportionately writing about it, because it's a new thing, and a lot of people know a lot to say about it, and a lot of people want to talk about it.
I don't think it makes a shred of sense to conclude that somehow the world is now more equal than it was in the 50s. It's disappointingly far from equal, though, and I think the change in lexicon is a change in people's focus specifically because the old system clearly wasn't working, and people are eager to try something different.
From 1945 to 1980 inequality was the lowest in the USA. From 1980 onward economic inequality exploded. I understand that you cannot follow my point without this important piece of information.
When I was in high school at a private school, I was surrounded by students who were religious but didn’t have much curiosity. I got into a debate with basically my whole class about how languages shift and change over time, and everyone was saying that languages stay the same and that they were all determined at the Tower of Babel.
I used the examples of Latin to Spanish and English, or Old English to new English.
I say that to say, languages changing over time is to some people not actually something they believe happens. The facts are right there in front of you, but some people cannot have their minds changed no matter how much sense you make.
Here’s one verse from the Bible itself that shows that language changed: 1 Samuel 9:9:
> (Formerly in Israel, when a man went to inquire of God, he said, “Come, let us go to the seer”; for he who is now called a prophet was formerly called a seer.)
I love that one because it translates so well into English because we also have an older and a newer word for close enough to the same thing. Though when saying older and newer I should note that the words “prophet” and “seer” have been used consistently since the very first English translation, Wycliffe’s in ~1382. Maybe it’s more the feel of the words. (In Bible Gateway’s catalogue of English translations, only the CEV doesn’t use both of those words: <https://www.biblegateway.com/verse/en/1sam9.9>; I disqualify OJB as not English.)
That’s the only one I can think of off the top of my head that’s specifically about language, but there are plenty of others about changed customs over time, in Old and New Testaments.
Arguably the CEV version is clearer, because approximately no-one knows the difference between ‘prophet’ and ‘seer’ in English (a seer is a practitioner of divination). I’m assuming that the distinction was similar in the original (ie that the original didn’t just use two words for the same thing).
There's a very easy way out for them: Just claim that the bible is rather metaphorical than literal, and many things can be interpreted to be in line with scientific findings. That seems to be at least what protestant churches in Europe seem to do.
Easy for you to say, but who says they're looking for a way out? It's often easier to find a reason to stay where you are, and easiest to not even need one.
And animals have evolved perceptibly in my lifetime, they still don't believe in evolution. I grew up in a culture of Jesus Freaks. The way they place faith above evidence and logic is so disturbing and irritating to me
I tried to build a similar list myself for German and it's not easy as just taking a lot of content and counting frequency. I also haven't found existing curated lists of most useful vocabulary.
There are some databases but e.g. they are biased towards Wikipedia and web which makes some very obscure words at the top of popularity (like some technical words which are present on each wiki page like Datenschutz or Impressum).
The author mentions various categories grew or shrank, but always in percentages. Since the list also grew from 2300 to 2800 words that feels like it might distort things a bit: in absolute word count, a category that shrank by 1% lost fewer words than a category that grew by 1% would have gained, no?
Having said that, the categories that shrank all did so by a big enough percentage to also shrink in absolute number of words, so at least that isn't a problem.
It's interesting reading the comments criticising this page's scroll behaviour. I didn't realize how many people scroll webpages without a mouse... This is good to know!
I thought it was one of those paywalls that give you a taste. Since it wasn't enough for me to pay I was going for close when more came up. Only then did I realize what was going on. It was still annoying enough give up after a few more pages.
Interesting one if you look at Google Ngram Viewer – usage dropped off massively to 70s/80s, and it's picked back up since but not to 1953 or earlier levels, so even that doesn't explain it.
Must just be the combination of that increase as well as other words decreasing in usage I suppose. E.g. perhaps we're a bit less keen, but also much less passionate, so keen ends up making the cut.
As a native English speaker, keen feels like a very 1950s TV word. Don't know if that's actually true but feels like that way. I expect you're more likely to hear like cool today are some more contemporary word.
Keen is definitely a word but when used to describe a person it’s often a bit of a backhanded compliment… you don’t really want to be keen.
Saying "I'm keen to do x" or "he's keen to do y" is a fairly common normal usage but having said that, wouldn't normally be my first choice of language as a millennial, maybe does sound a bit old fashioned
Still in common use in Britain as far as I know. A more local (Bristolian) word would be "keener" used to describe someone who puts lots of effort into a task to win praise.
“It offers fewer words for the people directly around you, but more for belonging at a distance” - the further I get into this article the more it just seems like sampling bias as a narrative.
It's a wordy (/AI?) way to say it, but I took it to be commenting on our lives being more 'abstract'/digital than they were, so naturally a lot of our language is less physical.
Oughtn't really affect emotive language like 'keen', though.
> It’s as if the world now requires you to be more precise about everything.
This is something I've been thinking a lot about. We have trended from subjective language to objective language. Why?
Computing. Software is written with objective language. Everything is clearly unambiguously defined. Blue is no longer a category, it's #0000FF. Logic must always reduce to a binary truth value. Most of what we have to talk about is somehow relative to software. Software even structures most of what we write! We don't just talk to each other, we tweet, email, message, post, search, etc. These structures each imply a specific set of phrase structures that can make sense.
Lately, it's hard to go even a day without reading some complaint that such and such was written by "AI" (an LLM). Why is this so obvious? Well, the core advantage that LLMs provide is that they don't compute. Inside an LLM, there is no arithmetic, no logical branches, no truth values. Phrases aren't generated to define or to resolve. They are generated to continue. Sure, we can direct the story to follow the steps of logical deduction, but that isn't anything like calculation. An LLM simply isn't invested in logic, precision, correctness, etc. the way we expect modern writers to be. It's not the em-dashes or the word choice that illustrates this, it's the fundamental perspective of the system.
We are sorely missing subjectivity. Natural language never was, and never will be, computable. You can't reduce a natural story to binary truth values without choosing an arbitrary perspective that resolves its ambiguity. The more precisely abstract our language gets, the more detached from reality our stories become. The more objective our assertions about reality are, the less relevant they can be.
My answer to this is to make the arbitrary choice of perspective a first-class feature. If we can explicitly decide what meaning is relevant, we should be able to weakly solve natural language processing. It seems like a pretty simple and obvious idea, but so far is easier said than done.
I don't agree with the assumed equivalence between precision and objectivity. Language can be precise when describing a subjective perspective, and it can be imprecise or ambiguous when describing objective facts. The tendency toward increasing precision is a good thing, in my opinion. If anything, precision in language allows writers to tell better, more nuanced stories about subjectivity.
Increasing precision is good to the end that is disambiguation. The problem is that that end is not always what language is good for. Metaphor is an incredibly useful tool, because it allows us to convey meaning with imprecise definition, but precise implications.
The meaning of an expression is its implication, not its definition. The implication must be decided by the reader. This is either done by strict definition, or by arbitrary inference. Inference is a powerful feature of language, because it expands the set implications that can be expressed without abstracting the language. Without inference and metaphor, we must instead create a tower of well-defined abstractions that rule over us; having already determined what implications are relevant: objective truth. With inference and metaphor, the writer/speaker can articulate their implications with familiar language; relying on the reader/listener to infer from the expected relevant perspective: subjective truth.
Essentially the tradeoff isn't whether or not you get precision, but whether that precision can be shared by the writer and the reader, or be managed entirely by the writer. Defined abstractions allow the writer to be unambiguous to anyone (objective), while inference allows the writer to offload that responsibility to the context and perspective of the reader (subjective).
Eh, this seems somewhat right, but somewhat not right either.
Language has to do with our Monkeysphere, that humans over long periods of time in the past were limited to a very small subset of people they interacted with socially and closely. A few institutions likely had a large effect on your language like the church depending on where you were. After that it was the people you interacted with to stay alive. Because almost everything was in person or person to person transfer of information a lot of socially encoded clues were involved which lessened the need for well defined words.
Books were the first stage of homogenizing language as they could be shared over long distances and to many people, but more sequentially than latter forms of communication. After that radio and TV had a huge effect, for example the 'General American' used in broadcasts that was based heavily on a midwestern accent.
As we encroached on the 70s and 80s the previous technological advances and things like high speed interstates and trucking shrank America to something you could drive across in less than a week, and you could reach anywhere by voice nearly instantly. Suddenly people in California, Texas and New York all could be in the same meetings and local colloquialisms would need explained, so people would trend to a shared vocabulary.
It's also odd to me to say an LLM isn't subjective. Each LLM has it's own behavior, it's that there are like 20 or 30 big LLMs in all, and people are using them millions to billions of time so we're getting that one LLMs language everywhere. And that's why I disagree and will say natural language is computable, but it's also lossy and probabilistic. And for the most part it's single prompt and being ran by the user for the cheapest price possible.
> It's also odd to me to say an LLM isn't subjective.
I was saying the opposite. The core feature of an LLM is that it is subjective. The implications of a written expression (prompt) are not well-defined objective truth, but instead a vague probability. We can compute the probability, but that doesn't ever intersect with logical reduction or arithmetic; so the implications we get are just vague guesses on the progression of the story. With enough examples and training, the LLM can guess correct arithmetic answers, but critically, it does not actually perform the arithmetic that verifies them.
At the moment this story has 2 upvotes in a half hour and is in the 8th position on the front page. Apparently HN has a fairy godmother algorithm that randomly promotes posts.
I tried to organize vocab by difficulty level for an English language-learning app once.
It shocked me how there is absolutely no "right" answer.
If you are teaching English for travel, then you're prioritizing a lot of stuff around bathrooms, transportation, menu items, etc.
If it's for understanding TV, it's a lot of words like "murder", etc. Depending on which TV shows you want to understand.
If it's for reading the newspaper, you don't ever need to know "bathroom", but you sure do need to know words like "congressman".
While if you are living somewhere, it's really important to know a lot of basic supermarket items that you wouldn't prioritize for other usages.
Also, while it's easy to calculate word frequencies for stuff like newspaper articles, there aren't any good statistics (last I checked) around just normal everyday conversation. Because that stuff isn't getting recorded and transcribed. And the substitutes -- transcribed speech from TV, radio, podcasts, etc. -- is not the same context as the random stuff you say at home and during an average day.
> If it's for reading the newspaper, you don't ever need to know "bathroom", but you sure do need to know words like "congressman".
Unless you're reading a newspaper from the last 5 years or so - in which case, the word "bathroom" becomes surprisingly more relevant.
> Also, while it's easy to calculate word frequencies for stuff like newspaper articles, there aren't any good statistics (last I checked) around just normal everyday conversation. Because that stuff isn't getting recorded and transcribed.
Linguists have resorted to spying on people in parks and shops and restaurants, to get "natural" language unperturbed by observer effects, audience tailoring, the filter of writing, etc. (In most cases that would not be considered ethical today!)
The gold standard is something like: get acculturated to the language community you wish to study, make some acquaintances and friends, somehow finagle an invite to their homes or workplaces or social venues, and then with their permission, record their conversations as unobtrusively as you can.
There is so little data on how language is really used it is quite bedevilling. As soon as people know you are listening they change how they speak.
> Linguists have resorted to spying on people in parks and shops and restaurants, to get "natural" language unperturbed by observer effects, audience tailoring, the filter of writing, etc.
Hence the common phrase, found in most language phrasebooks: “is that a linguist hiding behind that bush?”
That’s what makes ethnolinguistics fascinating. As a native French speaker, I started getting interested by linguistics when I learned Italian, and now I keep noting things I never thought about when I talk with other native French speakers. As someone said, “You don’t know your language until you know another one”.
That's what I discovered religion is for, understand the language as it was created.
Ever wonder who decides what's self-explanatory and what resonates?
This is one upside of the digital panopticon, I guess.
There is also a whole different language used to talk to toddlers and small children that native speakers know but very few adult learners ever pick up. And slang used among teenagers and young adults that often times not even their parents understand fully.
The problem with adding slang to any organised education program is two-fold: some of it changes much more quickly than you course materials can, and much of it is quite localised.
Beware though that only learning words may leave you confused as in my experience Americans tend to overload the same word with a different meaning depending on the context. They also often resort to idioms and cultural references.
For reasons unknown to me, instead of using the word with the meaning they probably are trying to convey, they rather use vague analogies or metaphors.
It always made me question if Americans in contrast to the British are a bit afraid to be precise.
When I started dating someone whose second language was English, I found that the idioms were a giant hurdle. We really do speak in idioms and metaphors and this makes it very difficult for people who understand the words but not the cultural context. While my (now spouse) adapted, I also adapted by learning how to speak far more literally, especially around people of mixed levels of English.
I don't think there is a fear of being imprecise. If anything, it is a fear of speaking plainly as boring.
> Americans tend to overload the same word with a different meaning depending on the context. They also often resort to idioms and cultural references.
This is not specific to "Americans". Learn any language and you will have the same impression, and experience the same gulf between textbook usage and everyday usage.
Interesting perspective, I'm used to seeing the exact opposite observation, that British people are famous for saying things meant as insults that sound positive at a surface level and that people are often unsure if they're being mocked/ridiculed or not.
Of course, American corporate-speak is unique from normal conversations, and people intentionally use vagueness to make sure there's general agreement before saying something concretely that might be contentious or cause problems.
Different context. One social register is extreme understatement, which may be laden with passive aggression, but could also be approving. "That's not a bad idea" is likely to mean "Good idea, let's do it, or at least consider it seriously." But "Interesting idea" is likely to mean "You're an idiot."
This is more corporate/middle class.
There's also a working class register which is very direct and sweary, and extreme insults are actually meant affectionately.
Even more confusingly, the two can overlap, and the same people will switch between them - sometimes in the same setting - with relative equals.
Americans don't seem to do understatement. "My business died" becomes "My incredible journey." Relationships are cross-bred with hustle, so you can be friends with someone and they'll ask you to invest in their MLM scheme.
Instead of using understatement US corporate speaks uses noise to act out hierarchy, to gaslight and to misdirect.
I was talking to someone today who was asked to produce a report. They sent it on time, and then the team lead called a meeting to ask why it hadn't arrived.
The report was literally sitting in their inbox unread. Everyone could see it, but they all went through the motions of pretending it wasn't there and developing an action plan for future delivery.
It's all very David Graeber. So far as I can tell the US seems to specialise in situations where corporate insanity is happening but the sharp edges have been filed off, so it looks like productive activity higher up the pyramid.
Seems like an extremely reductive and negative take on what is "American". Perhaps you've only experienced America via LinkedIn and a specific shitty company?
> Americans don't seem to do understatement.
Brits say this all the time because they assume we talk like people in movies and interviews do (or they interpret corporate-speak as how Americans actually talk). We use understatement plenty. In fact, the "interesting idea" understatement? I wouldn't even clock it as British because we use that in the US, too. I would say it is a classic example we use here of how you politely call an idea stupid. "Hm, interesting." We don't usually say "that's a stupid idea." That would be extremely rude.
I encounter this same attitude vis a vis Brits and sarcasm. "Oh, Americans don't get sarcasm." We absolutely do get sarcasm (insert claim Brits are being sarcastic when they say we don't get it). Britain is not special in this regard. It boggles the mind why Brits think we don't understand it. The languages are not so far gone.
I tell ya what, "understatement of the year" was not a phrase coined to describe something a Brit said.
You also find observers outside the Anglosphere describing understatement not as a British thing, but an anglophonic thing, including in American speech. https://www.identitytheory.com/anna-wierzbickas-english-mean...
I would go so far as to say that the hedges famous to American English opinion sharing is an example of understatement. "I feel like XYZ" is an Americanism, and it's understatement to the point of re-catorizing a fact as an opinion in order to soften your speech.
I can't tell you the number of times I've heard a Texan describe extremely hot weather as "a bit warm."
Examples abound.
(We also bust balls with our friends, and it lines up with class the same way you describe, including code switching between two registers.)
> They sent it on time, and then the team lead called a meeting to ask why it hadn't arrived. The report was literally sitting in their inbox unread. Everyone could see it, but they all went through the motions of pretending it wasn't there and developing an action plan for future delivery.
That is surreal.
>Interesting perspective
I see what you did there!
Darmok and Jalad at Tanagra
I always hear a phase that goes like “we have a word for it in Language, …”. You almost never hear it said where English is that language. We just don’t have many words or don’t like adding new ones very frequently, it seems.
> you almost never hear it said where English is that language
I'm willing to bet it's a combination of two factors:
1. you are consuming these things in English, and English natives are less likely to say "English has this word that those other people don't" because they fully understand English so it doesn't seem inscrutable, but some other language is kind of "magical an mysterious" to them. See, e.g., the urban legend that the Chinese word for crisis is "danger" and "opportunity." https://en.wikipedia.org/wiki/Chinese_word_for_crisis There's a whole cottage industry around "that foreign language is so cool compared to English"
2. "this language can say X but another language cannot" is invariably wrong
English has more words than any language on earth. People don't learn or use use most of them because they will be labeled pretentious.
I wonder if despite our large vocabulary, English speakers tend to use a small subsection of it because there are so many non-native speakers. It seems to me from reading and watching people from decades ago that the language was more complex. (I don't mean this as any knock on people who speak English as a second language.)
We don't use most of them because no one could learn them all. There's more than 100,000 hanzi recorded in Chinese. Some quick googling suggests educated Chinese people know 8,000, and the average Chinese person knows around 3,500.
So 3–8%.
Nothing to do with pretention and everything to do with impossibility :D
English tends to just borrow/steal words from other languages if they're useful enough. It could also be something to do with the lack of consistency of english rules so it's not so easy to create new words.
I think a lot about this. It's funny how there are certain domains of language, familiar to all native speakers, but that you are simply not likely to learn as an adult language learner, at least not without diligent and focused study.
I live and work in a foreign country, and have a modest but functional grasp of the language here. Which is to say, I know how to say 'sustainability', 'union-negotiated collective agreement', and 'offensive conduct in the workplace'.... but if you asked me the words for 'cedar', 'robin', 'pond', or 'linen' I would be struck dumb. And yet presumably every ten year old I walk past in the street would know those words as comfortably as I knew them in English as a ten year old in England.
It's kinda funny. My life switched to English when I was around 18 and, while my family still speaks my native language exclusively, everything I've learned since then I don't know how to say it in my native language.
Just earlier I was talking to them, trying to say "when life gives you lemons" and being unable to find an equivalent phrase. I hope they understood my lemons reference regardless.
Words like cedar/robin/linen come from either the physical or cultral environment that I (as a Chinese) wasn't exposed to when I was a child. Cedar and robin are all species native to Europe, and I guess they also appear in many Western fairy tales or historical stories.
Also, both because of the familiarity and how English form words, English assign very specific non-compound words to them (rather than "xxx tree/bird"), making it more difficult for people from a completely different language family to learn them.
But of course this is not only English. In Chinese a child is taught to act 孝 (filial piety, respect and obedience to parents) and know how your uncles 舅 (mother's brother) 伯 (father's elder brother) 叔 (father's younger brother) relate to your parents. I'm sure it's OK for a foreign learner not to master them.
Cedars, fwiw, are not found in most of Europe either. Small parts of the Mediterranean (also parts of the Himalayas, bizarrely; closer than you think!)
They likely show up in Western works a lot because they’re mentioned in the bible a good bit.
> if you asked me the words for 'cedar', 'robin', 'pond', or 'linen' I would be struck dumb. And yet presumably every ten year old I walk past in the street would know those words as comfortably as I knew them in English as a ten year old in England.
Indeed. I'm American but my family has spoken German in the USA uninterrupted for 200 years. I speak German with my kids. But there's a children's song called Alle Vögel sind schon da and another called die Vogelhochzeit that I listen to with my kids, and it's just a litany of bird species I do not know but, being in a kid's song, I assume means they are common words for German kids.
When I look them up, the English words are ones I've heard and know from context are birds, but I couldn't tell you what they are like, and I would never use the word in English when asked about birds. My go-tos would be mockingbird, cardinal, hummingbird...ones I see in my backyard and have seen my entire life.
When you're a foreigner learning a language your experience is mostly from reading. There are words, however, that are much more common at home and in spoken language. So you'll probably never learn the words that a 10 year old kid knows.
One subtle issue in learning words from reading is that with languages like English where there's ambiguity in how to pronounce a given spelling, sometimes you might not guess the correct pronunciation for words you learned. This isn't specific to learning non-native languages either; growing up I read a lot and learned most of my advanced vocabulary that way, so as a teenager I would often find out that I didn't pronounce a word correctly because I had only ever seen it written down before.
There's a quote I've come across before, never make fun of someone mispronouncing a word in English, because it's a sign they are a reader.
I was in my 30s when I learned "ennui" was pronounced "on wee" rather than N-U-I. I did not know it was from French. No shame. I never spoke the word aloud, but used it in writing. A teenager I knew was studying for a vocab test and had to learn the word, and I overheard him flash carding. Pronounced it "on-wee" and my brain exploded.
I started learning english around 1984, when I began to learn programming. Back then most books were, by very far, in english. I also spent some time in the US (about one year altogether).
Copying lyrics from my favorite songs of the 80s was helpful. And then later on TV series and movies in english.
I've watched Friends, HIMYM and Californication* more than once (it's probably the reason I swear so much) and those really helped.
Now I raised my kid in english: from the beginning she was only ever allowed to watch TV shows in english. And she's always been to international schools, in english too.
The other day she taught me a simply word which, surprisingly enough, I didn't know: a "coaster" (a drink coaster).
My absolute favorite is when she uses english grammar and applies it to french: the rules about where adjectives do go vary between french and english and she regularly messes it up in french (supposedly her "native" language but at this point I wonder whether english ain't a first language, and french second).
And one thing she has that I'll never have is a beautiful, proper, english accent. Mine shall forever be a strong french one.
My wife kept up her english via friends. And I am always surprised how much US cultural exports help people learn the language.
A French accent in English is easy to mock but it actually sounds pretty good. My American accent in Spanish sounds atrocious and sadly our bilingual kids have pretty American accents too. But honestly who cares?
Speaking another language is the best effort I have ever made (I am lucky not to do it out of necessity). Totally changed my world view and how I think, speak, read and dream. Though please do not make me listen to a recording of my own voice…
It is changing. A bulk of learners now get their vocabularies from youtube, netflix and podcasts. Watching kids shows is common recommendation (I disagree with it somewhat, but that does not make it not common), so I think people will learn also those 10 years old world words.
After years of reading technical and scientific materials, listening to lectures and youtube tutorials and learning English exclusively through them I hit a wall when I watched a cooking youtube video for the first time.
I was pretty confident in my English but I couldn't understand half of the sentences since I didn't know any of the vocabulary related to cooking. From tools (spatula) to ingredients (parsley) or even actions (frying). My delusions of proficiency shattered as I found out my everyday vocabulary is smaller than an elementary schooler.
I read years ago that:
1. TV vocabulary is 2,000 words
2. High school vocabulary is 10,000 words
3. College vocabulary is 30,000 words
4. English language has 1,000,000 words
This is good news - you can be proficient in a foreign language by learning only 2,000 words!
Being proficient in a language is really less about memorizing words than it is pronunciation and grammar. Memorization itself is pretty easy.
No, memorize many noun most important. Grammar less Important. Can do food, can do travel, can do tax. Because, noun most important.
Working with ESL people makes it clear that grammar isn't so important. One of my friends would say, instead of "go shopping", would say "make some shoppings". Instead of "it's time to go", he'd say "time for go". All words that started with 's' were pronounced 'ehs', as in "gas ehstation".
The other people at work soon picked those lines up, and we used them regularly amongst ourselves. I still use them decades later!
> This is good news - you can be proficient in a foreign language by learning only 2,000 words!
Depends what you mean by "proficient". I currently know ~6k Spanish words and would hesitate to self-apply that word. Others might, but damn languages are hard.
Please someone tell me where to get those 1 million words in decreasing order of difficulty or ascending order of usage along with their meanings and insinuations
https://en.wiktionary.org/wiki/Wiktionary:Frequency_lists
Also worth going through the references of https://en.wikipedia.org/wiki/Zipf%27s_law
Sounds like a job for LLMs.
Only if you mean llms finding already compiled lists on the internet. Since they would be too inefficient for actually compiling a list themselves.
I tried to teach 'magicE vocab', sorting them by difficulty level for an English language plan, and got them easily arranged. For example, sham/shame and slide/slid are for hard to learn level, while ate, pale, kite, are for the easy level.
Kinda like how there's no average-sized airplane pilot
> While if you are living somewhere, it's really important to know a lot of basic supermarket items that you wouldn't prioritize for other usages.
Why? Having spent a good amount of time living in Shanghai, I found it important to be able to understand menus. But there's no pressure to know the words for supermarket items; you can just go to the supermarket and look for the item.
Otherwise your point is correct; all semantic words are equally difficult and which ones you know depends on the things you like to talk about. Grammatical words are more difficult, and more important, but this is so widely understood that language-learning material already treats them as an entirely separate class of things to learn.
> Also, while it's easy to calculate word frequencies for stuff like newspaper articles, there aren't any good statistics (last I checked) around just normal everyday conversation. Because that stuff isn't getting recorded and transcribed.
(1) You seem to want COCA, which includes a bunch of transcribed telephone calls.
(2) Word frequencies are still the wrong concept. If you want to understand a particular document, you need to understand almost all of the words that appear in that document. (You'll be able to learn some of them from their use in the document.) If you decide to learn a list of "frequent" words, you're unlikely to be able to understand more than a couple of isolated sentences in any given document.
> you need to understand almost all of the words that appear in that document
I didn't learn English by reading vocabulary lists or dictionaries. Pretty much all was learned by context.
> The “Social-Communicative” level barely changed in size. But nearly a quarter of the words in the 1953 list are gone, and 39% of the 2023 words are new. Humble, loyalty, fellowship, generous, polite, and companionship gave way to community, identity, organization, ethnic, gender, and narrative. ...It offers fewer words for the people directly around you, but more for belonging at a distance.
I would blame inequality on this one. In a more unequal world tribalization is a survival strategy and language follows.
When you see everybody else as your equals then focusing on describing that individual person, instead of their group, makes more sense.
Economic inequality affects deeply how we think about others.
I don't follow your reasoning at all. It's a shift and what people talk about and write about. It can't be anything more than that, by construction.
What I see is shifting from a focus on individuals and close personal relationships to a focus on the functioning of society and, well, identity.
It seems like a swing of the pendulum to me. Encouraging people to create their own identities, creating vocabulary to describe one's identity, and advocating for a restructuring around society that is relatively collectivized economically, but culturally celebrates individual diversity. I'm not a professional historian, but I think that's somewhat of a new phenomenon historically.
And it's clearly a reaction to the perception that the ideals of equality and being uniformly kind to each other we're not enough to bring about a just and equitable society, and if anything were abused in order to suppress diversity. We still have to be kind to each other at a basic level, but it's not enough anymore.
So maybe now there's too much focus on that stuff and not enough focus on the part where you should actually just be nice to your neighbors and be humble and all that. Or, maybe people are disproportionately writing about it, because it's a new thing, and a lot of people know a lot to say about it, and a lot of people want to talk about it.
I don't think it makes a shred of sense to conclude that somehow the world is now more equal than it was in the 50s. It's disappointingly far from equal, though, and I think the change in lexicon is a change in people's focus specifically because the old system clearly wasn't working, and people are eager to try something different.
I can't quite follow your point. Are you saying there is more inequality today than in 1953?
From 1945 to 1980 inequality was the lowest in the USA. From 1980 onward economic inequality exploded. I understand that you cannot follow my point without this important piece of information.
I would blame it more on globalization.
In 1953 people were not exposed as much to different groups of people far away.
When I was in high school at a private school, I was surrounded by students who were religious but didn’t have much curiosity. I got into a debate with basically my whole class about how languages shift and change over time, and everyone was saying that languages stay the same and that they were all determined at the Tower of Babel.
I used the examples of Latin to Spanish and English, or Old English to new English.
I say that to say, languages changing over time is to some people not actually something they believe happens. The facts are right there in front of you, but some people cannot have their minds changed no matter how much sense you make.
Here’s one verse from the Bible itself that shows that language changed: 1 Samuel 9:9:
> (Formerly in Israel, when a man went to inquire of God, he said, “Come, let us go to the seer”; for he who is now called a prophet was formerly called a seer.)
I love that one because it translates so well into English because we also have an older and a newer word for close enough to the same thing. Though when saying older and newer I should note that the words “prophet” and “seer” have been used consistently since the very first English translation, Wycliffe’s in ~1382. Maybe it’s more the feel of the words. (In Bible Gateway’s catalogue of English translations, only the CEV doesn’t use both of those words: <https://www.biblegateway.com/verse/en/1sam9.9>; I disqualify OJB as not English.)
That’s the only one I can think of off the top of my head that’s specifically about language, but there are plenty of others about changed customs over time, in Old and New Testaments.
Arguably the CEV version is clearer, because approximately no-one knows the difference between ‘prophet’ and ‘seer’ in English (a seer is a practitioner of divination). I’m assuming that the distinction was similar in the original (ie that the original didn’t just use two words for the same thing).
There's a very easy way out for them: Just claim that the bible is rather metaphorical than literal, and many things can be interpreted to be in line with scientific findings. That seems to be at least what protestant churches in Europe seem to do.
Easy for you to say, but who says they're looking for a way out? It's often easier to find a reason to stay where you are, and easiest to not even need one.
Huh, English has changed perceptibly over just my lifetime.
And animals have evolved perceptibly in my lifetime, they still don't believe in evolution. I grew up in a culture of Jesus Freaks. The way they place faith above evidence and logic is so disturbing and irritating to me
Most people can't accept reality.
I tried to build a similar list myself for German and it's not easy as just taking a lot of content and counting frequency. I also haven't found existing curated lists of most useful vocabulary.
There are some databases but e.g. they are biased towards Wikipedia and web which makes some very obscure words at the top of popularity (like some technical words which are present on each wiki page like Datenschutz or Impressum).
Useless, obnoxious, absolutely frustrating Scrolljacker? Straight to jail.
I thought the same thing.
All that time spent programming those visuals. Which, I think, ironically, have made the article harder to read, not easier.
The author mentions various categories grew or shrank, but always in percentages. Since the list also grew from 2300 to 2800 words that feels like it might distort things a bit: in absolute word count, a category that shrank by 1% lost fewer words than a category that grew by 1% would have gained, no?
Having said that, the categories that shrank all did so by a big enough percentage to also shrink in absolute number of words, so at least that isn't a problem.
always hated this style of web presentation.
This is the worse I have seen.
Most of these kind of website have the animation on the centre of the screen. This one animate at the bottom
It's interesting reading the comments criticising this page's scroll behaviour. I didn't realize how many people scroll webpages without a mouse... This is good to know!
Trying to read this article by paging through it with the spacebar is ... absolutely impossible.
I'm not going to finger-scroll or down-arrow the whole thing.
Don't break scrolling. Please.
A new fad I've seen more and more lately is removing the scroll bars. Arrgh.
Not only have they killed the scrollbar, but they've attempted to kill my scrollbar-killing rant: <https://news.ycombinator.com/item?id=21356511>.
That seems not to be available at either the Internet Archive nor Archive Today:
<https://web.archive.org/web/20200000000000*/https://ello.co/...>
<https://archive.is/https%3A%2F%2Fello.co%2Fdredmorbius%2Fpos...>
Sic transit gloria data.
Update: At least some of the Wayback captures have the actual page content if you view source. See for example: <https://web.archive.org/web/20210524202824/https://ello.co/d...>.
(Another reason I'm pretty salty about breaking basic HTML page functionality for slick trix.)
My Mac mini has that wretched problem with every window.
I thought it was one of those paywalls that give you a taste. Since it wasn't enough for me to pay I was going for close when more came up. Only then did I realize what was going on. It was still annoying enough give up after a few more pages.
Man this pudding is a cool publication : ) Thanks for this.
Why keen?
Interesting one if you look at Google Ngram Viewer – usage dropped off massively to 70s/80s, and it's picked back up since but not to 1953 or earlier levels, so even that doesn't explain it.
Must just be the combination of that increase as well as other words decreasing in usage I suppose. E.g. perhaps we're a bit less keen, but also much less passionate, so keen ends up making the cut.
As a native English speaker, keen feels like a very 1950s TV word. Don't know if that's actually true but feels like that way. I expect you're more likely to hear like cool today are some more contemporary word.
Brits still use the word somewhat frequently, though I haven’t bumped into many of them in the last ten years.
Keen is definitely a word but when used to describe a person it’s often a bit of a backhanded compliment… you don’t really want to be keen.
Saying "I'm keen to do x" or "he's keen to do y" is a fairly common normal usage but having said that, wouldn't normally be my first choice of language as a millennial, maybe does sound a bit old fashioned
Right, as far as live exposure, I associate its usage with UK/AU/NZ expats in my western US, academic R&D microcosm.
Yeah, I guess I can also see it as more of a Britishism (etc.) currently.
I'm also a native English speaker, sounds perfectly normal & commonplace to me.
Still in common use in Britain as far as I know. A more local (Bristolian) word would be "keener" used to describe someone who puts lots of effort into a task to win praise.
In Canada I hear keener more often than keen (although both are rare).
“It offers fewer words for the people directly around you, but more for belonging at a distance” - the further I get into this article the more it just seems like sampling bias as a narrative.
It's a wordy (/AI?) way to say it, but I took it to be commenting on our lives being more 'abstract'/digital than they were, so naturally a lot of our language is less physical.
Oughtn't really affect emotive language like 'keen', though.
It's changed so much I can't even parse the title.
Evidently grammar's become slacker
> It’s as if the world now requires you to be more precise about everything.
This is something I've been thinking a lot about. We have trended from subjective language to objective language. Why?
Computing. Software is written with objective language. Everything is clearly unambiguously defined. Blue is no longer a category, it's #0000FF. Logic must always reduce to a binary truth value. Most of what we have to talk about is somehow relative to software. Software even structures most of what we write! We don't just talk to each other, we tweet, email, message, post, search, etc. These structures each imply a specific set of phrase structures that can make sense.
Lately, it's hard to go even a day without reading some complaint that such and such was written by "AI" (an LLM). Why is this so obvious? Well, the core advantage that LLMs provide is that they don't compute. Inside an LLM, there is no arithmetic, no logical branches, no truth values. Phrases aren't generated to define or to resolve. They are generated to continue. Sure, we can direct the story to follow the steps of logical deduction, but that isn't anything like calculation. An LLM simply isn't invested in logic, precision, correctness, etc. the way we expect modern writers to be. It's not the em-dashes or the word choice that illustrates this, it's the fundamental perspective of the system.
We are sorely missing subjectivity. Natural language never was, and never will be, computable. You can't reduce a natural story to binary truth values without choosing an arbitrary perspective that resolves its ambiguity. The more precisely abstract our language gets, the more detached from reality our stories become. The more objective our assertions about reality are, the less relevant they can be.
My answer to this is to make the arbitrary choice of perspective a first-class feature. If we can explicitly decide what meaning is relevant, we should be able to weakly solve natural language processing. It seems like a pretty simple and obvious idea, but so far is easier said than done.
I don't agree with the assumed equivalence between precision and objectivity. Language can be precise when describing a subjective perspective, and it can be imprecise or ambiguous when describing objective facts. The tendency toward increasing precision is a good thing, in my opinion. If anything, precision in language allows writers to tell better, more nuanced stories about subjectivity.
Increasing precision is good to the end that is disambiguation. The problem is that that end is not always what language is good for. Metaphor is an incredibly useful tool, because it allows us to convey meaning with imprecise definition, but precise implications.
The meaning of an expression is its implication, not its definition. The implication must be decided by the reader. This is either done by strict definition, or by arbitrary inference. Inference is a powerful feature of language, because it expands the set implications that can be expressed without abstracting the language. Without inference and metaphor, we must instead create a tower of well-defined abstractions that rule over us; having already determined what implications are relevant: objective truth. With inference and metaphor, the writer/speaker can articulate their implications with familiar language; relying on the reader/listener to infer from the expected relevant perspective: subjective truth.
Essentially the tradeoff isn't whether or not you get precision, but whether that precision can be shared by the writer and the reader, or be managed entirely by the writer. Defined abstractions allow the writer to be unambiguous to anyone (objective), while inference allows the writer to offload that responsibility to the context and perspective of the reader (subjective).
Does that make sense?
Eh, this seems somewhat right, but somewhat not right either.
Language has to do with our Monkeysphere, that humans over long periods of time in the past were limited to a very small subset of people they interacted with socially and closely. A few institutions likely had a large effect on your language like the church depending on where you were. After that it was the people you interacted with to stay alive. Because almost everything was in person or person to person transfer of information a lot of socially encoded clues were involved which lessened the need for well defined words.
Books were the first stage of homogenizing language as they could be shared over long distances and to many people, but more sequentially than latter forms of communication. After that radio and TV had a huge effect, for example the 'General American' used in broadcasts that was based heavily on a midwestern accent.
As we encroached on the 70s and 80s the previous technological advances and things like high speed interstates and trucking shrank America to something you could drive across in less than a week, and you could reach anywhere by voice nearly instantly. Suddenly people in California, Texas and New York all could be in the same meetings and local colloquialisms would need explained, so people would trend to a shared vocabulary.
It's also odd to me to say an LLM isn't subjective. Each LLM has it's own behavior, it's that there are like 20 or 30 big LLMs in all, and people are using them millions to billions of time so we're getting that one LLMs language everywhere. And that's why I disagree and will say natural language is computable, but it's also lossy and probabilistic. And for the most part it's single prompt and being ran by the user for the cheapest price possible.
> It's also odd to me to say an LLM isn't subjective.
I was saying the opposite. The core feature of an LLM is that it is subjective. The implications of a written expression (prompt) are not well-defined objective truth, but instead a vague probability. We can compute the probability, but that doesn't ever intersect with logical reduction or arithmetic; so the implications we get are just vague guesses on the progression of the story. With enough examples and training, the LLM can guess correct arithmetic answers, but critically, it does not actually perform the arithmetic that verifies them.
Reader mode required.
Point your Duck at "VOA Special English"
My mum learned watching cowboy TV in the 60s and 70s. She's got some uh colloquialisms for sure
I mean the subject is interesting but I have the say the design of the page is not only janky and needlessly complicated with animations.
Thank you, just at the right time.
At the moment this story has 2 upvotes in a half hour and is in the 8th position on the front page. Apparently HN has a fairy godmother algorithm that randomly promotes posts.
That is indeed how it works
https://news.ycombinator.com/pool
But not in this case. It's a slow Sunday afternoon and getting a few upvotes quickly is enough
Interesting! I didn't know about the 'pool' section of HN.
Would you mind explaining to us how it works?
Great work HN team, since it’s indeed an interesting story.
I assume it was for 30 minutes in waiting with 0 votes before someone digged it out.
Mods might be amused to be described as fairly godmothers.