Physicist here. I don't have time right now to read the papers in depth, nor are the results directly in my area, but I would say a few things.
One is that there are a near-infinite number of "open problems" in physics because the surface area of research programs in theoretical physics is extremely large. Before I was in the world of physics, I would have thought that "solving an open problem" meant that physicists around the world would be rejoicing and discussing the result. In reality, other than for the big, field-defining questions, only a small handful of people might care about any problem being solved. That holds true even for the Millennium problems.
Even if I were to read these papers in depth and understand them, without talking to somebody that knows the area and what has been done in it already, I would have no sense of the significance. The way to assess significance is to see how the community responds. Only time will tell whether people care about these results enough to cite them, incorporate them in future work, etc.
And so, like many other people I know, I plan to ignore all of these results until somebody I know comes and tells me to check one out: the cost of assessing any of them is too high, and there are too many other papers to read.
The hn comment guidelines say don’t complain hn is turning into Reddit, but if dang and co. still believe that’s an “illusion”, they’re not doing much to combat it.
This is just untrue? At the time of your writing; my comment was the third root comment and was about the paper. (Yours is currently the first root comment and mine is 4th).
So perhaps you are seeing what you’re biased towards, or you didn’t scroll past the first root comment?
The physics of black holes is far beyond the typical education or capacity of people here to understand or discuss intelligently. Outside of the occasional expert post most of the “technical” talk here is limited to development of software at varying levels of intellectual rigor.
edit: To be clear I don't mean this as an insult, it's a site with millions of people, and the overlap between "working with software" and "understanding Cauchy surfaces" is pretty damned small.
when i first discovered this site i spent most of my time in the articles themselves because i had no idea how much or little to value the comments
nowadays i open the comments first and often dont open the article at all
i dont think this is a good thing, but i do find it interesting. I think a big part of it is how often i would read an article and develop a bunch of thougths about it and then come into the comments and see someone correct a fundamental premise of the article rendering all of my thoughts kind of useless as they are all based on misunderstanding and so i would start checking the comments to see if the article had been 'overruled' so to speak before i waste my time on it. this seems to have slowly shifted me to not knowing if the articles are even worth reading to begin with
I get that, but I think we can try. I know there are at least some physicists here, from other threads about AI and physics, but we could at least talk about what this article is.
For example, the metaphor they give about walking from Penn Station to the High Line comes off as somewhat out of touch.
Most people here care more about defining what AI is and whether what it can do really is "physics", than about the advance of humanity.
I dunno, I'm not one to say "HN was better before", but I did get bored a couple of years ago with all the "akshually, it's not real AI until it can solve [this problem], anything else is just sparkling inference algorithms".
(And of course the goalposts get moved so often, they need an amazon prime subscription just for the free delivery)
I would make a comparison to illuminate the phenomenon I'm seeing in the rest of this thread, but unfortunately there is a specific rule artificially preventing me from doing so.
Don't worry, we all see it. Just not much point in talking about it here, I guess. I still manage to get sniped by a subthread occasionally like this one, though.
I mean FWIW, I came here to see if this actually happened, or if it's yet more marketing where a prompt engineer managed to get Claude to spit out an unreleased paper/in-progress theory/whatever from it's training data, and they're now calling it a physicist, as has happened like four times that I can recall right now.
It'd be cool if that WASN'T the case, but reality is often disappointing.
It tickled me that this was a bullet point in the Fable 5.2 announcement. I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Those theoretical physics papers look like the real thing (i.e. not mathematical physics like the OpenAI Yang-Mills result). It looks like AI is finally branching out of math.
In my (limited) experience it does not struggle with empirical research — at least in the procedural aspects thereof — as long as it has access to the right data.
It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.
I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.
I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing, all in applications that, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)
I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.
I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.
In empirical research, getting the right data represents the bulk of the intellectual effort. Designing the right experiment and collecting good data is painstaking, backbreaking work.
I agree, and this may be nitpicking, but would it not be more accurate to say “bulk of the effort” rather than “intellectual effort”?
My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.
I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.
> bulk of the effort” rather than “intellectual effort”?
No, it is intellectual. Designing and implementing an experiment that eliminates confounding variables requires a great deal of creativity and ingenuity. Reality is messy and complicated.
Some notable examples include: Michelson-Morley, Millikan, Wrights, Cas-9 for CRISPR, CERN (one giant experiment).
I agree, but it is the kind of math done the physicists' way (which I found recently asserted that AI cannot do) and not the kind which is formalizable in Lean.
From skimming the papers, it’s not clear to me what it is actually doing outside of proving what can be considered mathematical theorems (even if that’s done the physicist way). It doesn’t seem to be making testable predictions (but maybe I missed those).
For people not in the know, it's common - both now and historically - for physicists to use "mathematical techniques" that have not been proven valid.
I took grad level physics courses, and this drove me bonkers. I was accustomed to the comfort mathematics provided me. If something was unclear, I could always dig deeper and find a proof. But a lot of the stuff the physics professors would do - I couldn't, and nor could they. They just responded with "intuition". Some of them had dug deep earlier in their careers and stated that the technique was likely invalid mathematically, "but still useful in getting answers experiments can verify".
I won't even talk about relying on diverging series...
Can you give examples? Sometimes a simplification is enough to illustrate a theorem, especially to an undergraduate class, without the full proof being needed. The mathematics is a tool to understand what’s happening.
More mathematical rigour would be required for formal papers, though it wouldn’t need to be derived from first principles.
Trouble is you can declare things to be true that are strictly speaking mathematically false, and from there get to proving any falsehood.
The Dirac delta function is a famous example of something mathematically non-rigorous at its inception, and mathematicians objected to it, but a few decades later Laurent Schwartz developed generalized function theory, that made it work.
Or going even further back, calculus was done in terms of ratios of infinitesimals (like dy/dx) or infinite sums of them (integrals). A century or two later the formulas of calculus were proven rigorously through classical analysis (delta-epsilon proofs) but that lost sight of the original motivations. A century or two after THAT, nonstandard analysis made a rigorous theory of infinitesimals, but reliant on relatively high powered mathematical logic that didn't exist til the 1950s or so.
Right now I think quantum field theory (renormalization, path integrals etc.) have been put on a sound mathematical basis but physicists mostly don't care. And very recently, an AI proved something about Yang-Mills theory that helped rigorize part of the Standard Model of particle physics. I don't understand that last part at all.
Besides physics, a lot of the procedures of machine learning and AI are mathematically suspicious but people use it anyway because it empirically works. People in the field have told me that yeah, they expect mathematicians will someday get around to backing it up, but for now, practitioners are moving forward with what they have.
If you attempt to formalize math involving such assumptions, one expects to encounter a proliferation of contradictions. So I’m curious to see how the contributions of AI authors is handled by the physics community. With pure math, you can ostensibly write a compact statement of a theorem in Lean, and if so, trust the process.
Yeah the use of divergent series in modern physics is certainly something. There is an equality that includes the sum of the natural numbers in it, and that evaluates to -1/12, but it's not equal to the sum of the natural numbers on its own. I can see reasons for why it might produce sensible answers in practice, but it does make me (admittedly not a physicist) suspicious.
We used to joke in my physics undergrad that they didn’t need a math department because we were doing all the stuff they were doing but with actual applications. Then the mechanical engineers said the same thing about us!
Maybe “thrilled” except in the sense that you’re in a SciFi thriller with a giant alien spaceship hovering overhead in the sky, in much the same way bricks don’t, and you don’t know if they’re friendly or hostile or just doing a survey for their new hyperspatial express route ;-)
> I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Because they want you to think that you will be able to do the same, too.
Except, you don't have a dedicated cluster for a week with an unrestricted model.
"Claude solves" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "it broke out of the sandbox" vs. "we failed to build an adequate sandbox".
What does it mean for Claude to solve it? What was the prompt? I didn't read it all, but the word "prompt" does not appear in the blog post, either abstract, or either paper.
It means someone set up the question with the Claude tool and let it iterate until it came up with an acceptable solution.
When my accountant whips out a calculator, it is the accountant that defined the problem and set the solution in motion. Fantastic tools are still tools. Claude does not love me nor you no matter how its trained and encoded patterns express.
Right, but in that situation, the email from the accountant isn't titled "TI-34 finished your taxes". The accountant did all the interesting work. (This metaphor is getting stretched, since accountants usually use software to do the taxes, and that software does a lot more of the interesting work than a pocket calculator does. But even then, the accountant has done the most important work in telling the software about your tax situation and the summary is still "the accountant has finished your taxes".)
"Spinning Jenny-spun yarn" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "the boiled exploded" vs. we failed to build an adequate boiler".
What does it mean for Jenny to spin it? Who provided the power to it? I didn't read it all, but the word "power" does not appear in the patent, or the newspaper articles about it.
it's also meaningful though, in that it's a tool trained on enormous amounts of stolen human thought. so recognizing that it's the stolen thing that did the thing, and not the company itself, gives people back some of the credit
From a cursory glance the bootstrap paper is really hard to read, however the blog post is easier and seems more human written.
The first result is cool (but basically a complex error-prone calculation), the second is much much cooler, Claude proved the upper limit for the mass of a black-hole which is consistent with a given central charge. (thereby making it a consistent theory of quantum gravity), any theory predicting above this is not a theory of quantum gravity of that universe. This is very exciting!
> thereby making it a consistent theory of quantum gravity
Careful. Thereby making a not-inconsistent-via-bootstrap theory. Such a theory could be inconsistent for other reasons shown by other methods. The article expresses a desire to show inconsistency for M1 above c/12 for example, but it's now been shown that the boostrap method can't get you that far.
Hardly seemed sad to me: standard physicist coming-of-age story maybe.
Most who study physics at this level, especially theoretical physics, end up moving on to something else quantitative. Most of them do quit on some level: there's usually a way to keep going, and usually life's circumstances mean it's no longer worth it.
But very few actually regret the time they spent in it, from what I've seen.
"Neither result describes our own universe directly, and neither has practical applications, but both contribute to a long-running theoretical effort to understand how quantum mechanics and relativity fit together."
For example the famous Schwarzschild solution (that predicts black holes) doesn't apply to our universe, because it assumes a black hole that's been there forever, not one that formed. But it was still very useful for our understanding.
It also assumes zero angular momentum, which we know is essentially impossible in our universe. And rotating black holes (the Kerr metric) are much stranger beasts.
Schwarzschild allows you to still calculate a whole bunch of things outside the event horizon. The part where it changes from our universe is the physics inside the black hole and their formation
I think everyone asking for this kind of thing doesn't really understand the scale and complexity of solving a big problem with many agents.
For any of the big things I've worked on, it isn't one "prompt", it's a goal that keeps getting updated and a bunch of back-and-forth steering of the model and sub agents, where what the human is saying to guide the model is heavily context dependent on what the model is currently doing or saying. Much of that guidance will ultimately be useless guidance on dead-end explorations. Also, the model will likely have written huge programs to solve things symbolically or simulate things numerically, and both the programs that were written, and the output of those programs are critical to understanding how the model came up with the things that led to a solution.
Now, I'd be all for publishing the full transcript, but the transcript is likely to be massive. Gigabytes of text, and reproducing the local computation (often sympy or numpy) may be hundreds or thousands of CPU-hours.
It is common in physics and astronomy to share your code that takes millions of cpu hours to solve problems, and to share your resulting data that can be in the petabytes.
Gigabytes of text seems perfectly shareable nowadays. Just as with most computational physics stuff of that scale, sharing code that can reproduce the result and roughly describing the computational requirements would be fine.
LLMs are not deterministic, which to my dumb mind, seems to lessen the value of those inputs since they will not inherently get you down the same path, no?
Apart from Claude/Anthropic no attribution whatsoever - neither on the Hexagon entry nor in the PDF. Isn't this a novelty, even for papers that are 100% the product of AI?
The entity making the progress should be credited.
"Claude did it" doesn't cut it. What's Claude anyway? Some client app talking to Anthropic API's? That's just shuttling prompts and output back & forth.
Researchers x, y or z doesn't cover it either. In this case they'll have relied on Claude for some heavy lifting.
Suggestion: name all the parts involved. "This research was done by Alice, Bob & Carol, using Claude with compute provided by Anthropic" - or something along those lines.
Credits given, clear who did what, no implicit assumptions.
That's the most unfortunate part of these recent discoveries. Even if the human "only" proofread the entire thing, that's still worthy of credit, because without their work, none of that output would be worth writing about.
Even through after all my skepticism about AI in science, Anthropic proved they can search for and find non-trivial discoveries with their tech, they've done very little to dissuade my fear they are actively hurting the scientific community for PR.
We could treat AI as just a helpful fuzzer for open-problems that occasionally opens new interesting paths for the actual scientists, but we know the end-goal of these people is a future where there are no qualified people left to review, let alone make new discoveries independently from the machine.
i cant say i fully understand this, i do quantum chemistry work so i only kinda understand portions of the first paper on black hole phase transitions. it is interesting that they're doing things kinda similar in black hole theory! i had no idea! the idea of black holes having phase transitions is one that my thermodynamics brain enjoys, and its nice to see perturbation theory in the wild. i am unfamiliar with much of the vocabulary used + would need days to build proper intuition on the problem setup. i do wish i could form a proper critique, the paper is at a weird space for me because some of the terminology is familiar, techniques used are similar, and i feel like if i really locked in i could develop an understanding of the paper in a few months. makes me want to go back to grad school.
i feel solipsistic saying this, but the more i understand about physics, the less awed i am by papers? obviously i am impressed, i know firsthand the amount of thought and calculations that goes into these sorts of results. but i dunno im just not awed. awe implies an incomprehensible greater than thou incredulity, and some of the physics in this paper feels really normal and achievable to me. i think im just too young to properly understand the effort this takes, maybe i should be awed, but im not.
i think i am trying to get at something where, it feels when ai labs put out big press releases on topics, they are making a big show of something only truly interesting to a small portion of people. if a human came up with these same results independently it would yield conference talks and grants, but ai is getting more eyes and a bigger press release just because its ai that solved it and not a human. which is impressive from an ai development standpoint! but less so from a physics standpoint (insert deintensifiers of this statement here im just stupid), so the physics feels like a prop.
still really interesting results though, again, i wish i understood enough of the underlying theories theyre connecting to feel really moved by the results. sorry for being so self centered in my analysis lol, wish i could do better but i cant.
Think any novel idea coming out of Claude publically shared should legally require prompts to show up as part of the disclosure. That's more or less how science works with the papers already.
Over a decade ago I saw a talk about a cohesive and complete explanation for gravity. It didn't involve quantum mechanics nor a particle called a "graviton".
That talk did make enough sense.
I'm still waiting to see a "picture" of a black hole that didn't involve a "pre-trained model" developed with "synthetic data" or something like that.
I'm not feeling sufficiently persuaded that I can feel confident that gravitons are a thing.
Nonetheless, I am remaining open minded to this black hole stuff.
Also: The main result was first obtained autonomously by an internal Claude research model. The publicly available Claude Opus 5.5 later obtained the same result independently. Claude then wrote this paper, following brief guidance from a physicist, who also checked every main result.
Climate change too. In particular game theoretic solutions. I.e. technical solutions that can withstand global tensions and commercial and government constraints.
A lot of us are willing and today have already taken the bet that a model or system that can solve hard problems across math, physics, biology is genuine intelligence. It will command a great premium or it may even figure out in the not so distant future how to make money on its own.
> a model or system [...] can solve hard problems across math, physics, biology
...is all that has been proven. That may one thing that intelligent humans can do, but it doesn't mean it requires human level intelligence. All computers are superhuman in some narrow sense.
81 comments so far (82 as of now) and I haven't found one that is actually about the papers or even TFA. What are we doing here?
Physicist here. I don't have time right now to read the papers in depth, nor are the results directly in my area, but I would say a few things.
One is that there are a near-infinite number of "open problems" in physics because the surface area of research programs in theoretical physics is extremely large. Before I was in the world of physics, I would have thought that "solving an open problem" meant that physicists around the world would be rejoicing and discussing the result. In reality, other than for the big, field-defining questions, only a small handful of people might care about any problem being solved. That holds true even for the Millennium problems.
Even if I were to read these papers in depth and understand them, without talking to somebody that knows the area and what has been done in it already, I would have no sense of the significance. The way to assess significance is to see how the community responds. Only time will tell whether people care about these results enough to cite them, incorporate them in future work, etc.
And so, like many other people I know, I plan to ignore all of these results until somebody I know comes and tells me to check one out: the cost of assessing any of them is too high, and there are too many other papers to read.
Compare, barely three years ago:
https://news.ycombinator.com/item?id=37123792
The hn comment guidelines say don’t complain hn is turning into Reddit, but if dang and co. still believe that’s an “illusion”, they’re not doing much to combat it.
Good, thanks. How about you?
Superman does good; you're doing well.
the question was "what are we doing?" and "good" is a valid answer.
Can confirm, I am Superman.
OP said 'what are we doing' not 'how are we doing' :P
He's doing some kind of charity work.
Technically that makes you a do-gooder.
You are right to push back!
This is just untrue? At the time of your writing; my comment was the third root comment and was about the paper. (Yours is currently the first root comment and mine is 4th).
So perhaps you are seeing what you’re biased towards, or you didn’t scroll past the first root comment?
The physics of black holes is far beyond the typical education or capacity of people here to understand or discuss intelligently. Outside of the occasional expert post most of the “technical” talk here is limited to development of software at varying levels of intellectual rigor.
edit: To be clear I don't mean this as an insult, it's a site with millions of people, and the overlap between "working with software" and "understanding Cauchy surfaces" is pretty damned small.
Wait... our discussion of software development is supposed to include intellectual rigor? Fuck!
Yeah even under the technical posts… maybe 1 in a 100 comments contain some kind of smart, logical, coherent, synthetic analysis.
And that’s being generous.
The intersection between physicists and hacker news commenters is probably quite small.
All PhD physicists I know are hardcore coders, like AI and quantum. But you may be right in that they have better things to do than hang out here.
The German software giant SAP was jokingly dubbed "Sammelstelle arbeitsloser Physiker": agency for unemployed physicists.
I'm a PhD physicist and don't have better things to do than hang out here.
The article is still over my head though.
A ridiculously high proportion of Germans I have ever met in my life are physicists or other kinds of PhD educated researchers.
I'm not sure if that's sampling bias, but it's not true of the Dutch or Belgian or French people I have met.
As far as I can tell, the entire German economy is an agency for unemployed physicists.
"The German software giant SAP was jokingly dubbed "Sammelstelle arbeitsloser Physiker": agency for unemployed physicists."
Never heard that, but it explains some UI and UX choices.
There was a time not too long ago when I'd learn a lot from HN comments on posts about physics.
when i first discovered this site i spent most of my time in the articles themselves because i had no idea how much or little to value the comments
nowadays i open the comments first and often dont open the article at all
i dont think this is a good thing, but i do find it interesting. I think a big part of it is how often i would read an article and develop a bunch of thougths about it and then come into the comments and see someone correct a fundamental premise of the article rendering all of my thoughts kind of useless as they are all based on misunderstanding and so i would start checking the comments to see if the article had been 'overruled' so to speak before i waste my time on it. this seems to have slowly shifted me to not knowing if the articles are even worth reading to begin with
There have always been a lot of armchair physicists on HN.
There is at least one non-armchair physicist on here.
I'll have you know I only ever do physics while lying in bed.
Inelastic collisions?
3-body problem?
Complex harmonic motion, with a little friction and the occasional loss of momentum.
And now with the power of LLMs, we can all be armchair physicists! The future is now.
r/LLMPhysics is waiting for you.
I get that, but I think we can try. I know there are at least some physicists here, from other threads about AI and physics, but we could at least talk about what this article is.
For example, the metaphor they give about walking from Penn Station to the High Line comes off as somewhat out of touch.
Well, it's really simple.
Most people here care more about defining what AI is and whether what it can do really is "physics", than about the advance of humanity.
I dunno, I'm not one to say "HN was better before", but I did get bored a couple of years ago with all the "akshually, it's not real AI until it can solve [this problem], anything else is just sparkling inference algorithms".
(And of course the goalposts get moved so often, they need an amazon prime subscription just for the free delivery)
> I'm not one to say "HN was better before"
I would make a comparison to illuminate the phenomenon I'm seeing in the rest of this thread, but unfortunately there is a specific rule artificially preventing me from doing so.
Don't worry, we all see it. Just not much point in talking about it here, I guess. I still manage to get sniped by a subthread occasionally like this one, though.
Rules are for breaking and HN used to be better.
Can it at least fit in the margins?
I mean FWIW, I came here to see if this actually happened, or if it's yet more marketing where a prompt engineer managed to get Claude to spit out an unreleased paper/in-progress theory/whatever from it's training data, and they're now calling it a physicist, as has happened like four times that I can recall right now.
It'd be cool if that WASN'T the case, but reality is often disappointing.
Vibing
i wonder at this point anyways if all HN is a bot network
me too
It tickled me that this was a bullet point in the Fable 5.2 announcement. I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Copying my comment from that discussion:
Those theoretical physics papers look like the real thing (i.e. not mathematical physics like the OpenAI Yang-Mills result). It looks like AI is finally branching out of math.
https://news.ycombinator.com/item?id=50430239
> It looks like AI is finally branching out of math.
Is it really, though? It's still a heavily mathematical domain, rather than one involving empirical research, where AI still struggles.
In my (limited) experience it does not struggle with empirical research — at least in the procedural aspects thereof — as long as it has access to the right data.
It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.
I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.
I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing, all in applications that, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)
I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.
I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.
In empirical research, getting the right data represents the bulk of the intellectual effort. Designing the right experiment and collecting good data is painstaking, backbreaking work.
I agree, and this may be nitpicking, but would it not be more accurate to say “bulk of the effort” rather than “intellectual effort”?
My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.
I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.
> bulk of the effort” rather than “intellectual effort”?
No, it is intellectual. Designing and implementing an experiment that eliminates confounding variables requires a great deal of creativity and ingenuity. Reality is messy and complicated.
Some notable examples include: Michelson-Morley, Millikan, Wrights, Cas-9 for CRISPR, CERN (one giant experiment).
The majority of time goes into collecting nonsense data in the service of doing computations that aren't useful, because the data was nonsense.
https://desystemize.substack.com/p/desystemize-1
I'd argue that "the right data" should really be called "the right information in context."
Context is king.
https://xkcd.com/435/
I agree, but it is the kind of math done the physicists' way (which I found recently asserted that AI cannot do) and not the kind which is formalizable in Lean.
"It's not much, but it's honest work."
From skimming the papers, it’s not clear to me what it is actually doing outside of proving what can be considered mathematical theorems (even if that’s done the physicist way). It doesn’t seem to be making testable predictions (but maybe I missed those).
> and not the kind which is formalizable in Lean.
For people not in the know, it's common - both now and historically - for physicists to use "mathematical techniques" that have not been proven valid.
I took grad level physics courses, and this drove me bonkers. I was accustomed to the comfort mathematics provided me. If something was unclear, I could always dig deeper and find a proof. But a lot of the stuff the physics professors would do - I couldn't, and nor could they. They just responded with "intuition". Some of them had dug deep earlier in their careers and stated that the technique was likely invalid mathematically, "but still useful in getting answers experiments can verify".
I won't even talk about relying on diverging series...
Can you give examples? Sometimes a simplification is enough to illustrate a theorem, especially to an undergraduate class, without the full proof being needed. The mathematics is a tool to understand what’s happening.
More mathematical rigour would be required for formal papers, though it wouldn’t need to be derived from first principles.
Can you declare theorems in Lean for those techniques. And list them in the paper.
Trouble is you can declare things to be true that are strictly speaking mathematically false, and from there get to proving any falsehood.
The Dirac delta function is a famous example of something mathematically non-rigorous at its inception, and mathematicians objected to it, but a few decades later Laurent Schwartz developed generalized function theory, that made it work.
Or going even further back, calculus was done in terms of ratios of infinitesimals (like dy/dx) or infinite sums of them (integrals). A century or two later the formulas of calculus were proven rigorously through classical analysis (delta-epsilon proofs) but that lost sight of the original motivations. A century or two after THAT, nonstandard analysis made a rigorous theory of infinitesimals, but reliant on relatively high powered mathematical logic that didn't exist til the 1950s or so.
Right now I think quantum field theory (renormalization, path integrals etc.) have been put on a sound mathematical basis but physicists mostly don't care. And very recently, an AI proved something about Yang-Mills theory that helped rigorize part of the Standard Model of particle physics. I don't understand that last part at all.
Besides physics, a lot of the procedures of machine learning and AI are mathematically suspicious but people use it anyway because it empirically works. People in the field have told me that yeah, they expect mathematicians will someday get around to backing it up, but for now, practitioners are moving forward with what they have.
When the lecturer wrote 1+2+3+...=-1/12 on the black board, I dropped out of the string theory class.
Why would it not be formalizable in Lean? People are formalizing parts of linguistics in Lean.
Most famously: to a physicist, the sum of all natural numbers is -1/12 https://en.wikipedia.org/wiki/1_%2B_2_%2B_3_%2B_4_%2B_%E2%8B...
If you attempt to formalize math involving such assumptions, one expects to encounter a proliferation of contradictions. So I’m curious to see how the contributions of AI authors is handled by the physics community. With pure math, you can ostensibly write a compact statement of a theorem in Lean, and if so, trust the process.
Yeah the use of divergent series in modern physics is certainly something. There is an equality that includes the sum of the natural numbers in it, and that evaluates to -1/12, but it's not equal to the sum of the natural numbers on its own. I can see reasons for why it might produce sensible answers in practice, but it does make me (admittedly not a physicist) suspicious.
OK, that goes right past me. However, the reference, in the wiki article, to https://en.wikipedia.org/wiki/Monstrous_moonshine seems appropriate.
> asserted that AI cannot do
I just love to see this, particularly the response when AI then goes on to do it.
We used to joke in my physics undergrad that they didn’t need a math department because we were doing all the stuff they were doing but with actual applications. Then the mechanical engineers said the same thing about us!
One of the most efficient ways to torture a pure mathematician is to force him to watch how physicists treat math.
I have strong, complicated feelings about it, and I understand you may not feel the same way, but "I like" is not a good description in my case.
What do you not like?
"I do not like" is also not a good description.
Maybe “thrilled” except in the sense that you’re in a SciFi thriller with a giant alien spaceship hovering overhead in the sky, in much the same way bricks don’t, and you don’t know if they’re friendly or hostile or just doing a survey for their new hyperspatial express route ;-)
This is an excellent description.
I think this is due to the unrelatedness to our universe.
> https://news.ycombinator.com/item?id=50563604
> I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
Because they want you to think that you will be able to do the same, too.
Except, you don't have a dedicated cluster for a week with an unrestricted model.
or an IPO launch
"Claude solves" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "it broke out of the sandbox" vs. "we failed to build an adequate sandbox".
What does it mean for Claude to solve it? What was the prompt? I didn't read it all, but the word "prompt" does not appear in the blog post, either abstract, or either paper.
It means someone set up the question with the Claude tool and let it iterate until it came up with an acceptable solution.
When my accountant whips out a calculator, it is the accountant that defined the problem and set the solution in motion. Fantastic tools are still tools. Claude does not love me nor you no matter how its trained and encoded patterns express.
Right, but in that situation, the email from the accountant isn't titled "TI-34 finished your taxes". The accountant did all the interesting work. (This metaphor is getting stretched, since accountants usually use software to do the taxes, and that software does a lot more of the interesting work than a pocket calculator does. But even then, the accountant has done the most important work in telling the software about your tax situation and the summary is still "the accountant has finished your taxes".)
When you ask it to make a banana picture and it goes of on a tangent solving a black hole physics problem, what then.
Michael would be pissed it wasted $10 in tokens?
Congrats on the tangent!
> It means someone set up the question with the Claude tool and let it iterate until it came up with an acceptable solution.
And you know the details how?
"Spinning Jenny-spun yarn" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "the boiled exploded" vs. we failed to build an adequate boiler".
What does it mean for Jenny to spin it? Who provided the power to it? I didn't read it all, but the word "power" does not appear in the patent, or the newspaper articles about it.
it's also meaningful though, in that it's a tool trained on enormous amounts of stolen human thought. so recognizing that it's the stolen thing that did the thing, and not the company itself, gives people back some of the credit
It probably means some physicists were using it to study black holes and it stole their work.
From a cursory glance the bootstrap paper is really hard to read, however the blog post is easier and seems more human written.
The first result is cool (but basically a complex error-prone calculation), the second is much much cooler, Claude proved the upper limit for the mass of a black-hole which is consistent with a given central charge. (thereby making it a consistent theory of quantum gravity), any theory predicting above this is not a theory of quantum gravity of that universe. This is very exciting!
> thereby making it a consistent theory of quantum gravity
Careful. Thereby making a not-inconsistent-via-bootstrap theory. Such a theory could be inconsistent for other reasons shown by other methods. The article expresses a desire to show inconsistency for M1 above c/12 for example, but it's now been shown that the boostrap method can't get you that far.
Agreed on the correction.
Proved it in a 2d universe.
That's how all modern quantum gravity theory progress is done. You start with the simpler universes and move up from there.
I recommend this sad story:
https://nautil.us/what-does-any-of-this-have-to-do-with-phys...
Hardly seemed sad to me: standard physicist coming-of-age story maybe.
Most who study physics at this level, especially theoretical physics, end up moving on to something else quantitative. Most of them do quit on some level: there's usually a way to keep going, and usually life's circumstances mean it's no longer worth it.
But very few actually regret the time they spent in it, from what I've seen.
man that hit me like a brick. am going through the arc the writer went through myself right now. early 20s are a bitch in terms of these revelations.
"It works in vitro."
From the announcement --
"Neither result describes our own universe directly, and neither has practical applications, but both contribute to a long-running theoretical effort to understand how quantum mechanics and relativity fit together."
This sounds pretty normal for theoretical physics, like when models make assumptions about symmetries or homogeneity.
For example the famous Schwarzschild solution (that predicts black holes) doesn't apply to our universe, because it assumes a black hole that's been there forever, not one that formed. But it was still very useful for our understanding.
It also assumes zero angular momentum, which we know is essentially impossible in our universe. And rotating black holes (the Kerr metric) are much stranger beasts.
Doesn't GPS model Earth's gravity using Schwarzschild?
Schwarzschild allows you to still calculate a whole bunch of things outside the event horizon. The part where it changes from our universe is the physics inside the black hole and their formation
Yes, models can be useful, even if they don't strictly apply.
Spherical universe as opposed to spherical cows
It's the physics equivalent of "in mice"
Schrödinger's mouse?
Ok so the ultimate test is throwing mice in a black hole I guess
Though you need to start by throwing mice from another universe into a black hole in our universe.
That's how they got here in the first place.
I think AI papers should always include prompt / prompting history as an annex
I think everyone asking for this kind of thing doesn't really understand the scale and complexity of solving a big problem with many agents.
For any of the big things I've worked on, it isn't one "prompt", it's a goal that keeps getting updated and a bunch of back-and-forth steering of the model and sub agents, where what the human is saying to guide the model is heavily context dependent on what the model is currently doing or saying. Much of that guidance will ultimately be useless guidance on dead-end explorations. Also, the model will likely have written huge programs to solve things symbolically or simulate things numerically, and both the programs that were written, and the output of those programs are critical to understanding how the model came up with the things that led to a solution.
Now, I'd be all for publishing the full transcript, but the transcript is likely to be massive. Gigabytes of text, and reproducing the local computation (often sympy or numpy) may be hundreds or thousands of CPU-hours.
It is common in physics and astronomy to share your code that takes millions of cpu hours to solve problems, and to share your resulting data that can be in the petabytes.
Gigabytes of text seems perfectly shareable nowadays. Just as with most computational physics stuff of that scale, sharing code that can reproduce the result and roughly describing the computational requirements would be fine.
LLMs are not deterministic, which to my dumb mind, seems to lessen the value of those inputs since they will not inherently get you down the same path, no?
If it's good enough for kids ("show your working") it's surely good enough for the bros' puffery.
Yesterday's PBS Space Time: AI Is Breaking Math. Will It Solve Physics Next? https://youtu.be/wCRzZ0ccP_0
They should do something easy, like driving. Or have it figure out how to learn so anybody can teach it driving the same way we teach kids.
Unexpected PBS Space Time x Anthropic collab on Fable 5.2 announcement. The conspiracy theory: PBS insider-traded $ANT.
:)
Apart from Claude/Anthropic no attribution whatsoever - neither on the Hexagon entry nor in the PDF. Isn't this a novelty, even for papers that are 100% the product of AI?
I credit an entity with work that is largely AI. Soon it will just be people credited, everyone will just assume AI was used.
The entity making the progress should be credited.
"Claude did it" doesn't cut it. What's Claude anyway? Some client app talking to Anthropic API's? That's just shuttling prompts and output back & forth.
Researchers x, y or z doesn't cover it either. In this case they'll have relied on Claude for some heavy lifting.
Suggestion: name all the parts involved. "This research was done by Alice, Bob & Carol, using Claude with compute provided by Anthropic" - or something along those lines.
Credits given, clear who did what, no implicit assumptions.
Having a person on there would make the Machine God look bad.
That's the most unfortunate part of these recent discoveries. Even if the human "only" proofread the entire thing, that's still worthy of credit, because without their work, none of that output would be worth writing about.
Even through after all my skepticism about AI in science, Anthropic proved they can search for and find non-trivial discoveries with their tech, they've done very little to dissuade my fear they are actively hurting the scientific community for PR.
We could treat AI as just a helpful fuzzer for open-problems that occasionally opens new interesting paths for the actual scientists, but we know the end-goal of these people is a future where there are no qualified people left to review, let alone make new discoveries independently from the machine.
What do you expect them to do, give credit to all the physicists whose work they copied off the web without payment or licensing?
Companies working on theoretical physics problems. What a time to live in.
i cant say i fully understand this, i do quantum chemistry work so i only kinda understand portions of the first paper on black hole phase transitions. it is interesting that they're doing things kinda similar in black hole theory! i had no idea! the idea of black holes having phase transitions is one that my thermodynamics brain enjoys, and its nice to see perturbation theory in the wild. i am unfamiliar with much of the vocabulary used + would need days to build proper intuition on the problem setup. i do wish i could form a proper critique, the paper is at a weird space for me because some of the terminology is familiar, techniques used are similar, and i feel like if i really locked in i could develop an understanding of the paper in a few months. makes me want to go back to grad school.
i feel solipsistic saying this, but the more i understand about physics, the less awed i am by papers? obviously i am impressed, i know firsthand the amount of thought and calculations that goes into these sorts of results. but i dunno im just not awed. awe implies an incomprehensible greater than thou incredulity, and some of the physics in this paper feels really normal and achievable to me. i think im just too young to properly understand the effort this takes, maybe i should be awed, but im not.
i think i am trying to get at something where, it feels when ai labs put out big press releases on topics, they are making a big show of something only truly interesting to a small portion of people. if a human came up with these same results independently it would yield conference talks and grants, but ai is getting more eyes and a bigger press release just because its ai that solved it and not a human. which is impressive from an ai development standpoint! but less so from a physics standpoint (insert deintensifiers of this statement here im just stupid), so the physics feels like a prop.
still really interesting results though, again, i wish i understood enough of the underlying theories theyre connecting to feel really moved by the results. sorry for being so self centered in my analysis lol, wish i could do better but i cant.
And we are only at dawn
Interested to know if the writing has improved as compared to discoveries made by Astra.
Judging by the length of that page, no.
Whenever I see Claude publishing expensive research like this, I can’t help but think it’s because Anthropic has unsold compute capacity.
Think any novel idea coming out of Claude publically shared should legally require prompts to show up as part of the disclosure. That's more or less how science works with the papers already.
Over a decade ago I saw a talk about a cohesive and complete explanation for gravity. It didn't involve quantum mechanics nor a particle called a "graviton".
That talk did make enough sense.
I'm still waiting to see a "picture" of a black hole that didn't involve a "pre-trained model" developed with "synthetic data" or something like that.
I'm not feeling sufficiently persuaded that I can feel confident that gravitons are a thing.
Nonetheless, I am remaining open minded to this black hole stuff.
Really sick of seeing every single Claude post shoot to the very top every single time.
Also nice timing around same time as IPO
I think reality is these technologies just do not make money compared to the money they cost, at least not currently.
So they're just trying to shyster their way in as much as possible.
Really cringeworthy to see. I hope it all crumbles instead. They stole everyone's work.
ai is way to good
The biggest mystery to solve is if their IPO is in itself a black hole
It's not. Mystery over.
Given the date, more IPO-fodder or substantial?
Probably both.
First I've heard of Hexagon math ... backed by heavy hitters, no peer review:
Representatives of AI labs and other organizations may email admin@hexagonmath.org to arrange a verified lab account.
https://hexagonmath.org/organizations/anthropic
Also: The main result was first obtained autonomously by an internal Claude research model. The publicly available Claude Opus 5.5 later obtained the same result independently. Claude then wrote this paper, following brief guidance from a physicist, who also checked every main result.
Wild.
https://hexagonmath.org/who
Can they just focus on solving cancer?
Climate change too. In particular game theoretic solutions. I.e. technical solutions that can withstand global tensions and commercial and government constraints.
It doesn't exist.
Whilst there is no "world king" to make this decision, every nation will burn all their oil and coal, the world will warm, and people will adapt.
That has always been the future, and climate activists have mostly been wasting their time
Perhaps more impressive, Claude can also calculate the maximum number of Ewoks that will fit inside the Millennium Falcon
I'm glad they posted this today. For a moment, I got drawn back into the pre-singularity world -- I even checked a stock ticker!
It was a comforting moment, for sure. But ephemeral, self-imposed ignorance is no bliss at all :(
Impressive. Now, can they ask Claude how to run a profitable company?
its doing pretty good? It's in a growth stage, doesn't need to make a profit yet
A lot of us are willing and today have already taken the bet that a model or system that can solve hard problems across math, physics, biology is genuine intelligence. It will command a great premium or it may even figure out in the not so distant future how to make money on its own.
> is genuine intelligence
OK, but it's still an unfounded claim and...
> a model or system [...] can solve hard problems across math, physics, biology
...is all that has been proven. That may one thing that intelligent humans can do, but it doesn't mean it requires human level intelligence. All computers are superhuman in some narrow sense.
> in the not so distant future
Any minute now
Just 6 months away! /s
The new currency is hype and cult of personality
Hype always manages to outrun results, and hype can be turned into cash.
Barely done the IPO, solved two Black Holes already.
Next up, the Origins of the Universe... stay tuned for our Fable e^2. More on the 10 o'clock news...
/s
I'm guessing they solved something using Lean? LLM only solve coding problems. They're useless for anything else.
Answering myself: yes, one of the problems was solved using Lean. The other was undisclosed. Nothing new under the sun, huh.
Perhaps more impressive, Claude can also calculate the maximum number of unicorns that will fit inside the Millennium Falcon
Another Anthropic advertisement. Why do we even bother visiting this site anymore?
Honey, it's time for your daily Anthropic PR piece!
How does this make my life easier or better?
Like "How does contributing to humanity's shared understanding of the universe directly serve you?", is that what you are asking?
In other words, you don’t think theoretical physics is a worthwhile pursuit?
I do, just not worthwhile of a $2T valuation.
by increasing your net worth if you hold pre-IPO Anthropic shares ;)
For real
> a particle can take both routes simultaneously
Stopped reading right here. It took one. Maybe you don't know which one it took but things can't be in two places at once.
It can! Until you observe.
If you don't, it could have taken either route.
If you observed route A you either saw it, or saw nothing meaning it took route B.
Of course it would have taken route A until you decided to observe that route. Then it took route B.
That's just philosophizing. It didn't ACTUALLY take both routes. It took one. You just didn't know it.