General relativity from first principles – Adam Brown
General relativity from first principles – Adam Brown
Summary
Physicist Adam Brown — who now leads Blueshift at Google DeepMind and once taught a 20-lecture graduate course on general relativity at Stanford — returns to Dwarkesh Patel’s podcast to distill “the most beautiful product of a single mind” down to its core insight. He starts with the puzzle Einstein faced: Newton’s inverse-square law of gravity implies that jiggling the Sun would change the force on Earth instantly, violating special relativity’s rule that nothing travels faster than light. The clue Einstein seized on — his “most beautiful thought” — was a coincidence baked into Newtonian physics: the gravitational mass that gravity pulls on is exactly equal to the inertial mass that resists acceleration. Brown uses a bucket of water swung in a loop and the centrifugal force to show that “fictitious” inertial forces always have a charge equal to inertial mass, which let Einstein make the radical leap that gravity itself is an inertial force — meaning objects in freefall move along straight lines through a curved spacetime, while those of us standing still are the ones being accelerated.
The middle of the episode is a lecture on black holes. Brown reconstructs the 18th-century escape-velocity argument that yields the Schwarzschild radius (2GM/c²), then gives a more compelling thermodynamic argument: lowering a brick toward a compact enough object would let you extract more than its entire mc² of rest-mass energy — an apparent perpetual-motion machine that general relativity forbids by making the gravitational force become infinite at the event horizon, forming a black hole. He walks through three consequences of the Schwarzschild metric — the diverging static force, gravitational time dilation (already measured in a 1950s Harvard experiment and corrected for in GPS), and gravitational redshift — and shows how they resolve the paradox: a black hole is the ultimate 100%-efficient power plant. He contrasts the two perspectives on falling in: a distant observer sees you redshift and freeze at the horizon, fading to black, while you sail across it feeling nothing, “doomed but not dead” until the singularity.
The final act covers evidence and epistemics. Brown lays out the three independent lines of evidence that black holes are real (the stars orbiting Sagittarius A*, LIGO “feeling” spacetime shake from merging black holes, and the Event Horizon Telescope), and tells the story of the 1919 eclipse expeditions that confirmed light-bending and made Einstein a global celebrity — including how failed earlier expeditions luckily gave Einstein time to correct his prediction to twice the Newtonian value. He and Dwarkesh close on whether AI could rediscover physics from a “cave,” why string theory bet everything on there being only one consistent theory, and Brown’s optimistic case that large language models will be not just superhuman provers but “superhuman explainers” that make inscrutable proofs comprehensible to humans.
Highlights
”Could it be the case that gravity itself is an inertial force?”
“could it be the case that gravity itself is an inertial force?” — Adam Brown, 20:37
Clip command
yt-dlp --download-sections "*20:37-21:30" "https://www.youtube.com/watch?v=QbdbAhaJoCQ" --force-keyframes-at-cuts --merge-output-format mp4 -o "gravity-as-inertial-force.mp4"
”Matter tells spacetime how to curve”
“Matter tells spacetime how to curve. And then once matter has told spacetime how to curve, the curvature of spacetime tells matter how to move.” — Adam Brown, 30:00
Clip command
yt-dlp --download-sections "*30:00-30:55" "https://www.youtube.com/watch?v=QbdbAhaJoCQ" --force-keyframes-at-cuts --merge-output-format mp4 -o "matter-tells-spacetime-how-to-curve.mp4"
”The most efficient possible power plant”
“It is the most efficient possible power plant because by building an apparatus like this, in principle I could extract 100% of the energy of whatever I started with.” — Adam Brown, 70:23
Clip command
yt-dlp --download-sections "*70:23-71:15" "https://www.youtube.com/watch?v=QbdbAhaJoCQ" --force-keyframes-at-cuts --merge-output-format mp4 -o "black-hole-power-plant.mp4"
”You are doomed, but you are not dead”
“You are doomed, but you are not dead. You are only for sure dead once you hit the singularity and get spaghettified, get mangled by the tidal forces.” — Adam Brown, 78:00
Clip command
yt-dlp --download-sections "*78:00-78:50" "https://www.youtube.com/watch?v=QbdbAhaJoCQ" --force-keyframes-at-cuts --merge-output-format mp4 -o "doomed-but-not-dead.mp4"
”You just fade to black”
“There’s like a final photon that I see that you emit and then you just fade to black, fade through red to black, I never see you cross the event horizon.” — Adam Brown, 76:05
Clip command
yt-dlp --download-sections "*76:05-76:55" "https://www.youtube.com/watch?v=QbdbAhaJoCQ" --force-keyframes-at-cuts --merge-output-format mp4 -o "fade-to-black.mp4"
”Superhuman explainers”
“as well as being superhuman provers, we also expect these large language models to be superhuman explainers.” — Adam Brown, 96:11
Clip command
yt-dlp --download-sections "*96:11-97:00" "https://www.youtube.com/watch?v=QbdbAhaJoCQ" --force-keyframes-at-cuts --merge-output-format mp4 -o "superhuman-explainers.mp4"
Key Points
- “Not even gravity” can go faster than light (3:00) - Special relativity promotes “nothing goes faster than light” to a principle; general relativity extends it to gravity, completing the set of fundamental forces.
- Newton’s inverse-square law breaks special relativity (6:48) - Jiggling the Sun would change the force on Earth instantly, implying a faster-than-light influence — the inconsistency Einstein had to resolve.
- The equivalence principle (15:26) - Gravitational mass equals inertial mass to one part in 10^15, which is why a feather and a brick fall at the same rate in a vacuum.
- Centrifugal force as the model (18:16) - Inertial (“fictitious”) forces always have a charge equal to inertial mass — the property Einstein wanted gravity to share.
- The leap: gravity is an inertial force (20:37) - This turns the mass coincidence from an accident into a necessary fact, but requires being “wrong” about which paths are straight lines.
- Straight lines on a curved surface (24:40) - The San-Francisco-to-London flight path over Greenland shows how flattening a curved space distorts what counts as straight.
- Matter tells spacetime how to curve (30:00) - Einstein’s field equation: mass-energy curves spacetime, and that curvature tells matter how to move — from a falling apple to the expansion of the universe.
- Schwarzschild’s exact solution (33:00) - A Prussian artillery officer found an exact solution within months of Einstein’s equations; it describes a black hole, though it confused physicists (including Einstein) for half a century.
- Escape velocity equals the speed of light (33:59) - An 18th-century argument yields the critical radius 2GM/c² where not even light escapes.
- The energy-extraction paradox (43:23) - Lowering a brick toward a compact enough object would let you extract more than 100% of its rest-mass energy — something has to give.
- Infinite force at the event horizon (51:14) - At r = 2GM/c² the acceleration needed to stay static diverges; cross it and you cannot escape no matter how hard you fire your rocket.
- No stable orbits within 3GM/c² (52:58) - Because kinetic energy also gravitates, orbiting stops helping and starts hurting once you get too close.
- Gravitational time dilation (57:30) - Clocks run slower deeper in a gravitational well — measured in a 1950s Harvard experiment and corrected for in every GPS satellite.
- Gravitational redshift (61:30) - Light climbing out of a gravitational well loses energy and shifts red; the time exchange rate is also the energy exchange rate.
- Two perspectives on falling in (74:05) - A distant observer sees you freeze and redshift at the horizon; you feel nothing unusual and sail across it, doomed but not dead.
- Three ways we know black holes are real (79:01) - Stars orbiting Sagittarius A*, LIGO detecting merger gravitational waves, and the Event Horizon Telescope imaging infalling matter.
- The 1919 eclipse that made Einstein famous (84:27) - Light-bending measured during a total solar eclipse matched Einstein’s prediction of twice the Newtonian value.
- How far can thinking alone get you? (90:28) - General relativity was “an Ayn Rand hero sitting alone” — a singular vision from minimal empirical input that physics has been chasing ever since.
- AIs as superhuman explainers (96:11) - Rather than producing inscrutable proofs, LLMs may make hard proofs human-comprehensible, as with a recently proved Erdős problem.
Mentions
Companies
- Google DeepMind (0:00) - Adam Brown leads Blueshift, its team “cracking science and reasoning.”
- Stanford (0:00) - Where Brown taught his 20-lecture general relativity course.
- Jane Street (22:17) - Sponsor read; many of its traders have physics backgrounds.
- Harvard (57:30) - Site of the 1950s atomic-clock experiment confirming gravitational time dilation.
- Crusoe (46:05) - Sponsor; serverless fine-tuning product Dwarkesh used to build a question generator.
- Cursor (72:40) - Sponsor; its iOS app let Dwarkesh kick off a nanoGPT analysis from dinner.
- Mount Wilson Observatory (84:27) - Its director explained why light-bending could only be measured during an eclipse.
- Krupp (87:00) - Arms manufacturer that sponsored a German eclipse expedition to Crimea, aborted by WWI.
Products & Technologies
- GPS (57:30) - Must subtract gravitational time dilation to stay accurate.
- LIGO (81:00) - Laser interferometer that “felt” spacetime shake from merging black holes in 2015.
- Event Horizon Telescope (81:00) - Radio-telescope array that imaged matter falling into black holes.
- nanoGPT speedrun / GPT-2 (72:40) - Karpathy’s fixed-loss training benchmark Dwarkesh used to estimate sample-efficiency gains.
- Lean (95:31) - Proof assistant; Terry Tao’s “indigestion” worry about billion-line inscrutable proofs.
People
- Albert Einstein (0:32) - Developed both special (1905) and general (1915) relativity, largely single-handedly.
- Isaac Newton (4:03) - His 1687 Principia laws of motion and inverse-square gravity are the starting point.
- James Clerk Maxwell (9:54) - His equations turned out to be consistent with the speed-of-light limit, seeding special relativity.
- Karl Schwarzschild (32:09) - Prussian artillery officer who found the exact black-hole solution during WWI.
- John Michell & Pierre-Simon Laplace (35:50) - Wrote down the escape-velocity-equals-light argument in the late 18th century.
- Stephen Hawking & Jacob Bekenstein (71:45) - Discovered that black holes radiate energy and eventually evaporate.
- Roger Penrose (79:01) - Showed black-hole formation is a generic feature of general relativity (Nobel Prize).
- Sir Arthur Eddington (87:00) - Led the 1919 British eclipse expedition that confirmed light-bending.
- Terry Tao (95:31) - Coined the “indigestion” worry about inscrutable machine-generated proofs.
- Jett Thompson (22:23) - Former particle physicist turned Jane Street trader (sponsor segment).
Surprising Quotes
“frankly our universe should be honored to be described by such a beautiful theory.” — Adam Brown, 84:00
“So it is a very interesting fact once you turn on quantum gravity that black holes eat nucleon number.” — Adam Brown, 72:00
“if I took a black hole the mass of the galaxy, you’d be basically fine as you cross the event horizon.” — Adam Brown, 77:32
“theoretical physicists are pretty cheap… Well, the AI companies are really increasing the demand curve on the theoretical physicists.” — Adam Brown, 90:08
“while you could be building superintelligence, here explaining 100-year-old physics, but it was very interesting.” — Dwarkesh Patel, 98:14
Transcript
Dwarkesh Patel: 0:00 I’m back with Adam Brown. You currently lead Blue Shift at Google DeepMind, which is cracking science and reasoning. In a previous life, Adam was a prolific physicist, taught at Stanford, and did research on everything from cosmology, to string theory, to general relativity. It’s said that general relativity is the most beautiful thing the human mind has ever conceived or seen. And I was curious if there’s a way that ordinary people like me could understand what is happening, or have some vantage on why it’s beautiful, without taking your 20-lecture graduate course. So that was the prompt for this lecture. And I appreciate you being willing to do it.
Adam Brown: 0:32 Super exciting to be here. And yes, I think the answer is yes. Yes, we can. Yeah. So I mean, general relativity, Einstein’s theory of gravity, is, as I think as you said, like, the most beautiful product of a single mind that we’ve ever created. It’s one of the two great theories of 20th century physics, along with quantum mechanics. And unlike quantum mechanics, it was basically Einstein. He had a little help, but basically one person doggedly pursuing this idea for 10 years. And then wrote down this theory that ends up describing the motion of planets in a solar system, and also the the origin and fate of the universe. And it’s pretty, pretty extraordinary. And it took Einstein, one of the most famous minds in history, about a decade to figure it out. But, you know, when I teach it, I’ll do a 10 week course. And so in 10 weeks, people will get a better idea of general relativity than Einstein really had in 10 years. And that’s kind of because we have an advantage that Einstein didn’t have, which is that we have Einstein and many others like him going before us, who’ve been able to take these super complicated ideas that were understood at the time as being totally incomprehensible by anybody with a sub-Einstein level of intelligence and boil them down to their essentials and, you know, not make many of the same mistakes that were made by our forebears. I think in, you know, 10, 20 minutes, I can’t give you a better idea of general relativity than Einstein had, but we can get to the core insight, what Einstein said was his most beautiful idea, and push through it to try and understand what the central idea of this this theory is. Okay. Let’s go. Before general relativity, there was there was special relativity. So special, meaning it doesn’t apply everywhere. That was also invented by Einstein, 10 years earlier, in 1905, during his annus mirabilis. And, you know, if you want to sloganize special relativity, you would start with the observation or the the hypothesis that nothing can go faster than light. Special relativity takes that observation, promotes it to a principle, takes that principle extremely seriously as the central observation of our understanding of spacetime, and you arrive at special relativity. Special relativity applies to electromagnetism… relativism. It applies though Einstein didn’t even know about these at the time, it applies straightforwardly to the strong and weak nuclear forces, two of the other fundamental forces that we know about. It does not obviously apply to gravity. And so that was corrected 10 years later by Einstein in his general theory of relativity, a theory more general because it includes gravity, completes the set of fundamental forces. Again, invented by Einstein after 10 years of dogged pursuit in 1915. If you wanted to sloganize general relativity, you might say, not even gravity. Nothing can go faster than light, not even gravity. There’s much more to it than that, but it’s going to complete this arc of the centrality of nothing being able to go faster than the speed of light.
Dwarkesh Patel: 3:58 Okay, so to see, you know, some background here, we’re going to have to rewind
Adam Brown: 4:03 and we’re going to have to rewind all the way back to the theory of gravity that existed before Einstein. The reigning theory of gravity at the time of Einstein stretches all the way back to Newton in the late 17th century.
Dwarkesh Patel: 4:19 Um, so let’s talk about that.
Adam Brown: 4:21 So Newton’s laws in his Principia in 1687, Newton’s laws,
Dwarkesh Patel: 4:28 well he had a few.
Adam Brown: 4:31 And you know, maybe the one that we can most talk about today is two of them, which is his famous second law that says the acceleration A caused by a force is given by the formula MA equals F. That if you have a force F, it’ll cause an acceleration on an object given by A, where the mass tells you how much a object resists being accelerated. The bigger the mass, the bigger the force you need to cause a given acceleration. And this law, his second law, will turn out to be still true once we come to general relativity. We’ll have to have a more sophisticated understanding of what we mean by force and acceleration, but this will be preserved by general relativity. A special case of the second law is Newton’s first law. Newton’s first law says that if the force is zero, then the acceleration is zero. If the force is zero, then objects continue to move on a straight line at all times. And that will also continue to be true in general relativity, that if not subject to an external force, objects move along straight lines. However, we’ll have to upgrade our understanding of what we mean by force and what we mean indeed by straight line.
Dwarkesh Patel: 5:57 Okay, that’s going to keep being true.
Adam Brown: 5:59 The one that’s not going to keep being true is Newton’s law of gravity. So Newtonian gravity, this tells you what the acceleration is in response to a force, but you need to know what the force is to be able to do anything with that. And Newton’s law of gravity says that the force caused by the gravitational interaction of two bodies is, well, what’s called Newton’s constant, just some constant of nature, times the mass of one body times the mass of the other body, the mass of the Sun times the mass of the Earth, divided by the distance between them squared. His famous inverse square law. And it points, the vector that points in the direction of separation, and it’s attractive, so there’s a minus sign there. This will not be true in general relativity. And in fact, you immediately see that there’s a tension between this gravitational force law and the claim that nothing can go faster than the speed of light. If this was literally true, then by jiggling the sun, according to a straightforward interpretation of this law, it would just say that the force at the earth varied immediately. I’ve changed the distance of the Earth and the Sun, and so I can immediately detect it at the Earth, not eight light, you know, eight minutes later, but just immediately. So that would imply that you could send an influence faster than the speed of light. It is inconsistent, Newton’s force law, with this principle. One option, of course, could be that this is true for non-gravitational forces, but not true once you have gravity. And indeed, using gravity, you could perhaps build a faster-than-light telephone using gravitational effects. That’s a possibility, but not a possibility that Einstein really wanted to embrace. He’d spent, you know, many years chasing out any possibility of going faster than light or any superluminal influences. And so Einstein, and in fact, many people at the time, thought that this is the one that has to give. And indeed, that is in fact what’s going to turn out to be true. Okay, so where are we? There’s actually a precedent here for an inverse square law getting modified in such a way that it ends up being consistent with special relativity. And that precedent is the other force of nature, the electric force. So there’s also the electrostatic force law, not written down by Newton, but written down a century or so later, which says that the force caused not by the gravitational interaction of two objects, but by the electrostatic interaction of two charged objects, has a very similar form to the gravitational force. It tells you that the force is equal to some constant times the charge of one object times the charge of the other object, pointing also in the direction of separation between the two objects. divided by the distance squared. Another inverse square law. And again, for exactly the same reason, the electrostatics looks to be inconsistent with special relativity. But ultimately it’s not, or ultimately this is not the full story. Electrostatics is just one limit of the true theory of electromagnetism which is Maxwell’s laws, that has not just electric forces, it also has magnetic forces, and the electric forces only look exactly like this when nothing is moving. When things do start to move, there are additional corrections to this, all of which conspire to make the electrostatic force law fully consistent with special relativity. In fact, the historical direction of understanding ran the opposite way. First of all, you have Maxwell in the middle of the 19th century writing down Maxwell’s equations and only later do people notice, hey, Maxwell’s equations actually are sort of fully consistent with nothing can go faster than the speed of light, and that consistency is reflected in the symmetry called the Lorentz symmetry of the Maxwell field equations, only noticed later after they were written down, that eventually led Einstein to formulate his special theory of relativity. So we have a precedent for starting with an inverse square law and then, you know, dressing it up in a full relativistically invariant theory. And so you might say, well, let’s just take gravity and do exactly the same thing to gravity that we did to electrostatics in order to make some gravitomagnetic theory that makes Newton’s second law an approximation that’s ultimately consistent with special relativity. And in some grand sense, that is what we’re going to end up doing, that is what Einstein’s going to end up doing, but it’s going to be a much more radical departure than the Maxwell generalization of electrostatics. And there’s really two hints, both of which are visible in this formula, that we’re going to have to do something slightly different than we did for electrostatics. The first thing to notice, the first difference between the electrostatic law and Newton’s law of gravity, is this sign difference. There is a big difference, which is that here it’s a minus sign and here it’s a plus sign. That is reflected in the fact that if you have two positive mass, you know, the Earth and the Sun, they gravitationally attract each other. Conversely, if you have two like charges, they electrostatically repel each other, which is why that’s a minus sign and that’s a plus sign. That means that you cannot do literally the same thing for gravity that you did for electromagnetism because otherwise if you did… Mathematically the same trick, you’d end up with mathematically the same result, which is that you would find that like masses would repel rather than attract. Not to get ahead of ourselves, but ultimately that’s because electrostatics is mediated by a spin-one particle, the photon, and gravity is going to be mediated by a spin-two particle, and that’s… that’s responsible for the change in… change in that sign there.
Dwarkesh Patel: 12:25 Okay, so that’s why you can’t do exactly the same thing as electrostatics, and so Einstein had to look for something else.
Adam Brown: 12:31 He had to look for some other way to try and lift this to a relativistically invariant theory. And in doing that, he had one clue, and, you know, there’s lots of stuff going on. It’s parts of Einstein’s central genius to focus on this as a highly significant clue of where he should look. Sometimes described as his… his most beautiful thought, that… that is how he would describe it. And the clue is this: there is another difference between the gravitational… uh… force law and the electrostatics. And that is the… this object that plays the role of the charge, you know, the analog of the charge, uh, in electrostatics in gravity, and it’s the fact that it’s the mass sitting here. And that’s like a… a strange coincidence from Newtonian physics. So mass in electrostatics force equations and accelerations plays exactly one role. It’s sitting here, it’s the… it’s the inertia of the object and it’s what is resisting being accelerated. Uh, sitting here is sometimes called the inertial mass that’s sitting here. And then the charge is completely different and unrelated to the mass. You can have heavy objects that have no charge, like the neutron. You can have light objects, like the electron, that have high charge. There is no relation… necessary relation between the charge of a particle and its mass. They’re… they’re just two entirely separate things. Not true in gravity. In gravity, this mass that’s sitting here in Newton’s second law, the inertial mass that’s resisting the… resisting the force, is exactly equal to the mass that’s sitting here in Newton’s gravitational law, that’s telling you how much you’re pulled along. Uh, it’s the same mass. So this is sometimes called the gravitational mass. This is sometimes called the inertial mass. Um, and so unlike in electrostatics, the gravitational mass that appears in this formula is equal to what’s sometimes called the inertial mass that sits in this formula. This equation is already true in Newtonian physics. Newton noticed it, in fact, and did a number of experiments to confirm that this was true to, you know, one part in a thousand or so. By the time of Einstein we know it was true to one part in a billion and now we know it’s true to one part in 10 to the 10 to the 15. Um, you know, it’s striking that these two, the Newtonian physics, it’s just a complete coincidence essentially that those two are the same thing, nevertheless observed to be exactly the same thing. And this was Einstein, he honed in on this fact and it was his central, his central, his central clue for what to do next. This is sometimes called the equivalence principle and it’s responsible for the fact that if you take a feather and a brick in a vacuum chamber and drop them both, they will both fall and hit the ground at the same time. They’ll fall and hit the ground at the same time because even though the force on the brick is much stronger than the force on the feather because it’s heavier, that exactly cancels out the fact that the resistance to force on the brick is larger than the resistance to acceleration of a feather and they exactly fall at the same rate. So that, the equality of those two is responsible for that exact equality. Okay, so Einstein’s genius was to hone in on this as a central clue for how he’s going to end up replacing Newton’s law. And a reason it’s a central clue is because there is in fact another class of forces, not fundamental forces like electromagnetism or gravity, but a set of emergent forces that exactly have this property baked into them, that they must, that’s guaranteed in those theories. And to explain that, we’re now going to move over to the experimental section of this discussion. So here’s a bucket. Here’s some water filling the bucket.
Dwarkesh Patel: 16:49 You better know your physics Adam, otherwise I’m gonna throw the studio at you.
Adam Brown: 16:52 And no tricks, will you put your finger in there to confirm that it’s wet?
Dwarkesh Patel: 16:56 Okay.
Adam Brown: 16:57 So, you know, here is the bucket, at the bottom, no mystery why the water is not falling out of the bucket. It’s not falling out because the force of gravity, as we’d understand it, is pointing down to the bottom of the bucket. But now what we’re going to do is go a little bit faster and loop the loop. And now there is what you might find superficially surprising, which is that the water doesn’t fall out of the bucket even when the bucket is upside down. And there are two ways to understand that. One way is just the straightforward way, which is that you would say, you know, the water wants to fall out of the bucket when it’s at the top of its arc, but by the time it’s got itself together to accelerate enough to fall out of the bucket, the bucket’s moved on and is now below and it just didn’t have time to fall out of the bucket. You know, or you might say the same thing… that astronauts don’t end up falling to Earth. There is a second perspective. The second perspective, which is an equally valid perspective, is imagining that you’re riding along with the water in the bucket. And from that point of view, there’s another explanation for why the water doesn’t fall out of the bucket. And that is the centrifugal force. That from the perspective of somebody moving along with the bucket, there is a force pushing them towards the bottom of the bucket. Um, and that force is, is known as the centrifugal force and it’s what’s known as a fictitious or inertial force. And the centrifugal force just says that, you know, there is a force caused by being in a rotating reference frame, given by your speed divided by the radius of the circle you’re going around in, pointing outwards, positively outwards. And so this is the centrifugal force that pins you to the bottom of the bucket, or pins you to the outside of the car as you go around a bend. Um, and okay, what do we notice? What we notice is that your charge under the centrifugal force, if you will, how intensely you feel a centrifugal force, is once again, just like with gravity but unlike with electrostatics, given by your mass. You know, the centrifugal the mass of centrifugal force that tells you how much centrifugal force you get is given by your inertial mass. But of course, here it’s absolutely no mystery whatsoever why the mass that’s sitting here on the right-hand side is given by is given by your inertial mass. It is given by your inertial mass precisely because it is the tendency, the reason you’re experiencing this force is precisely the tendency of masses to wish to move along straight lines, and the fact that you’re not moving along straight lines, you’re moving in a circle, it is precisely that inertial tendency that causes the mass to begin with. Another way to say it is for any time you have one of these inertial forces caused just caused by your inertia, it is guaranteed to be the case that the charge under that force is given by the inertial mass. Okay, so inertial forces always have a charge given by the inertial mass. Gravity has a charge, the charge of gravity is given by the inertial mass. So Einstein leapt could it be the case, and this was his central idea could it be the case that gravity itself is an inertial force? That’s permitted because the gravitational mass is equal to the inertial mass. It would be totally impossible straightforwardly for something like electromagnetism, because it would require that the electromagnetic charge was equal to the inertial mass, which is just simply false for electromagnetism. Could it be the case, Einstein asked, that it that it’s true for gravity? It’s permitted by this fact, it would also explain this fact. It is now not an accidental truth like Newtonian’s laws but a necessary fact about the world. So this was Einstein’s central, central idea in 1907, his most beautiful thought. But it sounds totally crazy. And it sounds totally crazy because it requires us to be wrong about what straight lines are. This is an extremely radical proposition for the reason that I will describe right now. Inertial forces like, like the centrifugal force or like the Coriolis force or any of these other ones that we’re familiar with, inertial forces are forces you experience when you are not moving on a straight line. When you are moving on a straight line, you don’t experience any forces. You don’t experience inertial forces. So in order for this to be true, we’d have to say that astronauts who are free-floating and free-falling are moving along a straight line. And we’d have to say that you, who’s just sitting there not seemingly not moving, who is experiencing the force of gravity pushing you into your chair, we’d have to say that you’re not moving along a straight line. So we’d have to be pretty wrong about who’s moving along a straight line and who’s not moving along a straight line.
Dwarkesh Patel: 22:17 As I’ve gotten to know the folks at Jane Street, I’ve noticed that a lot of them have physics backgrounds. I recently got a chance to talk to Jett Thompson, who was a particle physicist before he was a trader, about how his physics training helps him with his work at Jane Street. I think very few Jane Street traders or researchers come in with any finance background or any trading background. When I used to be in physics, something that I would say is I almost never do a calculation without already having a pretty good guess at the answer. In trading, I think the same is true. These things are fundamentally models for how the world is behaving. You can build good intuition by seeing patterns over and over again and come to a point where you’re mostly asking the right question from the beginning, which short circuits a lot of the work. So even if you don’t have a finance background, or for that matter, a physics background, you should still consider applying. Go to janestreet.com/dwarkesh to learn more.
Adam Brown: 23:14 So this is a radical idea because it requires us to be wrong about what a straight line is. In particular, you sitting here, just sitting in your chair, here is your height above the center of the earth as a function of time. And here is Dwarkesh, just sitting here at constant height. Because you are experiencing the force of gravity, if gravity is an inertial force, because you’re experiencing a force down, that means that you have to be moving along a not straight line. And so that’s you. By contrast, this piece of chalk as it goes up and down executes some… And this is well approximated by a parabola. There is the chalk up and down. The chalk you know is in freefall until I catch it, which means that if gravity is an inertial force, this has to be straight. Now certainly the way I’ve plotted it, this looks straight and that one does not. So if gravity is to be an inertial force, we have to be confused, wrong about what is a straight line and what is not a straight line. Uh, however, this is actually a situation to which you should be familiar if you’ve sat in an airplane seat and looked at the screen in front of you. If you imagine the map that you see on an airplane, imagine you are flying from San Francisco to London. Now, I’m not, not good at drawing the Earth, but here, here is my version of it. Here we are, in fact, in San Francisco. Here is Greenland coming in from the North Pole, and here is England, here’s London.
Dwarkesh Patel: 25:06 I can tell you’re a physicist because of the very idealized forms of the continents.
Adam Brown: 25:10 And you know, sometimes it can be quite frustrating to sit there in the backseat of the airplane because you know, obviously the plane should be flying like this, moving along the shortest distance from one place to another, but instead they take this massive detour that clips Greenland and heads on down. You know that in fact that’s not what’s going on. You know that in fact, despite what it looks like on the graph, this is not a straight line, this rhumb line as it’s sometimes called, is not straight and would certainly not be the shortest path from San Francisco to London. And this is in fact to good approximation a straight line. So in fact, the straight line from San Francisco to London does indeed go over Greenland, as I will now demonstrate. So, here is San Francisco, here is London, and you can see that the straight line that goes straight from one to the other would go in this direction, over Greenland and hit London. That’s obvious on this map because this map obviously reflects the curvature of the Earth. This map is getting confused, and it’s getting confused because it’s trying to pretend that the Earth is flat. It is trying to ignore the curvature of the Earth and because it’s trying to map a round— On Earth, onto a flat panel, there has to be distortions. And whenever you try and take something that is curved and pretend it’s not curved, you will inevitably end up being wrong about what is and is not a straight line. You see this on the Earth, where this line that goes up and then comes down is in fact the straight line. You see it also in spacetime with general relativity, where this parabolic arc of the chalk as it’s thrown up, it is in freefall, it is the straight line in general relativity. And just like in general relativity, the reason you are confused about what’s straight and what’s not straight is that you are trying to pretend with this graph that you are in a flat spacetime and in fact you’re in a curved spacetime. So in Einstein’s theory, the fact of matter is going to be to curve spacetime. And through curving spacetime, it’s going to change what’s a straight line and what’s not a straight line. And then people who are going along what they incorrectly think of as straight lines are going to experience the gravitational force, whereas astronauts are going to not experience the gravitational force. The only missing piece here is to mathematically characterize the way in which spacetime is curved. You know that in Newtonian physics, the Newtonian force is caused by the presence of mass. In Einstein’s general theory of relativity, it will be the curvature of spacetime that is caused by the mass. And he struggled for eight years between 1907 when he had this picture approximately mapped out, and 1915 when he wrote down in its finished form his general theory of relativity. And the final output of that eight years was his famous formula that I will not explain but will write down that exactly captures his intuition. And I will walk you through this formula. And so this is just a beautiful formula and the left-hand side is some mathematics invented by some Eastern Europeans that characterizes the curvature of spacetime. This says how much spacetime is curved. This is some tensor and the tensor would be zero if spacetime were flat. And it’s non-zero when spacetime is not flat, it’s curved in a particular way. On the right-hand side is not spacetime anymore. On the right-hand side is matter. There’s some constants, just, you know, our old friend Newton… Planck’s constant, pi, an even older friend, and the speed of light. And, and then this quantity T mu nu. T mu nu is like a relativistic generalization of the mass that sits on the right hand side of Newton’s force equation. And so it is saying that the presence of mass and in fact, not just mass, but all forms of mass and energy on the right hand side causes the curvature of spacetime on the left hand side. Or in a slogan: Matter tells spacetime how to curve. And then once matter has told spacetime how to curve, the curvature of spacetime tells matter how to move in the second half of the slogan. Where the curvature of the spacetime tells matter to move along straight lines of the curved space and so experience fictitious forces if you try and pretend that spacetime is flat. And that is Einstein’s general theory of relativity in a nutshell. Backing up, like an amazing thing about Newtonian gravity is that he invented it, you know, allegedly due to some thought experiment to do with an apple falling off a tree and it describes not only an apple falling off a tree but the motion of the objects in the heavens. Like that’s its massive cross-hit like that, that it describes planetary motion and also an apple falling off a tree. And this was like this amazing thing that Newton like unified the heavens and the earth and like had one formula that applied to both. General relativity does all of that and goes one step further. It describes the motion of apples falling off trees, it describes the motion of Mercury and the planets in the solar system and it describes the expansion of the entire universe. That’s like a crazy, you know, huge numbers of orders of magnitude hit that does all of those.
Dwarkesh Patel: 31:46 And you were saying a moment ago, one of the beautiful things about this theory is that it has reach in all these interesting ways that was not originally anticipated to solve this original observation that Einstein had and one of them obviously is the black hole. So I would love to get more insight than the high school version of light falls into it and can’t get out of why black holes work the way they do.
Adam Brown: 32:09 Yeah, so black holes are fascinating objects in general relativity and really the quintessential object in general relativity that doesn’t really exist in the same way in Newtonian physics. And the story is kind of wild. So Einstein wrote down his field equations, the field equations we wrote on the board describing the relation between curvature and the amount of energy in the system and he thought, you know, that those equations were so complicated no one would ever come up with exact solutions to them and we’d just always be having to do approximations. And that turned out not to be correct. That Schwarzschild, who was a Prussian artillery officer in the First World War, in between writing, you know, calculating the trajectories of artillery that they were lobbing over in the direction of their enemy…
Dwarkesh Patel: 33:00 He figured out that in fact Einstein’s equations, pretty much immediately after Einstein had written them down, within a matter of months, in fact, have an exact solution. An exact solution, a solution now known as the Schwarzschild equation, and that we now understand describes a black hole. It is a solution in which there is no matter except possibly at the very, very center, in a way we will not describe, a central point-like amount of matter, and it describes what the space-time around that looks like. It’s called the Schwarzschild solution, and it describes a black hole. They were not called a black hole at the time, in fact, people were extremely confused about what this solution even meant. People wrote down wrong things for about half a century about what this meant, and perhaps the worst offender was Einstein, who got extremely confused about it, particularly confused about what I will describe as the event horizon and wrote all sorts of wrong things about how objects would maybe bounce off the event horizon, just totally confused. From a modern perspective, it’s extremely simple to understand what’s going on.
Adam Brown: 33:59 So let me tell you what a black hole is. General relativity, as we set it up, is about the collision between gravity and the finite speed of light. And the simplest collision you could do was actually noticed by people even in the 18th century, before we had special relativity or anything like that. And they just asked a very simple question. If you want to shoot something off the Earth, you need to know you need to shoot it with a certain velocity, the escape velocity. You need to shoot it fast enough if you want to escape far away from the Earth so that the kinetic energy of the object you’re shooting is equal to the gravitational binding energy of the Earth’s surface. M is the mass of the Earth, and R is the surface of the Earth. And for Earth, that turns out it’s about 11 kilometers per second is the escape velocity. But for objects that are heavier or more compact, the escape velocity is larger. So for instance, Jupiter would be hundreds of kilometers a second, you need to shoot it off. And you could imagine objects that are so heavy or so compact that in fact the escape velocity becomes equal to the speed of light. And so people idly wondered what would happen then. They didn’t have the tools to address it, but in the 18th century they wondered what would happen. And you can calculate what the critical value of the velocity is and just putting the velocity equal to the speed of light, this gives a critical radius of 2GM, the mass of the object, divided by the C squared. And so that sort of sits, somewhat suggests that if you had an object that was this compact and had this mass, the escape velocity would be given by C, the speed of light.
Dwarkesh Patel: 35:44 The connection you’re pointing out is a Newtonian one. Did anybody make this connection before Schwarzschild?
Adam Brown: 35:50 Absolutely. So people in the late 18th century wrote this formula down. I think both Mitchell and Laplace had this in the 18th century, and they said that if you had an object that was that- massive and and compact
Dwarkesh Patel: 36:02 like
Adam Brown: 36:03 light would not be able to escape. That reasoning is not particularly compelling by modern standards, but it does turn out to be exactly correct even including crazily the factor of 2 is even even correct for a complete completely coincidental reasons. Let me give you a more compelling more compelling argument than that that something funny is going to happen around this around this radius. And to do that, let’s think about trying to extract energy from objects by lowering the objects down towards a central central mass. So let let’s start off perhaps with the earth, here it is, and we’re going to start off a long way away from the earth with a brick, a brick of mass m. And I’m going to take this this brick and attach it to a pulley system. And then I’m going to slowly lower the brick down towards the surface of the earth and deposit it with zero velocity on the surface of the earth down there. And doing so, I can extract energy from the brick. I’ve extracted energy from the brick because I’m there’s a force pulling the brick down, that force I’m doing through a certain distance and that gives you an energy. And we know at least in Newtonian physics what the formula for the amount of energy you can extract in the brick is. The amount of energy you can extract from the brick is g times the mass of the earth times the mass of the brick divided by r the radius away. So it’s an energy not a force so it’s an inverse r distance law not an inverse square distance law. That’s the energy you can extract from the brick by lowering it down to a distance r away from the earth. And of course if you try and lower it beyond the surface of the earth this this formula changes, but let’s just put it on the surface of the earth. And so you know this is the amount of energy I’ve got out here a long way away and have extracted from the brick. You can ask what fraction of the rest mass energy of the brick have I extracted? This is a question that you would only naturally ask once you’ve invented special relativity and know that the rest mass energy is given by mc squared. And so the we can we can straightforwardly calculate at least in this approximation that the fraction of the energy that you’ve extracted is is that divided by the rest mass energy you started with. The mass of the brick of course is going to cancel but not the mass of the earth. And this is going to be given by G times the mass of the earth divided by c squared times the radius away from the earth at which you stop, the radius of the earth. So how much energy you know what fraction have I got out of it? If you lower down to the earth’s surface, then the answer is you haven’t really extracted that much from the brick. You’ve you’ve extracted a fraction 7 times 10 to the minus 10 of the original rest mass energy of the brick doing useful work along way away. Interestingly, well first observation: this is small. In other words the gravitational binding energy of something on the earth’s surface is quite small in natural units. And that’s why we didn’t really notice general relativity on the Earth’s surface until we did very sensitive experiments, because general relativity is in some sense a Taylor expansion in this, in this number, that the relativistic effects, where the first order term is just Newtonian and then the next order terms will give you the GR corrections to the Newtonian answer. Observation number two, and this is something of a digression, but observation number two is that by essentially sheer coincidence, this number here is very close to the chemical binding energy of rocket fuel. So if you take a rocket fuel like oxygen hydrogen mix, the chemical energy binding the rocket together, which is the energy that you’re going to extract when you burn it to make your rocket go, divided by the mc squared of the oxygen and hydrogen you’re going to- you’re going to mix together is- is given by 1.5 times 10 to the minus 10. First observation, these two are close to each other even though they came from completely different calculations. This was a gravitational calculation that was to some extent to do with the Earth, this is a chemical property of hydrogen and oxygen. This is also very small. The reason it’s very small is that almost all of the energy in hydrogen oxygen is not stored in the chemical binding energy of these things going together. The vast majority of it is stored in just the rest mass energy of the protons and the neutrons that chemistry burning doesn’t affect at all. The second largest amount is stored in the nuclear binding energy of the protons and the neutrons to each other given by the strong force and the weak force, which again chemical reactions don’t- don’t touch at all. This is a small number because chemistry is- chemical bonds are very weak compared to the rest mass of the things we’re considering. These two small numbers are almost exactly equal to each other, which is why we can use chemical rockets to get to space, but it’s hard. In particular, this number is a, you know, a few times bigger than this number, which means that almost all of the- the vast majority of your payload fraction is quite small when trying to use chemical rockets to get to space, because most of your fuel cannot get to orbit. You have to pay a rocket factor that’s going to tell you that most of your payload that’s sitting there on the launchpad is going to have to be burnt up before you get to space in order to get a small fraction of the- of the rocket up to space. In other words, we can use chemical rockets to get to space in a way that would be totally impossible if we tried to do it from the surface of the Sun, but it’s hard. Okay, that’s the fraction on the Earth, but this formula tells you that if you have an object that’s heavier or more compact, the fraction of energy that you extract by lowering the object down to the surface is going to be larger. So for example… Example: if you lower it not down to the Earth’s surface, but down to the Sun’s surface, this would be larger. You know, a million times larger because the Sun is, you know, a few million times the mass of the Earth, but then it’s also bigger, so that takes it away a little bit, and you end up with two times ten to the minus six famous redshift from the Sun’s surface. And you can escalate from there. You know, you can imagine cramming a sun-like mass into an Earth-like radius to make this formula even bigger. In fact, that’s pretty much exactly what — so, you know, sun mass, Earth radius — which is about what happens in a white dwarf like Sirius B. And this will get even bigger again. You know, a larger fraction of the mass of the object you’d be extracting by lowering it down to the surface. But it really feels like something has to give before we make an object that is too mass, too massive and too compact. In particular, if you look at this formula, you know, what happens for r less than or equal to GM over c squared? If this object here was so compact and so heavy that it had a radius less than the mass of the object divided by c squared, it sure looks like you could get more than a hundred percent. The fraction would be bigger than one. You could get more than a hundred percent of the mass of your brick back by lowering it down to the surface of this object. And that feels wrong. That feels, in fact, sort of more wrong than what’s going on here, because now you’ve got all this energy a long way away, and you could perhaps use it to make a whole new brick. You’ve got all this more than mc squared out there. Lower that one down, and it feels like we’ve figured out a way to make a huge amount of energy where there was no energy before. This argument is pretty suggestive that something has to go wrong by the time you get down to that radius. And indeed, when you do the calculation — you know, this is a Newtonian calculation, so it’s only suggestive — but when you do the calculation in full general relativity, indeed something does go wrong. And the thing that goes wrong is that you form a black hole. You can imagine two ways that you could avoid this conclusion. One would be somehow that gravity becomes very weak when you get close to a massive object, weaker than the Newtonian law would predict. That’s sort of what saves you if you try and repeat this same trick in electromagnetism, lowering a charge down towards another charge and trying to extract the electrostatic energy between them. What happens is essentially due to quantum effects. When one gets too close to the other, they… will start to fuzz out and and this the inverse the energy going like inverse r gets softened and you can’t extract more energy because they they stop attracting each other so hard. So that’s one possibility is that the force gets weaker than Newtonian law would predict as you approach the other object. That’s actually the opposite of how general relativity resolves this. General relativity resolves this paradox by the force getting stronger than Newtonian law would predict. In particular, the force gets so strong when you try and get within this radius that in fact you cannot slowly lower the brick down towards the surface because you’ve formed a black hole, the gravitational force becomes infinite a finite distance away, not at r equals zero, but at some finite value of r, and the brick simply gets ripped out of your hand and you are unable to extract any more energy out of it. And that’s the resolution that general relativity provides this paradox, and in particular you will find that you’ve formed a black hole.
Dwarkesh Patel: 46:05 Crusoe gave us early access to their serverless fine-tuning product, which lets you fine-tune open models without having to deal with infra or provisioning. I thought it’d be cool to try fine-tuning a question generator using the transcripts of my old interviews. If the models have gotten so good that if they had all my research and prep and they could look at a conversation so far, they could ask a next question better than I would. Crusoe made the implementation super straightforward. I just uploaded the data, picked an open model, and started the run. I didn’t have to touch any of the hyperparameters. Crusoe’s Applied AI team maintains optimal recipes for each model, so I just set everything on auto. When the run finished, I deployed it as a serverless endpoint and built an eval for my team. I had them choose the best next question out of three anonymized choices: one that was produced by the base model, one that was produced by the fine-tuned model, and one that I actually asked. Fortunately, my team preferred my actual questions about two-thirds of the time. Hopefully this benchmark doesn’t saturate. And in the remaining cases, they almost always preferred the fine-tuned model over the base model. Serverless inference is live now, and serverless fine-tuning goes live next week. Learn more at crusoe.ai/dwarkesh.
Adam Brown: 47:12 So far, everything we’ve written down on the board is is Newtonian. This is Newtonian, and you just start plugging in the speed of light, and you start getting confused. To actually answer some of these questions that we’re asking, you need to go to general relativity, the theory that correctly unifies the speed of light with gravity. And this was first done in the context of black holes by Schwarzschild, who wrote down the Schwarzschild metric that describes the gravitational field around a central mass, including potentially around a black hole. And let me just write down some of the formulas that emerge. In fact, I think I’m going to write down three formulas, the three direct consequences of the Schwarzschild metric that are going to give us intuition for what it’s like outside and indeed inside a black hole. And so the first formula I’m going to write down is the formula for the gravitational field that you would experience.
Dwarkesh Patel: 48:00 If you were trying to remain static outside a central mass.
Adam Brown: 48:07 And so, you know, let’s just talk about static observers. I can discuss how these will get upgraded for observers who are moving around. But for now, I’m just going to imagine that you’re trying to sit here at some radius r, some fixed radius r away from the black hole. The reason you don’t fall- the reason you’re static, the reason you don’t fall into a black hole, maybe, you know, I’ve lowered you down on a pulley. And you’re just sitting here, holding the pulley, and the question is how strong a force do you need to stop you falling down? You’re abseiling down very slowly, you’re static. What is the local force of gravity that you experience? Or you could imagine that you’re sitting here, the reason you’re static is you’re firing a rocket very hard, and, you know, what is the- how much acceleration do you locally feel? So by whatever mechanism you’re remaining static, what is the local force of gravity that you feel? The local force of gravity that you feel, well, in Newtonian physics, you know what the answer to that question would be. The force of gravity is G M over r squared, which is Newton’s famous inverse square law. But this gets a correction from general relativity. And the correction is one over square root of one minus two G M over c squared times r. So the- this same two G M over c squared that we find all over the place. And what this tells you, well, first of all, if you’re a very long way away from the black hole, this here is essentially one, r is very big, and you get Newton’s force law back again. And, you know, for the Earth, this is very small. This, as we discussed, is down by a factor of 10 to the minus 10 or so. And then you take the square root. So you don’t really notice it. But you can Taylor expand this at large r, and you find out that you get corrections. You get an inverse square law plus an inverse cube law correction plus an inverse fourth law correction. And you find that gravity at short distances is stronger than it would have been in Newtonian physics. This is the general relativity correction, and it’s making the gravitational field stronger. You have to accelerate harder to not fall into the black hole. And in particular, once r is equal to two G M over c squared, this what’s called the Schwarzschild radius, you have to accelerate infinitely. The acceleration, the proper acceleration required to not move in r goes to infinity. So, in fact, if we now convert this to an earth to a black hole, this is a- …very significant radius over here, 2GM over c squared. It’s, it’s called the event horizon. It’s called the event horizon because if you want to remain static outside the event horizon, further away from the event horizon, you just need to accelerate with some finite velocity in order to remain static. You need to have a finite gravitational field, but the gravitational field as you approach the event horizon becomes infinite. So once you’re at or beyond the event horizon, it is impossible to remain static, you will inevitably get sucked into the black hole no matter how hard you fire your rocket. Now, this is just the static formula. You might imagine, ‘Okay, it’s impossible to remain static outside the black hole closer than that, but maybe I could not fall into the black hole by orbiting really, really fast and if I orbit really, really fast, I have a huge centrifugal force that pushes me away from the black hole and I can stay out of the black hole that way.’ That actually doesn’t work and the reason it doesn’t work is somewhat instructive for the way gravitational attraction happens in general relativity. Of course, if you think about the International Space Station, why doesn’t it fall towards the Earth? It is precisely the fact that it’s orbiting, and the fact that it’s orbiting gives it a centrifugal force that shoots the astronauts away from the Earth and precisely balances the gravitational field of the astronauts, which is why they feel weightless there. So, orbital angular momentum if you’re a long way away from the black hole helps you escape from, stay away from the black hole, stops you falling in. There is this kind of sci-fi notion that black holes just suck in everything around them. Not true. You are perfectly able to orbit around a black hole if you’re a long way away from it, just like you would orbit around any central mass. You are not inevitably falling into the black hole, you can orbit just fine. But orbiting stops helping when you get too close to the black hole. We said that the event horizon is 2GM over c squared. In fact, already once you’re within 3GM over c squared, orbiting is counterproductive if you’re trying to stay away from the black hole. And that’s because there are two effects of orbiting. One effect of orbiting helps you stay away from the black hole, that’s the centrifugal effect. Orbital angular momentum pushes you away from the black hole due to the centrifugal effect. And if we wrote the - it’s not too hard to write down - if you wrote the version of this formula that applies when you have angular momentum, you would see that pushing you away from the black hole. But there’s another effect which drags you towards the black hole. And that is the fact that in general relativity, all energy gravitates. Not just rest mass energy gravitates, kinetic energy also gravitates. And so the effect of orbiting is that you have an additional pull down towards the black hole from the coupling between the mass of the black hole and the gravitational attraction between the mass of the… Black hole and your orbital angular energy. And when you’re far away from the black hole, the centrifugal force is is more the important term. When you’re close to the black hole, the that coupling is the more important term. And in fact, once you get within three GM, orbital angular momentum stops helping and starts hurting. There are no ballistic orbits that go within three GM and that manage to escape again. Okay, so that’s formula number one. It tells you that what the gravitational field is at distance R away from a black hole. And in particular, it shows you that once you get to this critical radius, the gravitational field becomes infinite, and you must if you cross that, you must proceed to the black to the center of the black hole, no matter how hard you fire a rocket. That’s called the event horizon. At the event horizon, you are not yet dead. You are, however, doomed. If you cross the event horizon, you will never be able to escape. Not if you convert yourself to light and try and shoot yourself out, not if you fire your rocket infinitely hard. The other place, of course, is R equals zero, which is that’s where you actually die, and that’s at the singularity, and we’ll describe that little bit in a moment. In Newtonian physics, the gravitational force only becomes infinite here. In general relativity, it becomes infinite already at the event horizon if you try and resist the force of gravity. Okay. That’s formula number one. Now let’s do formula number two. Formula number two, and all three formulas I’m going to write down are just going to be heavily related to each other. They’re really going to be reformulations of each other, asks about gravitational time dilation. So let’s again imagine that you’re sitting here. You know, this is Dwarkesh sitting here some radius R away from the black hole. And I’m sitting, you know, out here way off at infinity just watching you, and we’re static relative to each other. There’s no there’s no relative motion. You’re just suspended here by your by your pulley system. And the question is, how fast does your watch go relative to mine? Of course, as far as you’re concerned, your your watch is ticking at one second per second. As far as I’m concerned, my watch is ticking at one second per second. But if I watch you, if I look at you, I see your watch as running slow. If you look at me, you see my watch is running fast. And so the second formula makes that quantitative. How much slower you, who is close to the black hole, how much slower your wristwatch runs than mine. And it says that the time interval as measured by your wristwatch is given by the time interval as measured by my wristwatch, a long way away, times this exact same square root factor that’s showing up all over the place. Times the square root of one minus 2GM over RC squared. And so this factor here is less than one. So if I think one second has passed, you think less than one second has passed. In other words, if I slowly lower you down towards the black hole, you hang out some finite distance away from the black hole for what feels to you like a year, and then raise you back up a long way away from the black hole, you will return to a world that has aged a lot more than you have. And this formula makes that… makes that precise. I observe your wristwatch to be running slow, you observe my wristwatch to be running fast. Time passes slower down here than it does up here. This is a fact that has by now been extremely well observed experimentally. In the 1950s, in the Harvard physics department, they put two atomic clocks at two different heights in the building and noticed the one that was higher was running faster than the one that was lower. This is an effect that is now considerably within the precision of, for example, GPS. It just has to subtract that effect; otherwise, everything would drift all over the place. GPS clocks that are sitting on the Earth’s surface are running slow compared to the atomic clocks that are in orbit sending out the signal, and you have to account for that difference and subtract it off in order to get an accurate read. This is known as gravitational time dilation, and notice it’s quite different from the relativistic time dilation you see in special relativity, which is caused by two objects being in motion relative to each other. Here, we’re not in motion relative to each other. We’re both static; we’re fixed. This is caused by us being at a different place in the gravitational potential, you deeper in the gravitational potential than me. So those are two different sources of time dilation and they stack. So, let’s say instead of being static here, you’re in orbit. You’re far enough away that you can orbit the black hole, and I ask, how slow do I see you as moving? There are now two contributions, both of which make you look slow relative to me. The one contribution is the gravitational time dilation given by this formula. A second contribution is the good old special relativity correction where moving observers look like they’re going slow, and we’ll have both of those effects so you’ll look like you’re going even slower than you would have done otherwise as you go around the black hole.
Dwarkesh Patel: 59:34 So one thing that seems different between this and special relativity is that there’s no symmetry, where in special relativity both observers will feel that the other one is aging slower than they are because they’re both moving relative to each other at the same rate and there’s no true inertial path. But here it actually does seem like there’s a global sense in which one is a more correct… that the one that is…
Adam Brown: 60:00 Yeah.
Dwarkesh Patel: 60:00 …the more relevant inertial frame than the other one.
Adam Brown: 60:02 Uh you’re exactly right. Yes. So in special relativity, if you and I move relative to each other, I think your watch is moving slow, you think my watch is moving slow, neither of us is more correct than the other, the principle of relativity tells you that both of our perspectives is equally valid. Here, both of our perspectives are not equally valid because there is, uh, there is not the symmetry that there was in special relativity. In particular, the symmetry is broken by the black hole. You really, we both agree that you are deeper in the gravitational well than I am. We both agree on that and your clock runs slower than mine does. You do not see my clock reciprocally running slow. You in fact see me living sped up. If you are observing me, you see me living my life in fast forward.
Dwarkesh Patel: 60:44 Interesting.
Adam Brown: 60:46 So this is the second formula. It says how fast are wristwatches moving relative to each other. Now let’s imagine that you’re here with your slow-moving wristwatch and you shine a light towards me. And let’s say the light has a particular frequency, you made it with a with a sodium transition for example, a particular frequency of light. As that light travels upwards, by the time it reaches me, I’m going to think that it is a lower frequency than it was than you thought it was when you sent it. Why? Because frequency is about how rapidly it oscillates, and I just think that everything you do is moving slow relative to me, you think it’s oscillating slower. It has lower frequency, which means it gets shifted towards the red part of the spectrum. The word that we use is redshift, gravitational redshift. It gets redshifted. Lower frequency. And therefore less energy. If you send one photon up, the energy of the photon is given by the by the frequency, it’ll arrive at me more more redshifted and with lower energy than it than it had when it left you. Uh, conversely, if I am up here and I send you a photon generated by the the sodium transition, as observed by you, by the time the light reaches you, you see me moving in fast forward, so you think that it has higher frequency than it had when I when I left you. Um, it’s moved towards the blue part of the spectrum, we say that it is blueshifted. And so this thought experiment tells you that knowing the exchange rate for how time passes at different altitudes directly gives you the exchange rate for how much energy is worth at different different altitudes. If you try and send me some energy, by the time it reaches me, it’s worth less to me than you perceived it as being worth to you. And the amount it’s less is going to be precisely given by the same square root formula that’s that’s controlling everything else. And so that gives us our third equation. And so… So the third formula says, suppose that you, Dwarkesh, have an object of mass mc squared sitting with you at this fixed radius down there. How much energy, as measured by me a long way away from the black hole, how much energy is that worth to me?
Dwarkesh Patel: 63:16 Ah, of course if I had it with me, it would be worth mc squared worth of energy. But I don’t have it with me. It’s unfortunately sitting with you, deep in a gravitational potential.
Adam Brown: 63:30 So I have—it’s worth less than mc squared to me. In fact, it’s just the exact same formula. The amount of energy that it’s worth to me by the time it reaches me is root one minus 2GM over r c squared. And there are a couple of ways to see that. One is the way that we just—that we just said. Suppose you take your object of mass M, you know, it’s just an Avogadro’s numbers of carbon atoms, or let’s say it’s half an Avogadro’s numbers of carbon atoms and half an Avogadro’s numbers of anti-carbon atoms. And one way you could send me the energy is by smashing them together, violent explosion, you convert all of that energy to light and you try and beam that light energy up to me. But what you find, precisely because of this gravitational time dilation, is by the time it reaches me, I’m not getting mc squared worth out. I’m getting, by the argument we just gave, less than mc squared worth out. I’m getting root one minus 2GM over r c squared out. Mass down here suffers this redshifting as it goes up and has less energy by the time it reaches infinity than it did to begin with. There is another way that you could have gotten the energy to me. Not by beaming it up as light, but by just taking your mass object, attaching it to a pulley, and having me pull the object out. By the time I’ve pulled it out, I’ve now got mc squared sitting out here a long way away from the black hole, so I do have mc squared, the full mc squared worth of energy. But to get it, I needed to pay. And what I needed to pay was precisely pulling it out of the gravitational potential. So from that way of thinking about it, that’s why I have less than mc squared worth of energy left, because I had to pay the pulling it out of the potential in order to accrue that mass. So this formula tells you, if I have a brick of mass mc squared sitting at some radius R away from the black hole, how much energy can I extract from that brick if I start—if I’m a long way from the black hole? And so if we know that formula, then we can in fact calculate exactly this formula. How much energy have I extracted from the brick by lowering it down to a radius R? Well, we know the answer to that question. The energy it started with is mc squared. The energy it now has is this. So the energy I’ve extracted from the brick while slowly lowering it down using my pulley system must be the energy I started with, mc squared, minus the energy it now has. Or in other words, the fraction of the energy
Dwarkesh Patel: 66:02 Mm-hmm.
Adam Brown: 66:03 that I’ve extracted by lowering it down to a radius r is mc squared minus this, all divided by mc squared. 1 minus root 1 minus 2GM over c squared r. And this is the exactly correct answer for the fraction of the energy extracted. It doesn’t look exactly like this because this is only correct in the Newtonian limit. We derived this using Newtonian physics. This is exactly correct, not just in the Newtonian limit, but all the way to where the effects of general relativity are important. Now, if you’re a very, very long way away from the black hole, r is much, much bigger than 2GM over c squared, then you can Taylor expand this formula, and the first order term is just the old Newtonian formula. It better be. It better be that the long distance limit of general relativity recovers the Newtonian physics that we originally discovered. But as you get closer and closer to the black hole, this starts to deviate from the Newtonian answer and deviate in the Newtonian answer that exactly is going to resolve our original thought experiment to do with lowering a brick down towards a black hole. So, how much then, looking at this formula, have I extracted from the brick as I lower it down towards the black hole? If r equals infinity, if the brick’s still a long way from the black hole, then I’ve extracted one minus one equals zero. I haven’t extracted any energy from the black hole. As I lower it closer and closer to the black hole, well initially, I just get the Newtonian formula. So in fact, these are pretty close to correct in general relativity as well because the corrections are only going to start getting large when this term becomes order one, and it’s still very small here. So these are all essentially correct. But once I get closer and closer to the black hole, they stop being correct. And what I see is that as r approaches the black hole event horizon, as this formula goes to zero, I have extracted exactly all of the energy from the brick. So, I start off with a brick a very, very long way from the black hole, attach it to a rope, slowly lower the brick down towards the event horizon. Of course, I can’t lower it past the event horizon, otherwise I’ll lose control of the brick, but I lower it as, you know, right above the event horizon, the last possible place I can lower it to, and then just let go of it with zero velocity. The brick falls into the black hole, and I have extracted the entire mc squared that used to be in the brick in my pulley system out there. And so it exactly resolves this question we had. Is it possible to extract more than mc squared from the brick? No. Is it possible to extract the full mc squared from the brick? Yes. Wait, using a black hole? Yes, it is. And that’s actually pretty neat and why people talk about using black holes as as power plants. So, you know, most power plants today operate by burning chemical energy. That is not very efficient. That gets, you know, you have to pay a factor of 10 to the -10 because chemical bonds are super weak compared to the rest mass of objects and you’re really only extracting a tiny fraction of the rest mass of the fuel that you’re you’re considering. You can level up from there by going to nuclear energy, which instead of being dealing with the feeble electromagnetic bonds between atoms, starts to concern itself with the nuclear forces between the the protons and the neutrons in within the nucleus. And so you can go up from about 10 to the -10 to about 10 to the -3 for for fission or 10 to the -2 for fusion. But that’s about as good as you can go even even with fission and fusion because even though you can extract energy from the strong nuclear force, fission and fusion, neither of them change the total number of protons plus neutrons in your process. And the bulk of the energy, 99% of the energy, is stored not in the electromagnetic interaction, not in the strong interaction, but in the rest mass energy of the protons and neutrons, something that neither chemical reactions nor nuclear reactions can touch. But gravity can touch them. If I start off with a mass of mass object of M, I can extract up to quantum fractions essentially, I can extract essentially 100% of the rest mass energy that I’ve gone in. It is the most efficient possible power plant because by building an apparatus like this, in principle I could extract 100% of the energy of whatever I started with.
Dwarkesh Patel: 70:43 I intuitively get how energy equals mass and then there’s like these chemical bonds, those get dissolved, they release energy, the thing weighs less if those bonds are released. I even get that if the bonds between the protons and the neutrons are broken, that releases energy and makes the thing have less mass. But if something with protons and neutrons is just slightly above the event horizon, is the interpretation that those protons and neutrons stop existing right at that point? What does it mean for them to have 1% or 2% or 5% of their original mass?
Adam Brown: 71:18 Yeah, this is that’s a great question and really becomes relevant once you turn on quantum mechanics, which is beyond the scope of today’s discussion. But classically, the black hole just sits there forever and so you can just say, well, what happened to the protons and neutrons? You say, well, they now live inside the the black hole and the number of protons plus neutrons is still conserved out there in the universe, it’s just you need to assign a sort of nucleon number to the black hole itself. That’s fine as far as it goes classically. Quantum mechanically, way beyond the scope of today’s lecture, Hawking and Bekenstein discovered that black holes radiate away energy and eventually the black hole will be gone and all of the energy, if you calculate it, ends up in gravitons and photons. protons, perhaps on neutrinos, none of it or almost none of it ends up in protons and neutrons. So it is a very interesting fact once you turn on quantum gravity that black holes eat nucleon number. This thing that seems like it’s conserved, at least perturbatively, both by electromagnetism and by the nuclear forces, ends up being eaten by gravity. And people like to promote this, we’re talking about quantum gravity now, to a general principle that quantum gravity doesn’t respect any global symmetries. It doesn’t respect nucleon number symmetry, it doesn’t respect any of its symmetries. And that’s a whole other can of worms that we can open some other day.
Dwarkesh Patel: 72:40 I recently wrote this blog post where I speculated that sample efficiency during training actually hasn’t improved that much over the last few years. And rather, we’ve just dramatically improved and widened the data distribution. And I was having dinner with friends recently, and then I had this idea of how you could get some empirical information on this question. There’s this nanoGPT speedrun where people compete to train Karpathy’s GPT-2 baseline to a fixed loss with less and less compute. The training data is frozen, so I wondered if the loss curves over time of each record could tell you roughly how fast sample efficiency is improving. So I pulled out my phone, I dumped this idea into a voice note in the Cursor app, and I went back to dinner. And then I got a notification about 50 minutes later: the Cursor agent had cloned the modded nanoGPT repo, it had analyzed all the loss curves for all the records, and then it had estimated that sample efficiency had been improving about two to 5x every single year. Of course, this is very naive and circumstantial evidence, but it inspired me to start writing a full post with a friend where we investigate this question using many different methods. And the friction really mattered here. The idea would have just floated away if I wasn’t able to just kick off the investigation right then and there with the Cursor app. If you want to try Cursor’s iOS app, go to cursor.com/dwarkesh. Okay Adam, I like to think on this podcast we’ve imparted not only theoretical but practical knowledge as well. So suppose one learns all these equations but then finds himself in the unfortunate position of falling into a black hole. What would they see?
Adam Brown: 74:05 Great question. So there’s actually two different perspectives you could take. One is the perspective of me watching you falling into the black hole. The other is the perspective of you falling into the black hole. And those two perspectives are consistent with each other but interestingly different. So maybe I should describe them both. So first let’s ask the question: what do I see as you fall into the black hole? What I see—this is of course how fast you need to, how hard you need to fire your rocket so as not to fall into the black hole—but you’re not going to do this. You’re just going to sit here a long, long way away from the black hole, you’re going to turn off your rocket and accept what comes. And what comes is you’ll slowly accelerate towards the black hole with a rate first given by the Newtonian formula, and then when you get close to the black hole, start picking up corrections, start picking up general relativity corrections to the Newtonian inverse square law. And so what I will see as I watch you fall towards the black hole is, first, you’ll go faster and faster… faster towards the black hole as you fall down the gravitational potential of the black hole. And faster and faster and faster, but then something strange will happen, which is you’ll stop going faster and you’ll start going slower. And the reason you’re going slower is that as I watch you, you start to get gravitational time dilation as you fall down here and I start to see you running slow, your clock running slow. This is the formula for if you were static, you’re not static, you’re moving, so there’s some other formula, but the formula has the same effect, which is that as you get closer and closer towards the black hole, your wristwatch starts running slower and slower and slower. And in fact, if you do the appropriate integral, I never see you cross the event horizon. I just see you getting closer and closer to the event horizon but slowing and slowing and slowing as you get closer and closer to the event horizon. And as I watch you, I’m presumably using light to watch you, that light gets more and more redshifted. The wavelength gets longer and longer, the longer the wavelength of the light, the harder it is even to really see you, I start getting you start getting delocalized by the wavelength of the light. And eventually I just stop seeing you entirely. There’s like a final photon that I see that you emit and then you just fade to black, fade through red to black, I never see you cross the event horizon. This was noticed by people in the early days of general relativity and greatly confused them. And they started to think that something you would experience something funny yourself as you fell across the event horizon. That is that is not true. In fact, if I instead adopt the perspective of you, from your point of view, your clock isn’t running slow, it’s running at one second per second. If you look back at me, there’s some some funny stuff going on to do with me me running fast perhaps, but as far as you’re concerned, everything’s totally normal. You accelerate towards the black hole, you’re getting faster and faster and faster as you approach the black hole, and you just sail across the event horizon totally as as normal. The event horizon is not a particularly violent place for you. You can calculate the tidal forces as you cross the event horizon or as you approach and then cross the event horizon, and they’re not particularly big, or rather for large black holes, they’re not particularly big. For a solar mass black hole, they they would be pretty big and would be pretty painful for you. You’d find that the your feet are being attracted to the black hole much more vigorously than your head is because it’s because they’re closer, and you end up getting getting stretched. But if I take a big enough black hole, you wouldn’t notice anything funny happening whatsoever. The bigger the black hole, the smaller the tidal effects. And if I took a black hole the mass of the galaxy, you’d be basically fine as you cross the event horizon. If I took an even bigger black hole than that, you could live out your entire life having crossed the event horizon of a black hole before you hit the singularity, which is fatal. When you cross the event horizon, you are doomed. You are doomed because once you cross the event horizon, you must proceed to the singularity. There’s no way you can fire a rocket to stop yourself hitting the singularity. You are doomed, but you are not dead. You are only for sure dead once you hit the singularity and get spaghettified, get mangled by the tidal forces. But for a large enough black hole, you can be doomed and not even know it. The event horizon is really a non-locally measurable quantity. It is a teleological fact. It says that once you have crossed the event horizon, you must proceed to the singularity, but it can take a long time to get there for a large enough black hole. You could in principle, for a large enough black hole, live out your entire life if you had a black hole that was, you know, many light centuries across. You could live out your life, you could have descendants, all of whom live inside the black hole, and only once you really approach the singularity do the tidal forces get strong and kill you.
Dwarkesh Patel: 78:52 As you were saying, GR explains or predicts a lot of phenomenon, and some we think are correct, some we don’t know are correct. Why do we think black holes are correct, but not wormholes?
Adam Brown: 79:01 Yeah, that’s a great question, and people did not believe it to begin with. Schwarzschild wrote down his solution almost immediately after Einstein wrote his field equations. People thought that that equation was sick in some way, that it was a measure-zero thing that would never happen, it was some mathematical monstrosity, but it was impossible to make black holes naturally in the real universe. And they were wrong, because black holes do exist. We’re extremely confident now. There was theoretical developments and there was experimental evidence that black holes exist. The biggest theoretical development was Penrose and then later Hawking and Penrose, for which he won the Nobel Prize, who showed theoretically that the formation of black holes is a generic feature of general relativity. It’s not just some sick thing that happens if you fine-tune the initial conditions, that if you just start off with generic initial conditions, the development of black holes is a generic feature of that. That was a huge development. And then there was the experimental side. And the pieces of experimental evidence we have for black holes is now huge. It did not exist in Einstein’s day, and for 50 years after Einstein, people were extremely confused about black holes and thought they didn’t exist. But there’s numerous pieces of evidence. I think the most visually appealing piece of evidence is just observing the center of our galaxy. So if you look at the center of the galaxy, there is, spoiler alert, there is a black hole there. We call it Sagittarius A-star. A huge black hole, weighs many millions of times the mass of the sun. You can’t see the black hole, or at least you can’t see it directly, because it’s black. What you can see is the stars around it. If you watch these stars over the course of decades, and we now have a number of decades of observations of them, you will see the stars not moving along what we’d call straight lines, instead moving in nice little ellipses or processing ellipses, and those ellipses look like they are orbiting something. You cannot see the something, but you can see the stars that are orbiting that something. something, and you can calculate how big is it, how massive is it, and what you find is that it’s very massive indeed, and it’s also very small indeed. You know it’s small because the stars get super close to it but don’t seem to collide with it. And so by tracing these orbits, you can tell that there’s something super heavy, super dark, and super compact at the center of that galaxy. That is Sagittarius A star, the black hole at the center of our galaxy. That’s one compelling piece of evidence. Another piece of compelling evidence was about a decade ago we not only saw black holes, we felt them. So LIGO is this huge interferometer, laser interferometer, that we that we built at a number of different sites that is super attuned to vibrations in space-time itself. And there’s a famous event pretty much immediately after we turned it on in late 2015 where we felt space-time shaking. And you know it was space-time shaking, not just the earth shaking, because we had a bunch of these detectors, at then two, now now four, at different points on the earth, and they all shook in exactly the same way. So it couldn’t just be explained by a truck passing one and not the other or a seismic event in one and not the other. They all shook in exactly the same way and we were able to back calculate that the thing causing them to shake was the collision of two ginormous black holes, two black holes both of which weighed about 30 times as much as the sun on the other side of the universe, about 1.6 billion light-years away. That collision happened about 1.6 billion years ago and just happened to reach the earth within weeks of us turning on the LIGO detectors. We’ve now seen, we’ve now felt more accurately, thousands of such shakings corresponding to thousands of black hole mergers. And then there’s more evidence. There is a later we had what’s called the Event Horizon Telescope, which is a ginormous conglomeration of radio telescopes all over the earth that were able to look very closely at the black hole at the center of our galaxy, Sagittarius A star, and the black, the even bigger black hole at the center of our neighboring galaxy and see, very, very faintly, the radio emissions of matter falling into these black holes that shines super brightly as it does so, and we were able to see that in the radio emissions of these things. So we’ve felt them, we’ve seen them, we’ve seen their gravitational effects on orbiting stars. We’re extremely confident at this stage that black holes exist.
Dwarkesh Patel: 83:24 Mm. It’s so beautiful that not only can a single mind come up with this theory, but that the theory has so much reach and that we can come up with the machinery to evaluate and perturb and understand its implications in so many different wild ways.
Adam Brown: 83:39 It’s crazy. The number of degrees of freedom, the number of orders of magnitude that it covers. It covers, you know, you first start thinking about it by doing thought experiments to do with jumping up and down in elevators, and then it reaches out to describe the orbit of Mercury and detectable perturbations of orbital dynamics within the… solar system and then the bending of light and then it describes the rotation of the entire the entire galaxy and then it describes the expansion and potential you know fate of the entire universe. That’s many orders of magnitude indeed and it’s pretty impressive that it was the work of almost a single mind and frankly our universe should be honored to be described by such a beautiful theory.
Dwarkesh Patel: 84:21 Can you tell the story of how GR went from a theory that Einstein had to something that the world came to believe is true?
Adam Brown: 84:27 Oh, um, yeah, that would be the bending of light. So there were known anomalies with Newton’s physics beforehand, like we couldn’t get the orbit of Mercury exactly right, and one of the very nice early tests of general relativity is that it did get the orbit of Mercury exactly right. So that was a pretty, you know, good confirmation, but at the same time, that’s not quite so satisfying because it was a number that’s already known that you invent a theory and then it correctly predicts—you know, it’s considered more impressive if you get the right answer without knowing what the right answer is in advance. And so that would be the bending, bending of light, certainly historically that was the most influential. So according to general relativity, all energy gravitates and all energy is affected by gravity, and so light as it’s passing a massive object like the sun will will get bent in the direction of the sun. I should say the same will happen in Newtonian physics if you just say, suppose you have a particle going along, and you know it’s—you know how much it gets bent as it passes the sun depending on its what its impact parameter, but also its velocity, and the faster it’s going, the less it gets bent. So you just take that Newtonian formula and you plug in velocity equals the speed of light and see what the answer you get at, you get a certain amount of bending through Newtonian physics, and general relativity, you can do the same calculation and you actually get double the Newtonian answer. So this was a big—I mean, the slightly strange history of it—before he had finished writing down general relativity, Einstein had a prediction based on what he thought was the equivalence principle, you know, based on his understanding of the equivalence principle for what this answer should have been, and so he wrote down the answer, and then in response to him and a number of other people being interested in this, there were people started sending out expeditions to go and try and measure it. Actually, I think the very first thing that Newton did is he phoned up the observatory and said, you know, ‘Can you, can you measure, look at distant stars behind the sun and measure how, how light bends as it passes the sun?’ And this was, you know, this was the true theorist move because the—I think the director of the Mount Wilson Observatory said like, ‘Absolutely not, we cannot do that. If you point a telescope at the sun, you’ll go blind. If you point it just next to the sun, you’ll just get washed out by the corona of the sun and you won’t see anything.’ Except, there’s one time when you won’t get washed out by the sun, and that’s during a total solar eclipse, when the moon blocks the sun and you’re able to see stars very close to the sun and measure the bending of the light behind them. So during the 1910s, there was a whole bunch of expeditions sent to measure the deflection of light. They’d go, you know, park out in the path of totality and look through telescopes at the stars right next to the sun and see if they’d moved in the sky, and if they moved, how much they moved. And I think the first one that they did was in 1911. They went to Argentina for an eclipse, and then everything set up. I mean, this is the problem with this thing. And then you get there, all the way to Argentina, a very long way in those days, and it’s just washed out by the by the clouds, and you don’t don’t see anything. It’s very frustrating. And then the next one that went along was there was a German expedition sponsored by the arms manufacturer Krupp who went to the Crimea and tried to measure it there. And just before the solar eclipse happens, World War One breaks out, and now, you know, Germany and and Russia are at war, and they’re all like arrested and interned for the rest of the war. And so that also fails. Um, and it actually turns out to be a good thing for Einstein that they all failed, because it turned out that Einstein’s original, before he had full general relativity, his original equivalence principle argument was wrong and led him to predict that the bending of light in general relativity would be the same as it was in Newtonian physics. And so during the war, while everything shut down and no one is thinking about eclipse expeditions, he corrects this mistake and comes up with a new prediction that actually will be double the Newtonian prediction. And then in 1919, Sir Arthur Eddington launches a British expedition to go and observe the eclipses all over the world and successfully comes back and declares that, uh, that indeed it was the Einstein prediction, that it was that it was double the Newtonian prediction. And that’s really what launches Einstein as a global celebrity is that this this, you know, British experiment confirming a sort of German-origin theory, you know, was part of the postwar reconciliation and that Einstein had figured out figured out everything. And that is, I’d say, you know, the point at which general relativity became the consensus view and people were soon convinced it was a very impressive test. Nowadays, we’ve done huge number more tests than that, you know, very precise orbital dynamics. You can see it in the orbit of Mercury and indeed even in the other planets. Um, you can just measure the redshifting as light as it as it goes the gravitational effect on the propagation of light, of the energy of light all over the place. But historically, that was the most impressive confirmation of general relativity.
Dwarkesh Patel: 89:33 One question I have to ask is we are spending as a society billions, maybe tens of billions of dollars on building these huge physics experiments, basically. And if you look at maybe the most beautiful, the most important theory of physics ever conjured, it seems like a guy who’s just thinking in a cave. It seems like the empirical basis for that theory is maybe knowing that light has a speed. I mean, maybe you need to measure G experimentally?
Adam Brown: 89:57 Not really. G’s a free parameter in general relativity. It does not— Not required. It’s not required.
Dwarkesh Patel: 90:01 Yeah, so you’re right that the empirical basis is pretty thin. You don’t need much.
Adam Brown: 90:08 And theoretical physicists are pretty cheap. You don’t know, there’s a great temptation, why don’t we just spend it all on theoretical physicists and not build these vastly expensive experiments. Well, the AI companies are really increasing the demand curve on the theoretical physicists, but yeah.
Dwarkesh Patel: 90:24 That’s right. Yeah, not so cheap anymore. But how far can that get you?
Adam Brown: 90:28 I would say that general relativity is perhaps one extreme of that. That is not how it usually works in the history of physics. This really is closer to some Ayn Rand hero just sitting alone, you know, the product of a single mind. He got lots of help in various ways, but it really was just like a singular vision that he pursued for years. And it was pretty, you know, he wrote it down and a lot of people were very impressed almost immediately. It did require launching a somewhat expensive eclipse expedition to go confirm it before he really achieved global celebrity and most people were sold on it. But it was perhaps one of the most extreme examples of this where just somebody sits down and thinks very hard and writes down a true theory. And in some sense, physics has been chasing that high ever since. People love that romantic vision of themselves just sitting down and thinking with very few empirical insights and just thinking very, very hard and doing thought experiments. And it’s typically not worked out quite as well for everybody else as it worked out for Einstein. In fact, it didn’t even work out that well for Einstein in the later part of his career.
Dwarkesh Patel: 91:25 Yeah, how far you could get just by thinking. What do you need to do general relativity? You need the finiteness of the speed of light. You need to convince yourself not just that the speed of light is finite, but that there’s the symmetry that Einstein came up with in special relativity. Then you probably want the equivalence principle, that the inertial—it’s an empirical fact that the inertial mass and the gravitational mass are the same for everything. But that’s pretty sparse. And from just those two things, there’s still a few options. But if you have lots and lots of large language models, you can just—if there’s only a limited number of options, you can just explore the entire tree and say, ‘Okay, focus on this, you know, the equivalence principle is something that’s super significant, and this other thing. Now, okay, now abandon simultaneity and see how far that takes you.’ So still there’s only a finite number of things to explore there. I don’t know how that—how well—I think we got very, very lucky with general relativity, that that’s quite so powerful under those circumstances. But if you just had lots and lots of Einsteins and you just give each of them various options, you could presumably see them in parallel. At the frontiers of physics today, in your experience, does it feel like if you just have millions of them running autonomously you could have… enormous discoveries or are we are we in a different era now? And really that would the the there’s like limited usefulness of that parallelism.
Adam Brown: 93:08 I think there is usefulness, I do think that different parts of science have different branching fractions and how much you need a experiment to cut off that branch. You know, I talked about chasing the high of Einstein. Arguably string theory has already been going all in on that. So Einstein’s theory is just general relativity, there’s also quantum mechanics, we’re trying to marry those two in a consistent way that general relativity doesn’t do it all, like there’s no quantum mechanics in general relativity. How to do that has motivated a lot of people. The problem is that the in order to see that in experiments, if you just do the dimensional analysis, you need ginormous particle colliders, you know, absolutely galactic size particle colliders, it’s just very hard to to see any of that stuff. So but that didn’t stop people, I mean it stopped many people, but many people didn’t stop and keep trying to do it. And so there you just have to kind of hope that it works out sort of like how it did with general relativity, where just by thinking very very very hard with minimal input from experiment you can feel your way to the to the right answer. And for that to be true it needs to be the case that the number of possible you know the tool you have at your disposal is mathematical consistency and does it reduce correctly to the in the known limits. So you better hope that there’s only one or a very small number of possible consistent theories that would work out if you’re going to do that. If it turns out that there’s an unlimited number of consistent theories you’re never going to feel your way to the correct answer because because they’re all consistent and the only only tool you have is is consistency and and perhaps some notion of aesthetics. But if there’s only a few then then maybe you could do it all the way. And so string theory has kind of gone all in on that I would say is just trying to with minimal experimental input believing that there’s only one consistent theory of gravity and just by doing sufficient consistency checks you can find it. Um for other examples it’s you know much harder there’s clearly many you know condensed matter physics often you simply need to go and do an experiment to turn out which one is correct.
Dwarkesh Patel: 95:11 Mm. Whenever our future AI civilization does come up with more and more unified theories of physics or deeper theories make better predictions, do you think that humans will be able to keep up at like once the sort of step is taken that we will actually be in a position to understand what our AI civilization understands?
Adam Brown: 95:31 I don’t know that we’re going to be able to keep up entirely, but I think we’ll keep up pretty much better than pessimistic forecasts would suggest. So let’s take mathematics as a simpler example than than physics. In in mathematics, some people are many mathematicians are worried that these LLMs are just going to turn into proof machines. So Terry Tao has this phrase ‘indigestion’ he uses in which these LLMs will produce billion line inscrutable lean codes.
Dwarkesh Patel: 96:00 The worst-case scenario is a certificate that a particular theorem is true without providing any insight as to why that might be true. And wouldn’t, you know, wouldn’t that be a depressing world to say the mathematicians?
Adam Brown: 96:11 I think that is a possible future, but I actually don’t find that to be a very likely future. Um, because as well as being superhuman provers, we also expect these large language models to be superhuman explainers. And, you know, maybe they’ll do the exact opposite of that. Maybe what they’ll do is they’ll- they’ll take proofs that are very hard to understand and by doggedly trying and trying and trying, they will be able to come up with ways that are human-comprehensible. They will be able to, um, take proofs that are difficult to understand and- and make them easy to understand. And I think the empirical evidence- it’s early days, but is pretty supportive of that more positive vision. So if you look at, um, there was a- Erdős problem that was proved a few months ago now, and it wasn’t just an incomprehensible set of Lean- in fact, it wasn’t even proved in Lean, it was proved informally. And then there was a follow-up paper by some human mathematicians that took these, like, new ideas, human-interpretable ideas that the- the machine had come up with to prove this Erdős conjecture and used it to prove new theorems that had not been used before. So that was an- the exact opposite of that case. It came up with a very human-interpretable, uh, idea, and then humans were able to fully comprehend it and comprehend it so well they were able to deploy it in a new scenario. Um, we’ve seen that throughout. I mean, the- the unit distance conjecture, I think is- is a good example here for- for a number of the- the themes you’ve been discussing here. One is that it’s totally comprehensible, the- the- the- the- the disproof of the unit distance conjecture that it- that it came up with. I mean, to- to some mathematicians. I’m not a mathematician.
Dwarkesh Patel: 97:38 Mhm.
Adam Brown: 97:38 Perhaps the reason that humans haven’t disproved the unit distance conjecture is because they erroneously believe the conjecture to be true, and that the good thing about large language models is that they’re willing to push through that barrier and just waste their time, as a human would understand it, trying to disprove a presumed true conjecture and- and reach the other end. So that’s another, you know, aspect of large language models that makes me pretty optimistic is that they just have extreme patience, uh, even for doing things that perhaps look like low probability of success.
Dwarkesh Patel: 98:14 Mhm. Adam, thanks so much for coming back on and doing this. Um, while you could be building superintelligence, here explaining 100-year-old physics, but it was very interesting.
Adam Brown: 98:22 It’s a super fun subject, I’m so- so happy to share it.
