Lifeboat Foundation

Greg Yang is a mathematician and AI researcher at Microsoft Research who for the past several years has done incredibly original theoretical work in the understanding of large artificial neural networks. Greg received his bachelors in mathematics from Harvard University in 2018 and while there won the Hoopes prize for best undergraduate thesis. He also received an Honorable Mention for the Morgan Prize for Outstanding Research in Mathematics by an Undergraduate Student in 2018 and was an invited speaker at the International Congress of Chinese Mathematicians in 2019.

In this episode, we get a sample of Greg’s work, which goes under the name “Tensor Programs” and currently spans five highly technical papers. The route chosen to compress Tensor Programs into the scope of a conversational video is to place its main concepts under the umbrella of one larger, central, and time-tested idea: that of taking a large N limit. This occurs most famously in the Law of Large Numbers and the Central Limit Theorem, which then play a fundamental role in the branch of mathematics known as Random Matrix Theory (RMT). We review this foundational material and then show how Tensor Programs (TP) generalizes this classical work, offering new proofs of RMT. We conclude with the applications of Tensor Programs to a (rare!) rigorous theory of neural networks.

Continue reading “Greg Yang | Large N Limits: Random Matrices & Neural Networks | The Cartesian Cafe w/ Timothy Nguyen” »

As science fiction would have you believe, you can’t really go to “another dimension.” Dimensions are more about how we see the world. But some things point to not just one, but two dimensions of time, according to one expert. If it were true, the theory could fix the biggest problem in physics, which is that quantum mechanics and general relativity don’t agree with each other.

Itzhak Bars from the University of Southern California in Los Angeles says that’s the case. Up, down, left, right, forward, back, and space-time are the normal three dimensions. In Bars’s theory, time is not a straight line. Instead, it is a curved 2D plane that is woven into all of these dimensions and more.

Dr. Bars has been working on “two-time physics” for more than ten years. All of this started when he started to wonder what time has to do with gravity and other forces. Even though the idea of more dimensions sounds strange, more and more physicists are thinking about it because it could help create the “theory of everything” or “unified theory of physics” that everyone wants. This would put all of the basic forces of the universe into a single, simple math equation.

Support us! https://www.patreon.com/mlst.

Irina Rish is a world-renowned professor of computer science and operations research at the Université de Montréal and a core member of the prestigious Mila organisation. She is a Canada CIFAR AI Chair and the Canadian Excellence Research Chair in Autonomous AI. Irina holds an MSc and PhD in AI from the University of California, Irvine as well as an MSc in Applied Mathematics from the Moscow Gubkin Institute. Her research focuses on machine learning, neural data analysis, and neuroscience-inspired AI. In particular, she is exploring continual lifelong learning, optimization algorithms for deep neural networks, sparse modelling and probabilistic inference, dialog generation, biologically plausible reinforcement learning, and dynamical systems approaches to brain imaging analysis. Prof. Rish holds 64 patents, has published over 80 research papers, several book chapters, three edited books, and a monograph on Sparse Modelling. She has served as a Senior Area Chair for NeurIPS and ICML. Irina’s research is focussed on taking us closer to the holy grail of Artificial General Intelligence. She continues to push the boundaries of machine learning, continually striving to make advancements in neuroscience-inspired AI.

Continue reading “Prof. IRINA RISH — AGI, Complex Systems, Transhumanism #NeurIPS” »

If you know anything about special relativity then you probably know that how fast you’re moving has an impact on how quickly time passes for you. What physics gives rise to this effect? Do you need to know some complicated mathematics in order to understand it?

It turns out that this effect, known as “time dilation”, can be very easily derived for a special kind of clock: a light clock. In this video, I consider a light clock moving through space and show how the postulates of special relativity entail that this moving clock runs slow.

Continue reading “The Light Clock: How Moving Clocks Run Slow” »

On nights and weekends, Justin Gilmer attacked an old question in pure math using the tools of information theory.

Logic gates in biology can be set up to lead to timing important biological events. How is this done?

Edit: at 4:00, not all pathways make use of this motif. This is just one way timing can happen in biology.

Continue reading “Decoding nature’s masterful engineering using math” »

We may think we invented mathematics but we actually only discover it. It’s the immaterial underpinning of material nature.

In the current issue of Nature Photonics, Prof. Dr. Oliver G. Schmidt, Dr. Libo Ma and partners present a strategy for observing and manipulating the optical Berry phase in Möbius ring microcavities. In their research paper, they discuss how an optical Berry phase can be generated and measured in dielectric Möbius rings. Furthermore, they present the first experimental proof of the existence of a variable Berry phase for linearly or elliptically polarized resonant light.

A Möbius strip is a fascinating object. You can easily create a Möbius strip when twisting the two ends of a strip of paper by 180 degrees and connecting them together. Upon closer inspection, you realize that this ribbon has only one surface that cannot be distinguished between inside and outside or below and above. Because of this special topological property, the Möbius strip has become an object of countless mathematical discourses, artistic representations and practical applications, for example, in paintings by M.C. Escher, as a wedding ring, or as a drive belt to wear both sides of the belt equally.

A researcher has claimed time travel may actually be possible – and says he has the math to prove it. Time travel is a concept that has fascinated scientists for some time. It’s the idea that one can move to specific points in time, often seen in popular TV shows and films such as Donnie Darko, Back to the Future andNetflix’s The Umbrella Academy.