ChatGPT and the Future of AI

The Deep Language Revolution

An insightful exploration of Chat GPT and other advanced AI systems—how we got here, where we’re headed, and what it all means for how we interact with the world.

In ChatGPT and the Future of AI, the sequel to The Deep Learning Revolution, Terrence Sejnowski offers a nuanced exploration of large language models (LLMs) like ChatGPT and what their future holds. How should we go about understanding LLMs? Do these language models truly understand what they are saying? Or is it possible that what appears to be intelligence in LLMs may be a mirror that merely reflects the intelligence of the interviewer? In this book, Sejnowski, a pioneer in computational approaches to understanding brain function, answers all our urgent questions about this astonishing new technology.

Sejnowski begins by describing the debates surrounding LLMs’ comprehension of language and exploring the notions of “thinking” and “intelligence.” He then takes a deep dive into the historical evolution of language models, focusing on the role of transformers, the correlation between computing power and model size, and the intricate mathematics shaping LLMs. Sejnowski also provides insight into the historical roots of LLMs and discusses the potential future of AI, focusing on next-generation LLMs inspired by nature and the importance of developing energy-efficient technologies.

Grounded in Sejnowski’s dual expertise in AI and neuroscience, ChatGPT and the Future of AI is the definitive guide to understanding the intersection of AI and human intelligence.
Terrence J. Sejnowski is Francis Crick Chair at The Salk Institute for Biological Studies and Distinguished Professor at the University of California at San Diego. He has published over 500 scientific papers and 12 books, including The Computational Brain with Patricia Churchland. He was instrumental in shaping the BRAIN Initiative that was announced by the White House in 2013, and he received the prestigious Gruber Prize in Neuroscience in 2022.
Terrence J. Sejnowski View titles by Terrence J. Sejnowski
Table of Contents
Preface
Part I:  Living with Large Language Models
1. Introduction
2. How Chatbots Are Changing Our Lives
3. Interviews with Large Language Models
4. The Power of the Prompt
5. What are Intelligence, Thinking, and Consciousness?
Part II:  Transformers
6. Origins 
7. Mathematics 
8. Infrastructure 
9. Superintelligence 
10. Regulation 
Part III:  Back to the Future
11. Evolution of AI
12. The Next Generation 
13. Learning from Nature
14. The Future is Now
Afterword
Acknowledgments
Glossary
Notes
Index

About

An insightful exploration of Chat GPT and other advanced AI systems—how we got here, where we’re headed, and what it all means for how we interact with the world.

In ChatGPT and the Future of AI, the sequel to The Deep Learning Revolution, Terrence Sejnowski offers a nuanced exploration of large language models (LLMs) like ChatGPT and what their future holds. How should we go about understanding LLMs? Do these language models truly understand what they are saying? Or is it possible that what appears to be intelligence in LLMs may be a mirror that merely reflects the intelligence of the interviewer? In this book, Sejnowski, a pioneer in computational approaches to understanding brain function, answers all our urgent questions about this astonishing new technology.

Sejnowski begins by describing the debates surrounding LLMs’ comprehension of language and exploring the notions of “thinking” and “intelligence.” He then takes a deep dive into the historical evolution of language models, focusing on the role of transformers, the correlation between computing power and model size, and the intricate mathematics shaping LLMs. Sejnowski also provides insight into the historical roots of LLMs and discusses the potential future of AI, focusing on next-generation LLMs inspired by nature and the importance of developing energy-efficient technologies.

Grounded in Sejnowski’s dual expertise in AI and neuroscience, ChatGPT and the Future of AI is the definitive guide to understanding the intersection of AI and human intelligence.

Author

Terrence J. Sejnowski is Francis Crick Chair at The Salk Institute for Biological Studies and Distinguished Professor at the University of California at San Diego. He has published over 500 scientific papers and 12 books, including The Computational Brain with Patricia Churchland. He was instrumental in shaping the BRAIN Initiative that was announced by the White House in 2013, and he received the prestigious Gruber Prize in Neuroscience in 2022.
Terrence J. Sejnowski View titles by Terrence J. Sejnowski

Table of Contents

Table of Contents
Preface
Part I:  Living with Large Language Models
1. Introduction
2. How Chatbots Are Changing Our Lives
3. Interviews with Large Language Models
4. The Power of the Prompt
5. What are Intelligence, Thinking, and Consciousness?
Part II:  Transformers
6. Origins 
7. Mathematics 
8. Infrastructure 
9. Superintelligence 
10. Regulation 
Part III:  Back to the Future
11. Evolution of AI
12. The Next Generation 
13. Learning from Nature
14. The Future is Now
Afterword
Acknowledgments
Glossary
Notes
Index