Toby started to interact with the Japanese information theory community in the late 1970s. He presented a new problem of statistical inference in the framework of multiterminal source coding at the IEEE 7th Spring Workshop on Information Theory held at Mt. Kisco, NY in 1979. This problem was followed up by Shun'ichi Amari, Te Sun Han, and Kingo Kobayashi, resulting in many papers in the IT Transactions. This problem turns out to be closely related to the theory of information geometry pioneered by Amari. In 1980/81, Toby visited Suguru Arimoto at Osaka University for two months, supported by the Japan Society for the Promotion of Science.
In the early 1980’s, Toby received a fellowship from the Ministry of Education of China to give a series of lectures on information theory at South China Institute of Technology that attracted attendants across the country. It was a time when there was very little contact between China and the West. Three of the attendants subsequently became his PhD students.
In the 1990’s, Toby became interested in applications of information theory and multiple access theory. He founded the DISCOVERY Lab at Cornell in the mid-1990s to conduct research on practical methods for video conferencing over the telephone line, whose bandwidth was less than 1% of what we are used to nowadays. Sightspeed, a spinoff company from the DISCOVERY Lab, was acquired by Logitech in 2008 for $30 million. In the 1990s, Toby and his students were also granted a few patents on online compression of human signatures. In 2017 he co-founded with his student a Wi-Fi networks technology company, Cayuga Wireless, that is based on their multiple access research for multiuser physical layers.
At Cornell, Toby became the first Irwin and Joan Jacobs Professor of Engineering.
He taught a large number of undergraduate and graduate courses. Among the graduate courses he developed was “Bio-Information Theory,” first offered in 2001 and was the first regular course on the subject ever offered in a university. This course was part of his effort to help launch the interdisciplinary merger of information theory and biology, specifically neuroscience, around the turn of the century. The title of his 2002 Shannon Lecture was “Living Information Theory.” Based on this lecture, he published a tutorial paper with the same title in the Society’s Newsletter in 2003.
During his Cornell years, Toby was very active doing consulting work for IBM and Bell Labs. At IBM, he did a lot of unpublished work with Dick Blahut on various digital communication problems. At Bell Labs, he was a frequent visitor to the information theory group headed by Aaron Wyner.
In 1998 Toby took a sabbatical year at the University of Virginia. Here he began his collaboration with a neuroscientist, William “Chip” Levy. The collaboration was particularly successful because of their shared belief that information theory could be used to understand evolved communication and computation by neurons of the brain. They continued their research collaboration until his retirement.
Due to a family reason, Toby retired from Cornell in 2006 and joined University of Virginia. Bio-information theory continued to be his main research interest for the rest of his career. He remained very active in research until he finally retired at the age of 79, when most of his earlier students had already retired.
During his tenure at Virginia, Toby enjoyed teaching various graduate courses. The harmonica playing before finals and the home-made cookies from his wife Florence after exams were and will always be remembered as the sweetest treat.
Toby was deeply intrigued and amazed by the energy efficiency of information processing in the human brain. In particular, he thought it was fascinating that the 100 billion neurons composing the human brain consumed about 20 watts of power, whereas the IBM simulated cat visual cortex was 109 times more costly per neuron. This had led to his seminal 2010 IT Transactions paper, in which he laid the mathematical foundation of energy efficient neural computation and communication, i.e., the maximum bits-per-Joule (bpJ) theory. Through a subsequent collaboration with Terry Sejnowski – a pioneer in computational neuroscience, Toby helped bridge the gap between information theory and neuroscience, widening the scope of his theory and its potential range of applications.
Toby served the IEEE Information Theory Group in various capacities, including President (1979) and Editor-in-Chief (1987-89). He was also a Co-Chair of the 1977 IEEE International Symposium on Information Theory which was held in Ithaca, NY.
Toby was recognized by numerous awards. These include the 1982 Frederick E. Terman Award of the American Society for Engineering Education for outstanding young electrical engineering educator, the 2002 Claude E. Shannon Award, the 2006 IEEE Leon K. Kirchmayer Graduate Teaching Award, and the 2011 IEEE Richard W. Hamming Medal. He was a Member of the US National Academy of Engineering and a Life Fellow of the IEEE.
An outstanding researcher and educator of our time, Toby Berger will be remembered for his technical legacy. For those who know him, he will also be remembered for his harmonica playing, his enthusiasm in tennis, his generosity, his humility, and his humanity toward the underprivileged.