Simone: We began working together through my work in cellular engineering . One of my outstanding research problems was to track the movement of plankton in 3D fast enough so I could mathematically model changes in shape in behavior. With these models I could use plankton as chemical and environmental sensors, like a canary in a coal mine. The problem is with conventional microscopes moving plankton go in and out of focus. Enter Tom! A couple of years ago, he gave a talk on a 3D lensless microscope he invented. I was in the audience and realized his microscope could solve my big problem. Tom’s microscope has no lens, so no focusing is required. It relies on an imager chip, like the one in cell phone cameras, to capture the shadows of plankton as they swim on top of the imager chip. This is the imaging system used in the microscopic reality system.
Tom: Partnering with Simone let me bring together my interests in the environment, image processing, inventing and getting kids excited about science and engineering. Working with my mentor Barton Smith, I initially invented the 3D lensless microscope to look at the tiny creatures in my fish tank. I quickly became more interested in plankton than my fish. Before I met Simone, I had no idea that half a billion years ago plankton tripled the oxygen in the air, which led to an explosion of life - and to us. Now that we can explore the microscopic world in high definition, I want to share with young people the amazing world of “life in a drop of water”, and teach them how vital these little creatures are to our life and our future.
Engineers and scientists have so much to learn from nature. Biology is a profound motivator and teacher. The brain shows us what’s possible with AI. Cells show us what’s possible in chemical synthesis, sensing, data storage and learning. Cellular shape and behavior indicate their health and the health of their environment. Our challenge is to learn how to interpret and understand the signals, chemistry and structure nature uses to control, modify and create life.
Our vision for microscopic reality is to enable us to detect in real-time the interaction and subtle changes in shape and behavior of the many organisms that populate our environment.By combining microscopes with VR, AR and AI, we hope to gain a better understanding of how the ecosystem operates, to better manage the health of the environment.