In 2013, Jayaraman “Jay” Thiagarajan happened upon a job opening for a postdoctoral researcher at LLNL’s Center for Applied Scientific Computing (CASC). He had not visited the Livermore campus as an intern, nor did he have any connection to scientific staff prior to applying. Originally from India, Jay joined CASC after completing his dissertation—Sparse Methods in Image Understanding and Computer Vision—at Arizona State University.
Today, Jay’s research has grown to include multiple related fields. “I work with different types of large-scale, structured data that require the design of unique machine learning [ML] techniques,” he says. This exploration ranges from deep learning–based graph analysis to ML and artificial intelligence (AI) solutions for computer vision, healthcare, language modeling, and scientific applications.
For example, Jay helped develop a new approach for clinical time-series analysis of electronic health records—a data type with great potential for making inferences with ML methods. The 2018 research was accepted at a premier AI venue, the AAAI Conference on Artificial Intelligence. In the completely different application of geophysics, his work to characterize geologic features using an ML regression technique was recognized in a high-impact journal.
Jay leads a Laboratory Directed Research and Development project on high-dimensional sampling that develops new methods that are provably effective for fundamental problems in data such as surrogate modeling and automatic ML. The algorithms from this project can save millions of central processing unit hours in simulations through reliable, informative experiment designs.
Jay also uses ML to improve the way high performance computing (HPC) systems work. By modeling execution time, power consumption, and other data, he and CASC colleagues developed a semi-supervised ML framework that identifies performance-optimizing configurations. He also developed PADDLE (Performance Analysis using a Data-Driven Learning Environment), which enables more efficient user-centric workflows for tasks like identifying causes of network congestion. HPC codes running on these systems can similarly benefit from Jay’s optimization analysis.
“Explainable AI is another area I’m very excited about,” adds Jay. Research in this domain strives to make ML models more trustworthy so scientists can act on reliable predictions—in other words, ensuring the model makes the right decisions for the right reasons. Additionally, he studies the intersection of data analysis, uncertainty quantification, and visualization. “Science can’t progress without uncertainties, but many AI solutions don’t accommodate such a situation,” Jay explains. “Enabling deep learning models to quantify confidences about predictions will help us develop more realistic neural networks.”
To give back to the computing community, Jay provides peer review for several conferences and journals and serves on the ML technical program committee of the Supercomputing conference series. With nearly 100 publications, 6 patent applications, and 2 monographs on his curriculum vitae, he still finds time to mentor the next generation of ML experts. He has advised several PhD students, including a National Science Foundation intern, Department of Energy Computational Science Graduate Fellows, and Computing’s summer interns.
“I’m surprised by how much my research has expanded since CASC hired me,” Jay states. “This breadth is possible only because of the Lab’s diversity of thought.”
In 2020, Jay was honored for his accomplishments through the Lab’s annual Early and Mid-Career Recognition (EMCR) Program. The EMCR Program recognizes scientific and technical accomplishments, leadership, and future promise demonstrated by LLNL scientists and engineers early in their careers.
—Holly Auten