Completed Computing & AI Mathematics & Statistics

AI for Scientific Data Streams: Real-time detection of change and anomalous structure

In plain English

AI plain-English summary

A steel plant’s X-ray scanner, a particle accelerator’s detectors, and a weather satellite’s sensors all produce torrents of data that can hide a crucial glitch or a new discovery in plain sight—and this project will build software to spot those signals the instant they appear. Current methods for detecting when a scientific instrument starts recording something unusual—a structural change in a material, a rare particle event, or an unexpected shift in a sensor reading—often require scientists to stop and manually inspect the data, or to rely on bespoke algorithms that work for only one type of experiment. This project will develop general-purpose, real-time anomaly detection tools that can be dropped into any scientific data stream, from materials science to frontier physics. The researchers will work directly with leading experimental groups to test and refine the methods on real problems. If successful, the tools could accelerate discovery across multiple fields—for example, flagging a new material phase as it forms inside a synchrotron beamline, or catching a transient signal in a physics detector before it is buried in noise. The project is primarily about building fundamental computational methods, not a specific application, but the same techniques could eventually find use in monitoring industrial manufacturing lines, energy grids, or environmental sensor networks for early signs of failure or change.

View original technical description
The explosion in the volume and velocity of data now collected means that, across a range of scientific disciplines, there is a pressing need for general-purpose detection methods capable of identifying changes and other anomalous phenomena in real-time. This project will focus on the development and deployment of leading edge real-time change and anomalous detection methods into the science base. Working closely with internationally leading research groups in Materials Science, Digital Futures and Frontier Physics this project will (i) disseminate current state of the art change and anomaly methods to accelerate scientific discoveries; (ii) identify, develop and trial new approaches inspired by new change and anomaly challenges that emerge from the Science base; and (iii) seek to develop understanding and a shared vision which will help catalyse interdisciplinary partnerships for future trans-disciplinary research.

View the original record at the funder ↗

Researchers

Florian Pein (Co-Investigator)Gaetano Romano (Co-Investigator)Idris Eckley (Principal Investigator)Paul Fearnhead (Co-Investigator)

Related Research

Grants with similar aims, by meaning.

Statistical Foundations for Detecting Anomalous Structure in Stream Settings (DASS)
Change and Anomaly Detection in Data Streams.
Data-efficient scientific AI: a new paradigm for low-data discovery across scientific disciplines
Novel statistical methods for detecting anomalies in data streams.
AI for autonomous serial diffraction and large data insights

Original classification

Research Grant

Plain English summaries and category classifications on this site are generated by AI and may not perfectly reflect the original research.