TY - JOUR
T1 - Finding radio transients with anomaly detection and active learning based on volunteer classifications
AU - Andersson, Alex
AU - Lintott, Chris
AU - Fender, Rob
AU - Lochner, Michelle
AU - Woudt, Patrick
AU - Van Den Eijnden, Jakob
AU - Van Der Horst, Alexander
AU - Horesh, Assaf
AU - Saikia, Payaswini
AU - Sivakoff, Gregory R.
AU - Tremou, Lilia
AU - Vaccari, Mattia
N1 - Publisher Copyright:
© 2025 The Author(s).
PY - 2025/4/1
Y1 - 2025/4/1
N2 - In this work, we explore the applicability of unsupervised machine learning algorithms to finding radio transients. Facilities such as the Square Kilometre Array (SKA) will provide huge volumes of data in which to detect rare transients; the challenge for astronomers is how to find them. We demonstrate the effectiveness of anomaly detection algorithms using 1.3 GHz light curves from the SKA precursor MeerKAT. We make use of three sets of descriptive parameters ('feature sets') as applied to two anomaly detection techniques in the astronomaly package and analyse our performance by comparison with citizen science labels on the same data set. Using transients found by volunteers as our ground truth, we demonstrate that anomaly detection techniques can recall over half of the radio transients in the 10 per cent of the data with the highest anomaly scores. We find that the choice of anomaly detection algorithm makes a minor difference, but that feature set choice is crucial, especially when considering available resources for human inspection and/or follow-up. Active learning, where human labels are given for just 2 per cent of the data, improves recall by up to 20 percentage points, depending on the combination of features and model used. The best-performing results produce a factor of 5 times fewer sources requiring vetting by experts. This is the first effort to apply anomaly detection techniques to finding radio transients and shows great promise for application to other data sets, and as a real-Time transient detection system for upcoming large surveys.
AB - In this work, we explore the applicability of unsupervised machine learning algorithms to finding radio transients. Facilities such as the Square Kilometre Array (SKA) will provide huge volumes of data in which to detect rare transients; the challenge for astronomers is how to find them. We demonstrate the effectiveness of anomaly detection algorithms using 1.3 GHz light curves from the SKA precursor MeerKAT. We make use of three sets of descriptive parameters ('feature sets') as applied to two anomaly detection techniques in the astronomaly package and analyse our performance by comparison with citizen science labels on the same data set. Using transients found by volunteers as our ground truth, we demonstrate that anomaly detection techniques can recall over half of the radio transients in the 10 per cent of the data with the highest anomaly scores. We find that the choice of anomaly detection algorithm makes a minor difference, but that feature set choice is crucial, especially when considering available resources for human inspection and/or follow-up. Active learning, where human labels are given for just 2 per cent of the data, improves recall by up to 20 percentage points, depending on the combination of features and model used. The best-performing results produce a factor of 5 times fewer sources requiring vetting by experts. This is the first effort to apply anomaly detection techniques to finding radio transients and shows great promise for application to other data sets, and as a real-Time transient detection system for upcoming large surveys.
KW - radio continuum: Transients
KW - radio continuum: general
KW - software: data analysis
KW - software: machine learning
KW - surveys
UR - http://www.scopus.com/inward/record.url?scp=105000737935&partnerID=8YFLogxK
U2 - 10.1093/mnras/staf336
DO - 10.1093/mnras/staf336
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:105000737935
SN - 0035-8711
VL - 538
SP - 1397
EP - 1414
JO - Monthly Notices of the Royal Astronomical Society
JF - Monthly Notices of the Royal Astronomical Society
IS - 3
ER -