首页|Explainable predictive modeling for limited spectral data

Explainable predictive modeling for limited spectral data

扫码查看
原文链接
  • NSTL
  • Elsevier
Feature selection of high-dimensional labeled data with limited observations is critical for making powerful predictive modeling accessible, scalable, and interpretable for domain experts. Spectroscopy data, which records the interaction between matter and electromagnetic radiation, particularly holds a lot of information in a single sample. Since acquiring such high-dimensional data is a complex task, it is crucial to exploit the best analytical tools to extract necessary information. In this paper, we investigate the most commonly used feature selection techniques and introduce applying recent explainable AI techniques to interpret the prediction outcomes of highdimensional and limited spectral data. Interpretation of the prediction outcome is beneficial for the domain experts as it ensures the transparency and faithfulness of the ML models to the domain knowledge. Due to the instrument resolution limitations, pinpointing important regions of the spectroscopy data creates a pathway to optimize the data collection process through the miniaturization of the spectrometer device. Reducing the device size and power and therefore cost is a requirement for the real-world deployment of such a sensor-to-prediction system as a whole. Furthermore, we consider a wide range of machine learning models that have been proven to be successful for the prediction of the Cetane Number of fuels. We specifically design three different scenarios to ensure that the evaluation of ML models is robust for the real-time practice of the developed methodologies and to uncover the hidden effect of noise sources on the final outcome. The evaluation is performed for both the full model and reduced models using different feature selection techniques on a real dataset. Finally, we propose a correctness metric for the feature selection techniques to assess the conformance of the selected subset of features to the domain expertise. As a result, the Support Vector Regression yields better prediction accuracy and generalization power as it leads to less complex and computationally more efficient than model Neural Network. More importantly, using the reduced subset of features from original data creates a pathway to deploying less complex, scalable, and explainable prediction models.

InterpretabilityPredictive modelingExplainable AISpectral dataFeature selectionInterpretabilityPredictive modelingExplainable AISpectral dataFeature selectionPARTIAL LEAST-SQUARESNEAR-INFRARED SPECTROSCOPYSUPPORT VECTOR REGRESSIONCETANE NUMBERWAVELENGTH SELECTIONVARIABLE SELECTIONNEURAL-NETWORKSBIODIESELFUELCHEMOMETRICS

Akulich, Frantishek、Anahideh, Hadis、Sheyyab, Manaf、Ambre, Dhananjay

展开 >

Univ Illinois

2022

10.1016/j.chemolab.2022.104572

Chemometrics and Intelligent Laboratory Systems

Chemometrics and Intelligent Laboratory Systems

EISCI
ISSN：0169-7439
年,卷(期)：2022.225
  • 7
  • 97