TY - GEN
T1 - A Transformer Framework for Remaining Useful Life Prediction Using Sensor Attention and Operational Context Embeddings
AU - Garzón, Jordy
AU - Flores-Moyano, Ricardo
AU - Baldeon-Calisto, Maria
AU - Vega-Sánchez, José
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - This work presents a novel and efficient approach for predicting the Remaining Useful Life (RUL) of turbofan aircraft engines using NASA's C-MAPSS dataset. A two-phase methodology is introduced: baseline modeling with classical regressors (Ridge, Random Forest, XGBoost), followed by advanced deep learning techniques employing Long Short-Term Memory (LSTM) networks and a custom transformer-based architecture. The proposed transformer model integrates dynamic operatingcondition embeddings and a sensor-specific attention mechanism inspired by squeeze-and-excitation (SE) networks. This design enhances the interpretability while capturing complex multivariate temporal dependencies. Comparative experiments across multiple configurations d emonstrated s uperior p erformance in t erms of RMSE and R2, outperforming both traditional models and recent state-of-the-art deep learning approaches. The proposed method is computationally efficient and can be generalized across diverse degradation patterns. These findings r einforce t he r ole of lean transformer architecture as a scalable, interpretable, and effective tool for predictive maintenance in aerospace applications.
AB - This work presents a novel and efficient approach for predicting the Remaining Useful Life (RUL) of turbofan aircraft engines using NASA's C-MAPSS dataset. A two-phase methodology is introduced: baseline modeling with classical regressors (Ridge, Random Forest, XGBoost), followed by advanced deep learning techniques employing Long Short-Term Memory (LSTM) networks and a custom transformer-based architecture. The proposed transformer model integrates dynamic operatingcondition embeddings and a sensor-specific attention mechanism inspired by squeeze-and-excitation (SE) networks. This design enhances the interpretability while capturing complex multivariate temporal dependencies. Comparative experiments across multiple configurations d emonstrated s uperior p erformance in t erms of RMSE and R2, outperforming both traditional models and recent state-of-the-art deep learning approaches. The proposed method is computationally efficient and can be generalized across diverse degradation patterns. These findings r einforce t he r ole of lean transformer architecture as a scalable, interpretable, and effective tool for predictive maintenance in aerospace applications.
KW - multivariate time series
KW - Predictive maintenance
KW - remaining useful life
KW - sensor attention
KW - transformer
UR - https://www.scopus.com/pages/publications/105032510430
U2 - 10.1109/ETCM67548.2025.11304467
DO - 10.1109/ETCM67548.2025.11304467
M3 - Contribución a la conferencia
AN - SCOPUS:105032510430
T3 - ETCM 2025 - 9th Ecuador Technical Chapters Meeting
BT - ETCM 2025 - 9th Ecuador Technical Chapters Meeting
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 9th Ecuador Technical Chapters Meeting, ETCM 2025
Y2 - 21 October 2025 through 24 October 2025
ER -