TY - JOUR
T1 - Transformers in protein informatics
T2 - A survey of structure prediction, function annotation, interactions, and drug discovery
AU - Zhang, Yumin
AU - Ling, Xiaowen
AU - Li, Zhiqiang
AU - Song, Liangliang
AU - Jia, Yifan
AU - Wang, Yanbin
AU - You, Zhuhong
N1 - Publisher Copyright:
Copyright © 2026. Published by Elsevier Ltd.
PY - 2026/10/15
Y1 - 2026/10/15
N2 - Protein informatics increasingly requires artificial intelligence models for analyzing biological sequences, structures, interactions, and drug-related targets. Transformer architectures, built on self-attention mechanisms, have become widely used in this field, but their reliability remains dependent on data coverage, biological context, and evaluation protocol. This survey critically reviews over 100 representative studies on Transformer-based methods for protein research. We organize the literature through a two-level taxonomy that separates model-class principles from problem-space applications, covering sequence-only language modeling, geometry-aware prediction, multimodal alignment, and generative design, together with structure prediction, function annotation, interaction analysis, drug discovery, and drug-target identification. We examine how pre-trained protein language models, structure-aware Transformers, and multimodal variants incorporate sequences, evolutionary profiles, and three-dimensional coordinates to address protein-specific constraints. We further synthesize key methodological issues, including geometric inductive bias, physical plausibility, scalability, uncertainty calibration, dataset bias, reproducibility, and generative-model evaluation. Through comparative tables and cross-domain analysis, this survey connects protein Transformer architectures to automated protein engineering, high-throughput drug screening, proteome-scale annotation, and laboratory-in-the-loop design. It evaluates these systems not only by predictive accuracy, but also by computational cost, latency, calibration, reproducibility, physical validation, and experimental utility, and concludes with a prioritized roadmap for deployable protein artificial intelligence.
AB - Protein informatics increasingly requires artificial intelligence models for analyzing biological sequences, structures, interactions, and drug-related targets. Transformer architectures, built on self-attention mechanisms, have become widely used in this field, but their reliability remains dependent on data coverage, biological context, and evaluation protocol. This survey critically reviews over 100 representative studies on Transformer-based methods for protein research. We organize the literature through a two-level taxonomy that separates model-class principles from problem-space applications, covering sequence-only language modeling, geometry-aware prediction, multimodal alignment, and generative design, together with structure prediction, function annotation, interaction analysis, drug discovery, and drug-target identification. We examine how pre-trained protein language models, structure-aware Transformers, and multimodal variants incorporate sequences, evolutionary profiles, and three-dimensional coordinates to address protein-specific constraints. We further synthesize key methodological issues, including geometric inductive bias, physical plausibility, scalability, uncertainty calibration, dataset bias, reproducibility, and generative-model evaluation. Through comparative tables and cross-domain analysis, this survey connects protein Transformer architectures to automated protein engineering, high-throughput drug screening, proteome-scale annotation, and laboratory-in-the-loop design. It evaluates these systems not only by predictive accuracy, but also by computational cost, latency, calibration, reproducibility, physical validation, and experimental utility, and concludes with a prioritized roadmap for deployable protein artificial intelligence.
KW - Bioinformatics
KW - Protein interactions
KW - Proteomics
KW - Transformers
UR - https://www.scopus.com/pages/publications/105047564165
U2 - 10.1016/j.engappai.2026.115976
DO - 10.1016/j.engappai.2026.115976
M3 - 短篇评述
AN - SCOPUS:105047564165
SN - 0952-1976
VL - 182
JO - Engineering Applications of Artificial Intelligence
JF - Engineering Applications of Artificial Intelligence
M1 - 115976
ER -