Hongen Kang, Xiuli Zhu, Ying Cui, Zhuang Xiong, Wenting Zong, Yiming Bao, Peilin Jia
Immune checkpoint blockades (ICBs) have revolutionized cancer therapy by inducing durable clinical responses, but only a small percentage of patients can benefit from ICB treatments. Many studies have established various biomarkers to predict ICB responses. However, different biomarkers were found with diverse performances in practice, and a timely and unbiased assessment has yet to be conducted due to the complexity of ICB-related studies and trials. In this study, we manually curated 29 published datasets with matched transcriptome and clinical data from more than 1400 patients, and uniformly preprocessed these datasets for further analyses. In addition, we collected 39 sets of transcriptomic biomarkers, and based on the nature of the corresponding computational methods, we categorized them into the gene-set-like group (with the self-contained design and the competitive design, respectively) and the deconvolution-like group. Next, we investigated the correlations and patterns of these biomarkers and utilized a standardized workflow to systematically evaluate their performance in predicting ICB responses and survival statuses across different datasets, cancer types, antibodies, biopsy times, and combinatory treatments. In our benchmark, most biomarkers showed poor performance in terms of stability and robustness across different datasets. Two scores (TIDE and CYT) had a competitive performance for ICB response prediction, and two others (PASS-ON and EIGS_ssGSEA) showed the best association with clinical outcome. Finally, we developed ICB-Portal to host the datasets, biomarkers, and benchmark results and to implement the computational methods for researchers to test their custom biomarkers. Our work provided valuable resources and a one-stop solution to facilitate ICB-related research.
Cell. 2016 Mar 24;165(1):35-44
[PMID:
26997480]
Science. 2017 Jan 20;355(6322):
[PMID:
28104840]
Nat Commun. 2019 Sep 19;10(1):4278
[PMID:
31537801]
Nat Med. 2019 Mar;25(3):389-402
[PMID:
30842677]
Nat Biotechnol. 2019 Jul;37(7):773-782
[PMID:
31061481]
Nat Commun. 2020 Oct 8;11(1):5077
[PMID:
33033240]
Nature. 2018 Feb 22;554(7693):544-548
[PMID:
29443960]
Cell. 2018 Apr 19;173(3):624-633.e8
[PMID:
29656892]
Nat Commun. 2022 Jul 8;13(1):3938
[PMID:
35803911]
N Engl J Med. 2014 Dec 4;371(23):2189-2199
[PMID:
25409260]
Nat Biotechnol. 2022 Apr;40(4):499-506
[PMID:
34725502]
J Clin Invest. 2017 Aug 1;127(8):2930-2940
[PMID:
28650338]
Science. 2018 Feb 16;359(6377):801-806
[PMID:
29301960]
Cell. 2017 Nov 2;171(4):934-949.e16
[PMID:
29033130]
Science. 2015 Apr 3;348(6230):124-8
[PMID:
25765070]
Science. 2015 Oct 9;350(6257):207-211
[PMID:
26359337]
Cancer Cell. 2020 Oct 12;38(4):500-515.e3
[PMID:
32916126]
Cancer Cell. 2021 Jun 14;39(6):845-865.e7
[PMID:
34019806]
Nat Commun. 2020 Apr 20;11(1):1897
[PMID:
32312968]
NPJ Genom Med. 2021 Oct 11;6(1):83
[PMID:
34635662]
Lancet. 2016 Apr 9;387(10027):1540-1550
[PMID:
26712084]
Genome Res. 2018 Nov;28(11):1747-1756
[PMID:
30341162]
Lancet. 2017 Oct 21;390(10105):1853-1862
[PMID:
28822576]
N Engl J Med. 2015 Jun 25;372(26):2509-20
[PMID:
26028255]
Nat Genet. 2018 Sep;50(9):1271-1281
[PMID:
30150660]
Cell. 2018 Nov 1;175(4):984-997.e24
[PMID:
30388455]
Nat Med. 2019 Dec;25(12):1916-1927
[PMID:
31792460]
Cell. 2015 Jan 15;160(1-2):48-61
[PMID:
25594174]
Nat Cancer. 2020 Feb;1(2):210-221
[PMID:
32110781]
Clin Cancer Res. 2014 Oct 1;20(19):5064-74
[PMID:
24714771]
Nat Commun. 2018 Aug 29;9(1):3503
[PMID:
30158554]
Cancer Cell. 2019 Feb 11;35(2):238-255.e6
[PMID:
30753825]
Cell Rep. 2020 Jul 7;32(1):107873
[PMID:
32640238]
Nat Methods. 2015 May;12(5):453-7
[PMID:
25822800]
Cancer Immunol Res. 2017 Jan;5(1):84-91
[PMID:
27956380]
Nat Med. 2018 Oct;24(10):1550-1558
[PMID:
30127393]
Brief Bioinform. 2022 May 13;23(3):
[PMID:
35395670]
Nat Biotechnol. 2020 Jun;38(6):675-678
[PMID:
32444850]
Nature. 2014 Nov 27;515(7528):568-71
[PMID:
25428505]
Liver Cancer. 2021 Jul;10(4):346-359
[PMID:
34414122]
Nat Med. 2018 Sep;24(9):1449-1458
[PMID:
30013197]
Nat Commun. 2022 Aug 18;13(1):4851
[PMID:
35982052]
Nature. 2014 Nov 27;515(7528):563-7
[PMID:
25428504]
Nat Commun. 2016 Jan 29;7:10582
[PMID:
26822383]
Cancer Discov. 2022 Apr 1;12(4):1088-1105
[PMID:
34983745]
Mol Cancer Ther. 2015 Apr;14(4):847-56
[PMID:
25695955]
Cancers (Basel). 2021 Apr 01;13(7):
[PMID:
33915876]
Clin Cancer Res. 2017 Jun 15;23(12):3158-3167
[PMID:
28619999]
Genome Biol. 2016 Oct 20;17(1):218
[PMID:
27765066]
Science. 2018 Oct 12;362(6411):
[PMID:
30309915]
PLoS Med. 2017 May 26;14(5):e1002309
[PMID:
28552987]
J Immunother Cancer. 2019 Dec 4;7(1):341
[PMID:
31801636]
Nat Commun. 2021 Oct 15;12(1):6023
[PMID:
34654806]
Cancer Immunol Res. 2019 May;7(5):737-750
[PMID:
30842092]
Nature. 2020 Jan;577(7791):561-565
[PMID:
31942071]
Cell Rep. 2017 Jan 3;18(1):248-262
[PMID:
28052254]
N Engl J Med. 2018 Jan 11;378(2):158-168
[PMID:
29320654]
Contemp Oncol (Pozn). 2015;19(1A):A68-77
[PMID:
25691825]
Cell. 2021 Oct 14;184(21):5482-5496.e28
[PMID:
34597583]
Nat Med. 2020 Jun;26(6):909-918
[PMID:
32472114]
Aging (Albany NY). 2019 Dec 3;11(23):11576-11590
[PMID:
31796647]
Nucleic Acids Res. 2016 May 5;44(8):e71
[PMID:
26704973]
Nat Med. 2020 Nov;26(11):1733-1741
[PMID:
32895571]
Sci Rep. 2020 Jan 20;10(1):643
[PMID:
31959763]
Nat Commun. 2022 Jan 10;13(1):42
[PMID:
35013211]
Nature. 2020 Mar;579(7798):274-278
[PMID:
32103181]
Nat Commun. 2018 Nov 8;9(1):4692
[PMID:
30410077]
Nat Med. 2018 Jun;24(6):749-757
[PMID:
29867230]
Nat Commun. 2013;4:2612
[PMID:
24113773]
Genome Biol. 2016 Nov 17;17(1):231
[PMID:
27855702]
Cancer Cell. 2022 Jan 10;40(1):36-52.e9
[PMID:
34822775]
Mol Biosyst. 2016 Feb;12(2):477-9
[PMID:
26661513]
Genome Biol. 2017 Nov 15;18(1):220
[PMID:
29141660]
Clin Epigenetics. 2020 Aug 6;12(1):119
[PMID:
32762727]
Nat Commun. 2022 Apr 11;13(1):1935
[PMID:
35410325]
Oncoimmunology. 2019 Oct 3;8(12):e1659094
[PMID:
31741756]
Nat Genet. 2019 Feb;51(2):202-206
[PMID:
30643254]
Nat Med. 2020 May;26(5):781-791
[PMID:
32284588]
Cancer Res. 2020 Nov 1;80(21):4854-4867
[PMID:
32855206]
Nat Med. 2018 Oct;24(10):1545-1549
[PMID:
30127394]