Medical Segmentation Decathlon

Generalisable 3D Semantic Segmentation

Paper

MSD Challenge - Phase 1 Rank

Note that this rank includes only tasks that were available at algorithm development time, and thus some task specific bias could have been introduced. Results are presented per task, per metric (Dice/NSD), and per region (L1,L2,L3). Rank was estimated using the model proposed in the challenge description page.

		BRATS						Heart		Hippocampus				Liver				Lung		Pancreas				Prostate
		Dice			NSD			Dice	NSD	Dice		NSD		Dice		NSD		Dice	NSD	Dice		NSD		Dice		NSD
Team	Rank	L1	L2	L3	L1	L2	L3	L1	L1	L1	L2	L1	L2	L1	L2	L1	L2	L1	L1	L1	L2	L1	L2	L1	L2	L1	L2
nnU-Net	1	0.68	0.48	0.68	0.87	0.73	0.91	0.93	0.96	0.90	0.89	0.98	0.98	0.95	0.74	0.98	0.88	0.69	0.69	0.80	0.52	0.95	0.73	0.76	0.90	0.96	0.99
K.A.V.athlon	2	0.67	0.47	0.67	0.88	0.73	0.90	0.92	0.95	0.90	0.89	0.98	0.97	0.95	0.62	0.98	0.79	0.61	0.64	0.75	0.43	0.92	0.66	0.73	0.88	0.95	0.98
NVDLMED	3	0.68	0.45	0.68	0.87	0.70	0.90	0.92	0.96	0.88	0.87	0.96	0.97	0.95	0.71	0.98	0.87	0.52	0.50	0.78	0.38	0.95	0.57	0.69	0.87	0.93	0.97
Lupin	4	0.66	0.42	0.64	0.88	0.68	0.89	0.92	0.97	0.90	0.88	0.98	0.98	0.95	0.61	0.98	0.77	0.55	0.55	0.76	0.21	0.95	0.37	0.73	0.88	0.94	0.98
CerebriuDIKU	5	0.70	0.43	0.67	0.88	0.69	0.89	0.89	0.91	0.90	0.88	0.97	0.97	0.94	0.57	0.97	0.73	0.59	0.56	0.71	0.25	0.92	0.46	0.69	0.86	0.95	0.98
LS Wang's Group	6	0.68	0.46	0.66	0.87	0.70	0.87	0.90	0.92	0.90	0.89	0.98	0.97	0.94	0.55	0.98	0.72	0.55	0.56	0.71	0.26	0.91	0.48	0.71	0.85	0.96	0.98
MIMI	7	0.65	0.44	0.66	0.88	0.70	0.89	0.90	0.92	0.89	0.88	0.97	0.97	0.94	0.60	0.97	0.74	0.55	0.56	0.70	0.26	0.89	0.45	0.71	0.87	0.94	0.98
Whale	8	0.64	0.30	0.23	0.85	0.54	0.55	0.89	0.91	0.86	0.85	0.93	0.95	0.94	0.62	0.98	0.81	0.51	0.51	0.66	0.28	0.89	0.43	0.70	0.88	0.95	0.98
VST	9	0.54	0.30	0.63	0.78	0.54	0.82	0.89	0.92	0.86	0.87	0.92	0.96	0.93	0.54	0.96	0.66	0.47	0.48	0.71	0.37	0.92	0.62	0.72	0.86	0.93	0.97
UBIlearn	10	0.65	0.37	0.62	0.85	0.63	0.85	0.91	0.94	0.89	0.85	0.97	0.96	0.94	0.50	0.97	0.62	0.51	0.50	0.69	0.18	0.9	0.33	0.67	0.84	0.93	0.96
BCVuniandes	11	0.69	0.43	0.65	0.88	0.69	0.88	0.80	0.83	0.89	0.88	0.97	0.97	0.87	0.44	0.91	0.63	0.42	0.42	0.56	0.15	0.85	0.33	0.69	0.86	0.94	0.98
BUT	12	0.64	0.35	0.62	0.86	0.59	0.84	0.76	0.79	0.83	0.83	0.89	0.93	0.94	0.60	0.97	0.73	0.33	0.37	0.73	0.21	0.92	0.38	0.65	0.85	0.92	0.97
A-REUMI01	13	0.64	0.4	0.64	0.84	0.64	0.85	0.90	0.91	0.88	0.86	0.96	0.96	0.93	0.43	0.94	0.56	0.45	0.44	0.65	0.20	0.87	0.40	0.67	0.86	0.93	0.98
LfB	14	0.60	0.44	0.62	0.83	0.68	0.80	0.91	0.93	0.79	0.84	0.80	0.93	0.90	0.46	0.88	0.53	0.47	0.39	0.59	0.28	0.79	0.46	0.58	0.82	0.89	0.96
SIAT_MIDS	15	0.33	0.27	0.31	0.62	0.37	0.56	0.88	0.91	0.88	0.86	0.97	0.97	0.84	0.29	0.92	0.43	0.55	0.54	0.56	0.20	0.73	0.37	0.7	0.84	0.94	0.98
Lesswire1	16	0.63	0.41	0.58	0.81	0.68	0.84	0.72	0.73	0.80	0.77	0.89	0.89	0.85	0.48	0.89	0.66	0.32	0.33	0.60	0.08	0.87	0.27	0.52	0.78	0.86	0.92
AI-Med	17	0.64	0.35	0.61	0.83	0.62	0.85	0.76	0.75	0.83	0.73	0.90	0.74	0.91	0.51	0.92	0.60	0.20	0.17	0.48	0.04	0.75	0.18	0.56	0.78	0.85	0.87
RegionTec	18	0.42	0.35	0.55	0.67	0.62	0.82	0.63	0.68	0.72	0.70	0.72	0.76	0.91	0.32	0.96	0.46	0	0	0.61	0.07	0.87	0.23	0.34	0.64	0.72	0.78
EdwardMa12593	19	0.37	0.01	0.18	0.58	0.11	0.38	0.73	0.70	0.87	0.87	0.94	0.97	0.81	0.15	0.85	0.25	0.08	0.03	0.50	0	0.74	0.02	0.43	0.74	0.79	0.93

MSD Challenge - Phase 2 Rank

Note that this rank was part of a task holdout set, i.e. participants did not have access to this data when developing the method. Results are presented per task, per metric (Dice/NSD), and per region (L1,L2,L3). Rank was estimated using the model proposed in the challenge description page.

		Hepatic Vessel				Spleen		Colon
		Dice		NSD		Dice	NSD	Dice	NSD
Team	Rank	L1	L2	L1	L2	L1	L1	L1	L1
nnU-Net	1	0.63	0.69	0.83	0.79	0.96	0.99	0.56	0.68
NVDLMED	2	0.63	0.64	0.83	0.72	0.96	1.00	0.56	0.66
K.A.V.athlon	3	0.62	0.63	0.83	0.72	0.97	1.00	0.36	0.47
LS Wang's Group	4	0.55	0.64	0.77	0.73	0.96	0.99	0.41	0.51
MIMI	5	0.60	0.56	0.79	0.64	0.94	0.97	0.29	0.38
CerebriuDIKU	6	0.59	0.38	0.79	0.44	0.95	0.98	0.28	0.43
Whale	7	0.56	0.46	0.80	0.57	0.95	0.99	0.18	0.29
UBIlearn	8	0.59	0.37	0.80	0.42	0.95	0.98	0.16	0.25
Lupin	9	0.60	0.47	0.81	0.54	0.94	0.98	0.09	0.16
SIAT_MIDS	10	0.51	0.37	0.73	0.39	0.93	0.98	0.19	0.26
LfB	11	0.55	0.35	0.79	0.37	0.83	0.88	0.24	0.32
A-REUMI01	12	0.56	0.39	0.79	0.46	0.92	0.95	0.12	0.21
VST	13	0.44	0.36	0.58	0.39	0.94	0.97	0.15	0.22
AI-Med	14	0.42	0.26	0.65	0.33	0.91	0.93	0.11	0.26
Lesswire1	15	0.44	0.31	0.73	0.28	0.86	0.90	0.10	0.26
BUT	16	0.44	0.39	0.65	0.45	0.89	0.95	0.05	0.10
RegionTec	17	0.42	0.20	0.69	0.22	0.92	0.95	0.06	0.10
BCVuniandes	18	0.14	0.32	0.45	0.36	0.82	0.93	0.06	0.16
EdwardMa12593	19	0.14	0.11	0.31	0.12	0.83	0.88	0.06	0.12

Sponsorship