Medical Segmentation Decathlon

Generalisable 3D Semantic Segmentation



MSD Challenge - Phase 1 Rank

Note that this rank includes only tasks that were available at algorithm development time, and thus some task specific bias could have been introduced. Results are presented per task, per metric (Dice/NSD), and per region (L1,L2,L3). Rank was estimated using the model proposed in the challenge description page.

 

 

BRATS

Heart

Hippocampus

Liver

Lung

Pancreas

Prostate

 

 

Dice

NSD

Dice

NSD

Dice

NSD

Dice

NSD

Dice

NSD

Dice

NSD

Dice

NSD

Team

Rank

L1

L2

L3

L1

L2

L3

L1

L1

L1

L2

L1

L2

L1

L2

L1

L2

L1

L1

L1

L2

L1

L2

L1

L2

L1

L2

nnU-Net

1

0.68

0.48

0.68

0.87

0.73

0.91

0.93

0.96

0.90

0.89

0.98

0.98

0.95

0.74

0.98

0.88

0.69

0.69

0.80

0.52

0.95

0.73

0.76

0.90

0.96

0.99

K.A.V.athlon

2

0.67

0.47

0.67

0.88

0.73

0.90

0.92

0.95

0.90

0.89

0.98

0.97

0.95

0.62

0.98

0.79

0.61

0.64

0.75

0.43

0.92

0.66

0.73

0.88

0.95

0.98

NVDLMED

3

0.68

0.45

0.68

0.87

0.70

0.90

0.92

0.96

0.88

0.87

0.96

0.97

0.95

0.71

0.98

0.87

0.52

0.50

0.78

0.38

0.95

0.57

0.69

0.87

0.93

0.97

Lupin

4

0.66

0.42

0.64

0.88

0.68

0.89

0.92

0.97

0.90

0.88

0.98

0.98

0.95

0.61

0.98

0.77

0.55

0.55

0.76

0.21

0.95

0.37

0.73

0.88

0.94

0.98

CerebriuDIKU

5

0.70

0.43

0.67

0.88

0.69

0.89

0.89

0.91

0.90

0.88

0.97

0.97

0.94

0.57

0.97

0.73

0.59

0.56

0.71

0.25

0.92

0.46

0.69

0.86

0.95

0.98

LS Wang's Group

6

0.68

0.46

0.66

0.87

0.70

0.87

0.90

0.92

0.90

0.89

0.98

0.97

0.94

0.55

0.98

0.72

0.55

0.56

0.71

0.26

0.91

0.48

0.71

0.85

0.96

0.98

MIMI

7

0.65

0.44

0.66

0.88

0.70

0.89

0.90

0.92

0.89

0.88

0.97

0.97

0.94

0.60

0.97

0.74

0.55

0.56

0.70

0.26

0.89

0.45

0.71

0.87

0.94

0.98

Whale

8

0.64

0.30

0.23

0.85

0.54

0.55

0.89

0.91

0.86

0.85

0.93

0.95

0.94

0.62

0.98

0.81

0.51

0.51

0.66

0.28

0.89

0.43

0.70

0.88

0.95

0.98

VST

9

0.54

0.30

0.63

0.78

0.54

0.82

0.89

0.92

0.86

0.87

0.92

0.96

0.93

0.54

0.96

0.66

0.47

0.48

0.71

0.37

0.92

0.62

0.72

0.86

0.93

0.97

UBIlearn

10

0.65

0.37

0.62

0.85

0.63

0.85

0.91

0.94

0.89

0.85

0.97

0.96

0.94

0.50

0.97

0.62

0.51

0.50

0.69

0.18

0.9

0.33

0.67

0.84

0.93

0.96

BCVuniandes

11

0.69

0.43

0.65

0.88

0.69

0.88

0.80

0.83

0.89

0.88

0.97

0.97

0.87

0.44

0.91

0.63

0.42

0.42

0.56

0.15

0.85

0.33

0.69

0.86

0.94

0.98

BUT

12

0.64

0.35

0.62

0.86

0.59

0.84

0.76

0.79

0.83

0.83

0.89

0.93

0.94

0.60

0.97

0.73

0.33

0.37

0.73

0.21

0.92

0.38

0.65

0.85

0.92

0.97

A-REUMI01

13

0.64

0.4

0.64

0.84

0.64

0.85

0.90

0.91

0.88

0.86

0.96

0.96

0.93

0.43

0.94

0.56

0.45

0.44

0.65

0.20

0.87

0.40

0.67

0.86

0.93

0.98

LfB

14

0.60

0.44

0.62

0.83

0.68

0.80

0.91

0.93

0.79

0.84

0.80

0.93

0.90

0.46

0.88

0.53

0.47

0.39

0.59

0.28

0.79

0.46

0.58

0.82

0.89

0.96

SIAT_MIDS

15

0.33

0.27

0.31

0.62

0.37

0.56

0.88

0.91

0.88

0.86

0.97

0.97

0.84

0.29

0.92

0.43

0.55

0.54

0.56

0.20

0.73

0.37

0.7

0.84

0.94

0.98

Lesswire1

16

0.63

0.41

0.58

0.81

0.68

0.84

0.72

0.73

0.80

0.77

0.89

0.89

0.85

0.48

0.89

0.66

0.32

0.33

0.60

0.08

0.87

0.27

0.52

0.78

0.86

0.92

AI-Med

17

0.64

0.35

0.61

0.83

0.62

0.85

0.76

0.75

0.83

0.73

0.90

0.74

0.91

0.51

0.92

0.60

0.20

0.17

0.48

0.04

0.75

0.18

0.56

0.78

0.85

0.87

RegionTec

18

0.42

0.35

0.55

0.67

0.62

0.82

0.63

0.68

0.72

0.70

0.72

0.76

0.91

0.32

0.96

0.46

0

0

0.61

0.07

0.87

0.23

0.34

0.64

0.72

0.78

EdwardMa12593

19

0.37

0.01

0.18

0.58

0.11

0.38

0.73

0.70

0.87

0.87

0.94

0.97

0.81

0.15

0.85

0.25

0.08

0.03

0.50

0

0.74

0.02

0.43

0.74

0.79

0.93



MSD Challenge - Phase 2 Rank

Note that this rank was part of a task holdout set, i.e. participants did not have access to this data when developing the method. Results are presented per task, per metric (Dice/NSD), and per region (L1,L2,L3). Rank was estimated using the model proposed in the challenge description page.

 

 

Hepatic Vessel

Spleen

Colon

 

 

Dice

NSD

Dice

NSD

Dice

NSD

Team

Rank

L1

L2

L1

L2

L1

L1

L1

L1

nnU-Net

1

0.63

0.69

0.83

0.79

0.96

0.99

0.56

0.68

NVDLMED

2

0.63

0.64

0.83

0.72

0.96

1.00

0.56

0.66

K.A.V.athlon

3

0.62

0.63

0.83

0.72

0.97

1.00

0.36

0.47

LS Wang's Group

4

0.55

0.64

0.77

0.73

0.96

0.99

0.41

0.51

MIMI

5

0.60

0.56

0.79

0.64

0.94

0.97

0.29

0.38

CerebriuDIKU

6

0.59

0.38

0.79

0.44

0.95

0.98

0.28

0.43

Whale

7

0.56

0.46

0.80

0.57

0.95

0.99

0.18

0.29

UBIlearn

8

0.59

0.37

0.80

0.42

0.95

0.98

0.16

0.25

Lupin

9

0.60

0.47

0.81

0.54

0.94

0.98

0.09

0.16

SIAT_MIDS

10

0.51

0.37

0.73

0.39

0.93

0.98

0.19

0.26

LfB

11

0.55

0.35

0.79

0.37

0.83

0.88

0.24

0.32

A-REUMI01

12

0.56

0.39

0.79

0.46

0.92

0.95

0.12

0.21

VST

13

0.44

0.36

0.58

0.39

0.94

0.97

0.15

0.22

AI-Med

14

0.42

0.26

0.65

0.33

0.91

0.93

0.11

0.26

Lesswire1

15

0.44

0.31

0.73

0.28

0.86

0.90

0.10

0.26

BUT

16

0.44

0.39

0.65

0.45

0.89

0.95

0.05

0.10

RegionTec

17

0.42

0.20

0.69

0.22

0.92

0.95

0.06

0.10

BCVuniandes

18

0.14

0.32

0.45

0.36

0.82

0.93

0.06

0.16

EdwardMa12593

19

0.14

0.11

0.31

0.12

0.83

0.88

0.06

0.12

Sponsorship