Evaluation will be done according to the following metrics:

  • Dice
  • Hausdorff distance (modified, 95th percentile)
  • Average volume difference (in percentage)
  • Sensitivity for individual lesions (in percentage)
  • F1-score for individual lesions

Individual lesions are defined as 3D connected components. The full source code that will be used for evaluation can be found here: evaluation.py.