This challenge is organized in the spirit of cooperative scientific progress. We therefore ask all participants to respect the rules below.

The rules below apply to those who register a team and download the data.


  • The downloaded datasets or any data derived from these datasets with the exception of datasets that are already publicly available, may not be given or redistributed under any circumstances to persons not belonging to the registered team;
  • The datasets downloaded from this website must primarily be used for preparing an entry to be submitted to this challenge. The datasets may not be used for other purposes in scientific studies and may not be used to train or develop other algorithms, including but not limited to algorithms used in commercial products, without prior participation in this challenge. After participation in the challenge, the teams are free to use the datasets for other purposes;
  • Use of other datasets during the development of a method that will be submitted to the challenge is allowed, provided that the datasets are publicly available. The teams must name all data sources that were used during the method development when submitting a method for evaluation; 
  • The testing dataset must not be used in any way during the method development (for example, semi-supervised learning with the testing dataset is not allowed); 


  • All information entered when registering a team, including the name of the contact person, the affiliation (institute, organization or company the team's contact person works for) and the e-mail address must be complete and correct. In other words, anonymous registration is not allowed. The data provided will not be used for any purposes other than the challenge;
  • Evaluation of results uploaded to this website will be made publicly available on this site, and by submitting results, you grant us permission to publish our evaluation.
  • Participating teams maintain full ownership and rights to their method. We do not claim any ownership or rights to the algorithms;


  • If the results of algorithms in this challenge are to be used in scientific publications (journal publications, conference papers, technical reports, presentations at conferences and meetings) you must make an appropriate citation. Currently, this citation will refer to the this web-site, and later to the publication that will describe the results of this challenge;
  • Teams must notify the organizers of the challenge about any publication that is (partly) based on the results data published on this site, in order for us to maintain a list of publications associated with the challenge;

Feel free to contact us if you have any questions or need clarification of the rules of the challenge.