Skip to main content

Competition

How can I join a competition?

Users are either invited via mail or if you are already tracebloc user you can join competition available on competitions tab as given in the guide

Who qualifies for the prize money?

All participating users other than host company admin and tracebloc users are eligible for the winner's prize. The competition leaderboard will be assessed independently of host company admin and tracebloc users participation.

How are experiments evaluated during a competition on leaderboard?

Experiments within a competition undergo evaluation based on criteria chosen by the hosting company. For instance, in the Approach and Landing Phase competition for Support Pilots, the selected metric for assessment is the F1 score.

Users can refer to the details page and navigate to the evaluation tab for more comprehensive information about the evaluation metric.

How are experiments assessed within a competition, and what's the process for determining winners?

The evaluation of competitions occurs in two stages. Firstly, assessments are conducted on 20% of the test dataset during the competition itself. After the competition concludes, the selected experiments undergo evaluation on the remaining 80% of the test dataset. This difference in phases and datasets contributes to variations in the final scores compared to those achieved during the competition.

Will every experiment I submit appear on the leaderboard?

Users have the option to submit up to five experiments per day. If a user is part of a team, the entire team can collectively submit a maximum of five experiments per day.

It's important to note that not every experiment submitted by a user will automatically appear on the leaderboard. The leaderboard will only update with the latest experiment if that particular submission receives a score better than the user's previous leaderboard score.

Is it possible for participants to access and download the competition dataset?

No, downloading the dataset from tracebloc competitions is not an option. Unlike some other competition platforms that offer direct access to their data, our competition platform has a distinct goal of connecting data scientists with real-time data. To preserve data privacy and security, the dataset remains hidden.

However, we do offer sample datasets that can be accessed through the Data tab on the competition page, along with additional dataset information. To facilitate comprehension, we have also conducted exploratory data analysis (EDA) on the available data.