Skip to main content

Collaboration

How can I join a collaboration?​

Users can either be invited via email or, if you're already a Tracebloc user, you can join available collaborations by navigating to the Collaborations tab. For detailed instructions, refer to the collaboration guide.

Who qualifies for the prize money?​

All participating users, except for host company admins and Tracebloc staff, are eligible for the winner's prize. The collaboration leaderboard is evaluated independently of any participation by host company admins and Tracebloc users.

How are experiments evaluated during a collaboration on leaderboard?​

Experiments are evaluated based on criteria set by the hosting company. For example, in the "Approach and Landing Phase" collaboration for Support Pilots, the chosen metric is the F1 score.

Users can find detailed information by navigating to the Evaluation tab on the collaboration details page.

How are experiments assessed within a collaboration, and how are winners determined?​

Collaborations are evaluated in two stages:

  • During the collaboration: some percentage as specified on collaboration page of the test dataset is used to assess experiments.
  • After the collaboration ends: The selected experiments are evaluated on the remaining 80% of the test dataset. This phased evaluation process can lead to differences between final scores and the scores displayed during the collaboration.

Will every experiment I submit appear on the leaderboard?​

Each user (or team, if participating as a group) can submit up to five experiments per day. However, not every experiment will appear on the leaderboard. The leaderboard only updates if a newly submitted experiment achieves a better score than your previous submission.

Can participants access and download the collaboration dataset?​

No, the dataset cannot be downloaded in Tracebloc collaborations. Unlike some other platforms, our goal is to connect data scientists with real-time data while ensuring privacy and security. Therefore, the dataset remains hidden.

However, sample datasets and additional information can be accessed through the Data tab on the collaboration page. We also provide exploratory data analysis (EDA) to help participants better understand the data.

On This Page