For TC4TL Challenge information (data, scoring software, etc.) please email: tc4tl_poc@nist.gov
For the TC4TL Challenge discussion please visit our Google Group. https://groups.google.com/a/list.nist.gov/forum/#!forum/tc4tl-challenge
Team | System Description | System Presentation |
---|---|---|
HKUST | Download | Download |
UNC-LCD | X | Download |
MIT PathCheck | Download | Download |
MITRE | Download | Download |
The purpose of this pilot evaluation is to foster research in and measure performance of proximity detection technologies using a preliminary dataset containing RSSI and IMU measurements of interactions between phone pairs. Acknowledging that this preliminary dataset has limitations in terms of size and available real-world conditions, the results, analysis, and participant feedback from the pilot challenge will be used to refine data, design, and metrics for future evaluations. Participants are allowed to publish the leaderboard results unaltered, but they should not make advertising claims regarding their standing/ranking in the evaluation or winning the evaluation, or claim NIST or the U.S. Government endorsement of their system(s) or commercial product(s). See the evaluation plan for more details regarding the participation rules in the TC4TL Challenge.
RANK | TEAM | TIMESTAMP | NDCF(D=1.2|SET=FINE) | NDCF(D=1.8|SET=FINE) | NDCF(D=3.0|SET=FINE) | NDCF(D=1.8|SET=COARSE) |
---|---|---|---|---|---|---|
1 | Contact-Tracing-Project | 20200815-113248 | 0.680 | 0.540 | 0.590 | 0.410 |
2 | LCD | 20200806-173523 | 0.600 | 0.580 | 0.630 | 0.550 |
3 | PathCheck | 20200819-114609 | 0.700 | 0.670 | 0.650 | 0.550 |
4 | MITRE | 20200820-103933 | 0.940 | 0.680 | 0.900 | 0.600 |
The table below summarizes proximity detection results obtained by systems that use the NIST supplied development set for training. The live leaderboard above is for systems not trained using the NIST supplied development set.
TEAM | NDCF(D=1.2m|SET=FINE) | NDCF(D=1.8m|SET=FINE) | NDCF(D=3.0m|SET=FINE) | NDCF(D=1.8m|SET=COARSE) |
---|---|---|---|---|
PathCheck | 0.37 | 0.04 | 0.23 | 0.02 |
LCD | 0.23 | 0.21 | 0.23 | 0.04 |
MITRE | 0.99 | 0.17 | 0.29 | 0.04 |
Contact-Tracing-Project | 0.24 | 0.21 | 0.23 | 0.19 |