Best “F-score” (a measure of accuracy that factors in both precision and recall):
First Place ($25,000): Vynca
Second Place ($20,000): PICSURE
Third Place ($15,000): Information Softworks
Best First Run ($5,000): Information Softworks
Best Recall ($5,000): PICSURE
Best Precision ($5,000): Ocuvera
Each winner employed widely different methods. PICSURE used an algorithm based on the Fellegi-Sunter (1969) method for probabilistic record matching and performed a significant amount of manual review. Vynca used a stacked model that combined the predictions of eight different models. They reported that they manually reviewed less than .001 percent of the records. Although Information Softworks also used a Fellegi-Sunter-based enterprise master patient index (EMPI) system with some additional tuning, they also reported extremely limited manual review.