Monthly Archives: February 2019

Otomatch Residency Rank

The 2019 Otomatch survey of the Top 3 from ENT applicants rank list is underway here:

Otomatch Rank List Top 3 Survey

So far there has bee a good response to the survey with over 60 applicants responding. That’s about 15% based on ACGME estimates on the number of applicants. So far the rank order list has a lot of similarities with the Doximity Rank list, but some significant programs that moved up and down the top 25. The Doximity reputation score is a simple “who is the absolute best” vote.

Otomatch’s score is who are the three best for you, in order. It will be interesting to see how this difference shakes out in the Otomatch Composite rank score where each program gets 3 points every time it gets ranked #1, 2 points for a #2 rank and 1 point for a #3 rank. Of course, the Otomatch-One score should be directly comparable with the doximity rank score.

Differencces in these could have a lot of causes including regional preferences, gender equity, felloswhip vs GP alumni, and lots of other “fit” factors that may show up in the comments. It will be particulary intersting to see the comments for programs who jump up or down relative to their Doximity ranks.

It will be interesting to see what percent of rank lists show a regional bias. This could be quantized by computing a travel distance in miles between the cities where the top three programs are located. Bin the distances into 10 bins and plot how many are in each bin as a historgram. This gives you a graphic of what percent of participants have a strong top 3 regional preference.

nationwide #1 rank. This should be basically the same as the doximity rank…differences may be due to population differences (med students vs attendings – age and academimc proximity issues).

Kendall Tau and W may be useful in interpreting the otomatch rank lists versus the other rank lists. Tau will tell if the tests are correlated while W can tell if the lists are concordant (the same).

https://www.researchgate.net/post/When_to_use_Kendalls_Tau_correlation_against_Kendalls_W_concordance_A_bit_confused_on_both_of_their_distinctiveness_on_usage_and_requirement

Tau may need correction for dijointedness since the residents dont have to option to rank every program in the country while doximity does.

ideal test would be to see if the order of ranks on each top 3 is the same as the order of ranks on doximity. Compare number of swaps needed between the otomatch list and the variability in the number of swaps needed to make eachindividual list the same order as doximity. ??? just my try at this.

Leave a Comment

Filed under Uncategorized