Performance evaluation of learning algorithms - Mohak Shah
Performance evaluation of learning algorithms - Mohak Shah
Performance evaluation of learning algorithms - Mohak Shah
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Example II: What’s wrong with our results?<br />
A new algorithm was designed based on data that had<br />
been provided to us by the National Institute <strong>of</strong> Health<br />
(NIH). [Wang and Japkowicz, 2008, 2010]<br />
According to the standard <strong>evaluation</strong> practices in machine<br />
<strong>learning</strong>, we found our results to be significantly better<br />
than the state-‐<strong>of</strong>-‐the-‐art.<br />
The conference version <strong>of</strong> the paper received a best paper<br />
award and the work is receiving a bit <strong>of</strong> attention in the ML<br />
community (35+ citations)<br />
NIH would not consider our algorithm because it was<br />
probably not significantly better (if at all) than others as<br />
they felt we had not conducted our <strong>evaluation</strong> according to<br />
their standards. 6
Change language