27.12.2016 Views

Hacker Bits, Issue 12

HACKER BITS is the monthly magazine that gives you the hottest technology stories crowdsourced by the readers of Hacker News. We select from the top voted stories and publish them in an easy-to-read magazine format. Get HACKER BITS delivered to your inbox every month! For more, visit https://hackerbits.com/issue12.

HACKER BITS is the monthly magazine that gives you the hottest technology stories crowdsourced by the readers of Hacker News. We select from the top voted stories and publish them in an easy-to-read magazine format.

Get HACKER BITS delivered to your inbox every month! For more, visit https://hackerbits.com/issue12.

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Now, allow me to introduce this guy:<br />

He was a product manager at an online auction site that you may have heard of. His story was about an<br />

A/B test of a new prototype algorithm for the main product search engine. The test was successful and<br />

the new algorithm was moved to production.<br />

Unfortunately, after much time and expense, it was realised that there was a bug in the A/B test code:<br />

the prototype had not been used. They had accidentally tested the old algorithm against itself. The<br />

results were nonsense.<br />

This was the problem:<br />

hacker bits<br />

19

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!