11.07.2015 Views

Encyclopedia of Computer Science and Technology

Encyclopedia of Computer Science and Technology

Encyclopedia of Computer Science and Technology

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Bell, C. Gordon 41has changed. There are now two fewer face cards (12 - 2 = 10)<strong>and</strong> four fewer non-face cards (40 - 4 = 36), so the probabilitythat a given card is a face card becomes 10/36 or 5/18.While this is pretty straightforward, in many situationsone cannot easily calculate the shifting probabilities. WhatBayes discovered was a more general formula:P(T|E) =P(E|T) * P(T)P(E)In this formula T is a theory or hypothesis about afuture event. E represents a new piece <strong>of</strong> evidence thattends to support or oppose the hypothesis. P(T) is an estimate<strong>of</strong> the probability that T is true, before considering theevidence represented by E. The question then becomes: IfE is true, what happens to the estimate <strong>of</strong> the probabilitythat T is true? This is called a conditional probability, representedby the left side <strong>of</strong> the equation, P(T|E), which isread “the probability <strong>of</strong> T, given E.” The right side <strong>of</strong> Bayes’sequation considers the reverse probability—that E will betrue if T turns out to be true. This is represented by P(E|T),multiplied by the prior probability <strong>of</strong> T <strong>and</strong> divided by theindependent probability <strong>of</strong> E.Practical ApplicationsIn the real world one generally has imperfect knowledgeabout the future, <strong>and</strong> probabilities are seldom as clear cutas those available to the card counter at the blackjack table.However, Bayes’s formula makes it possible to continuallyadjust or “tune” estimates based upon the accumulatingevidence. One <strong>of</strong> the most common applications <strong>of</strong> Bayesiananalysis is in e-mail filters (see spam). Bayesian spamfilters work by having the user identify a sample <strong>of</strong> messagesas either spam or not spam. The filter then looks forpatterns in the spam <strong>and</strong> non-spam messages <strong>and</strong> calculatesprobabilities that a future message containing thosepatterns will be spam. The filter then blocks future messagesthat are (above some specified threshold) probablyspam. While it is not perfect <strong>and</strong> does require work on thepart <strong>of</strong> the user, this technique has been quite effective inblocking spam.A Bayesian algorithm’s effectiveness can be expressed interms <strong>of</strong> its rate <strong>of</strong> false positives (in the spam example, thiswould be the percentage <strong>of</strong> messages that have been mistakenlyclassified as spam). If the rate <strong>of</strong> “true positives” istoo low, the algorithm is not effective enough. However, ifthe rate <strong>of</strong> false positives is too high, the negative effects(blocking wanted e-mail) might outweigh the positiveones (blocking unwanted spam).Further ReadingKantor, Andrew. “Bayesian Spam Filters Use Math that WorksLike Magic.” USA Today online, September 17, 2004. Availableonline. URL: http://www.usatoday.com/tech/columnist/<strong>and</strong>rewkantor/2004-09-17-kantor_x.htm. Accessed March15, 2007.Lee, Peter M. Bayesian Statistics: An Introduction. 3rd ed. NewYork: Wiley, 2004.Sivia, D. S. Data Analysis: A Bayesian Tutorial. 2nd ed. New York:Oxford University Press, 2006.“Thomas Bayes, 1702–1761.” St. Andrews University Mac Tutor.Available online. URL: http://www-history.mcs.st-<strong>and</strong>rews.ac.uk/Mathematicians/Bayes.html. Accessed March 15, 2007.BBS See bulletin board system.Bell, C. Gordon(1934– )AmericanEngineer, <strong>Computer</strong> DesignerChester Gordon Bell (also known as Gordon Bennet Bell)was born August 19, 1934, in Kirksville, Missouri. As ayoung boy Bell worked in his father’s electrical contractingbusiness, learning to repair appliances <strong>and</strong> wire circuits.This work led naturally to an interest in electronics, <strong>and</strong>Bell studied electrical engineering at MIT, earning a B.S. in1956 <strong>and</strong> an M.S. in 1957. After graduation <strong>and</strong> a year spentas a Fulbright Scholar in Australia, Bell worked in the MITSpeech Computation Laboratory (see speech recognition<strong>and</strong> synthesis). In 1960 he was invited to join the DigitalEquipment Corporation (DEC) by founders Ken Olsen <strong>and</strong>Harlan Anderson.Bell was a key architect <strong>of</strong> DEC’s revolutionary PDPseries (see minicomputer), particularly as designer <strong>of</strong> theinput/output (I/O) hardware in the PDP-1 <strong>and</strong> the multitaskingPDP-6. Bell left DEC to teach computer science atCarnegie Mellon University (1966–72), but then returned toDEC until his retirement in 1983 following a heart attack.During this time Bell developed a deployment plan for thenew VAX series minicomputers, which were data-processingworkhorses in many organizations during the 1970s<strong>and</strong> 1980s.As a close observer <strong>of</strong> the computer industry, Bell formulated“Bell’s Law <strong>of</strong> <strong>Computer</strong> Classes” in 1972. It basicallystates that as new technologies (such as the microprocessor)emerge, they result about once a decade in the emergence<strong>of</strong> new “classes” or computing platforms, each beinggenerally cheaper <strong>and</strong> being perceived as a distinct productwith new applications. Within a given class, price tends tohold constant while performance increases. Examples thusfar include mainframes, minicomputers, personal computers<strong>and</strong> workstations, networks, cluster or grid computing,<strong>and</strong> today’s ubiquitously connected wireless, portabledevices. Bell has indeed suggested that the trend to ubiquitouscomputing will continue (see ubiquitous computing<strong>and</strong> wearable computers).After retirement Bell soon became active again. Hefounded Encore <strong>Computer</strong>, a company that specialized inmultiprocessor computers, <strong>and</strong> later was a founding member<strong>of</strong> Ardent <strong>Computer</strong> as well as participating in the establishment<strong>of</strong> the Microelectronics <strong>and</strong> <strong>Computer</strong> <strong>Technology</strong>Corporation, a consortium that attempted to be America’sanswer to a surging competitive threat from Japanese companies.Bell was also active in debates over technology policy,playing an instrumental role as an assistant directorin the National <strong>Science</strong> Foundation’s computing initiatives

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!