The Annoyance Filter.pdf - Fourmilab

156 CLASSIFY MESSAGE ANNOYANCE-FILTER §183
183. Classify message.
The classifyMessage class reads input from a mailFolder and returns the junk probability for
successive messages. The input mailFolder may contain only a single message.
〈 Class definitions 10 〉 +≡
class classifyMessage {
public:
mailFolder ∗mf ;
tokenParser tp;
unsigned int nExtremal ;
dictionary ∗d;
fastDictionary ∗fd ;
double unknownWordProbability ;
classifyMessage(mailFolder &m, dictionary &dt , fastDictionary ∗fdt = Λ, unsigned int
nExt = 15, double uwp = 0.2);
double classifyThis (bool createTranscript = false );
protected:
void addSignificantWordDiagnostics (list〈string〉 &l, list〈string〉::iterator where ,
multimap〈double, string〉 &rtokens , string endLine = "");
};
184. The constructor initialises the classifier for the default parsing of ISO-8859 messages.
〈 Global functions 184 〉 ≡
classifyMessage ::classifyMessage(mailFolder &m, dictionary &dt , fastDictionary
∗fdt , unsigned int nExt , double uwp)
{
mf = &m;
tp.setSource (m);
tp.setTokenDefinition (isoToken , asciiToken );
tp.setTokenLengthLimits (maxTokenLength , minTokenLength , streamMaxTokenLength ,
streamMinTokenLength );
if (pDiagFilename .length ( ) > 0) {
tp.setSaveMessage (true );
}
d = &dt ;
fd = fdt ;
nExtremal = nExt ;
unknownWordProbability = uwp;
}
See also sections 229, 230, 231, and 242.
This code is used in section 254.