The Annoyance Filter.pdf - Fourmilab

More documents

Recommendations

Info

186 HEADER INCLUDE FILES ANNOYANCE-FILTER §234 234. We also use the following C library include files for low-level operations. 〈 C library include files 234 〉 ≡ #include #include #include #include #include #include This code is used in section 232. 235. Some C library header files are included only on platforms which support the facilities they provide. This is determined by the ./configure script, which sets variables in config.h which we use to include them if present. 〈 Conditional C library include files 235 〉 ≡ #ifdef HAVE_STAT #include #endif #ifdef HAVE_UNISTD_H #include #endif #ifdef HAVE_DIRENT_H #include #endif #ifdef HAVE_MMAP #include #endif This code is used in section 232. 236. The following libraries are required to support the network operations required by the POP3 proxy server. If the minimal subset required to support the server are not present, it will be disabled. 〈 Network library include files 236 〉 ≡ #if defined (HAVE_SOCKET) ∧ defined (HAVE_SIGNAL) #define POP3_PROXY_SERVER #endif #ifdef POP3_PROXY_SERVER #include #include #include #include #include #include #include #endif This code is used in section 232.
§237 ANNOYANCE-FILTER HEADER INCLUDE FILES 187 237. Some capabilities of the program depend in non-trivial ways on the presence of certain system features detected by the ./configure script. Here we test for the prerequisites and define an internal tag to enable the feature if all are met. 〈 Configuration of conditional capabilities 237 〉 ≡ #if defined (HAVE_GNUPLOT) ∧ defined (HAVE_NETPBM) ∧ defined (HAVE_SYSTEM) #define HAVE_PLOT_UTILITIES #endif #if defined (HAVE_DIRENT_H) ∧ defined (HAVE_STAT) #define HAVE_DIRECTORY_TRAVERSAL #endif #if defined (HAVE_PDFTOTEXT) ∧ defined (HAVE_POPEN) ∧ (defined (HAVE_MKSTEMP) ∨ defined (HAVE_TMPNAM)) #define HAVE_PDF_DECODER #endif This code is used in section 232. 238. It’s a pain in the posterior to have to edit the config.h file to disable features not supported on Win32 platforms. Since we can’t run ./configure there, the process can’t be automated. So, we take the lazy way out and manually undefine features absent on Win32, even if they were auto-detected on the platform which generated config.h. Tacky. 〈 Tweak configuration when building for Win32 238 〉 ≡ #ifdef WIN32 #undef HAVE_MMAP #endif This code is used in section 232. 239. The following global variables are used to keep track of command line options. #define Annotate (c) (annotations .test (c)) /∗ Test if annotation is requested ∗/ 〈 Command line arguments 239 〉 ≡ static double mailBias = 2.0; /∗ Bias for words in legitimate mail ∗/ static unsigned int minOccurrences = 5; /∗ Minimum occurrences to trust probability ∗/ static double junkThreshold = 0.9; /∗ Threshold above which we classify mail as junk ∗/ static double mailThreshold = 0.9; /∗ Threshold below which we classify as mail ∗/ static int significantWords = 15; /∗ Number of words to use in classifying message ∗/ static double novelWordProbability = 0.2; /∗ Probability assigned to words not in dictionary ∗/ static bitset〈1 ≪ (sizeof (char) ∗ 8)〉 annotations ; /∗ Annotations requested in transcript ∗/ #ifdef POP3_PROXY_SERVER static int popProxyPort = 9110; /∗ POP3 proxy server listen port ∗/ static string popProxyServer = ""; /∗ POP3 server (IP address or fully-qualified domain name) ∗/ static int popProxyServerPort = 110; /∗ POP3 server port ∗/ #endif static bool bsdFolder = false ; /∗ Does mail folder use pure BSD “From␣” semantics ? ∗/ See also section 240. This code is used in section 254. 240. These globals are used to check for inconsistent option specifications. 〈 Command line arguments 239 〉 +≡ static unsigned int nTested = 0; /∗ Number of messages tested ∗/
Page 1 and 2:
§1 ANNOYANCE-FILTER INTRODUCTION 1
Page 3 and 4:
§3 ANNOYANCE-FILTER GETTING STARTE
Page 5 and 6:
§4 ANNOYANCE-FILTER OPTIONS 5 4. O
Page 7 and 8:
§4 ANNOYANCE-FILTER OPTIONS 7 −
Page 9 and 10:
§5 ANNOYANCE-FILTER PHRASE-BASED C
Page 11 and 12:
§6 ANNOYANCE-FILTER INTEGRATING WI
Page 13 and 14:
§7 ANNOYANCE-FILTER OPERATING A PO
Page 15 and 16:
§9 ANNOYANCE-FILTER A BRIEF HISTOR
Page 17 and 18:
§9 ANNOYANCE-FILTER A BRIEF HISTOR
Page 19 and 20:
§10 ANNOYANCE-FILTER DICTIONARY WO
Page 21 and 22:
Page 23 and 24:
Page 25 and 26:
§19 ANNOYANCE-FILTER DICTIONARY 25
Page 27 and 28:
Page 29 and 30:
Page 31 and 32:
Page 33 and 34:
Page 35 and 36:
§32 ANNOYANCE-FILTER FAST DICTIONA
Page 37 and 38:
Page 39 and 40:
Page 41 and 42:
Page 43 and 44:
§40 ANNOYANCE-FILTER MIME DECODERS
Page 45 and 46:
Page 47 and 48:
Page 49 and 50:
§47 ANNOYANCE-FILTER SINK MIME DEC
Page 51 and 52:
§50 ANNOYANCE-FILTER BASE64 MIME D
Page 53 and 54:
Page 55 and 56:
Page 57 and 58:
§60 ANNOYANCE-FILTER QUOTED-PRINTA
Page 59 and 60:
§63 ANNOYANCE-FILTER QUOTED-PRINTA
Page 61 and 62:
§66 ANNOYANCE-FILTER MULTIPLE BYTE
Page 63 and 64:
§68 ANNOYANCE-FILTER DECODER PAREN
Page 65 and 66:
§71 ANNOYANCE-FILTER EUC DECODER 6
Page 67 and 68:
§75 ANNOYANCE-FILTER SHIFT-JIS DEC
Page 69 and 70:
§79 ANNOYANCE-FILTER SHIFT-JIS DEC
Page 71 and 72:
§83 ANNOYANCE-FILTER UTF-8 UNICODE
Page 73 and 74:
§84 ANNOYANCE-FILTER UTF-8 UNICODE
Page 75 and 76:
§87 ANNOYANCE-FILTER INTERPRETERS
Page 77 and 78:
§91 ANNOYANCE-FILTER GB2312 INTERP
Page 79 and 80:
§96 ANNOYANCE-FILTER UNICODE INTER
Page 81 and 82:
§99 ANNOYANCE-FILTER APPLICATION S
Page 83 and 84:
§100 ANNOYANCE-FILTER FLASH STREAM
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
§114 ANNOYANCE-FILTER FLASH TEXT E
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
§125 ANNOYANCE-FILTER PDF TEXT EXT
Page 107 and 108:
§127 ANNOYANCE-FILTER PDF TEXT EXT
Page 109 and 110:
§129 ANNOYANCE-FILTER MAIL FOLDER
Page 111 and 112:
Page 113 and 114:
Page 115 and 116:
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
Page 123 and 124:
Page 125 and 126:
Page 127 and 128:
Page 129 and 130:
Page 131 and 132:
Page 133 and 134:
Page 135 and 136: §160 ANNOYANCE-FILTER MAIL FOLDER
Page 143 and 144: §170 ANNOYANCE-FILTER TOKEN DEFINI
Page 145 and 146: §173 ANNOYANCE-FILTER TOKEN PARSER
Page 157 and 158: §185 ANNOYANCE-FILTER CLASSIFY MES
Page 163 and 164: §193 ANNOYANCE-FILTER POP3 PROXY S
Page 181 and 182: §223 ANNOYANCE-FILTER MAIN PROGRAM
Page 183 and 184: §228 ANNOYANCE-FILTER MAIN PROGRAM
Page 185: §232 ANNOYANCE-FILTER HEADER INCLU
Page 189 and 190: §242 ANNOYANCE-FILTER HEADER INCLU
Page 201 and 202: §250 ANNOYANCE-FILTER ISO 8859-1 C
Page 203 and 204: §255 ANNOYANCE-FILTER RELEASE HIST
Page 205 and 206: §256 ANNOYANCE-FILTER DEVELOPMENT
Page 229 and 230: §257 ANNOYANCE-FILTER INDEX 229 ch
Page 231 and 232: §257 ANNOYANCE-FILTER INDEX 231 fs
Page 233 and 234: §257 ANNOYANCE-FILTER INDEX 233 k:
Page 235 and 236: §257 ANNOYANCE-FILTER INDEX 235 pa
Page 237 and 238:
§257 ANNOYANCE-FILTER INDEX 237 se
Page 239 and 240:
§257 ANNOYANCE-FILTER INDEX 239 17
Page 241 and 242:
ANNOYANCE-FILTER NAMES OF THE SECTI
Page 243 and 244:
ANNOYANCE-FILTER Section Introducti
show all

The Annoyance Filter.pdf - Fourmilab

Create successful ePaper yourself

Delete template?

Save as template?