PDFlib TET PDF IFilter 4.0 Manual

5.3 PDF Documents are not or not completely indexed
Maximum file size. The registry value MaxDownloadSize determines the maximum
file size of documents which will be crawled and indexed (unit: MB, default: 16).
Maximum growth factor. The registry value MaxGrowFactor contains a factor with
which the MaxDownloadSize value is multiplied to determine the maximum amount of
text for a document that will be indexed. This factor is necessary because the text can be
compressed inside the file, as is usually the case for PDF documents (unit: none, default:
4).
With the default settings a maximum of 64 MB of extracted text per document will
be indexed. Depending on the exact product and version the MaxDownloadSize and
MaxGrowFactor registry values can be found under the following keys in the Windows
registry:
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Office Server\
\Search\Applications\\Gathering Manager
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Shared Tools\Web Server Extensions\
\Search\Applications\\Gathering Manager
HKEY_LOCAL_MACHINE\Software\Microsoft\SPSSearch\Gathering Manager
The GUID will vary from installation to installation. A Microsoft article on this topic can
be found here:
SharePoint Server and Search Server are subject to limitations which affect indexing of
large documents. Since these limitations are not well explained in Microsoft documentation
the following notes collect information based on Microsoft support articles and
blogs. These notes are not authoritative; if in doubt please contact Microsoft for guidance.
office.microsoft.com/en-us/sharepoint-server-help/specifying-the-file-size-that-sharepointportal-server-2003-can-crawl-HA001164841.aspx
Chunk buffer size. Another limitation affects the total number of unique words per
document which can be indexed. The value CB_ChunkBufferSizeInMegaBytes determines
the space which is reserved for the collection of unique words per document (unit: MB,
default: 8).
Bytes reserved for document. The value CB_MinBytesReservedForDoc depends on the
CB_ChunkBufferSizeInMegaBytes value. It should be 2 MB less than the value of CB_
ChunkBufferSizeInMegaBytes, although this relation is not true for the default values
(unit: bytes, default: 3,145,728).
Depending on the exact product and version the CB_ChunkBufferSizeInMegaBytes and
CB_MinBytesReservedForDoc registry values can be found under the following keys in the
Windows registry:
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Office Server\
\Search\Global\Gathering Manager
74 Chapter 5: Troubleshooting