PDFlib Text Extraction Toolkit (TET) Manual

Since the PDF document may map presentation forms either to the isolated Unicode
character or one of the presentation forms (e.g. in the document’s ToUnicode CMap),
TET cannot guarantee that the output contains presentation forms even when decompositions
are disabled.
Table 6.2 Processing Arabic presentation forms with the decompose option
description and option list
Decompose final, initial, isolated, and medial presentation forms:
no decompose option (default) or
decompose=none
or
decompose=
{final=_all medial=_all initial=_all isolated=_all}
Preserve final, initial, isolated, and medial presentation forms:
decompose=
{final=_none medial=_none initial=_none isolated=_none}
before
decomposition
U+FEB2
U+FEB3
U+FD0E
U+FEB4
U+FEB2
U+FEB3
U+FD0E
U+FEB4
after decomposition
(in logical order)
U+0633
U+0633
U+0633 U+0631
U+0633
U+FEB2
U+FEB3
U+FD0E
U+FEB4
Remove Arabic Tatweel character. The Tatweel character U+0640 (also called kashida)
is often used in Arabic text to stretch words so that they completely fill the line. Since
the Tatweel doesn’t carry any text information itself it is usually not required in the extracted
text. By default, TET removes Tatweel characters from the extracted text. As
shown in Table 6.3 the fold option can be used to preserve Tatweel characters (see Section
7.3.1, »Unicode Folding«, page 97).
Table 6.3 Processing the Tatweel character U+0640 with the fold option
description and option list before folding after folding
Remove Arabic Tatweel characters: no fold option (default) or
n/a
fold={{[U+0640] remove}} or fold={default}
U+0640
Preserve Arabic Tatweel characters (which are removed by default):
fold={{[U+0640] preserve}}
U+0640
U+0640
6.4 Bidirectional Arabic and Hebrew Text 83