TXT2TeX Copyright (C) 1998 --- 2008 Kalvis M. Jansons
=====================================================
This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
You should have received a copy of the GNU General Public License
along with this program. If not, see .
This perl script (which is part of the KalTeX package) converts plain text
into something with a little LaTeX formatting. If you are reading a LaTeXed
version of this ``readme'' file, it was made from the comments in the code
of txt2tex using txt2tex to format them; if you are reading the plain text
version, try running it through txt2tex (you can use ``txt2tex --demo'' for
this on a unix system).
Written by Kalvis M. Jansons (email address k@kalvis.com), but based on
txt2html by Seth Golub (email address seth@aigeek.com). So if you like it,
send an email to both of us, but thank Seth the most; if you have any
problems or suggestions send an email to me (Kalvis).
By default, much of LaTeX's fine structure is disabled by definitions in the
.tex file header. If you need to edit the LaTeX you may need to remove
or change some of these statements; or you may need to rerun txt2tex in a
lower escaping mode, to add more complex structures, like tables and
complex equations. I did it this way as I will use txt2tex myself mainly
for non-mathematical documents, and for those, I like to be able to type %
for percent etc., and paste in emails without worrying too much about all
the strange symbols. Set the ``-ec'' flag if you want to ``escape'' all
of LaTeX's special functions, and kill the ``\'', which is often the
safest setting for ``unknown'' document formats.
DO YOU WANT A DEMONSTRATION? IF SO, SEE BELOW.
* For a trivial demo of txt2tex, type ``txt2tex --info |txt2tex -ec''.
o For a nicer copy of this readme file, try
``txt2tex --info |txt2tex -ec -ns -10pt''.
o Or maybe you will like the look of this better:
``txt2tex --info |txt2tex -tf -ec -ns -10pt''.
- Remember, to see the nice output, type something like:
``txt2tex --info |txt2tex -tf -ec -r off > readme.tex''
followed by ``latex readme.tex; xdvi readme.dvi''.
o On a unix or linux system try ``txt2tex --demo''.
* The best test is clearly to try it on one of your own plain text files.
Paper size
~~~~~~~~~~
The paper size is set to ``a4paper'', but if you would like a different
paper size I suggest finding the line with ``a4paper'' in txt2tex and
changing it once and for all. This can also be changed using the
``--doctype'' option.
Tag syntax
~~~~~~~~~~
In the options in the next section, the term ``tag'' is often used. I
have used this term for many types of LaTeX mark-up instruction. The
syntax for using tags with txt2tex is easy. For a simple tag, which
puts a heading into a LaTeX subsection form, the tag is just ``subsection''.
For more complex, or nested, tags the syntax is a little more complex. If,
for example, you wanted all section headings to be centered, the tag to do
it with would be ``section{\center''. You could also add a ``clearpage''
so each section is on a new page, and a ``*'' so the sections are not
numbered; the tag would then be ``clearpage\section*{\center''. Also
remember when using tags on a command line, you must take account of the
normal shell escaping conventions.
Some important command line options
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Note that any command line option name can contain any number of ``_'' to
make the command line more readable, and, in fact, you only need a single
``-'' for any of the names listed with ``--''.
[(-dt|--doctype) ]
Used to set the LaTeX documentclass or documentstyle. It can be set to
``null'' for no doctype, which is useful if you want to add some LaTeX
definitions above the definitions in the txt2tex header. For an example,
see the definition of ``--switch slides'' at the end of txt2tex.
[-10pt|-11pt|-12pt]
Used to set the LaTeX font size. The default is 12pt. The ``pt'' can
be dropped.
[(-up|--usepackage) |off]
Sets a LaTeX ``usepackage'' definition. No default packages loaded.
[(-lh|--latexhooks) ]
Used to add LaTeX instructions from files. Given a ``name'', it tells LaTeX
to read (if they exist) the files name-HeadB, name-HeadE, name-BodyB,
name-BodyE (with or without a suffix .tex); these files are read in to the
beginning and end of the HEAD and the beginning and end of the BODY.
Given a number, it sets the ``latex-hook'' mode, which controls which LaTeX
input statements are added; these are 1,2,4,8 for the above files, which
are bitwise ORed. If a new LaTeX-hook name is given, the mode is set to 15,
i.e. all bits set. If a mode is given, and no name has been set, the
default name ``\jobname'' is used as the name. Hooks are off by default.
Remember in LaTeX the basename of the LaTeX file is stored in the LaTeX
variable ``\jobname'', so by using this as the base part of your LaTeX
hooks, you would not have to change the LaTeX itself if you wanted to
use a different set of hook files, as you would need only to change the
name of the main LaTeX file.
[(-ec|--escapechars) []]
Used to set the escape mode. The options (which can be bitwise ORed) are:
1 --- escape \
2 --- escape $
4 --- escape ^ and _
8 --- escape < and >
16 --- escape &
32 --- escape |
64 --- escape #
128 --- escape ~
512 --- escape %
1024 --- escape "
(The above list shows what txt2tex does with complex formatting in the
plain text document, namely puts it in a LaTeX verbatim block, at least
in the LaTeX version of the documentation.)
The default mode is 2046, so the LaTeX backslash is still active. Using
``-ec'' without a following number will escape everything, and ``-ec 0''
will escape nothing. Note that mode 1 also fixes a problem with a line
that begins with white space and has ``['' as the first non-space
character.
[-bm|--batchmode]
Makes LaTeX run in its non-stopping mode, i.e. ignores any LaTeX
warnings about over-full boxes etc.. Off by default.
[-nv|--noverbatim]
Stops any output being put in verbatim blocks even if it looks like it
is ``preformatted''. This sometimes gives other subroutines a chance
to format the data. Off by default.
[-sv|--splitverbatim]
Use this if verbatim blocks can be split by page breaks; the default is
that they cannot.
[(-pb|--prebegin) ]
Sets the number of preformatted-looking lines (2 by default) needed
to begin a verbatim block. The options are:
* 0 --- put the entire document in a verbatim block.
* 1 --- one trigger line, so even a single line can be put in verbatim.
* 2 --- two trigger lines.
* 3 --- same as 1, but verbatim blocks can start only after a
blank line.
Less than 0 is set to 0 and more than 3 is set to 3.
[(-pe|--preend) ]
Sets the number of non-preformatted-looking lines (2 by default) needed
to end a verbatim block. The options are from 0 to 3, with less than
0 set to 0 and more than 3 set to 3. Option 3 has the special meaning
of ending the verbatim block on a blank line.
NOTE for --prebegin and --preend: If only one is zero, the other is ignored.
If both are zero, the entire document is put in a verbatim block.
[(-p|--preformat) ]
This option sets the values of the following variables:
* $verbatim_white_min (6),
* $verbatim_min (6),
* $verbatim_post_min (3),
where the numbers in () are the defaults. If only one number is given,
it sets $verbatim_white_min and $verbatim_min to this value, otherwise it
sets the variables in order. A line is considered to be preformatted if
either there is a non-space character followed by $verbatim_min non-word
characters, or if there are at least $verbatim_white_min spaces after
the start of the line and the line contains a non-space character
followed by $verbatim_post_min non-word characters.
Note that tabs are expanded before these tests.
[-ns|--nosectionnumbers]
Do not number LaTeX sections. They may already have numbers, for example,
or you may feel that the document looks better without them. In fact, all
this really does is add a ``*'' at the end of the headings tags, so if you
have changed these tags, be sure that ``-ns'' still makes sense for your
tags.
[-np|--nopagenumbers]
Do not number LaTeX pages, i.e. set the pagestyle to empty.
[(-lm|--listmode) ]
Sets the list mode; the bitwise ORed options are:
* 0 --- automatically number and label lists, renumbering what appear
to be lists with errors. Use standard LaTeX numbering and labelling.
* 1 --- keep the original numbers (or letters) on enumerated lists, but
put standard labels on itemized lists.
* 2 --- turn itemized lists into enumerated lists.
* 4 --- hrules end all active lists.
* 8 --- easy start. Enumerated lists need not start with 1, A, etc.,
which is useful for documents that have headings, diagrams etc. in
lists. You would normally use this with list mode 1, to avoid
renumbering.
* 16 --- turn LaTeX description environments into enumerate; this may
sound a strange thing to do, but leads to nice results. Try it!
* 32 --- do not nest description environments. Normally a new
description starts for every new level of indentation, but this mode
switches this feature off.
Using ``-lm'' without a following number sets the default mode 0.
[(-de|--description) |off]
Sets the regular expressions to identify lines that should be put in a LaTeX
``description'' environment. Only the ``first match'' in the regular
expression will be used as the ``name'' in the ``description'', and the
rest is deleted. So, if you do not want to delete anything, put your
regular expression in ``()''. This is off by default, and the default
can be reset with the command line option ``-de off''. See the definitions
of ``-sw remind'' and ``-sw dict'' for examples.
[(-s|--shortline) <[-]num>]
Sets the upper bound of the length of a ``short line'' (40 by default),
which is assumed to be intentionally this short, so must be kept broken.
If the number given is negative, leading spaces are not ignored when
determining if a line is ``short''. The default is that leading spaces
are ignored.
[(-ss|--shortlineskip) ]
Sets the vertical skip after a ``short line'', for example try ``-ss 1ex''.
The default is a normal line break. The default can be restored by setting
it to ``null''.
[(-r|--hrule) |off]
If given a number, sets the minimum number of ``==='' etc. for a horizontal
rule. The default is 4. If given ``off'', sets $hrules_on = 0, and any
hrules found are not printed.
[(-sm|--smallmargins) []]
LaTeX defaults to large margins, but I like small (1in) margins. The
bitwise ORed options are:
* 0 --- standard LaTeX margins.
* 1 --- 1in X margins.
* 2 --- 1in Y margins.
* 3 --- 1in X and Y margins.
The default is 0. If ``-sm'' is not followed by a valid number, then
option 3 is set.
[(-t|--title) ]
You can specify a title to be placed at the top of the document.
[(-tt|--titletag) ]
Used to set the title tag. The default tag is ``centerline{\LARGE\bf''.
[-tf/+tf] | [--titlefirst/--notitlefirst]
Use the first non-blank line as the title of the document. Off by default.
[(-pi|--parindent) ]
Sets the minumum number of spaces indented in first line of a paragraph.
This is used only when there's no blank line preceding the paragraph.
The default is 3.
[(-c|--caps) ]
Sets the minimum sequential CAPS for a ``caps line'', which is then put
in a special font. For the full definition of a caps line, see the code.
The default is 3.
[(-ct|--capstag) |off]
Sets the tag to put around ``caps lines''. Set it to ``off'' for no
caps lines, but note that some of these lines could then be marked as solo
lines; if you want to avoid this, set it to ``null'', which is turned into
the empty tag. The default tag is ``subsubsection*''.
[(-st|--solotag) |off]
Sets the tag for ``solo lines'', i.e. lines that have a blank line before
and after, and have the ``right'' important-looking ending (see
``sub solo'' for the full definition). The default tag for solo lines is
``subsubsection*{\textit''. Set it to ``off'' for no solo lines.
[(-m|--mail) []]
Used to set the mail mode. The bitwise ORed options are:
* 1 --- deal with mail headers and mail quoted text.
* 2 --- add half-line width right-flushed hrules at the beginning of
new messages. Strange, but easy to see!
* 4 --- add a LaTeX ``clearpage'' before each new message.
* 8 --- do not print the mail header.
``-m'' without a following number sets the default mail mode of 1. (Any
non-zero option also includes option 1.)
[-u/+u] | [--unhyphenate/--nounhyphenate]
Enables unhyphenation of the raw text, so we can leave hyphenation to
LaTeX. On by default.
[(-ul|--ulength) ]
Sets the underline tolerance for plain text headings, i.e. how much longer
or shorter than the text can underlines be and still be underlines. The
default is 1.
[(-uo|--uoffset) ]
Sets the offset tolerance for underlines of plain text headings. The
default is 1.
[(-tw|--tabwidth) ]
Sets the width of a tab. The default is 8.
[-e/+e] | [--extract/--noextract]
Sets extract mode for making inserts for other LaTeX documents. Off
by default.
[(-rs|--ruleset) ]
[+rs|--noruleset]
By default reads the ruleset in ``.txt2tex-ruleset'' (if it exists),
but a different file can be given. When looking for a specified ruleset
file, if it fails to find a direct match, it will then try ``file-ruleset''
and last of all ``~/.txt2tex-file'', where ``file'' is the given file name.
[-ro/+ro] | [--rulesetonly/--norulesetonly]
Do no escaping or marking up at all, except for processing the ruleset
dictionary file and applying it. This is useful if you want to use
txt2tex's rulesetting feature on a LaTeX document. If the LaTeX is a
complete document (includes HEAD and BODY) then you will need to use
the --extract option also. Off by default.
[(-H|--heading) ]
Used to set regular expressions to pick out custom headings in the plain
text. For examples, see the ``switch'' options at the end of txt2tex,
in particular ``num''. Header levels are assigned by regexp in the order
seen; when a line matches a custom header regexp, it is tagged as
a header. If it is the first time that particular regexp has matched,
the next available header level is associated with it and applied to
the line. Any later matches of that regexp will use the same header level.
Therefore, if you want to match numbered header lines, you could use
something like this:
-H '^ *\d+\. \w+' -H '^ *\d+\.\d+\. \w+' -H '^ *\d+\.\d+\.\d+\. \w+'
Then lines like:
2. Examples
2.1. More Examples
2.1.1. Even More Examples
would be marked as section, subsection, etc., assuming they were found in
that order, and that no other header styles were found. If you prefer
that the first heading specified always becomes ``section'', the second
always becomes ``subsection'' etc., then use the --explicitheadings option.
Also you would probably want the --nosectionnumbers option, to avoid getting
two sets of numbers; this could also be fixed using the --trimheadings
option (see the definition of ``--switch n'').
[(-HT|--headingtags) |shift|number]
[(-TH|--trimheadings) ]
The sequence of tags for the section headings can be set by something like:
``-HT something,anotherthing,...'' and the headings can be trimmed using
``-TH '', i.e. whatever matches ``regexp'' is removed. Note that
all headings are trimmed using the same regular expression and that the
regular expression is applied after the heading tag and label have been
added. The argument of ``-HT'' can also be ``shift'', which shifts the
sequence of heading tags down by one, or ``number'', which tells txt2tex
(rather than LaTeX) to number the headings (off by default). Remember not
to ask LaTeX to number the headings too, if you use ``number''.
[-EH/+EH] | [--explicitheadings/--noexplicitheadings]
This tells txt2tex not to try to find any headings except the custom ones
specified. Also, the custom headings will not be assigned levels in the
order they are encountered in the document, but in the order they are
specified on the command line. Off by default.
[(-db|--debug) ]
Debug mode for ruleset dictionaries. Bitwise OR what you want to see:
* 1 --- the parsing of the dictionary.
* 2 --- the code that will make the ruleset.
[(-tr|--trim) ]
Used to trim ``n'' characters from the beginning of each line longer than
``n'', or to trim using a regular expression. The default is 0.
[(-sw|--switch) ]
Used to add sets of command line options that are kept at the bottom
of this file. For example ``-sw num'' will help pick out numbered
section headings, and ``-sw lynx'' cleans up text files from the lynx
browser. Take a look at the definition of ``-sw num'', and see if you
can work out what all the options do. Then add some ``-sw'' options
of your own. Also see the section on option sets below.
[-tc|--twocolumn]
Sets LaTeX's ``twocolumn'' option. Off by default. To see what this looks
like with 1in margins, take a look at this ``readme'' file in this format
by typing ``txt2tex --demo'' on a unix or linux machine.
[-ls|--landscape]
Sets LaTeX's ``landscape'' option. Off by default.
[-sp|--sloppy]
Sets LaTeX's ``sloppy'' option, which is particularly useful for slides.
Off by default.
[-d|--draft]
Save the output in a file called draft.tex. Off by default.
[(-h|--help)/--info/--demo]
--help gives a short help message listing the options, --info gives a
plain text version of the ``readme'' file, and --demo (on a standard
unix or linux system) will run the plain text from --info through
txt2tex to give a nice LaTeXed version of the ``readme'' file; note that
the ``demo'' makes t2t_readme.txt, .tex, .dvi, .aux, and .log.
[-v|--version]
Prints the txt2tex version number.
Option sets
~~~~~~~~~~~
Below the ``__END__'' in txt2tex you can put lists of command line
options after a ``keyword''; these can then be loaded by putting
``-sw keyword'' on the command line. Note that ``\'' is a continuation
character, so long options can be put on several lines. These include:
* remind --- turns the output of the unix remind program into nice LaTeX;
call remind using ``rem -n |sort''.
* num --- picks out simple numbered headings.
* n --- a variant of the above.
* plain --- a very plain style, which is good for university work!
* trim --- removes leading spaces before txt2tex processes the line.
* lynx --- for lynx browser output.
* noL --- normally \014 produces a LaTeX ``clearpage'', but this option
removes \014 before txt2tex sees the line.
* HH --- this is what I use to print the ``Happy Hacker'' newsletter.
* man --- useful for dealing with unix man pages, but could be better!
* pagesec --- each new section starts on a new page.
* pagesubsec --- each subsection starts on a new page.
* slides --- turns plain text into (very) simple slides. You might also
want to set ``noverbatim''. Note that many of the standard options will
not work with switch ``slides'' set.
* handout --- used for student handouts.
* letter --- used for writing letters, but you need to define your own
letter-hook files with your address etc.
* preview --- not for LaTeXing, but marks up the file in a manner to show
you what txt2tex was thinking; this can help in choosing the right tags
etc. for the print run. It can be followed by other options, so you can
see how that changes the mark up. It is also useful for debugging, but that
is probably my job [:-)]
* dict --- turns a list of the form `word: text' into a LaTeX description
environment.
* phone --- turns a list of the form `phrase: text' into a LaTeX description
environment. I use this for a personal phone book.
* fn --- turns fancy numbered lists, with numbers like 1.1.1, into LaTeX
description environments. Often useful for printing contracts off the net!
* lpr --- used as part of a fancy plain text printer filter.
* lpn --- used by the Lockpicker Network.
* netrc --- used to print a .netrc file.
A sample ruleset
~~~~~~~~~~~~~~~~
Txt2tex by default tries to load a file called ``.txt2tex-ruleset'' from
your home directory (assuming you are using a unix system). This file, if
it exists, contains transformation rules that are executed AFTER all other
txt2tex subroutines with the exception of ``tidy'' (which does a little
cleaning up) and the escaping of ``funny'' characters. Strange behaviour
can result from not keeping the time of execution in mind.
I most often use ``rulesets'' for writing my own documents in plain text, to
be transformed later by txt2tex into LaTeX. So let us look at rules
that help in such tasks. Each rule must be on a single line in the ruleset
file.
/<<(.*?)>>/ -f-> $1
The ``-f->'' type rule, when the regular expression on the left matches,
takes the expression on the right and turns it into a footnote, then
removes the triggering text. So the above example transforms
``Kalvis M. Jansons<>'' into
``Kalvis M. Jansons\footnote{Mathematics, UCL}'' in the LaTeX output.
Kalvis M. Jansons -Fo-> Email: kalvis\@jansons.org
The ``-F->'' type rules are the same as the ``-f->'' ones, but do not
remove the triggering text. So the above rule adds a footnote with my email
address to my name. So that this happens once only per document, I have
added the ``o'' (for once) in the rule.
/txt2tex/ -oi-> TXT2TeX \\emph{(written by Kalvis)}
/pheonix/ ---> phoenix
The above rules are simple transformations, the first is case insensitive,
hence the ``i'', and is executed once only. The second corrects a common
spelling error (every time it occurs).
/tagad/ -ie-> my $time = localtime(time); $time =~ s/\:\d\d\s.*//; $time
The ``e'' option means evaluate the righthand side as a perl expression.
So the above expression turns ``tagad'' (the Latvian for ``now'') into the
current date and time (and removes ``tagad''). The ``e'' option can also
be used to change the value of txt2tex parameters while running, by setting
them when certain patterns are first encountered.
/\*([a-z][a-z ]*[a-z])\*/ -ti-> emph
/\*([a-z])\*/ -ti-> emph
The ``t'' option is used to tag the text in (), so leads to a shorter
rule than could be obtained using the above rules to do this job.
The above rules put any sequence of letters and spaces which are between
two stars in the LaTeX ``emph'' style. This use of ``*'' is often seen
in plain text ``readme'' files.
/<\*(.*?)\*>/ -tfi-> textbf
Putting a few bits together, we can turn anything in <* ... *> into a
``textbf'' footnote, but I am sure you can think of a better application.
Saving the sample ruleset
.........................
If you want to save this sample ruleset to adapt for your own use, type
``txt2tex -sampleruleset > ~/.txt2tex-ruleset'',
or direct it into a different file if you do not want it to be the default.
Getting help
~~~~~~~~~~~~
Please contact me (Kalvis) with any problems or suggestions.
Bugs
~~~~
Send any bug reports to me, and I will do my best to fix them, but note that
there is a limit to what txt2tex can be expected to do on poorly formatted
text files. For such files, it is often better to fix the worst features
before giving them to txt2tex; then there should not be the need to do much
work, if any, on the LaTeX file produced.
Ensure that you are using the latest version, which can be obtained from
any CTAN site.
Kalvis@Jansons.org