% [![Build Status](https://travis-ci.org/michal-h21/make4ht.svg?branch=master)](https://travis-ci.org/michal-h21/make4ht)
# Introduction
`make4ht` is a simple build system for `tex4ht`, \TeX\ to XML converter. It provides a command line tool
that drive the conversion process. It also provides a library which can be used to create
customized conversion tools. An example of such conversion tool is
[tex4ebook](https://github.com/michal-h21/tex4ebook) for conversion of \TeX\ to
ePub and other e-book formats.
## How it works
### The issues with default `tex4ht` conversion commands
`tex4ht` system supports several output formats, most notably `XHTML`, `HTML 5` and `ODT`.
The conversion can be invoked using several commands. These commands invoke LaTeX\ or Plain TeX
with special instructions to load `tex4ht.sty` package. The \TeX\ run produces special `DVI` file
which contains the code for desired output format. Produced `DVI` file is then processed and
desired output files are created.
The basic command provided by `tex4ht` is named `htlatex`. It compiles \LaTeX\
files to `HTML` with this command sequence:
latex $latex_options 'code for loading tex4ht.sty \input{filename}'
latex $latex_options 'code for loading tex4ht.sty \input{filename}'
latex $latex_options 'code for loading tex4ht.sty \input{filename}'
tex4ht $tex4ht_options filename
t4ht $t4ht_options filename
The options for various parts of the system can be passed on the command line:
htlatex filename "tex4ht.sty options" "tex4ht_options" "t4ht_options" "latex_options"
For basic `HTML` conversion it is possible to use the most basic invocation:
htlatex filename.tex
It can be much more involved for `HTML 5` output in `UTF-8` encoding:
htlatex filename.tex "xhtml,html5,charset=utf-8" "-cmozhtf -utf8"
`make4ht` can simplify it:
make4ht -uf html5 filename.tex
Another issue is the fixed compilation order and hard-coded number of LaTeX invocations.
When you need to run a program which interact with LaTeX, such as `Makeindex`
or `Bibtex`, you need to create a new script based on `htlatex`, or run
`htlatex` twice, which means that LaTeX will be invoked six times.
This can lead to significantly long compilation times. `make4ht` provides build files and
extensions, which can be used for interaction with external tools.
It is also possible to have several compilation modes. When you just add new text to a document,
which doesn't contain cross-references, don't add new stuff to the table of contents, etc.,
it is possible to use the `draft` mode which will invoke LaTeX only once. It
can save quite a lot of the compilation time:
make4ht -um draft -f html5 filename.tex
There are also issues with a behaviour of the `t4ht` application. It reads file
`filename.lg`, generated by `tex4ht`, where are instructions about generated
files, `CSS` instructions, calls to external applications, instructions for
image conversions etc. It can be instructed to copy generated files to some
output directory, but it doesn't preserve directory structure, so when you
have images in a subdirectory, they will be copied to the output directory.
Links will be pointing to a non-existing subdirectory. The following command
should copy all output files to the correct destinations.
make4ht -d outputdir filename.tex
The image conversion is configured in the
[env file](http://www.tug.org/applications/tex4ht/mn35.html#index35-73001),
which has really strange syntax based and the rules are
[os dependent](http://www.tug.org/applications/tex4ht/mn-unix.html#index27-69005).
`make4ht` provides simpler means for the image conversion in the build files.
With `make4ht` build files, we have simple mean to fix these issues. We can
change image conversion parameters without the need to modify the `env file`,
or execute actions on the output files. These actions can be either external
programs such as `xslt` processors or `HTML tidy` or `Lua` functions.
The idea is to make system controlled by a build file. Because `Lua`
interpreter is included in modern TeX distributions and `Lua` is ideal language
for such task, it was chosen as language in which the build scripts are written.
# Output file formats and extensions
The default output format used by `make4ht` is `html5`. Different
format can be requested using the `--format` option. Supported formats are:
- `xhtml`
- `html5`
- `odt`
- `tei`
- `docbook`
The `--format` option can be also used for extension loading.
## Extensions
Extensions can be used to modify the build process without the need to use a build file. They
may post-process the output files or request additional commands for the compilation.
The extensions can be enabled or disabled by appending `+EXTENSION` or `-EXTENSION` after
the output format name:
make4ht -uf html5+tidy filename.tex
Available extensions:
latexmk_build
: use `Latexmk` for \LaTeX\ compilation.
tidy
: clean the `HTML` files using the `tidy` command.
dvisvgm_hashes
: efficient generation of SVG pictures using Dvisvgm. It can utilize
multiple processor cores and generates only changed images.
common\_filters
: clean the output HTML files using filters.
common\_domfilters
: clean the HTML file using DOM filters. It is more powerful than
`common_filters`. Used DOM filters are `fixinlines`, `idcolons` and
`joincharacters`.
join\_colors
: load the `joincolors` domfilter for all HTML files.
mathjaxnode
: use [mathjax-node-page](https://github.com/pkra/mathjax-node-page/) to
convert from MathML code to HTML + CSS or SVG. See [the available
settings](#mathjaxsettings).
odttemplate
: automatically load the `odttemplate` filter.
staticsite
: build the document in form suitable for static site generators like [Jekyll](https://jekyllrb.com/).
# Build files
`make4ht` supports build files. These are `Lua` scripts which can adjust
the build process. You can request external applications like `bibtex` or `makeindex`,
pass options to the commands, modify the image conversion process, or post-process the
generated files.
`make4ht` tries to load default build file named as `filename + .mk4 extension`.
You can choose different build file with `-e` or `--build-file` command line
option.
Sample build file:
Make:htlatex()
Make:match("html$", "tidy -m -xml -utf8 -q -i ${filename}")
`Make:htlatex()` is preconfigured command for calling LaTeX with `tex4ht`
loaded on the input file. In this case, it will be called one time. After
compilation, the `tidy` command is executed on the output `HTML` file.
Note that you don't have to call `tex4ht` and `t4ht` commands explicitly in the
build file, they are called automatically.
## User commands
You can add more commands like `Make:htlatex` using `Make:add` command:
Make:add("name", "command", {parameters}, repetition)
The `name` and `command` parameters are required, rest of the parameters are optional.
This defines `name` command, which can be then executed as `Make:name()` command.
### Provided commands
`Make:htlatex`
: One call to TeX engine with special configuration for `tex4ht` loading.
`Make:latexmk`
: Use `Latexmk` for the document compilation. `tex4ht` will be loaded automatically.
`Make:tex4ht`
: Process the `DVI` file and creates the output files.
`Make:t4ht`
: Creates the CSS file.
### Command function
The `command` parameter can be either string template or function:
Make:add("text", "echo hello, input file: ${input}")
Make:add("function", function(params)
for k, v in pairs(params) do
print(k..": "..v)
end, {custom="Hello world"}
)
The template can get variable value from the parameters table using a
`${var_name}` placeholder. Templates are executed using operating system, so
they should invoke existing OS commands. Function commands may execute system
commands using `os.execute` function.
### Parameters table
`parameters` parameter is optional, it can be table or `nil` value, which
should be used if you want to use the `repetition` parameter, but don't want to
modify the parameters table.
The table with default parameters is passed to all commands, they can be accessed from command functions
or templates. When you specify your own parameters in the command definition, these additional
parameters are added to the default parameters table for this particular
command. You can override the default parameters in the parameters table.
The default parameters are following:
`htlatex`
: used compiler
`input`
: it is output file name in fact
`tex_file`
: input TeX file
`latex_par`
: parameters to `latex`
`packages`
: insert additional LaTeX code which is inserted before `\documentclass`.
Useful for passing options to packages or additional packages loading
`tex4ht_sty_par`
: parameters to `tex4ht.sty`
`tex4ht_par`
: parameters to the `tex4ht` application
`t4ht_par`
: parameters to the `t4ht` application
`outdir`
: the output directory
`repetition`
: limit number of command execution.
`correct_exit`
: expected `exit code` from the command. The compilation will be terminated
if the command `exit code` is different.
### Repetition
Repetition is number which specifies a maximal number of executions of the
particular command. This is used for instance for `tex4ht` and `t4ht`
commands, as they should be executed only once in the compilation. They would
be executed multiple times if you include them in the build file because they
are called by `make4ht` by default. Because these commands allow only one
`repetition`, the second execution will be blocked.
### Expected exit code
You can set the expected exit code from a command with a `correct_exit` key in the
parameters table. The compilation will be stopped when the command returns a
different exit code.
This mechanism isn't used for LaTeX (for all TeX engines and formats, in
fact), because it doesn't differentiate between fatal and non-fatal errors, and
it returns the same exit code in all cases. Log parsing is used because of
that, error code `1` is returned in the case of fatal error, `0` is used
otherwise. The `Make.testlogfile` function can be used in the build file to
detect compilation errors in the TeX log file.
## File matches
Another type of action which can be specified in the build file is
`match`. It can be called on the generated files:
Make:match("html$", "tidy -m -xml -utf8 -q -i ${filename}")
It tests output file names with `Lua` pattern matching and on matched items will
execute a command or a function, specified in the second argument. Commands may be
specified as strings, the templates will be expanded, `${var_name}` placeholders
will be replaced with corresponding variables from the `parameters` table,
described in the previous subsection. One additional variable is available:
`filename`. It contains the name of the current output file.
The above example will clean all output `HTML` files using the `tidy` command.
If function is used instead, it will get two parameters.
The first one is a current filename, the second one
table with parameters.
### Filters
Some default `match` actions which can be used are available from the
`make4ht-filter` module. It contains some functions which are useful for
fixing some `tex4ht` bugs or shortcomings.
Example:
local filter = require "make4ht-filter"
local process = filter{"cleanspan", "fixligatures", "hruletohr"}
Make:htlatex()
Make:htlatex()
Make:match("html$",process)
The `make4ht-filter` module return a function which can be used for the filter
chain building. Multiple filters can be chained, each of them can modify the string
which was modified by the previous filters. The changes are then saved to the
processed file.
Built-in filters are:
cleanspan
: clean spurious span elements when accented characters are used
cleanspan-nat
: alternative clean span filter, provided by Nat Kuhn
fixligatures
: decompose ligatures to base characters
hruletohr
: `\hrule` commands are translated to series of underscore characters
by `tex4ht`, this filter translate these underscores to `
` elements
entites
: convert prohibited named entities to numeric entities (currently, only
` `, as it causes validation errors, and `tex4ht` is producing it
sometimes)
fix-links
: replace colons in local links and `id` attributes with underscores. Some
cross-reference commands may produce colons in internal links, which results in
validation error.
mathjaxnode
: use [mathjax-node-page](https://github.com/pkra/mathjax-node-page/) to
convert from MathML code to HTML + CSS or SVG. See [the available
settings](#mathjaxsettings).
odttemplate
: use styles from another `ODT` file serving as a template in the current
document. It works for the `styles.xml` file in the `ODT` file. During
the compilation, this file is named as `\jobname.4oy`.
staticsite
: create HTML files in format suitable for static site generators such as [Jekyll](https://jekyllrb.com/)
svg-height
: some SVG images produced by `dvisvgm` seem to have wrong dimensions. This filter
tries to set the correct image size.
Function `filter` accepts also function arguments, in this case this function
takes file contents as a parameter and modified contents are returned.
Example:
local filter = require "make4ht-filter"
local changea = function(s) return s:gsub("a","z") end
local process = filter{"cleanspan", "fixligatures", changea}
Make:htlatex()
Make:htlatex()
Make:match("html$",process)
In this example, spurious span elements are joined, ligatures are decomposed,
and then all letters 'a' are replaced with 'z' letters.
### DOM filters
DOM filters use the [`LuaXML`](https://ctan.org/pkg/luaxml) library to modify
directly the XML object. This enables more powerful
operations than the regex based filters from the previous section.
Example:
local domfilter = require "make4ht-domfilter"
local process = domfilter {"joincharacters"}
Make:match("html$", process)
Available DOM filters:
aeneas
: [Aeneas](https://www.readbeyond.it/aeneas/) is a tool for automagical synchronization of text and audio.
This filter modifies the HTML code to support the synchronization.
fixinlines
: put all inline elements which are direct children of the `` elements to a paragraph.
idcolons
: replace the colon (`:`) character in internal links and `id` attributes. They cause validation issues.
joincharacters
: join consecutive `` or `` elements.
joincolors
: many `` elements with unique `id` attribute are created when \LaTeX\ colors are being used in the document.
CSS rule is added for each of these elements, which may result in
substantial grow of the CSS file. This filter replace these rules with a
common one for elements with the same color value.
odtimagesize
: set correct dimensions for images in the ODT format. It is loaded by default for the ODT output.
t4htlinks
: fix hyperlinks in the ODT format.
### make4ht-aeneas-config package
Companion for the `aeneas` DOM filter is the `make4ht-aeneas-config` plugin. It
can be used to write Aeneas configuration file or execute Aeneas on the
generated HTML files.
Available functions:
write\_job(parameters)
: write Aenas job configuration to `config.xml` file. See the [Aeneas
documentation](https://www.readbeyond.it/aeneas/docs/clitutorial.html#processing-jobs)
for more information about jobs.
execute(parameters)
: execute Aeneas.
process\_files(parameters)
: process the audio and generated subtitle files.
By default, the `smil` file is created. It is assumed that there is audio file
in `mp3` format named as the TeX file. It is possible to use different formats
and file names using mapping.
The configuration options can be passed directly to the functions or set using
`filter_settings "aeneas-config" {parameters}` function.
Available parameters:
lang
: document language. It is interfered from the HTML file, so it is not necessary to set it.
map
: mapping between HTML, audio and subtitle files. More info bellow.
text\_type
: type of the input. The `aeneas` DOM filter produces `unparsed` text type.
id\_sort
: sorting of id attributes. Default value is `numeric`.
id\_regex
: regular expression to parse the id attributes.
sub\_format
: generated subtitle format. Default `smil`.
Additional parameters for the job configuration file:
- description
- prefix
- config\_name
- keep\_config
It is possible to generate multiple HTML files from the LaTeX source. For
example, `tex4ebook` generates separate file for each chapter or section. It is
possible to set options for each HTML file, in particular names of the
corresponding audio files. This mapping is done using `map` parameter.
Example:
filter_settings "aeneas-config" {
map = {
["sampleli1.html"] = {audio_file="sample.mp3"},
["sample.html"] = false
}
}
Table keys are the configured file names. It is necessary to insert them as
`["filename.html"]`, because of Lua syntax rules.
This example maps audio file `sample.mp3` to a section subpage. The main HTML
file, which may contain title and table of contents doesn't have a
corresponding audio file.
Filenames of the sub files corresponds to the chapter numbers, so they are not
stable when a new chapter is added. It is possible to request file names
interfered from the chapter titles using the `sec-filename` option or `tex4ht`.
Available `map` options:
audio\_file
: the corresponding audio file
sub\_file
: name of the generated subtitle file
The following options are same as their counter-parts from the main parameters table and generally don't need to be set:
- prefix
- file\_desc
- file\_id
- text\_type
- id\_sort
- id\_prefix
- sub\_format
Full example:
local domfilter = require "make4ht-domfilter"
local aeneas_config = require "make4ht-aeneas-config"
filter_settings "aeneas-config" {
map = {
["krecekli1.xhtml"] = {audio_file="krecek.mp3"},
["krecek.xhtml"] = false
}
}
local process = domfilter {"aeneas"}
Make:match("html$", process)
if mode == "draft" then
aeneas_config.process_files {}
else
aeneas_config.execute {}
end
## Image conversion
It is possible to convert parts of LaTeX input to pictures, it is used
for example for math or diagrams in `tex4ht`.
These pictures are stored in a special `dvi` file, which can be processed by
the `dvi to image` commands.
This conversion is normally configured in the `env file`,
which is system dependent and which has a bit unintuitive syntax.
This configuration is processed by the `t4ht` application and conversion
commands are called for all pictures.
It is possible to disable `t4ht` image processing and configure image
conversion in the build file:
Make:image("png$",
"dvipng -bg Transparent -T tight -o ${output} -pp ${page} ${source}")
`Make:image` takes two parameters, pattern to match image name and action.
Action can be either string template with conversion command,
or function which takes a table with parameters as an argument.
There are three parameters:
- `output` - output image file name
- `source` - `dvi` file with the pictures
- `page` - page number of the converted image
## The `mode` variable
There is global `mode` variable available in the build file. It contains
contents of the `--mode` command line option. It can be used to run some commands
conditionally. For example:
if mode == "draft" then
Make:htlatex{}
else
Make:htlatex{}
Make:htlatex{}
Make:htlatex{}
end
In this example (which is the default configuration used by `make4ht`),
LaTeX is called only once when `make4ht` is called with `draft` mode:
make4ht -m draft filename
## The `settings` table
You may want to access to the parameters also outside commands, file matches
and image conversion functions. For example, if you want to convert your file to
the `OpenDocument Format (ODT)`, you can use the following settings, based on the `oolatex`
command:
settings.tex4ht_sty_par = settings.tex4ht_sty_par ..",ooffice"
settings.tex4ht_par = settings.tex4ht_par .. " ooffice/! -cmozhtf"
settings.t4ht_par = settings.t4ht_par .. " -cooxtpipes -coo "
There are some functions to ease access to the settings:
`set_settings{parameters}`
: overwrite settings with values from a passed table
`settings_add{parameters}`
: add values to the current settings
`filter_settings "filter name" {parameters}`
: set settings for a filter
`get_filter_settings(name)`
: get settings for a filter
Using these functions, it is possible to simplify the settings for the `ODT` format:
settings_add {
tex4ht_sty_par =",ooffice",
tex4ht_par = " ooffice/! -cmozhtf",
t4ht_par = " -cooxtpipes -coo "
}
Settings for filters and extensions can be set using `filter_settings`:
filter_settings "test" {
hello = "world"
}
These settings can be read in the extensions and filters using `get_filter_settings`:
function test(input)
local options = get_filter_settings("test")
print(options.hello)
return input
end
## List of available settings for filters and extensions.
These settings may be set using `filter_settings` function.
### The `tidy` extension
options
: command line options for the `tidy` command. Default value is `-m -utf8 -w 512 -q`.
### The `fixinlines` dom filter
inline\_elements
: table of inline elements which shouldn't be direct descendants of the `body` element. The element names should be table keys, the values should be true.
Example
filter_settings "fixinlines" {inline_elements = {a = true, b = true}}
### The `joincharacters` dom filter
charelements
: table of elements which should be joined if several instances with the same value of `class` attribute are side by side.
Example
filter_settings "joincharacters" { charclases = { span=true, mn = true}}
### The `mathjaxnode` filter {#mathjaxsettings}
options
: command line options for the `mjpage` command. Default value is `--output CommonHTML`
Example
filter_settings "mathjaxnode" {
options="--output SVG --font Neo-Euler"
}
cssfilename
: `mjpage` puts some CSS code into the HTML pages. `mathjaxnode` extracts this information and saves it to a standalone CSS file. Default CSS filename is `mathjax-chtml.css`
fontdir
: directory with MathJax font files. This option enables use of local fonts, which
is usefull in Epub conversion, for example. The font directory should be
sub-directory of the current directory. Only TeX font is supported at the moment.
Example
filter_settings "mathjaxnode" {
fontdir="fonts/TeX/woff/"
}
### The `aeneas` filter
skip\_elements
: List of CSS selectors that match elements which shouldn't be processed. Default value: `{ "math", "svg"}`.
id\_prefix
: prefix used in the ID attribute forming.
sentence\_match
: Lua pattern used to match a sentence. Default value: `"([^%.^%?^!]*)([%.%?!]?)"`.
### The `staticsite` filter and extension
site\_root
: directory where generated files should be copied.
map
: table where keys are patterns that match filenames, value contains destination directoryfor matched files, relative to the `site_root` (it is possible to use `..` to swich to parent directory).
file\_pattern
: pattern used for filename generation. It is possible to use string templates and format strings for `os.date` function. Default value of `%Y-%m-%d-${input}` creates names in the form of `YYYY-MM-DD-file_name`.
header
: table with variables to be set in the YAML header in HTML files. If the table value is a function, it is executed with current parameters and HTML page DOM object as arguments.
Example:
local outdir = os.getenv "blog_root"
filter_settings "staticsite" {
site_root = outdir,
map = {
[".css$"] = "../css/"
},
header = {
layout="post",
date = function(parameters, dom)
return os.date("!%Y-%m-%d %T", parameters.time)
end
}
}
### The `dvisvgm_hashes` extension
options
: command line options for Dvisvgm. The default value is `-n --exact -c 1.15,1.15`.
cpu_cnt
: number of processor cores used for conversion. The extension tries to detect the available cores automatically by default.
parallel_size
: number of pages used in each Dvisvgm call. The extension detects changed pages in the DVI file and construct multiple calls to Dvisvgm with only changed pages.
scale
: SVG scaling.
### The `odttemplate` filter and extension
template
: filename of the template `ODT` file
`odttemplate` can also get the template filename from the `odttemplate` option from `tex4ht_sty_par` parameter. It can be set useing following command line call, for example:
make4ht -f odt+odttemplate filename.tex "odttemplate=template.odt"
# Configuration file {#configfile}
It is possible to globally modify the build settings using the configuration
file. New compilation commands can be added, extensions can be loaded or
disabled and settings can be set.
## Location
The configuration file can be saved either in
`$HOME/.config/make4ht/config.lua` or in `.make4ht` in the current directory or
it's parents (up to `$HOME`).
## Additional commands
There are two additional commands:
`Make:enable_extension(name)`
: require extension
`Make:disable_extension(name)`
: disable extension
## Example
The following configuration add support for the `biber` command, requires
`common_domfilters` extension and requires MathML
output for math.
Make:add("biber", "biber ${input}")
Make:enable_extension "common_domfilters"
settings_add {
tex4ht_sty_par =",mathml"
}
# Command line options
make4ht - build system for tex4ht
Usage:
make4ht [options] filename ["tex4ht.sty op." "tex4ht op."
"t4ht op" "latex op"]
-b,--backend (default tex4ht) Backend used for xml generation.
possible values: tex4ht or lua4ht
-c,--config (default xhtml) Custom config file
-d,--output-dir (default "") Output directory
-e,--build-file (default nil) If build file name is different
than `filename`.mk4
-f,--format (default nil) Output file format
-l,--lua Use lualatex for document compilation
-m,--mode (default default) Switch which can be used in the makefile
-n,--no-tex4ht Disable dvi file processing with tex4ht command
-s,--shell-escape Enables running external programs from LaTeX
-u,--utf8 For output documents in utf8 encoding
-v,--version Print version number
-x,--xetex Use xelatex for document compilation
(string) Input file name
You can still invoke `make4ht` in the same way as `htlatex`:
make4ht filename "customcfg, charset=utf-8" "-cunihtf -utf8" "-dfoo"
Note that this will not use `make4ht` routines for output directory making and
copying. If you want to use them, change the line above to:
make4ht -d foo filename "customcfg, charset=utf-8" "-cunihtf -utf8"
This call has the same effect as the following:
make4ht -u -c customcfg -d foo filename
Output directory doesn't have to exist, it will be created automatically.
Specified path can be relative to current directory, or absolute:
make4ht -d use/current/dir/ filename
make4ht -d ../gotoparrentdir filename
make4ht -d ~/gotohomedir filename
make4ht -d c:\documents\windowspathsareworkingtoo filename
# Troubleshooting
## Incorrect handling of command line arguments for `tex4ht`, `t4ht` or `latex`
Sometimes, you may get a similar error:
make4ht:unrecognized parameter: i
It may be caused by a following `make4ht` invocation:
make4ht hello.tex "customcfg,charset=utf-8" "-cunihtf -utf8" -d foo
The command line option parser is confused by mixing options for `make4ht` and
`tex4ht` in this case and tries to interpret the `-cunihtf -utf8`, which are
options for `tex4ht` command as `make4ht` options. To fix that, you can either
move the `-d foo` directly after `make4ht` command:
make4ht -d foo hello.tex "customcfg,charset=utf-8" "-cunihtf -utf8"
Another option is to add a space before `tex4ht` options:
make4ht hello.tex "customcfg,charset=utf-8" " -cunihtf -utf8" -d foo
The former way is preferable, though.
## Filenames containing spaces
`tex4ht` cannot handle filenames containing spaces. `make4ht` thus replaces spaces in input file names with underscores, so generated XML files use underscores instead of spaces as well.
## Filenames containing non-ASCII characters
The `odt` output doesn't support accented filenames, it is best to stick to ASCII characters in filenames.
# License
Permission is granted to copy, distribute and/or modify this software
under the terms of the LaTeX Project Public License, version 1.3.