HTML file Character set converter

Recodes the HTML file using a new character set, while losing no characters at all. You can recode shift_jis to euc-jp, utf8 to latin1, iso-8859-15 to GB18030, iso-2022-jp to koi8-r etc if you wish, and none of the characters on the page will become unreadable (unless you specify -l switch, which disables making &#nnnn; escapes).

htmlrecode 1.1.5.1 - Copyright (C) 1992,2003 Bisqwit (http://iki.fi/bisqwit/)

Usage: htmlrecode [<option> [<...>]]

Reads stdin, writes stdout.

Options:
    -I, --inset setname   Assumed input character set (default: iso-8859-1)
    -O, --outset setname  Wanted output character set (default: iso-8859-1)
    -V, --version         Displays version information.
    -h, --help            This help.
    -l, --lossy           Disable lossless conversion.
    -x, --usehex          Use hexadecimal escapes.

Pipe in the html file and pipe the output to result file.

I'll soon add an interface for modifying the text content of a HTML file.
This should make making filters like Pootpoot or Pikachifier easier. It is already theoretically supported, but I haven't invented an interface for it yet.

$ make
$ su
# make install

If you do not want to install libargh (included in the archive), do not use "make install" and edit Makefile and enable the STATIC linking instead of DYNAMIC.

If somebody knows how to get this example code here below to compile and link with g++-3, please tell me.

#include <string>

using namespace std;

int main(void)
{
    basic_string<unsigned> test;
    test += 5;
    return 0;
}

This page template is locally stored in iso-8859-1, but is automatically converted to utf-8 to make the final version.

Here are some latin letters: åäöñé
Here are some CJK (chinese/japanese/korean ideograms): 日本
Here are some html escapes: >"äöê

Source code of the above:

Here are some latin letters: åäöñé<br>
Here are some CJK (chinese/japanese/korean ideograms): &#26085;&#26412;<br>
Here are some html escapes: &gt;&quot;&auml;&ouml;&ecirc;<br>

What your browser is getting, is not 日 etc but the actual utf-8 characters.

If you have problems using this program or ideas how to develop it, email me your questions or ideas. Please do not omit the details.

htmlrecode has been written in C++, utilizing the standard template library.
GNU make is required.
I have g++ version 3.1.0, and htmlrecode compiles without warnings.
You also need libiconv.
Note: The Makefile tries to link the program against librecode. Try replacing the line LDFLAGS=-lrecode with LDFLAGS=-liconv or even commenting it out, if your linking fails.

  - tags are now recognized in all mixed case
  - tag values can be in '', not only in ""
  - -:_. are recognized to be part of tag value if no "" is there
  - SCRIPT and STYLE contents are "raw" until the next </
  - Also ,/ are unconditionally recognized as part of the tag value

htmlrecode has been written by Joel Yliluoma, a.k.a. Bisqwit,
and is distributed under the terms of the General Public License (GPL).

The official home page of htmlrecode is at http://iki.fi/bisqwit/source/htmlrecode.html.
Check there for new versions.