top | item 3766089

XeTeX: could it be TeX's saviour?

92 points| steeleduncan | 14 years ago |vallettaventures.com | reply

64 comments

order
[+] jwr|14 years ago|reply
There are two problems with TeX (in general):

1. It is a local maximum. It produces great output and works now. Changing it requires a huge effort which will result in a system that is inferior, for many years to come. Only then another maximum could be achieved. This means there is resistance to change — it's easier to adapt to TeX's flaws than it is to write something completely new. Many systems suffer from similar fate (think Emacs).

2. It is a black hole, a programmer sink. People start using TeX and curse it, then they learn it, and by the time they know its limitations and are ready to take on a job of writing something better, they are proficient enough in TeX to stay within it. Many systems suffer from similar fate (think Emacs).

I wonder if something will eventually happen to budge the TeX community from where it is now.

[+] wladimir|14 years ago|reply
Many systems suffer from similar fate (think Emacs)

That happens so much in software there needs to be a word for it, a term of its own.

After a while, you get deep enough in the rabbit hole so that it seems your initial judgement of redundant complexity was wrong. Even though it's still true, you've adapted to it. You just can't see it from the viewpoint of someone new anymore. For this reason I tend to carefully write down my initial concerns with something.

More on-topic, I don't think what TeX needs is a complete, sudden break with the past. It would be better to deprecate old, flawed features, and later on disable them and provide and optional compatibility mode (which is a bigger download).

[+] bo1024|14 years ago|reply
> 2. It is a black hole, a programmer sink. People start using TeX and curse it, then they learn it, and by the time they know its limitations and are ready to take on a job of writing something better, they are proficient enough in TeX to stay within it. Many systems suffer from similar fate (think Emacs).

I don't really see this. Tex requires a huge investment to learn, but so do most programming languages. That doesn't mean the languages are bad or need replacing. I think that the high cost of entry to tex programming is not necessarily a tex problem -- it's difficult to visualize a system with equal power being much easier to learn. (Though the rough edges could be smoother.)

More importantly, when you say "Take on the job of writing something better", I have to believe that there are very very few who are up for this task in the world, and it would probably require their combined efforts. It doesn't seem likely at this stage. Maybe eventually, though.

[+] larsberg|14 years ago|reply
XeTeX-generated PDFs are not compatible with the toolchains of some academic publishers (Cambridge University Press, which publishes the Journal of Functional Programming comes to mind, but I seem to recall Springer-Verlag having issues as well). Without full support for academic publishers, I believe that majority of TeX users could not upgrade.
[+] JoshTriplett|14 years ago|reply
What about XeTeX-generated PDFs makes them incompatible?
[+] JoachimSchipper|14 years ago|reply
Umm, have these people ever heard of backward compatibility? Admittedly, many TeX package authors haven't either, but just dropping pstricks is going to make a ridiculous number of documents that have a figure in them impossible to compile. Not to mention the fact that TikZ, while better, is not better enough that everyone will want to invest time learning it...

MikTeX's install-on-first-use has its problems, but does help balance bloat and not removing older packages.

[+] JoshTriplett|14 years ago|reply
I agree that XeTeX doesn't provide a drop-in replacement for TeX-with-dvips, but neither does pdftex/pdflatex, and many people already use that. Generating postscript or DVI first and converting to PDF produces suboptimal PDFs.

For quite a long time, pstricks didn't work very well with pdflatex, until eventually pstricks added limited support for PDF.

Also, I do consider TikZ sufficiently better than pstricks to switch. The low-level PGF library alone wouldn't provide enough benefit, but the addition of the high-level TikZ makes it extraordinarily good.

[+] jvm|14 years ago|reply
Can't they just maintain both a bloated legacy version and a stripped down version that they focus on?
[+] rmk2|14 years ago|reply
>> Undoubtably a change this severe will be painful for some, but it will be less less painful than heading out to the computer shop in 3 years time to purchase the 2TB harddrive that will be required for the exponentially expanding tex updates.

Few arguments ever gain feasibility from hyperbole, this article is not an exception. The size of his texlive installation is purely circumstantial evidence, since that folder also includes backups of updated packages and all sorts of other "dynamic", i.e. user-specific data. Basing the argument on that seems...silly.

>> For those for whom adding the letters xe before typesetting is too much to bear, or for typesetting ancient documents

It isn't as easy as "just adding xe" before (La)TeX, since not all packages are integrated with it yet, and since the polyglossia package is still not fully stable, either (yes I know babel is old, but at least stable), so some packages have trouble dealing with polyglossia or have experimental interfaces in order to work with Xe(La)TeX. Csquotes is one of the packages that comes to mind. A further problem with XeTeX is that it still does not offer a proper version of the microtype package. And on top of everything, the hyperref-support for colours is spotty at times, at least for me.

For me, depending on situation, pdflatex and xelatex live happily next to each other and are both included in the same in my generic template via the ifxetex package and \ifxetex...\else...\fi, so depending on what I need in a given instance, running either binary on the same file produces either output.

[+] siphr|14 years ago|reply
In all honesty I did not realise LaTeX needed saving.
[+] _delirium|14 years ago|reply
Outside of mathematics and physics conference/journal publishing, there's a widespread perception that it's losing ground. In CS some conferences are slowly switching to Word, or offering an option to authors (who are slowly switching to Word, especially outside of theory-heavy areas). In book publishing it's shrunk to a very small niche, even in technical areas. Part of the problem is cruftiness of tools, and part is the bizzareness of the underlying languages. As far as I can tell, few people who've written significant chunks of LaTeX stylesheet code or TeX macros/packages think the language is good, and it's complex/weird enough that even the vast majority of people who've written dozens of papers in LaTeX have no idea how to make nontrivial changes to its stylesheets. Also, many of the base tools still don't have Unicode support.

Belief that something is broken and attempts to fix it are a 20-year-old refrain at this point, e.g. ConTeXt is an attempt to make TeX more usable for book publishing, LuaTeX is an attempt to reduce reliance on TeX macros in favor of a less weird scripting language, XeTeX is a project to add Unicode, etc.

[+] tomjen3|14 years ago|reply
I don't know. I can write LaTex but I must admit at times I would prefer something that could be written from a real language but still use LaTeXs typesetting, kerning, etc.
[+] pnathan|14 years ago|reply
Neither did I. I use LaTeX frequently and /vastly/ prefer it to the drek of Word.

It provides a nice default, fast editing, and an incredibly large and featureful set of libraries.

[+] batista|14 years ago|reply
Download and install LaTeX from scratch.

Write a document, add some figures, use a custom OT font with it and save it as a PDF.

If you couldn't find at least 10 things that beg to be hugely improved in the whole process, don't ever try to work at QA.

[+] batista|14 years ago|reply
Yes, people can continue to obliviously work with the same legacy tools and the same convoluted processes for years, until something better comes along and they wonder why they put up with that shit all along.

Oh, you meant it sarcastically? Well, I didn't.

[+] beza1e1|14 years ago|reply
The mission of TeXLive is to include everything and the kitchen sink. However, why should their TeXpad support everything? They could go the XeTeX+biber+TikZ route and educate their users how to switch from pdflatex,bibtex,pstricks,etc.
[+] tincholio|14 years ago|reply
Precisely, there are other people out there who use TeX in different ways. They should just target their preferred compilation chain and just handle that in their app (they are not wrong in thinking that _most_ people out there just wan LaTeX to spit out PDFs and use "normal" graphics).

Otherwise, has anyone used their app? How does it stack against Emacs+AucTex+RefTex+Skim?

[+] antihero|14 years ago|reply
I think one of the best moves to get this in the works would be updated tutorials and documentation "Using LaTeX in 2012" or whatever, because a huge amount of the resources out there will promote use of outdated or old packages that would hinder moving forward.
[+] radarsat1|14 years ago|reply
Why is it necessary for TeX to keep all the libraries in source form on disk? Why not use compression, or package some pre-compiled form of the library code, or both?
[+] Avshalom|14 years ago|reply
From what I understand everything above TeX is one giant text manipulation macro, which means it all has to be available to the programs in text form, you could compress it but that would me decompressing hundreds (thousands?) of files every time you compile.
[+] ajray|14 years ago|reply
I just use XeTeX so I can get proper kerning and ligatures. Oddly enough, as a typography nerd LaTeX just doesn't cut it.
[+] leephillips|14 years ago|reply
I understand that XeTeX allows some fancy ligatures and access to other opentype features, but what's lacking in [La]TeX's kerning, and basic ligature support?
[+] dfc|14 years ago|reply
Why don't you use luatex?
[+] MrKurtHaeusler|14 years ago|reply
I have used XeLaTeX for a while because of the support for freetype fonts and better support for unicode.

Linux Libertine is my favorite font for XeLaTeX because it has better ligatures than any of the computer modern etc. fonts.

[+] leephillips|14 years ago|reply
I didn't understand why they wanted to port LaTeX to the iPad when they first wrote about it:

http://lee-phillips.org/latexipad/

[+] jacobwil|14 years ago|reply
I'm sorry, but your logic here is just terrible. Your argument is that "I don't want an iPad" and "The iPad isn't a full computer" implies that "Nobody needs/wants LaTeX on an iPad". This doesn't logically follow and is instead a self-centered presumption that because you don't want something, nobody else does.

They want LaTeX on their iPads, I would like LaTeX on my iPad, and I have met other people who also want LaTeX on their iPads. When I'm taking notes, LaTeX works well for me (I'm not claiming for everyone) when I need to type up equations. I use my iPad with a bluetooth keyboard to take notes (the iPad's battery life (amongst other things) makes it very attractive for this application). I'd like to be able to render my equations to make sure I didn't make a transcription error.

[+] killa_bee|14 years ago|reply
I use xelatex in my work and it's still embarassingly fragmented and outdated. We need to start over on a new TeX-like project (also so that it can be ported to mobile).
[+] dfc|14 years ago|reply
I thought that luatex was going to be the savior?
[+] gnosis|14 years ago|reply
The lack of microtype support in XeTeX is a deal breaker. That's the main reason why I continue to use pdflatex.
[+] rmk2|14 years ago|reply
Microtype is partially supported (read: half of what it mainly does), i.e. protrusion sort of works, but expansion does not. Protrusion is already something, though I agree that this is one of the biggest things holding me back from switching completely.
[+] jhnewhall|14 years ago|reply
Tex, because it's author didn't care to reuse XML.

Having used it for publications and during the university i really, i despise Tex. Simply the language sucks, the outcome is nice, but those slashes and parenthesis really sucked.

With a XML syntax we could easily create beautiful editors, make it easy to parse with schema validation, etc.

Problem is that this card castle grew, avoiding alternatives such as docbook, and is and will always be a mess, since it's foundations are not parseable.

[+] jff|14 years ago|reply
XML: published 1996.

TeX: Initially released 1978.

Plus, writing XML makes me puke, so even with the occasional grossness of TeX syntax I'm happy it's not XML.

[+] jhpriestley|14 years ago|reply
An XML-syntax language? Like XSLT? Yeah, that's thriving.

The awesome editors and tools that are supposed to grow around any XML-based syntax (after the hard part -- parsing -- is taken care of), are like the modern version of the "sufficiently smart compiler".

[+] adavies42|14 years ago|reply
XML 1.0 is from 1998. more than twenty years after Knuth started TeX. Even SGML is only from 1986, I suppose he could've used GML....
[+] simon|14 years ago|reply
Doesn't Tex pre-date XML? If so, that would make it hard, even for Donald Knuth, to reuse a non-existent technology.