Thu May 7 14:24:32 CEST 2009

speeding up inner parser


cpu time: 1228 real time: 1588 gc time: 108
cpu time: 2056 real time: 2455 gc time: 52

Now that's simply ridiculous.

Let's see.. I think I need to have a proper look at the regexp syntax
instead of writing all these adhoc tokenizers.

Ok. All representation uses bytes now + _compiled_ regular
expressions.  This is what i get:

cpu time: 19 real time: 20 gc time: 0
cpu time: 12 real time: 12 gc time: 0

A little better ;)

Using strings instead of bytes makes it not more than twice as