[OpenBIOS] bug in toke?

[Segher Boessenkool]

>>> 2) the clean solution: Implement future versions of toke on top of 
>>> the
>>>    OpenBIOS forth engine "BeginAgain". This is a pretty minimal forth
>>>    implementation that is well suited.
>>
>> 3) Implement the FCode tokenizer in some standard Forth dialect, for
>> example, in ANS Forth -- it'll run on _any_ Forth system (that
>> implements
>> that standard), then (this should include BeginAgain).
>
> Which is 2). BeginAgain is just a light ANS forth implementation.

Of course, and I already said that -- I was just emphasising the
need for a _portable_ tokenizer, not something that runs _only_ on
BeginAgain.


Segher