[Discuss] 'C' string tokenizer for those who hate strtok

[Brian Quinlan]

I'm not actually sure that I agree with Peter's point that his code is 
somehow "safer" but I think that this discussion is raising some 
interesting issues.

One is the trade-off between correctness/reliability and performance. By 
choosing C as your implementation language, I think that you've already 
taking a large step in deciding that you favor performance. Usually, you 
would be better to write the bulk of your language in a higher-level 
language and then implement the performance critical sections in C. 
Hopefully those sections would be small enough that you could carefully 
test and scrutinize them.

You are also losing a lot in terms of programmer productivity, long term 
maintenance costs, etc. by using C.

<ding> <ding> Round 3...

Cheers,
Brian