phlogo::Tokenizer Class Reference

#include <Tokenizer.h>

List of all members.

Public Member Functions
	Tokenizer (Verbs *verbs)
std::string	tokenizeToString (const std::string &input)

---

Detailed Description

Take a line of logo syntax and parse it into an intermediate form that is much easier to evaluate.

Lot's of cool stuff:

• all tokens are seperated by spaces
• all sub-expressions and sub-sequences are parened.
• no arithmetic, all RPN.
• literals are deliteralised (no quote)
• variables are left as they were (start with :)
• verbs and functions are converted to there internal name, starting with $
• lists and arrays are compressed (no whitespace) with commas seperating elements.

Definition at line 32 of file Tokenizer.h.

---

The documentation for this class was generated from the following files:

• /Users/paul/Documents/phlogo/core/Tokenizer.h
• /Users/paul/Documents/phlogo/core/Tokenizer.cpp