This class allows an application to break a string into tokens.
public class Korzh.EasyQuery.StringTokenizer
Type | Name | Description |
---|
String | FullToken | Gets the full token string including quotes, brackets, etc. |
TokenType | LastBreak | Returns the type of the last scan stop. It can be either space or separator. |
Int32 | Position | Returns current position in the scanned string. |
Boolean | ProcessAIdents | Gets or sets a value indicating whether the tokenizer should recognize the identifiers placed in [] brackets. |
Int32 | TokenStart | Returns start position of the current token. |
TokenType | TokType | Gets the current token type. |
Type | Name | Description |
---|
String | FirstToken() | Get first token. |
String | NextToken() | Returns next token. |