Class QueryTokenizer
[PublicAPI]
public sealed class QueryTokenizer
- Inheritance
-
QueryTokenizer
- Inherited Members
Constructors
QueryTokenizer(string)
public QueryTokenizer(string source)
Parameters
sourcestring
Fields
SingleCharacterToTokenKinds
public static readonly IReadOnlyDictionary<char, TokenKind> SingleCharacterToTokenKinds
Field Value
Methods
EnumerateTokens()
public IEnumerable<Token> EnumerateTokens()