LanguageCharacteristics<TTokenizer,TSymbol,TSymbolType>.TokenizeString Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Overloads
| TokenizeString(String) |
This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens. |
| TokenizeString(SourceLocation, String) |
This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens. |
TokenizeString(String)
This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.
public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString(string content);abstract member TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>Public Overridable Function TokenizeString (content As String) As IEnumerable(Of TSymbol)Parameters
- content
- String
The string to tokenize.
Returns
The collection of token.
Applies to
TokenizeString(SourceLocation, String)
This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.
public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString(System.Web.Razor.Text.SourceLocation start, string input);abstract member TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>Public Iterator Overridable Function TokenizeString (start As SourceLocation, input As String) As IEnumerable(Of TSymbol)Parameters
- start
- SourceLocation
The source ___location as the start marker for the tokenizer.
- input
- String
The string to tokenize.
Returns
The collection of token.