Class PhpParser\Lexer

PhpParser\Lexer
- PhpParser\Lexer\Emulative

Located at vendor/nikic/php-parser/lib/PhpParser/Lexer.php

Methods


					
	public

tokenize(string $code, ErrorHandler|null $errorHandler = null): Token[]

Tokenize the provided source code.

The token array is in the same format as provided by the PhpToken::tokenize() method in PHP 8.0. The tokens are instances of PhpParser\Token, to abstract over a polyfill implementation in earlier PHP version.

The token array is terminated by a sentinel token with token ID 0. The token array does not discard any tokens (i.e. whitespace and comments are included). The token position attributes are against this token array.

Parameters

`$code`	The source code to tokenize.
`$errorHandler`	Error handler to use for lexing errors. Defaults to ErrorHandler\Throwing.

Returns

Tokens

Overriden by

PhpParser\Lexer\Emulative::tokenize()


					
	protected

postprocessTokens(list<Token> &$tokens, ErrorHandler $errorHandler): void

Namespaces

Classes

Interfaces

Exceptions

Class PhpParser\Lexer

Parameters

Returns

Overriden by