_PyTokenizer_Get (reference) in projects: third_party

Repository(s)

Full Search		Search through all text tokens(words,strings,identifiers,numbers) in index.
Definition		Only finds symbol definitions(where e.g a variable(function,...) is defined).
Symbol		Only finds symbol(e.g. methods classes,function,variables).
File Path		Path of the source file(use "/").If you want just exact path,enclose it in "".Source files end with: .jar/.bz2/.a/.h/.java...
History		History log comments.
Type		Type of analyzer used to filter file types include with selected(e.g. just C sources).

Help

/third_party/python/Parser/
H A D	tokenizer.h	`95 extern int _PyTokenizer_Get(struct tok_state , const char , const char *);`
H A D	pegen.c	`213 int type = _PyTokenizer_Get(p->tok, &start, &end); in _PyPegen_fill_token() 230 type = _PyTokenizer_Get(p->tok, &start, &end); in _PyPegen_fill_token()`
H A D	pegen_errors.c	`171 switch (_PyTokenizer_Get(p->tok, &start, &end)) { in _PyPegen_tokenize_full_source_to_check_for_errors()`
/third_party/python/Python/
H A D	Python-tokenize.c	`64 int type = _PyTokenizer_Get(it->tok, &start, &end); in tokenizeriter_next()`