Searched refs:untokenize (Results 1 - 3 of 3) sorted by relevance
| /third_party/python/Lib/test/ |
| H A D | test_tokenize.py | 3 from tokenize import (tokenize, _tokenize, untokenize, NUMBER, NAME, OP, namespace
971 return untokenize(result).decode('utf-8')
1507 self.assertEqual(u.untokenize(iter([token])), 'Hello ')
1509 self.assertEqual(u.untokenize(iter(tokens)), 'Hello ')
1511 self.assertEqual(untokenize(iter(tokens)), b'Hello ')
1518 Test roundtrip for `untokenize`. `f` is an open file or a string.
1521 tokenize.untokenize(), and the latter tokenized again to 2-tuples.
1524 When untokenize bugs are fixed, untokenize with 5-tuples should
1538 bytes_from2 = untokenize(tokens
[all...] |
| /third_party/python/Lib/lib2to3/pgen2/ |
| H A D | tokenize.py | 38 "generate_tokens", "untokenize"]
185 def untokenize(self, iterable): member in Untokenizer
314 def untokenize(iterable): function
327 newcode = untokenize(t1)
333 return ut.untokenize(iterable)
|
| /third_party/python/Lib/ |
| H A D | tokenize.py | 43 "untokenize", "TokenInfo"]
187 def untokenize(self, iterable): member in Untokenizer
261 def untokenize(iterable): function
276 newcode = untokenize(t1)
282 out = ut.untokenize(iterable)
|
Completed in 5 milliseconds