{>>> t $ $ $ $ $r. N)r1 r2 r r3 )r@ rA r r3 )__name__
__module__ __qualname____doc__r< sys version_inforI r. r, r0 r0 P sZ ..& & & &
7"" % % % % % % #"r. r0 r1 r2 r c # @ K t j t j t j t j h}g }d}| d dd } t | }t j
j rt | j
}t | D ]s\ }}\ }} \ }
} }
d} t j d| D ]G}
|
dk r |V g }d}d}n0|
dk rd}n&||v rd}n | r%| |k r | d d
| |z
z f d} t j |d d d
}|t j k rt- j | rd}n}t0 j dk rmt j
j r\t- j | rHt7 | dk rd}n*t7 | dk r|d d d k rd}nd}|r||v rd}| ||
f d}d} I|r| }u|r|V d S d S )a Generate a series of lines, one for each line in `source`.
Each line is a list of pairs, each pair is a token::
[('key', 'def'), ('ws', ' '), ('nam', 'hello'), ('op', '('), ... ]
Each pair has a token class, and the token text.
If you concatenate all the token texts, and then join them with newlines,
you should have your original `source` back, with two differences:
trailing white space is not preserved, and a final line with no newline
is indistinguishable from a final line with a newline.
r z
r Tz(
)Fr ws xxNr> keyr= r ) r INDENTDEDENTr r r
expandtabsreplacegenerate_tokensr
PYBEHAVIOR
soft_keywordsr0 r7 r- rer appendtok_namegetlowerNAMEkeyword iskeywordrN rO
issoftkeywordr )r1 ws_tokenslinecoltokgenr7 r# r$ sliner& _r(
mark_startpartmark_end tok_classis_start_of_lines r, source_token_linesrr ` sq u|U]HKHI"$D
C
q
!
!
)
)&$
7
7F
V
$
$F
~# D*622C5A&5I5I ' '1umudYa
HVU++ # # Dt||
)## '$**KKsdSj'9 :;;;!&J $ - 1 1% > > D D F Frr J EJ&& (// 2$) )W44 >7
2G ! ! !DN{4((1H
#'(@(J(J#K#K
!% s &A
A N)r r3 )rx r2 r r
)rJ rK rL rM r< r[ rP r. r, rt rt sF 8 8 8 8
r. rt bytesc t | d j }t j | d S )zDetermine the encoding for `source`, according to PEP 263.
`source` is a byte string: the text of the program.
Returns a string, the name of the encoding.
Tr )iter
splitlines__next__r detect_encoding)r1 r| s r, source_encodingr s8 F%%d++,,5H #H - -a 00r. )r r
r r
)r1 r2 r r )r1 r~ r r2 ) rM
__future__r r9 rz rd r^ rN r r typingr r r r r coverager coverage.typesr
r r r
r- NodeVisitorr0 rr rt r[ r rP r. r, r ss ) ( " " " " " "
7 7 7 7 7 7 7 7 7 7 7 7 7 7 5 5 5 5 5 5 5 5 h(
)
4 4 4 4 n
%
%
%
%
%co
%
%
% D D D DN 8 "/##3 1 1 1 1 1 1r.