d= Z?d> Z@i d?d@dAdBdCdDdEdFdFdFdGdHdIdJdKdLdMdNdOdPdQdQdRdRdSdSdTdTdUdVdWdXdYdZd[d\iZAd]d^d_d`ZBda ZCdb ZDdc ZEdd ZFde ZGdf ZHdg ZIdh ZJdi ZKdjS )kr c d| _ d| _ g | _ | d| _ d| _ g | _ d| _ i | _ dS )zInitialize the scanner.F TN) done
flow_leveltokensfetch_stream_start tokens_takenindentindentsallow_simple_keypossible_simple_keysr s r
r zScanner.__init__0 sg
!!! , !% %'!!!r c | r(| | (| j r'|sdS |D ] }t | j d | r dS !dS )NTr F)need_more_tokensfetch_more_tokensr
isinstance)r choiceschoices r
check_tokenzScanner.check_tokenq s ##%% % " " $ $ $ ##%% % ;
t!
dk!nf55 44 ur c | r(| | (| j r
| j d S d S )Nr )r) r* r r' s r
peek_tokenzScanner.peek_token} s[ ##%% % " " $ $ $ ##%% % ; ;q> !4r c | r(| | (| j r*| xj dz
c_ | j d S d S )Nr r )r) r* r r" popr' s r
get_tokenzScanner.get_token sz ##%% % " " $ $ $ ##%% % ; & " ;??1%% % & &r c | j rdS | j sdS | | | j k rdS d S )NFT)r r stale_possible_simple_keysnext_possible_simple_keyr" r' s r
r) zScanner.need_more_tokens s\ 9 5{ 4
''))) ( ( * *d.? ? ?4 @ ?r c 4 | | | | j | }|dk r| S |dk r(| r| S |dk r(| r| S |dk r(|
r| S |dk r| S |dk r|
S |dk r| S |dk r| S |d k r| S |dk r(| r| S |d
k r(| r| S |d k r(| r| S |d k r| S |d
k r| S |dk r| S |dk r| j s| S |dk r| j s| S |dk r| S |dk r| S | r| S tC dd d|z | " )N %-.[{]},?:r &!|>'"z!while scanning for the next tokenz.found character %r that cannot start any token)#scan_to_next_tokenr5
unwind_indentr peekfetch_stream_endcheck_directivefetch_directivecheck_document_startfetch_document_startcheck_document_endfetch_document_endfetch_flow_sequence_startfetch_flow_mapping_startfetch_flow_sequence_endfetch_flow_mapping_endfetch_flow_entrycheck_block_entryfetch_block_entry check_key fetch_key check_value fetch_value fetch_alias fetch_anchor fetch_tagr
fetch_literal fetch_folded fetch_single fetch_double check_plain fetch_plainr get_markr chs r
r* zScanner.fetch_more_tokens s2
!!!
'')))
4;''' YY[[ ::((** * 99--//9'')) ) 9922449,,.. . 9900229**,, , 991133 3 990022 2 99//11 1 99..00 0 99((** * 99//119))++ + 99 ))9>>## # 99))++9##%% % 99##%% % 99$$&& & 99>>## # 99T_9%%'' ' 99T_9$$&& & ::$$&& & ::$$&& & &##%% % >@2E
! ! !r c ` d }| j D ]#}| j | }| |j |k r|j }$|S r )r& r )r min_token_numberlevelkeys r
r6 z Scanner.next_possible_simple_key sM . 4 4E+E2C '3+;>N+N+N# r c t | j D ]j}| j | }|j | j k s| j |j z
dk r8|j r)t d|j d| | j |= kd S )Ni while scanning a simple keycould not find expected ':')listr& r r r r r rg )r rl rm s r
r5 z"Scanner.stale_possible_simple_keys s $344 5 5E+E2Cx49$$z#)+d22< L&'Dch 94==??L L L-e4 5 5r c 0 | j o| j | j k }| j rv| | j t
| j z }t ||| j | j
| j | }|| j | j < d S d S r )
r r# r r% remove_possible_simple_keyr" lenr r r r rg r& )r r r rm s r
save_possible_simple_keyz Scanner.save_possible_simple_key' s &E4;$++E = + + - - - ,S-=-==LL(J 4;
I IC9$55666 r c | d | d| _ | j | d S )Nr F)rJ rs r% r rx scan_directiver' s r
rN zScanner.fetch_directive s^
2
''))) %
4..0011111r c : | t d S r )fetch_document_indicatorDocumentStartTokenr' s r
rP z Scanner.fetch_document_start s %%&899999r c : | t d S r )r DocumentEndTokenr' s r
rR zScanner.fetch_document_end s %%&677777r c ( | d | d| _ | }| d | }| j ||| d S )Nr F )rJ rs r% rg forwardr rx r
TokenClass
start_markend_marks r
r z Scanner.fetch_document_indicator s
2
''))) % ]]__
Q==?? ::j(;;<<<<?????r c | | xj dz
c_ d| _ | }| | }| j ||| d S )Nr T)ru r r% rg r r rx r s r
r z#Scanner.fetch_flow_collection_start s
%%'''
1 !% ]]__
==?? ::j(;;<<<<*h??@@@@@r c | j s| j s$t d d d| | | j r<| }| j t || n d| _ | | }|
| }| j t || d S )Nz%sequence entries are not allowed hereT) r r% r rg r{ r r rx BlockSequenceStartTokenrs r BlockEntryTokenr r r r s r
rY zScanner.fetch_block_entry s (
)"4?
) ) )
t{++
H}} ""#:4#F#FGGG
!%
''))) ]]__
==?? ?:x@@AAAAAr c | j s| j s$t d d d| | | j r<| }| j t || | j | _ | | }|
| }| j t || d S )Nz!mapping keys are not allowed here) r r% r rg r{ r r rx BlockMappingStartTokenrs r KeyTokenr s r
r[ zScanner.fetch_key s G (
)"4;
) ) )
t{++
G}} ""#9$#E#EFFF %)O 3
''))) ]]__
==?? 8J99:::::r c | j | j v r| j | j }| j | j = | j |j | j z
t
|j |j | j sZ| |j r@| j |j | j z
t |j |j d| _ n| j s+| j s$t d d d|
| j sV| | j r<|
}| j t || | j | _ | |
}| |
}| j t# || d S )NFz#mapping values are not allowed here)r r& r insertr r" r r r{ r r r% r rg rx rs r
ValueToken)r rm r r r s r
r] zScanner.fetch_value! s ?d 7 7 7 +DO> >r c B | j rdS | d dv S r r r' s r
r\ zScanner.check_value r r c | }|dvp(| d dvo|dk p | j o|dv S )Nu
-?:,[]{}#&*!|>'"%@`r r r: z?:)rK r rh s r
re zScanner.check_plain sY YY[[II QIIaLL(CC P 3Y Nt+>+M2: Qr c | j dk r,| dk r| d}|s| dk r,| | dk ,| dk r@| dvr*| | dv*| r| j sd| _ nd}|d S d S )Nr u F #
T)r rK r scan_line_breakr r% )r founds r
rI zScanner.scan_to_next_token s ( :??tyy{{h 6 6 LLNNN
))++$$ ))++$$yy{{c!!iikk)AAALLNNN iikk)AAA##%%
1,0D)
r c 6 | }| | | }d }|dk r*| | }| }n|dk r*| | }| }nT| }| dvr*| | dv*| | t |||| S )NYAMLTAGr )rg r scan_directive_namescan_yaml_directive_valuescan_tag_directive_valuerK scan_directive_ignored_lineDirectiveToken)r r namevaluer s r
r zScanner.scan_directive s ]]__
''
33 6>>22:>>E}}HH
U]]11*==E}}HH}}H))++%=== ))++%=== ((444 dE:x@@@r c P d}| | }d|cxk rdk s$n d|cxk rdk sn d|cxk rdk sn |dv rK|d z
}| | }d|cxk rdk 'n d|cxk rdk 6n d|cxk rdk En |dv K|s't d
|d |z | | | }| | | }|d vr't d
|d |z | |S )
Nr 09AZaz-_r while scanning a directive6expected alphabetic or numeric character, but found %r
)rK r rg r r )r r lengthri r s r
r zScanner.scan_directive_name& s
YYv
R 3 #"2"2"2"2s"2"2"2"2cR6F6F6F6F36F6F6F6F:: aKF6""B R 3 #"2"2"2"2s"2"2"2"2cR6F6F6F6F36F6F6F6F:: + ;ZL --//+ +
+ F## V
YY[[
. . . ;ZL --//+ +
+ r c N | dk r,| | dk ,| | }| dk r9t d|d| z | | | | }| dvr9t d|d| z | ||fS )Nr r; r z%expected a digit or '.', but found %rr z%expected a digit or ' ', but found %r)rK r scan_yaml_directive_numberr rg )r r majorminors r
r z!Scanner.scan_yaml_directive_value; s iikkS LLNNN iikkS //
;; 99;;# ;Z;diikkIMMOO% %
%
//
;; 99;; 7 7 7 ;Z;diikkIMMOO% %
% u~ r c | }d|cxk rdk s)n t d|d|z | d}d| | cxk rdk r*n n'|dz
}d| | cxk rdk %n t | | }| | |S )Nr r r z expected a digit, but found %rr r )rK r rg intr r )r r ri r r s r
r z"Scanner.scan_yaml_directive_numberL s
YY[[r S ;Z4r94==??L L
LTYYv&&----#----- aKF TYYv&&----#----DKK''(( V r c n | dk r,| | dk ,| | }| dk r,| | dk ,| | }||fS )Nr )rK r scan_tag_directive_handlescan_tag_directive_prefix)r r handler s r
r z Scanner.scan_tag_directive_valueY s iikkS LLNNN iikkS //
;;iikkS LLNNN iikkS //
;; r c | d| }| }|dk r't d|d|z | |S )N directiver r expected ' ', but found %r)scan_tag_handlerK r rg r r r ri s r
r z!Scanner.scan_tag_directive_handlec s^ $$[*==
YY[[
99 ;Z025t}}H H
H r c | d| }| }|dvr't d|d|z | |S )Nr r r r ) scan_tag_urirK r rg r s r
r z!Scanner.scan_tag_directive_prefixl sa !!+z::
YY[[
. . . ;Z025t}}H H
H r c | dk r,| | dk ,| dk r@| dvr*| | dv*| }|dvr't d|d|z | | d S )Nr r r r 0expected a comment or a line break, but found %rrK r r rg r r r ri s r
r z#Scanner.scan_directive_ignored_lineu s iikkS LLNNN iikkS 99;;# ))++%=== ))++%===
YY[[
- - - ;ZF "mmoo/ /
/
r c ( | }| }|dk rd}nd}| d}| | }d|cxk rdk s$n d|cxk rdk sn d |cxk rd
k sn |d v rK|d z
}| | }d|cxk rdk 'n d|cxk rdk 6n d |cxk rd
k En |d v K|s*t d
|z |d|z | | | }| | | }|dvr*t d
|z |d|z | | } |||| S )Nr aliasanchorr r r r r r r r r zwhile scanning an %sr u
?:,]}%@`)rg rK r r r ) r r r indicatorr r ri r r s r
r zScanner.scan_anchor s ]]__
IIKK DDD
YYv
R 3 #"2"2"2"2s"2"2"2"2cR6F6F6F6F36F6F6F6F:: aKF6""B R 3 #"2"2"2"2s"2"2"2"2cR6F6F6F6F36F6F6F6F:: + 5 ', but found %rr rD Fr Tzwhile scanning a tagr )rg rK r r r r TagToken) r r ri r suffixr
use_handler r s r
r zScanner.scan_tag s ]]__
YYq\\
99F LLOOO&&uj99Fyy{{c!!"#8*4tyy{{B
) ) )
LLNNNN
.
.
.FF LLNNNNF J 55599!%J! YYv&& 555 F
--eZ@@ &&uj99F
YY[[
. . . 5z025t}}H H
H ==??z8444r c < |dk rd}nd}g }| }| | | \ }}| | | j dz }|dk rd}|)| \ }} }
t
|| } n ||z dz
} | | \ }}
d} | j | k rx| dk r_|
| | dv}
d}| | d vr |dz
}| | d v | | | | | |
} | | \ }}
| j | k rf| dk rN|r6| d
k r0|
r.| dvr|s| d n| | nn$| j | k r| dk _|dur| | |du r|
| t d | d||
| S ) NrF TFr r8 r r
r )rg r scan_block_scalar_indicators scan_block_scalar_ignored_liner# scan_block_scalar_indentationmaxscan_block_scalar_breaksr rK extendrx r r ScalarTokenjoin)r r foldedchunksr chomping increment
min_indentbreaks
max_indentr r#
line_breakleading_non_spacer s r
r zScanner.scan_block_scalar s C<<FFF]]__
" ? ?
K K) ++J777 []
>>J +/+M+M+O+O (FJZ00FF )!+F # < >&'F
Z MMOO- - -
<
BIA~~"#BJV
) ) )
LLNNNBTzz99 #HH $H
YY[[
. . . >
O --//+ +
+ ""r c | dk r,| | dk ,| dk r@| dvr*| | dv*| }|dvr't d|d|z | | d S )Nr r r r' r r r s r
r z&Scanner.scan_block_scalar_ignored_lineD s iikkS LLNNN iikkS 99;;# ))++%=== ))++%===
YY[[
- - - >
FKMMOO% %
%
r c g }d}| }| dv r| dk r<| | | }n&| | j |k r| j }| dv |||fS )Nr
r )rg rK rx r r r )r r r! r s r
r z%Scanner.scan_block_scalar_indentationR s
==??iikk 444yy{{c!!
d 2 2 4 4555 ==?? ;++!%J iikk 444 z8++r c l g }| }| j |k rO| dk r7| | j |k r| dk 7| dv r| | | }| j |k rO| dk r7| | j |k r| dk 7| dv ||fS )Nr
)rg r rK r rx r )r r# r r s r
r z Scanner.scan_block_scalar_breaksa s ==??kF""tyy{{c'9'9 LLNNN kF""tyy{{c'9'9iikk 333 MM$..00 1 1 1}}H+&&499;;#+=+= +&&499;;#+=+= iikk 333
x r c |dk rd}nd}g }| }| }| | | || | |k rj| | || | | || | |k j| | }t
d | d||| S )NrH TFr )rg rK r r scan_flow_scalar_non_spacesscan_flow_scalar_spacesr r )r r doubler r quoter s r
r zScanner.scan_flow_scalarn s C<<FFF]]__
d66vzJJKKKiikkU"" MM$66vzJJ K K K MM$::6:NN O O O iikkU""
==??2776??E:x r r r8 r bt nr v f r
er rH \/N
_ Lu
Pu
r
)xuUc
g } d}| | dvr |dz
}| | dv |r=| | | | | | }|sK|dk rE| d dk r,| d | d n|r|dk s|s/|dv r+| | | n|r|dk r| | }|| j v r6| | j | | nU|| j v r| j | }| t
| D ]U}| | d vr| | |
|| n)t d
|d|z | |S )NTr u '"\
r rG r
z"\r@ 0123456789ABCDEFabcdefz%while scanning a double-quoted scalarz@expected escape sequence of %d hexadecimal numbers, but found %r r, z!found unknown escape character %r)rK rx r r ESCAPE_REPLACEMENTS ESCAPE_CODESranger rg r chrr r scan_flow_scalar_breaks)r r0 r r r ri kcodes r
r. z#Scanner.scan_flow_scalar_non_spaces s & F))F##+LLL! ))F##+LLL
%
dkk& 1 1222 V$$$B
bDjjTYYq\\T-A-A
d### Q
R4ZZZB&LL
b!!!
B$JJ YY[[111MM$":2">???LLNNNN4,,, ! .r 2FLLNNN "6]] Q Q 99Q<%?@D
#Q #Q Q H t{{6 2 2B77DMM#d)),,,LL((((111((***MM$">">vz"R"RSSSS&'NPZ ?" DdmmooW W W
M& r c \ g }d}| | dv r |dz
}| | dv | | }| | | }|dk r$t d|d| |dv rs| }| || }|dk r| | n|s| d | | n| | |S )
Nr r r r8 while scanning a quoted scalarz found unexpected end of streamr, r r ) rK r r r rg r rT rx r ) r r0 r r r whitespacesri r" r s r
r/ z Scanner.scan_flow_scalar_spaces s= ii 5(( aKF ii 5((kk&)) V
YY[[
:: ?4dmmooG G
G
)
)
) --//J11&*EEFT!!
j))))
#
c""" MM& ! ! ! ! MM+ & & &
r c g } | d }|dk s|dk r;| d dv r$t d|d| | dv r*| | dv *| d v r(| | n|S )
NTr r r r rX z#found unexpected document separatorr r, )r rK r rg r rx r )r r0 r r r s r
rT z Scanner.scan_flow_scalar_breaks s
[[^^F%6U?? ! (CCC"#CZ=t}}P P P))++&& ))++&&yy{{ 444
d 2 2 4 45555
r c g }| }|}| j dz }g } d}| dk rn | | }|dv s7|dk r&| |dz d| j rdndz v s | j r|d v rn|dz
}W|dk rnd
| _ | | | | | | | | }| || }|r*| dk s| j s | j
|k rn-t d | d|| S ) Nr Tr r r rB z,[]{}r z,?[]{}F)
rg r# rK r r% r rx r r scan_plain_spacesr r r )r r r r r# spacesr ri s r
r zScanner.scan_plain s ]]__
Q
Fyy{{c!!
YYv&&444 #II $ &( 3 37R59_)M#8O !O !O O!O02h!
{{$)D ! MM& ! ! ! MM$++f-- . . . LL }}H++FJ??F
TYY[[C / / O 004 f0D0D/ 0 2776??D*hGGGr c g }d}| | dv r |dz
}| | dv | | }| | | }|dv rZ| }d| _ | d }|dk s|dk r| d d v rd S g } | d
v r| dk r| na| | | d }|dk s|dk r| d d v rd S | d
v |d k r| | n| s| d | | n|r| | |S ) Nr r r r, Tr r r r r* r )rK r r r r% rx r )
r r# r r r rY ri r" r r s
r
r\ zScanner.scan_plain_spaces s ii 3&& aKF ii 3&&kk&)) V
YY[[
' ' ' --//J$(D ![[^^F%6U?? ! (CCCF))++!88899;;#%%LLNNNNMM$"6"6"8"8999 ![[^^F %6U?? $ ! 0K K K ))++!888 T!!
j))))
#
c""" MM& ! ! ! !
' MM+ & & &
r c | }|dk r*t d|z |d|z | d}| | }|dk rd|cxk rdk s$n d|cxk rd k sn d
|cxk rd k sn |d v rK|dz
}| | }d|cxk rdk 'n d|cxk rd k 6n d
|cxk rd k En |d v K|dk r?| | t d|z |d|z | |dz
}| | }| | |S )
NrD while scanning a %szexpected '!', but found %rr r r r r r r r r )rK r rg r r )r r r ri r r s r
r zScanner.scan_tag_handleD s YY[[
99 4t ;Z025t}}H H
H
YYv
99""""s""""cR&6&6&6&63&6&6&6&6#:J:J:J:Js:J:J:J:JTzz! YYv&& """"s""""cR&6&6&6&63&6&6&6&6#:J:J:J:Js:J:J:J:JTzz Syy V$$$"#84#?4r94==??L L L aKF F## V r c g }d}| | }d|cxk rdk s$n d|cxk rdk sn d|cxk rdk sn |dv r|d k ri| | | | | d}| | || n|d
z
}| | }d|cxk rdk n d|cxk rdk n d|cxk rdk n |dv |r?| | | | | d}|s*t d |z |d |z | d
| S )Nr r r r r r r z-;/?:@&=+$,_.!~*'()[]%r9 r zwhile parsing a %szexpected URI, but found %rr )rK rx r r scan_uri_escapesr rg r )r r r r r ri s r
r zScanner.scan_tag_uri\ s
YYv
R 3 #"2"2"2"2s"2"2"2"2cR6F6F6F6F36F6F6F6F222Syy
dkk& 1 1222 V$$$
d 3 3D* E EFFFF! 6""B R 3 #"2"2"2"2s"2"2"2"2cR6F6F6F6F36F6F6F6F222 MM$++f-- . . . LL F H 3d :J025t}}H H
Hwwv r c g }| }| dk r| t d D ]V}| | dvr=t d|z |d| | z | W| t
| d d | d | dk t | d }n4# t $ r'}t d|z |t | | d }~ww xY w|S )Nr9 r
rN r` zCexpected URI escape sequence of 2 hexadecimal numbers, but found %rrO zutf-8) rg rK r rR r rx r r bytesdecodeUnicodeDecodeErrorstr)r r r codesr rU r excs r
rb zScanner.scan_uri_escapesu sW }}iikkS LLNNN1XX
=
=99Q<<'???&'
!
! LLNNNIrr N)Lr r r
r r. r0 r3 r) r* r6 r5 ru rs rJ r{ r! rL rN rP rR r rS rT r rU rV r rW rY r[ r] r^ r_ r` ra rb r rc rd r rf rM rO rQ rX rZ r\ re rI r r r r r r r r r r r r r r r r rP rQ r. r/ rT r r\ r r rb r r r r
r r . s\ =' =' ='B
& & & h! h! h!X
5 5 5 = = =" ; ; ;: : :0 % % % &
2
2
2: : :8 8 8= = = A A A@ @ @= = ="= = =< < <= = =" A A A B B BB; ; ;86= 6= 6=p 9 9 9 : : : , , ,+ + ++ + + : : :+ + +* * * 9 9 9 . . . ; ; ;
? ? ?? ? ?Q Q Q*! ! ! FA A A& * " "7 "7 "7H'5 '5 '5RJ J JX&# &# &#P
,
,
, 0
!" #$ % , L ) ) ) V 0 $'H 'H 'HR# # #J 0 2 & r N)__all__errorr r r r r r r r
rm s 6 n
% " " " " " " ? m m m m m m m m m mr