RA ( ( ( s# /usr/lib64/python2.7/robotparser.pyR s 3 R0 c B s) e Z d Z d „ Z d „ Z d „ Z RS( so A rule line is a single "Allow:" (allowance==True) or "Disallow:" (allowance==False) followed by a path.c C s; | d k r | r t } n t j | ƒ | _ | | _ d S( NR ( R R- R9 R R; ( R R R; ( ( s# /usr/lib64/python2.7/robotparser.pyR Ÿ s c C s | j d k p | j | j ƒ S( NR ( R t startswith( R t filename( ( s# /usr/lib64/python2.7/robotparser.pyR: ¦ s c C s | j r d p d d | j S( Nt Allowt Disallows : ( R; R ( R ( ( s# /usr/lib64/python2.7/robotparser.pyRA © s ( RB RC RD R R: RA ( ( ( s# /usr/lib64/python2.7/robotparser.pyR0 œ s R( c B s2 e Z d Z d „ Z d „ Z d „ Z d „ Z RS( s? An entry has one or more user-agents and zero or more rulelinesc C s g | _ g | _ d S( N( R R/ ( R ( ( s# /usr/lib64/python2.7/robotparser.pyR ¯ s c C sj g } x' | j D] } | j d | d g ƒ q Wx* | j D] } | j t | ƒ d g ƒ q: Wd j | ƒ S( Ns User-agent: s R ( R t extendR/ R@ R? ( R t rett agentR ( ( s# /usr/lib64/python2.7/robotparser.pyRA ³ s c C s] | j d ƒ d j ƒ } x= | j D]2 } | d k r9 t S| j ƒ } | | k r# t Sq# Wt S( s2 check if this entry applies to the specified agentR4 i R ( R* R, R R R ( R R< RK ( ( s# /usr/lib64/python2.7/robotparser.pyR: » s c C s. x' | j D] } | j | ƒ r | j Sq Wt S( sZ Preconditions: - our agent applies to this entry - filename is URL decoded( R/ R: R; R ( R RF R ( ( s# /usr/lib64/python2.7/robotparser.pyR; È s ( RB RC RD R RA R: R; ( ( ( s# /usr/lib64/python2.7/robotparser.pyR( s R c B s# e Z d „ Z d „ Z d „ Z RS( c G s t j j | | Œ d | _ d S( NiÈ ( R- t FancyURLopenerR R ( R t args( ( s# /usr/lib64/python2.7/robotparser.pyR Ò s c C s d S( N( NN( R ( R R t realm( ( s# /usr/lib64/python2.7/robotparser.pyt prompt_user_passwdÖ s c C s( | | _ t j j | | | | | | ƒ S( N( R R- RL t http_error_default( R R t fpR t errmsgt headers( ( s# /usr/lib64/python2.7/robotparser.pyRP Û s ( RB RC R RO RP ( ( ( s# /usr/lib64/python2.7/robotparser.pyR Ñ s ( ( ( ( RD R R- t __all__R R0 R( RL R ( ( ( s# /usr/lib64/python2.7/robotparser.pyt s Š$