-jM D S r SSKJr SrS/rSSKJr SSKrSSKJ r J
r
J r J r J
r
JrJrJrJrJrJr SSKJrJrJrJrJrJr SS KJ r J r SS
K J r J r J!r!J"r" SS K#J$r$ \( a SS K%J&r& SS
KJ'r' SSK(J)r)J*r*J+r+ Sr,\
\ \-\-4 \-\-/S4 r. " S S\\ 5 r/ " S S\!5 r0g)zCUse the HTMLParser library to parse HTML files that aren't too bad. ) annotationsMITHTMLParserTreeBuilder)
HTMLParserN) AnyCallablecastDictIterableListOptional
TYPE_CHECKINGTupleTypeUnion)
AttributeDictCDataComment DeclarationDoctypeProcessingInstruction)EntitySubstitution
UnicodeDammit)DetectsXMLParsedAsHTMLHTMLHTMLTreeBuilderSTRICTParserRejectedMarkup)
BeautifulSoup)NavigableString) _Encoding
_Encodings
_RawMarkupz html.parserc ` \ rS rSr% SrS\S' SrS\S' \S. S S jjrS \S
' S
\S' S \S' S S jr S!S jr S" S#S jjr
S"S$S jjr S%S jr \
R " S5 r\
R " S5 r\S&S j5 rS'S jrS'S jrS%S jrS(S jrS%S jrS%S jrS rg ))BeautifulSoupHTMLParser> replacestrREPLACEignoreIGNOREon_duplicate_attributesoupr r. &Union[str, _DuplicateAttributeHandler]c Xl X l UR R U l [ R
" U /UQ70 UD6 / U l U R 5 g N)r/ r. builderattribute_dict_classr __init__ already_closed_empty_element_initialize_xml_detector)selfr/ r. argskwargss O/mnt/data/Frawley/.venv/lib/python3.13/site-packages/bs4/builder/_htmlparser.pyr5 BeautifulSoupHTMLParser.__init__U sO &<#$(LL$E$E!D24262 -/) %%' z List[str]r6 c [ U5 er2 r )r8 messages r; error BeautifulSoupHTMLParser.errorp s #7++r= c D U R XSS9 U R USS9 g)zmHandle an incoming empty-element tag.
html.parser only calls this method when the markup looks like
.
F)handle_empty_elementcheck_already_closedN)handle_starttag
handle_endtag)r8 tagattrss r; handle_startendtag*BeautifulSoupHTMLParser.handle_startendtag s,
Se D
3U;r= c p U R 5 nU Hc u pVUc SnXT; aP U R nXpR :X a M, USU R 4; a XdU' MD [ [
U5 nU" XEU5 M_ XdU' Me U R R R ( a U R 5 u pOS=pU R R USSXHU S9n
U
bC U
R ( a2 U( a+ U R USS9 U R R U5 U R c U R! U5 gg)zHandle an opening tag, e.g. ''
:param handle_empty_element: True if this tag is known to be
an empty-element tag (i.e. there is not expected to be any
closing tag).
N )
sourceline sourceposFrD )r4 r. r, r* r _DuplicateAttributeHandlerr/ r3 store_line_numbersgetposrF is_empty_elementrG r6 append_root_tag_name_root_tag_encountered) r8 rH rI rC attr_dictkeyvalueon_duperN rO tagObjs r; rF 'BeautifulSoupHTMLParser.handle_starttag s. $(#<#<#> JC } 55kk) t|| 44%*cN "#=w GGIE2!&#% , 99 / /$(KKM !J %) )J** tY +
&"9"9>R
s ?
- - 4 4S 9 & & &s + 'r= c U( a+ XR ; a U R R U5 gU R R U5 g)zHandle a closing tag, e.g. ''
:param tag: A tag name.
:param check_already_closed: True if this tag is expected to
be the closing portion of an empty-element tag,
e.g. ''.
N)r6 remover/ rG )r8 rH rE s r; rG %BeautifulSoupHTMLParser.handle_endtag s: C+L+L$L
- - 4 4S 9 II # #C (r= c : U R R U5 g)z4Handle some textual data that shows up between tags.N)r/ handle_datar8 datas r; ra #BeautifulSoupHTMLParser.handle_data s d#r= z
^([0-9]+)(.*)z^([0-9a-f]+)(.*)c SnSnSnSnU R nUR S5 ( d UR S5 ( a USS nSnU R nSn [ X5 nUc SnUnO[ R " U5 u p#X#U4$ ! [ aG UR U5 nUb0 [ UR
5 S U5 nUR
5 S n Ntf = f)
aX Convert a numeric character reference into an actual character.
:param name: The number of the character reference, as
obtained by html.parser
:return: A 3-tuple (dereferenced, replacement_added,
extra_data). `dereferenced` is the dereferenced character
reference, or the empty string if there was no
reference. `replacement_added` is True if the reference
could only be dereferenced by replacing content with U+FFFD
REPLACEMENT CHARACTER. `extra_data` is a portion of data
following the character reference, which was deemed to be
normal data and not part of the reference at all.
rM F
xX N r ) &_DECIMAL_REFERENCE_WITH_FOLLOWING_DATA
startswith"_HEX_REFERENCE_WITH_FOLLOWING_DATAint
ValueErrorsearchgroupsr numeric_character_reference) clsname dereferencedreplacement_added
extra_databasereg real_namematchs r; (_dereference_numeric_character_reference@BeautifulSoupHTMLParser._dereference_numeric_character_reference s !&
88 ??3 4??3#7#78DD88C"& /DI$ L J.;.W.WXa.b +L
::- / JJt$E q 14 8 "\\^A .
/s B ACCc U R U5 u p#nU( a SU R l Ub U R U5 Ub U R U5 gg)zHandle a numeric character reference by converting it to the
corresponding Unicode character and treating it as textual
data.
:param name: Character number, possibly in hexadecimal.
TN)r| r/ contains_replacement_charactersra )r8 rt ru rv rw s r; handle_charref&BeautifulSoupHTMLParser.handle_charref" sV 7;6c6cdh6i3 8 '??CCDI D 4 s GS FC $ JQ (( ( !G (
(. CB"++
, << ><
<0 &* <,
<, /<, # <,
<,|)$$ .0ZZ-H*)+4F)G&4; 4;l
) &##
1r= r& c ^ \ rS rSr% SrSrS\S' SrS\S' \r S\S ' \ \
\ /r S
\S ' S \S
' Sr
S\S' S SU 4S jjjr S SS jjr\4SS jjrSrU =r$ )r iq zA Beautiful soup `bs4.builder.TreeBuilder` that uses the
:py:class:`html.parser.HTMLParser` parser, found in the Python
standard library.
Fr is_xmlT picklabler) NAMEz
Iterable[str]featuresz$Tuple[Iterable[Any], Dict[str, Any]] parser_argsTRACKS_LINE_NUMBERSc > [ 5 nS H nXS; d M
UR U5 nXdU' M! [ [ U ] " S0 UD6 U=( d / nU=( d 0 nUR U5 SUS' X4U l g)aB Constructor.
:param parser_args: Positional arguments to pass into
the BeautifulSoupHTMLParser constructor, once it's
invoked.
:param parser_kwargs: Keyword arguments to pass into
the BeautifulSoupHTMLParser constructor, once it's
invoked.
:param kwargs: Keyword arguments for the superclass constructor.
r- Fconvert_charrefsNr )dictpopsuperr r5 updater )r8 r
parser_kwargsr: extra_parser_kwargsargrY __class__s r; r5 HTMLParserTreeBuilder.__init__ s $ #f.C}
3+0C( / #T3=f=!'R %+
01,1
() '7r= c # Z # [ U[ 5 ( a USSS4v g/ nU( a UR U5 / nU( a UR U5 [ UUUSUS9nUR c [ S5 eUR UR UR UR 4v g7f)a Run any preliminary steps necessary to make incoming markup
acceptable to the parser.
:param markup: Some markup -- probably a bytestring.
:param user_specified_encoding: The user asked to try this encoding.
:param document_declared_encoding: The markup itself claims to be
in this encoding.
:param exclude_encodings: The user asked _not_ to try any of
these encodings.
:yield: A series of 4-tuples: (markup, encoding, declared encoding,
has undergone character replacement)
Each 4-tuple represents a strategy for parsing the document.
This TreeBuilder uses Unicode, Dammit to convert the markup
into Unicode, so the ``markup`` element of the tuple will
always be a string.
NFT)known_definite_encodingsuser_encodingsis_htmlexclude_encodingszPCould not convert input to Unicode, and html.parser will not accept bytestrings.)
isinstancer) rT r unicode_markupr original_encodingdeclared_html_encodingr )r8 markupuser_specified_encodingdocument_declared_encodingr r r dammits r; prepare_markup$HTMLParserTreeBuilder.prepare_markup s 2 fc " "4u- - 57 "
% + +,C D*, %
! !"< = %=) /
( 'b
%%((--66
s B)B+c $ U R u p4[ U[ 5 ( d eU R c eU" U R /UQ70 UD6n UR U5 UR 5 / Ul g! [ a n[ U5 eSnAff = f)z
:param markup: The markup to feed into the parser.
:param _parser_class: An HTMLParser subclass to use. This is only intended for use in unit tests.
N) r r r) r/ feedcloseAssertionErrorr r6 )r8 r
_parser_classr9 r: parseres r; r HTMLParserTreeBuilder.feed s
'' &#&&&&
yy$$$ tyy:4:6: * KK LLN /1+ * 'q) ) *s !A5 5
B? B
B)r )NN)r zOptional[Iterable[Any]]r zOptional[Dict[str, Any]]r: r )NNN)
r r$ r Optional[_Encoding]r r r zOptional[_Encodings]r zDIterable[Tuple[str, Optional[_Encoding], Optional[_Encoding], bool]])r r$ r z type[BeautifulSoupHTMLParser]r r )r r r r __doc__r r r
HTMLPARSERr r r r r r5 r r& r r
__classcell__)r s @r; r r q s FDItD# #T6 2Hm255 !%$ 0426 8, 8 0 8 8 8B 8<:>26 FF "5F %8 F
0 F
N
FP Ul 1 1r= )1r
__future__r __license____all__ html.parserr r typingr r r r
r r r
r r r r bs4.elementr r r r r r
bs4.dammitr r bs4.builderr r r r bs4.exceptionsr bs4r r! bs4._typingr" r# r$ r r) rP r& r r r= r; r s I " # 9 0!+
%tCH~sC&@$&F G p1j*@ p1f T1O T1r=