html-to-markdown 2.24.6 → 2.25.0

data/rust-vendor/markup5ever_rcdom/xml5lib-tests/tokenizer/README.md

@@ -1,92 +0,0 @@
-Tokenizer tests
-===============
-
-The test format is [JSON](http://www.json.org/). This has the advantage
-that the syntax allows backward-compatible extensions to the tests and
-the disadvantage that it is relatively verbose.
-
-Basic Structure
----------------
-
-    {"tests": [
-        {"description": "Test description",
-        "input": "input_string",
-        "output": [expected_output_tokens],
-        "initialStates": [initial_states],
-        "lastStartTag": last_start_tag,
-        "ignoreErrorOrder": ignore_error_order
-        }
-    ]}
-
-Multiple tests per file are allowed simply by adding more objects to the
-"tests" list.
-
-`description`, `input` and `output` are always present. The other values
-are optional.
-
-### Test set-up
-
-`test.input` is a string containing the characters to pass to the
-tokenizer. Specifically, it represents the characters of the **input
-stream**, and so implementations are expected to perform the processing
-described in the spec's **Preprocessing the input stream** section
-before feeding the result to the tokenizer.
-
-If `test.doubleEscaped` is present and `true`, then `test.input` is not
-quite as described above. Instead, it must first be subjected to another
-round of unescaping (i.e., in addition to any unescaping involved in the
-JSON import), and the result of *that* represents the characters of the
-input stream. Currently, the only unescaping required by this option is
-to convert each sequence of the form \\uHHHH (where H is a hex digit)
-into the corresponding Unicode code point. (Note that this option also
-affects the interpretation of `test.output`.)
-
-`test.initialStates` is a list of strings, each being the name of a
-tokenizer state. The test should be run once for each string, using it
-to set the tokenizer's initial state for that run. If
-`test.initialStates` is omitted, it defaults to `["data state"]`.
-
-`test.lastStartTag` is a lowercase string that should be used as "the
-tag name of the last start tag to have been emitted from this
-tokenizer", referenced in the spec's definition of **appropriate end tag
-token**. If it is omitted, it is treated as if "no start tag has been
-emitted from this tokenizer".
-
-### Test results
-
-`test.output` is a list of tokens, ordered with the first produced by
-the tokenizer the first (leftmost) in the list. The list must mach the
-**complete** list of tokens that the tokenizer should produce. Valid
-tokens are:
-
-    ["DOCTYPE", name, public_id, system_id, correctness]
-    ["StartTag", name, {attributes}*, true*]
-    ["StartTag", name, {attributes}]
-    ["EndTag", name]
-    ["Comment", data]
-    ["Character", data]
-    "ParseError"
-
-`public_id` and `system_id` are either strings or `null`. `correctness`
-is either `true` or `false`; `true` corresponds to the force-quirks flag
-being false, and vice-versa.
-
-When the self-closing flag is set, the `StartTag` array has `true` as
-its fourth entry. When the flag is not set, the array has only three
-entries for backwards compatibility.
-
-All adjacent character tokens are coalesced into a single
-`["Character", data]` token.
-
-If `test.doubleEscaped` is present and `true`, then every string within
-`test.output` must be further unescaped (as described above) before
-comparing with the tokenizer's output.
-
-`test.ignoreErrorOrder` is a boolean value indicating that the order of
-`ParseError` tokens relative to other tokens in the output stream is
-unimportant, and implementations should ignore such differences between
-their output and `expected_output_tokens`. (This is used for errors
-emitted by the input stream preprocessing stage, since it is useful to
-test that code but it is undefined when the errors occur). If it is
-omitted, it defaults to `false`.
-

data/rust-vendor/markup5ever_rcdom/xml5lib-tests/tokenizer/comments.test

@@ -1,274 +0,0 @@
-{"tests": [
-
-
-{"description":"Comment",
-"input":"<!--comment-->",
-"output":[["Comment", "comment"]]
-},
-
-{"description":"--Comment",
-"input":"<!----comment -->",
-"output":[["Comment", "--comment "]]
-},
-
-{"description":"--Comment-",
-"input":"<!----comment--->",
-"output":[["Comment", "--comment-"]]
-},
-
-{"description":"Error comment --!>",
-"input":"<!----!>",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"EOF inside comment",
-"input":"<!----!",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"EOF inside comment 2",
-"input":"<!----",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"EOF inside comment 3",
-"input":"<!--->",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"EOF inside comment 4",
-"input":"<!-----",
-"output":["ParseError", ["Comment", "-"]]
-},
-
-{"description":"EOF inside comment 5",
-"input":"<!-->",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"EOF inside comment 6",
-"input":"<!--",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"EOF inside comment 7",
-"input":"<!--x",
-"output":["ParseError", ["Comment", "x"]]
-},
-
-{"description":"EOF inside comment 8",
-"input":"<!--<",
-"output":["ParseError", ["Comment", "<"]]
-},
-
-{"description":"EOF inside comment 9",
-"input":"<!--<!",
-"output":["ParseError", ["Comment", "<!"]]
-},
-
-{"description":"EOF inside comment 10",
-"input":"<!--<!-",
-"output":["ParseError", ["Comment", "<!"]]
-},
-
-{"description":"EOF inside comment 11",
-"input":"<!--<!--",
-"output":["ParseError", ["Comment", "<!"]]
-},
-
-{"description":"EOF inside comment 12",
-"input":"<!--<!--!",
-"output":["ParseError", "ParseError", ["Comment", "<!"]]
-},
-
-{"description":"<!-- inside comment",
-"input":"<!--<!--!>",
-"output":["ParseError", "ParseError", ["Comment", "<!"]]
-},
-
-{"description":"<!-- inside comment 2",
-"input":"<!--<!---",
-"output":["ParseError", "ParseError", ["Comment", "<!-"]]
-},
-
-{"description":"<!-- inside comment 3",
-"input":"<!--<!--->",
-"output":["ParseError", ["Comment", "<!-"]]
-},
-
-{"description":"<!-- inside comment 4",
-"input":"<!--<!--x",
-"output":["ParseError", "ParseError", ["Comment", "<!--x"]]
-},
-
-{"description":"<!-- inside comment 5",
-"input":"<!--<!--x-",
-"output":["ParseError", "ParseError", ["Comment", "<!--x"]]
-},
-
-{"description":"<!-- inside comment 6",
-"input":"<!--<!--x--",
-"output":["ParseError", "ParseError", ["Comment", "<!--x"]]
-},
-
-{"description":"<!-- inside comment 7",
-"input":"<!--<!--x-->",
-"output":["ParseError", ["Comment", "<!--x"]]
-},
-
-{"description":"<!-- inside comment 8",
-"input":"<!--<!-x",
-"output":["ParseError", ["Comment", "<!-x"]]
-},
-
-{"description":"<!-- inside comment 9",
-"input":"<!--<!-x-",
-"output":["ParseError", ["Comment", "<!-x"]]
-},
-
-{"description":"<!-- inside comment 10",
-"input":"<!--<!-x--",
-"output":["ParseError", ["Comment", "<!-x"]]
-},
-
-{"description":"<!-- inside comment 11",
-"input":"<!--<!x",
-"output":["ParseError", ["Comment", "<!x"]]
-},
-
-{"description":"<!-- inside comment 12",
-"input":"<!--<!x-",
-"output":["ParseError", ["Comment", "<!x"]]
-},
-
-{"description":"<!-- inside comment 13",
-"input":"<!--<!x--",
-"output":["ParseError", ["Comment", "<!x"]]
-},
-
-{"description":"<!-- inside comment 14",
-"input":"<!--<<!--x-->",
-"output":["ParseError", ["Comment", "<<!--x"]]
-},
-
-{"description":"<!-- inside comment 15",
-"input":"<!--<!<!--x-->",
-"output":["ParseError", ["Comment", "<!<!--x"]]
-},
-
-{"description":"<!-- inside comment 16",
-"input":"<!--<!-<!--x-->",
-"output":["ParseError", ["Comment", "<!-<!--x"]]
-},
-
-{"description":"EOF inside comment 13",
-"input":"<!----!->",
-"output":["ParseError", ["Comment", "--!->"]]
-},
-
-{"description":"EOF inside comment 14",
-"input":"<!----!x>",
-"output":["ParseError", ["Comment", "--!x>"]]
-},
-
-{"description":"EOF inside comment 15",
-"input":"<!-----x>",
-"output":["ParseError", ["Comment", "---x>"]]
-},
-
-{"description":"Tiny Bogus Comment",
-"input":"<!>",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"<head> in Comment",
-"input":"<!--<head>-->",
-"output":[["Comment", "<head>"]]
-},
-
-{"description":"Short Bogus Comment",
-"input":"<!-->",
-"output":["ParseError", ["Comment", ""]]
-},
-
-{"description":"Short Bogus Comment2",
-"input":"<!-->test",
-"output":["ParseError", ["Comment", ""], ["Character", "test"]]
-},
-
-{"description":"Comments 1",
-"input":"<!----!-->",
-"output":[["Comment", "--!"]]
-},
-
-{"description":"Comments 2",
-"input":"<!----!x-->",
-"output":[["Comment", "--!x"]]
-},
-
-{"description":"Comments 3",
-"input":"<!----->",
-"output":[["Comment", "-"]]
-},
-
-{"description":"Comments 4",
-"input":"<!-----x-->",
-"output":[["Comment", "---x"]]
-},
-
-{"description":"Comments 5",
-"input":"<!--x-->",
-"output":[["Comment", "x"]]
-},
-
-{"description":"Comments 6",
-"input":"<!--<!-x-->",
-"output":[["Comment", "<!-x"]]
-},
-
-{"description":"Comments 7",
-"input":"<!--<!x-->",
-"output":[["Comment", "<!x"]]
-},
-
-{"description":"Comments 8",
-"input":"<!--<<!x-->",
-"output":[["Comment", "<<!x"]]
-},
-
-{"description":"Comments 9",
-"input":"<!--<<!-x-->",
-"output":[["Comment", "<<!-x"]]
-},
-
-{"description":"Comments 10",
-"input":"<!--<x-->",
-"output":[["Comment", "<x"]]
-},
-
-{"description":"Comments 11",
-"input":"<!--<>-->",
-"output":[["Comment", "<>"]]
-},
-
-{"description":"Comments 12",
-"input":"<!--<-->",
-"output":[["Comment", "<"]]
-},
-
-{"description":"Comments 13",
-"input":"<!--<--->",
-"output":[["Comment", "<-"]]
-},
-
-{"description":"Comments 13",
-"input":"<!--<!-->",
-"output":[["Comment", "<!"]]
-},
-
-{"description":"Comments long",
-"input":"<!---->",
-"output":[["Comment", ""]]
-}
-
-]}