Fuzzer benchmark

8 C libraries with memory errors, vetted by libFuzzer finding a crash within five minutes. Termo runs the AddressSanitizer build through its persistent driver, which keeps the library loaded between inputs ("a process per input" is how it ran before, shown for comparison); libFuzzer, AFL++ and the random baseline run inputs in-process. Every crash is replayed on one reference AddressSanitizer build, and only confirmed crashes count. Every tool gets the same seed inputs, token dictionary, input size limit and time budget, and one shared oracle decides when the bug is found. darwin arm64, 11 cores, Node v26.13.0; Termo 0.1.0, clang 23.1.5, AFL++ 5.03c.

Ranking

Each tool fuzzes each library 10 times: 10 separate runs of 60 seconds, each with a different random seed. On every library, the tools are ranked from 1 (best) to 4: first by how many of their 10 runs found the bug, then, to break ties, by the median time those runs took to find it (a run that never found it counts as the full 60 seconds). Tools with exactly the same result share the rank. A suite's score is a tool's average rank over that suite's libraries, and the overall score is the average of the suite scores, so a suite with many libraries counts the same as a small one. 1.00 means best on every library; 4.00 means last on every one.

#ToolScoreDocument parsersSmall languagesRuns that found the bugBest on
1libFuzzer1.731.801.6775 of 803 of 8 libraries
2AFL++2.673.002.3380 of 801 of 8 libraries
3Random baseline2.702.403.0046 of 803 of 8 libraries
4Termo2.902.803.0064 of 801 of 8 libraries

Time to find the bugs

For each kind of bug, the share of runs that had found it by each moment, over all the libraries of that kind. A line that rises early and ends high finds more bugs, sooner. Hover for the numbers.

Memory errors (crashes)Out-of-bounds reads and writes in C libraries, caught by AddressSanitizer: share of runs that had found the bug, by time (8 libraries, 10 runs each). Higher and further left is better.
TermolibFuzzerAFL++Random baseline
0%25%50%75%100%0.1 s1 s10 s60 sAFL++ 100%libFuzzer 94%Termo 80%Random baseline 58%
Table
ToolRunsFound by 1 sby 10 sby 60 s
Termo8046%58%80%
libFuzzer8060%93%94%
AFL++800%84%100%
Random baseline8050%54%58%

Document parsers

JSON, Markdown, YAML and XML parsers: memory errors caught by AddressSanitizer, confirmed by replaying the input on one reference build.

cJSON 1.7.10 · crash · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 1: 0.7 s, 6 inputsTermo, run 2: 0.3 s, 5 inputsTermo, run 3: 0.3 s, 11 inputsTermo, run 4: 0.3 s, 5 inputsTermo, run 5: 0.3 s, 7 inputsTermo, run 6: 0.2 s, 11 inputsTermo, run 7: 0.3 s, 4 inputsTermo, run 8: 0.3 s, 5 inputsTermo, run 9: 0.3 s, 6 inputsTermo, run 10: 0.3 s, 4 inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: 0.8 s, 4 inputsTermo, a process per input (before persistent mode), run 2: 1.0 s, 10 inputsTermo, a process per input (before persistent mode), run 3: 0.7 s, 6 inputsTermo, a process per input (before persistent mode), run 4: 0.7 s, 5 inputsTermo, a process per input (before persistent mode), run 5: 0.9 s, 8 inputsTermo, a process per input (before persistent mode), run 6: 0.7 s, 6 inputsTermo, a process per input (before persistent mode), run 7: 0.5 s, 4 inputsTermo, a process per input (before persistent mode), run 8: 0.5 s, 4 inputsTermo, a process per input (before persistent mode), run 9: 0.5 s, 4 inputsTermo, a process per input (before persistent mode), run 10: 0.7 s, 6 inputslibFuzzerlibFuzzer, run 1: 0.3 s, 6 inputslibFuzzer, run 2: 0.2 s, 12 inputslibFuzzer, run 3: 0.2 s, 7 inputslibFuzzer, run 4: 0.2 s, 22 inputslibFuzzer, run 5: 0.2 s, 13 inputslibFuzzer, run 6: 0.2 s, 19 inputslibFuzzer, run 7: 0.2 s, 6 inputslibFuzzer, run 8: 0.2 s, 6 inputslibFuzzer, run 9: 0.2 s, 7 inputslibFuzzer, run 10: 0.2 s, 15 inputsAFL++AFL++, run 1: 2.3 s, 14 inputsAFL++, run 2: 2.2 s, 13 inputsAFL++, run 3: 2.2 s, 13 inputsAFL++, run 4: 2.2 s, 13 inputsAFL++, run 5: 2.2 s, 13 inputsAFL++, run 6: 2.2 s, 13 inputsAFL++, run 7: 2.2 s, 13 inputsAFL++, run 8: 2.2 s, 13 inputsAFL++, run 9: 2.2 s, 13 inputsAFL++, run 10: 2.2 s, 13 inputsRandom baselineRandom baseline, run 1: 0.5 s, 0 inputsRandom baseline, run 2: 0.2 s, 0 inputsRandom baseline, run 3: 0.2 s, 0 inputsRandom baseline, run 4: 0.2 s, 0 inputsRandom baseline, run 5: 0.2 s, 0 inputsRandom baseline, run 6: 0.2 s, 0 inputsRandom baseline, run 7: 0.2 s, 0 inputsRandom baseline, run 8: 0.2 s, 0 inputsRandom baseline, run 9: 0.2 s, 0 inputsRandom baseline, run 10: 0.2 s, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo10 of 100.3 s6
Termo, a process per input (before persistent mode)10 of 100.7 s6
libFuzzer10 of 100.2 s10
AFL++10 of 102.2 s6
Random baseline10 of 100.2 s0

md4c 0.4.7 · crash · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 1: 0.5 s, 14 inputsTermo, run 2: 0.4 s, 75 inputsTermo, run 3: 0.5 s, 381 inputsTermo, run 4: 0.3 s, 56 inputsTermo, run 5: 0.3 s, 104 inputsTermo, run 6: 0.3 s, 94 inputsTermo, run 7: 0.4 s, 310 inputsTermo, run 8: 0.4 s, 336 inputsTermo, run 9: 0.4 s, 416 inputsTermo, run 10: 0.4 s, 147 inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: 1.6 s, 25 inputsTermo, a process per input (before persistent mode), run 2: 9.3 s, 110 inputsTermo, a process per input (before persistent mode), run 3: 0.5 s, 4 inputsTermo, a process per input (before persistent mode), run 4: 2.2 s, 25 inputsTermo, a process per input (before persistent mode), run 5: 5.1 s, 58 inputsTermo, a process per input (before persistent mode), run 6: 3.1 s, 38 inputsTermo, a process per input (before persistent mode), run 7: 2.8 s, 31 inputsTermo, a process per input (before persistent mode), run 8: 1.8 s, 21 inputsTermo, a process per input (before persistent mode), run 9: 3.9 s, 45 inputsTermo, a process per input (before persistent mode), run 10: 12 s, 133 inputslibFuzzerlibFuzzer, run 1: 0.4 s, 620 inputslibFuzzer, run 2: 0.2 s, 4 inputslibFuzzer, run 3: 0.3 s, 2.3k inputslibFuzzer, run 4: 0.3 s, 730 inputslibFuzzer, run 5: 0.2 s, 383 inputslibFuzzer, run 6: 0.4 s, 2.3k inputslibFuzzer, run 7: 0.2 s, 296 inputslibFuzzer, run 8: 0.2 s, 120 inputslibFuzzer, run 9: 0.2 s, 251 inputslibFuzzer, run 10: 0.2 s, 281 inputsAFL++AFL++, run 1: 2.5 s, 2.3k inputsAFL++, run 2: 2.4 s, 2.4k inputsAFL++, run 3: 2.4 s, 550 inputsAFL++, run 4: 2.5 s, 3.5k inputsAFL++, run 5: 2.4 s, 2.6k inputsAFL++, run 6: 2.4 s, 1.9k inputsAFL++, run 7: 2.4 s, 3.4k inputsAFL++, run 8: 2.4 s, 2.2k inputsAFL++, run 9: 2.4 s, 2.7k inputsAFL++, run 10: 2.4 s, 2.9k inputsRandom baselineRandom baseline, run 1: 0.3 s, 0 inputsRandom baseline, run 2: 0.2 s, 0 inputsRandom baseline, run 3: 0.2 s, 0 inputsRandom baseline, run 4: 0.2 s, 0 inputsRandom baseline, run 5: 0.2 s, 0 inputsRandom baseline, run 6: 0.2 s, 0 inputsRandom baseline, run 7: 0.2 s, 0 inputsRandom baseline, run 8: 0.2 s, 0 inputsRandom baseline, run 9: 0.2 s, 0 inputsRandom baseline, run 10: 0.2 s, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo10 of 100.4 s126
Termo, a process per input (before persistent mode)10 of 103.0 s11
libFuzzer10 of 100.2 s340
AFL++10 of 102.4 s1.0k
Random baseline10 of 100.2 s0

libyaml 0.1.4 · crash · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 1: 2.1 s, 4.1k inputsTermo, run 2: 0.3 s, 160 inputsTermo, run 3: 0.9 s, 2.6k inputsTermo, run 4: 0.5 s, 849 inputsTermo, run 5: 0.3 s, 17 inputsTermo, run 6: 0.9 s, 3.8k inputsTermo, run 7: 1.7 s, 8.3k inputsTermo, run 8: 0.8 s, 3.1k inputsTermo, run 9: 0.5 s, 1.4k inputsTermo, run 10: 1.3 s, 6.5k inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: 47 s, 583 inputsTermo, a process per input (before persistent mode), run 2: not found, 680 inputsTermo, a process per input (before persistent mode), run 3: not found, 676 inputsTermo, a process per input (before persistent mode), run 4: 29 s, 336 inputsTermo, a process per input (before persistent mode), run 5: 5.2 s, 58 inputsTermo, a process per input (before persistent mode), run 6: 10 s, 121 inputsTermo, a process per input (before persistent mode), run 7: not found, 687 inputsTermo, a process per input (before persistent mode), run 8: 57 s, 634 inputsTermo, a process per input (before persistent mode), run 9: 23 s, 262 inputsTermo, a process per input (before persistent mode), run 10: 9.3 s, 107 inputslibFuzzerlibFuzzer, run 1: 9.9 s, 367k inputslibFuzzer, run 2: not found, 462k inputslibFuzzer, run 3: 1.6 s, 60k inputslibFuzzer, run 4: 2.6 s, 99k inputslibFuzzer, run 5: 2.0 s, 75k inputslibFuzzer, run 6: 3.5 s, 161k inputslibFuzzer, run 7: 25 s, 1.2M inputslibFuzzer, run 8: 4.3 s, 192k inputslibFuzzer, run 9: not found, 93k inputslibFuzzer, run 10: 1.0 s, 37k inputsAFL++AFL++, run 1: 3.3 s, 20k inputsAFL++, run 2: 2.8 s, 16k inputsAFL++, run 3: 3.0 s, 21k inputsAFL++, run 4: 3.4 s, 35k inputsAFL++, run 5: 2.9 s, 16k inputsAFL++, run 6: 9.4 s, 230k inputsAFL++, run 7: 5.5 s, 102k inputsAFL++, run 8: 5.7 s, 107k inputsAFL++, run 9: 12 s, 331k inputsAFL++, run 10: 4.4 s, 64k inputsRandom baselineRandom baseline, run 1: not found, 0 inputsRandom baseline, run 2: not found, 0 inputsRandom baseline, run 3: not found, 0 inputsRandom baseline, run 4: not found, 0 inputsRandom baseline, run 5: not found, 0 inputsRandom baseline, run 6: not found, 0 inputsRandom baseline, run 7: not found, 0 inputsRandom baseline, run 8: not found, 0 inputsRandom baseline, run 9: not found, 0 inputsRandom baseline, run 10: not found, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo10 of 100.8 s2.3k
Termo, a process per input (before persistent mode)7 of 1038 s11
libFuzzer8 of 103.9 s37k
AFL++10 of 103.9 s12k
Random baseline0 of 10> 60 s0

Mini-XML 2.12 · crash · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 1: 24 s, 256k inputsTermo, run 2: 27 s, 284k inputsTermo, run 3: 10 s, 94k inputsTermo, run 4: 3.7 s, 42k inputsTermo, run 5: 27 s, 310k inputsTermo, run 6: not found, 506k inputsTermo, run 7: not found, 563k inputsTermo, run 9: 25 s, 266k inputsTermo, run 8: 41 s, 455k inputsTermo, run 10: 1.1 s, 13k inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: not found, 718 inputsTermo, a process per input (before persistent mode), run 2: not found, 680 inputsTermo, a process per input (before persistent mode), run 3: not found, 675 inputsTermo, a process per input (before persistent mode), run 4: not found, 694 inputsTermo, a process per input (before persistent mode), run 5: not found, 693 inputsTermo, a process per input (before persistent mode), run 6: not found, 693 inputsTermo, a process per input (before persistent mode), run 7: not found, 697 inputsTermo, a process per input (before persistent mode), run 8: not found, 673 inputsTermo, a process per input (before persistent mode), run 9: not found, 692 inputsTermo, a process per input (before persistent mode), run 10: not found, 687 inputslibFuzzerlibFuzzer, run 1: 0.2 s, 713 inputslibFuzzer, run 2: 0.3 s, 1.6k inputslibFuzzer, run 3: 0.3 s, 7.2k inputslibFuzzer, run 4: 0.3 s, 12k inputslibFuzzer, run 5: 0.3 s, 4.2k inputslibFuzzer, run 6: 0.3 s, 12k inputslibFuzzer, run 7: 0.2 s, 1.3k inputslibFuzzer, run 8: 0.3 s, 3.5k inputslibFuzzer, run 9: 0.2 s, 410 inputslibFuzzer, run 10: 0.3 s, 8.2k inputsAFL++AFL++, run 1: 2.6 s, 14k inputsAFL++, run 2: 2.4 s, 6.2k inputsAFL++, run 3: 2.6 s, 15k inputsAFL++, run 4: 2.6 s, 22k inputsAFL++, run 5: 2.4 s, 9.7k inputsAFL++, run 6: 2.6 s, 21k inputsAFL++, run 7: 3.6 s, 98k inputsAFL++, run 8: 2.4 s, 8.4k inputsAFL++, run 9: 2.4 s, 6.0k inputsAFL++, run 10: 2.6 s, 20k inputsRandom baselineRandom baseline, run 1: 0.4 s, 0 inputsRandom baseline, run 2: 0.9 s, 0 inputsRandom baseline, run 3: 0.9 s, 0 inputsRandom baseline, run 4: 0.6 s, 0 inputsRandom baseline, run 5: 2.5 s, 0 inputsRandom baseline, run 6: 1.2 s, 0 inputsRandom baseline, run 7: 0.3 s, 0 inputsRandom baseline, run 8: 0.9 s, 0 inputsRandom baseline, run 9: 0.8 s, 0 inputsRandom baseline, run 10: 0.4 s, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo8 of 1026 s11k
Termo, a process per input (before persistent mode)0 of 10> 60 s12
libFuzzer10 of 100.3 s3.9k
AFL++10 of 102.6 s5.5k
Random baseline10 of 100.8 s0

libxml2 2.9.2 · crash · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 1: 40 s, 110k inputsTermo, run 4: 16 s, 49k inputsTermo, run 2: not found, 142k inputsTermo, run 3: 49 s, 132k inputsTermo, run 5: 24 s, 79k inputsTermo, run 7: 0.6 s, 975 inputsTermo, run 6: not found, 141k inputsTermo, run 8: 18 s, 60k inputsTermo, run 9: 23 s, 70k inputsTermo, run 10: 25 s, 79k inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: not found, 683 inputsTermo, a process per input (before persistent mode), run 2: not found, 696 inputsTermo, a process per input (before persistent mode), run 3: not found, 692 inputsTermo, a process per input (before persistent mode), run 4: not found, 694 inputsTermo, a process per input (before persistent mode), run 5: not found, 697 inputsTermo, a process per input (before persistent mode), run 6: not found, 688 inputsTermo, a process per input (before persistent mode), run 7: not found, 713 inputsTermo, a process per input (before persistent mode), run 8: not found, 693 inputsTermo, a process per input (before persistent mode), run 9: not found, 692 inputsTermo, a process per input (before persistent mode), run 10: not found, 710 inputslibFuzzerlibFuzzer, run 1: 1.0 s, 9.5k inputslibFuzzer, run 2: 0.3 s, 865 inputslibFuzzer, run 3: 0.3 s, 258 inputslibFuzzer, run 4: 0.7 s, 4.2k inputslibFuzzer, run 5: 0.4 s, 1.4k inputslibFuzzer, run 6: 1.1 s, 11k inputslibFuzzer, run 7: 1.4 s, 17k inputslibFuzzer, run 8: 0.6 s, 4.0k inputslibFuzzer, run 9: 2.0 s, 23k inputslibFuzzer, run 10: 1.0 s, 8.9k inputsAFL++AFL++, run 1: 2.9 s, 5.0k inputsAFL++, run 2: 3.7 s, 12k inputsAFL++, run 3: 8.1 s, 79k inputsAFL++, run 4: 4.4 s, 24k inputsAFL++, run 5: 5.6 s, 41k inputsAFL++, run 6: 4.2 s, 22k inputsAFL++, run 7: 8.5 s, 86k inputsAFL++, run 8: 3.4 s, 8.8k inputsAFL++, run 9: 2.7 s, 2.8k inputsAFL++, run 10: 3.3 s, 8.4k inputsRandom baselineRandom baseline, run 1: not found, 0 inputsRandom baseline, run 2: not found, 0 inputsRandom baseline, run 3: not found, 0 inputsRandom baseline, run 4: not found, 0 inputsRandom baseline, run 5: 40 s, 0 inputsRandom baseline, run 6: 3.5 s, 0 inputsRandom baseline, run 7: 0.3 s, 0 inputsRandom baseline, run 8: 24 s, 0 inputsRandom baseline, run 9: 0.4 s, 0 inputsRandom baseline, run 10: 23 s, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo8 of 1025 s2.9k
Termo, a process per input (before persistent mode)0 of 10> 60 s12
libFuzzer10 of 100.8 s6.5k
AFL++10 of 103.9 s4.2k
Random baseline6 of 1032 s0

Small languages

Regular expressions, C++ symbol names and DNS host names: compact syntaxes whose memory errors hide behind exact sequences of characters.

c-ares 1.11.0 · CVE-2016-5180 · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 1: 1.0 s, 545 inputsTermo, run 2: 0.3 s, 451 inputsTermo, run 3: 0.3 s, 281 inputsTermo, run 4: 0.3 s, 151 inputsTermo, run 5: 0.3 s, 433 inputsTermo, run 6: 0.3 s, 236 inputsTermo, run 7: 0.3 s, 592 inputsTermo, run 8: 0.3 s, 124 inputsTermo, run 9: 0.3 s, 532 inputsTermo, run 10: 0.4 s, 1.4k inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: not found, 707 inputsTermo, a process per input (before persistent mode), run 2: 5.5 s, 61 inputsTermo, a process per input (before persistent mode), run 3: not found, 677 inputsTermo, a process per input (before persistent mode), run 4: not found, 699 inputsTermo, a process per input (before persistent mode), run 5: 48 s, 552 inputsTermo, a process per input (before persistent mode), run 6: not found, 696 inputsTermo, a process per input (before persistent mode), run 7: not found, 702 inputsTermo, a process per input (before persistent mode), run 8: not found, 675 inputsTermo, a process per input (before persistent mode), run 9: not found, 696 inputsTermo, a process per input (before persistent mode), run 10: not found, 690 inputslibFuzzerlibFuzzer, run 1: 0.2 s, 358 inputslibFuzzer, run 2: 0.2 s, 256 inputslibFuzzer, run 3: 0.2 s, 831 inputslibFuzzer, run 4: 0.2 s, 3.7k inputslibFuzzer, run 5: 0.2 s, 1.8k inputslibFuzzer, run 6: 0.2 s, 1.7k inputslibFuzzer, run 7: 0.2 s, 664 inputslibFuzzer, run 8: 0.2 s, 3.7k inputslibFuzzer, run 9: 0.2 s, 631 inputslibFuzzer, run 10: 0.2 s, 752 inputsAFL++AFL++, run 1: 2.5 s, 1.3k inputsAFL++, run 2: 2.5 s, 2.0k inputsAFL++, run 3: 2.4 s, 4.7k inputsAFL++, run 4: 2.5 s, 4.2k inputsAFL++, run 5: 2.5 s, 1.9k inputsAFL++, run 6: 2.4 s, 2.9k inputsAFL++, run 7: 2.4 s, 2.4k inputsAFL++, run 8: 2.4 s, 1.6k inputsAFL++, run 9: 2.4 s, 817 inputsAFL++, run 10: 2.4 s, 1.7k inputsRandom baselineRandom baseline, run 1: 0.2 s, 0 inputsRandom baseline, run 2: 0.2 s, 0 inputsRandom baseline, run 3: 0.2 s, 0 inputsRandom baseline, run 4: 0.2 s, 0 inputsRandom baseline, run 5: 0.2 s, 0 inputsRandom baseline, run 6: 0.2 s, 0 inputsRandom baseline, run 7: 0.2 s, 0 inputsRandom baseline, run 8: 0.2 s, 0 inputsRandom baseline, run 9: 0.2 s, 0 inputsRandom baseline, run 10: 0.2 s, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo10 of 100.3 s442
Termo, a process per input (before persistent mode)2 of 10> 60 s12
libFuzzer10 of 100.2 s792
AFL++10 of 102.4 s774
Random baseline10 of 100.2 s0

PCRE2 10.00 · crash · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 3: 2.6 s, 7.5k inputsTermo, run 1: not found, 167k inputsTermo, run 2: not found, 175k inputsTermo, run 4: 8.6 s, 30k inputsTermo, run 5: 37 s, 119k inputsTermo, run 6: not found, 179k inputsTermo, run 7: not found, 151k inputsTermo, run 8: not found, 226k inputsTermo, run 9: not found, 189k inputsTermo, run 10: not found, 203k inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: not found, 695 inputsTermo, a process per input (before persistent mode), run 2: not found, 696 inputsTermo, a process per input (before persistent mode), run 3: not found, 704 inputsTermo, a process per input (before persistent mode), run 4: not found, 701 inputsTermo, a process per input (before persistent mode), run 5: not found, 699 inputsTermo, a process per input (before persistent mode), run 6: not found, 690 inputsTermo, a process per input (before persistent mode), run 7: not found, 699 inputsTermo, a process per input (before persistent mode), run 8: not found, 688 inputsTermo, a process per input (before persistent mode), run 9: not found, 684 inputsTermo, a process per input (before persistent mode), run 10: not found, 689 inputslibFuzzerlibFuzzer, run 1: 0.4 s, 8.9k inputslibFuzzer, run 2: 3.8 s, 288k inputslibFuzzer, run 3: 3.5 s, 303k inputslibFuzzer, run 4: 0.8 s, 40k inputslibFuzzer, run 5: 3.9 s, 298k inputslibFuzzer, run 6: 2.4 s, 187k inputslibFuzzer, run 7: 7.5 s, 517k inputslibFuzzer, run 8: 5.5 s, 425k inputslibFuzzer, run 9: 2.7 s, 203k inputslibFuzzer, run 10: 8.3 s, 531k inputsAFL++AFL++, run 1: 9.4 s, 448k inputsAFL++, run 2: 17 s, 671k inputsAFL++, run 3: 9.3 s, 442k inputsAFL++, run 4: 7.9 s, 309k inputsAFL++, run 5: 14 s, 712k inputsAFL++, run 6: 13 s, 662k inputsAFL++, run 7: 9.4 s, 439k inputsAFL++, run 8: 11 s, 564k inputsAFL++, run 9: 15 s, 722k inputsAFL++, run 10: 18 s, 962k inputsRandom baselineRandom baseline, run 1: not found, 0 inputsRandom baseline, run 2: not found, 0 inputsRandom baseline, run 3: not found, 0 inputsRandom baseline, run 4: not found, 0 inputsRandom baseline, run 5: not found, 0 inputsRandom baseline, run 6: not found, 0 inputsRandom baseline, run 7: not found, 0 inputsRandom baseline, run 8: not found, 0 inputsRandom baseline, run 9: not found, 0 inputsRandom baseline, run 10: not found, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo3 of 10> 60 s3.1k
Termo, a process per input (before persistent mode)0 of 10> 60 s12
libFuzzer10 of 103.6 s76k
AFL++10 of 1012 s48k
Random baseline0 of 10> 60 s0

LLVM 3.9.1 C++ demangler · crash · vetted with libFuzzer

Memory errors caught by AddressSanitizer.

0.1 s1 s10 s60 snot foundTermoTermo, run 1: not found, 147k inputsTermo, run 2: 58 s, 154k inputsTermo, run 3: not found, 158k inputsTermo, run 4: not found, 165k inputsTermo, run 5: 57 s, 145k inputsTermo, run 6: not found, 157k inputsTermo, run 7: 12 s, 51k inputsTermo, run 8: 3.0 s, 12k inputsTermo, run 9: 14 s, 51k inputsTermo, run 10: not found, 133k inputsTermo, a process per input (before persistent mode)Termo, a process per input (before persistent mode), run 1: not found, 701 inputsTermo, a process per input (before persistent mode), run 2: not found, 699 inputsTermo, a process per input (before persistent mode), run 3: not found, 711 inputsTermo, a process per input (before persistent mode), run 4: not found, 692 inputsTermo, a process per input (before persistent mode), run 5: not found, 705 inputsTermo, a process per input (before persistent mode), run 6: not found, 693 inputsTermo, a process per input (before persistent mode), run 7: not found, 710 inputsTermo, a process per input (before persistent mode), run 8: not found, 698 inputsTermo, a process per input (before persistent mode), run 9: not found, 701 inputsTermo, a process per input (before persistent mode), run 10: not found, 769 inputslibFuzzerlibFuzzer, run 1: 4.5 s, 546k inputslibFuzzer, run 2: not found, 2.7M inputslibFuzzer, run 3: 3.1 s, 373k inputslibFuzzer, run 4: 3.4 s, 415k inputslibFuzzer, run 5: 4.0 s, 453k inputslibFuzzer, run 6: not found, 631k inputslibFuzzer, run 7: not found, 778k inputslibFuzzer, run 8: 6.8 s, 822k inputslibFuzzer, run 9: 8.0 s, 889k inputslibFuzzer, run 10: 4.8 s, 563k inputsAFL++AFL++, run 1: 10 s, 469k inputsAFL++, run 2: 11 s, 515k inputsAFL++, run 3: 9.6 s, 439k inputsAFL++, run 4: 12 s, 655k inputsAFL++, run 5: 11 s, 609k inputsAFL++, run 6: 8.4 s, 422k inputsAFL++, run 7: 20 s, 985k inputsAFL++, run 8: 7.7 s, 347k inputsAFL++, run 9: 14 s, 779k inputsAFL++, run 10: 8.2 s, 409k inputsRandom baselineRandom baseline, run 1: not found, 0 inputsRandom baseline, run 2: not found, 0 inputsRandom baseline, run 3: not found, 0 inputsRandom baseline, run 4: not found, 0 inputsRandom baseline, run 5: not found, 0 inputsRandom baseline, run 6: not found, 0 inputsRandom baseline, run 7: not found, 0 inputsRandom baseline, run 8: not found, 0 inputsRandom baseline, run 9: not found, 0 inputsRandom baseline, run 10: not found, 0 inputs
ToolRuns that found itMedian time to find itInputs per second
Termo5 of 1059 s2.6k
Termo, a process per input (before persistent mode)0 of 10> 60 s12
libFuzzer7 of 105.8 s115k
AFL++10 of 1011 s50k
Random baseline0 of 10> 60 s0