Fuzzer benchmark
8 C libraries with memory errors, vetted by libFuzzer finding a crash within five minutes. Termo runs the AddressSanitizer build through its persistent driver, which keeps the library loaded between inputs ("a process per input" is how it ran before, shown for comparison); libFuzzer, AFL++ and the random baseline run inputs in-process. Every crash is replayed on one reference AddressSanitizer build, and only confirmed crashes count. Every tool gets the same seed inputs, token dictionary, input size limit and time budget, and one shared oracle decides when the bug is found. darwin arm64, 11 cores, Node v26.13.0; Termo 0.1.0, clang 23.1.5, AFL++ 5.03c.
Ranking Each tool fuzzes each library 10 times: 10 separate runs of 60 seconds, each with a different random seed. On every library, the tools are ranked from 1 (best) to 4: first by how many of their 10 runs found the bug, then, to break ties, by the median time those runs took to find it (a run that never found it counts as the full 60 seconds). Tools with exactly the same result share the rank. A suite's score is a tool's average rank over that suite's libraries, and the overall score is the average of the suite scores, so a suite with many libraries counts the same as a small one. 1.00 means best on every library; 4.00 means last on every one.
# Tool Score Document parsers Small languages Runs that found the bug Best on 1 libFuzzer 1.73 1.80 1.67 75 of 80 3 of 8 libraries 2 AFL++ 2.67 3.00 2.33 80 of 80 1 of 8 libraries 3 Random baseline 2.70 2.40 3.00 46 of 80 3 of 8 libraries 4 Termo 2.90 2.80 3.00 64 of 80 1 of 8 libraries
Time to find the bugs For each kind of bug, the share of runs that had found it by each moment, over all the libraries of that kind. A line that rises early and ends high finds more bugs, sooner. Hover for the numbers.
Memory errors (crashes) Out-of-bounds reads and writes in C libraries, caught by AddressSanitizer: share of runs that had found the bug, by time (8 libraries, 10 runs each). Higher and further left is better.
Termo libFuzzer AFL++ Random baseline
0% 25% 50% 75% 100% 0.1 s 1 s 10 s 60 s AFL++ 100% libFuzzer 94% Termo 80% Random baseline 58%
Table Tool Runs Found by 1 s by 10 s by 60 s Termo 80 46% 58% 80% libFuzzer 80 60% 93% 94% AFL++ 80 0% 84% 100% Random baseline 80 50% 54% 58%
Against libFuzzer, Termo was significantly faster to find the bug on 1 library and significantly slower on 6 (exact permutation test over the runs, p ≤ 0.05). Against AFL++, Termo was significantly faster to find the bug on 4 libraries and significantly slower on 4 (exact permutation test over the runs, p ≤ 0.05). Against Random baseline, Termo was significantly faster to find the bug on 2 libraries and significantly slower on 4 (exact permutation test over the runs, p ≤ 0.05).
Document parsers JSON, Markdown, YAML and XML parsers: memory errors caught by AddressSanitizer, confirmed by replaying the input on one reference build.
cJSON 1.7.10 · crash · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 1: 0.7 s, 6 inputs Termo, run 2: 0.3 s, 5 inputs Termo, run 3: 0.3 s, 11 inputs Termo, run 4: 0.3 s, 5 inputs Termo, run 5: 0.3 s, 7 inputs Termo, run 6: 0.2 s, 11 inputs Termo, run 7: 0.3 s, 4 inputs Termo, run 8: 0.3 s, 5 inputs Termo, run 9: 0.3 s, 6 inputs Termo, run 10: 0.3 s, 4 inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: 0.8 s, 4 inputs Termo, a process per input (before persistent mode), run 2: 1.0 s, 10 inputs Termo, a process per input (before persistent mode), run 3: 0.7 s, 6 inputs Termo, a process per input (before persistent mode), run 4: 0.7 s, 5 inputs Termo, a process per input (before persistent mode), run 5: 0.9 s, 8 inputs Termo, a process per input (before persistent mode), run 6: 0.7 s, 6 inputs Termo, a process per input (before persistent mode), run 7: 0.5 s, 4 inputs Termo, a process per input (before persistent mode), run 8: 0.5 s, 4 inputs Termo, a process per input (before persistent mode), run 9: 0.5 s, 4 inputs Termo, a process per input (before persistent mode), run 10: 0.7 s, 6 inputs libFuzzer libFuzzer, run 1: 0.3 s, 6 inputs libFuzzer, run 2: 0.2 s, 12 inputs libFuzzer, run 3: 0.2 s, 7 inputs libFuzzer, run 4: 0.2 s, 22 inputs libFuzzer, run 5: 0.2 s, 13 inputs libFuzzer, run 6: 0.2 s, 19 inputs libFuzzer, run 7: 0.2 s, 6 inputs libFuzzer, run 8: 0.2 s, 6 inputs libFuzzer, run 9: 0.2 s, 7 inputs libFuzzer, run 10: 0.2 s, 15 inputs AFL++ AFL++, run 1: 2.3 s, 14 inputs AFL++, run 2: 2.2 s, 13 inputs AFL++, run 3: 2.2 s, 13 inputs AFL++, run 4: 2.2 s, 13 inputs AFL++, run 5: 2.2 s, 13 inputs AFL++, run 6: 2.2 s, 13 inputs AFL++, run 7: 2.2 s, 13 inputs AFL++, run 8: 2.2 s, 13 inputs AFL++, run 9: 2.2 s, 13 inputs AFL++, run 10: 2.2 s, 13 inputs Random baseline Random baseline, run 1: 0.5 s, 0 inputs Random baseline, run 2: 0.2 s, 0 inputs Random baseline, run 3: 0.2 s, 0 inputs Random baseline, run 4: 0.2 s, 0 inputs Random baseline, run 5: 0.2 s, 0 inputs Random baseline, run 6: 0.2 s, 0 inputs Random baseline, run 7: 0.2 s, 0 inputs Random baseline, run 8: 0.2 s, 0 inputs Random baseline, run 9: 0.2 s, 0 inputs Random baseline, run 10: 0.2 s, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 10 of 10 0.3 s 6 Termo, a process per input (before persistent mode) 10 of 10 0.7 s 6 libFuzzer 10 of 10 0.2 s 10 AFL++ 10 of 10 2.2 s 6 Random baseline 10 of 10 0.2 s 0
md4c 0.4.7 · crash · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 1: 0.5 s, 14 inputs Termo, run 2: 0.4 s, 75 inputs Termo, run 3: 0.5 s, 381 inputs Termo, run 4: 0.3 s, 56 inputs Termo, run 5: 0.3 s, 104 inputs Termo, run 6: 0.3 s, 94 inputs Termo, run 7: 0.4 s, 310 inputs Termo, run 8: 0.4 s, 336 inputs Termo, run 9: 0.4 s, 416 inputs Termo, run 10: 0.4 s, 147 inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: 1.6 s, 25 inputs Termo, a process per input (before persistent mode), run 2: 9.3 s, 110 inputs Termo, a process per input (before persistent mode), run 3: 0.5 s, 4 inputs Termo, a process per input (before persistent mode), run 4: 2.2 s, 25 inputs Termo, a process per input (before persistent mode), run 5: 5.1 s, 58 inputs Termo, a process per input (before persistent mode), run 6: 3.1 s, 38 inputs Termo, a process per input (before persistent mode), run 7: 2.8 s, 31 inputs Termo, a process per input (before persistent mode), run 8: 1.8 s, 21 inputs Termo, a process per input (before persistent mode), run 9: 3.9 s, 45 inputs Termo, a process per input (before persistent mode), run 10: 12 s, 133 inputs libFuzzer libFuzzer, run 1: 0.4 s, 620 inputs libFuzzer, run 2: 0.2 s, 4 inputs libFuzzer, run 3: 0.3 s, 2.3k inputs libFuzzer, run 4: 0.3 s, 730 inputs libFuzzer, run 5: 0.2 s, 383 inputs libFuzzer, run 6: 0.4 s, 2.3k inputs libFuzzer, run 7: 0.2 s, 296 inputs libFuzzer, run 8: 0.2 s, 120 inputs libFuzzer, run 9: 0.2 s, 251 inputs libFuzzer, run 10: 0.2 s, 281 inputs AFL++ AFL++, run 1: 2.5 s, 2.3k inputs AFL++, run 2: 2.4 s, 2.4k inputs AFL++, run 3: 2.4 s, 550 inputs AFL++, run 4: 2.5 s, 3.5k inputs AFL++, run 5: 2.4 s, 2.6k inputs AFL++, run 6: 2.4 s, 1.9k inputs AFL++, run 7: 2.4 s, 3.4k inputs AFL++, run 8: 2.4 s, 2.2k inputs AFL++, run 9: 2.4 s, 2.7k inputs AFL++, run 10: 2.4 s, 2.9k inputs Random baseline Random baseline, run 1: 0.3 s, 0 inputs Random baseline, run 2: 0.2 s, 0 inputs Random baseline, run 3: 0.2 s, 0 inputs Random baseline, run 4: 0.2 s, 0 inputs Random baseline, run 5: 0.2 s, 0 inputs Random baseline, run 6: 0.2 s, 0 inputs Random baseline, run 7: 0.2 s, 0 inputs Random baseline, run 8: 0.2 s, 0 inputs Random baseline, run 9: 0.2 s, 0 inputs Random baseline, run 10: 0.2 s, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 10 of 10 0.4 s 126 Termo, a process per input (before persistent mode) 10 of 10 3.0 s 11 libFuzzer 10 of 10 0.2 s 340 AFL++ 10 of 10 2.4 s 1.0k Random baseline 10 of 10 0.2 s 0
libyaml 0.1.4 · crash · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 1: 2.1 s, 4.1k inputs Termo, run 2: 0.3 s, 160 inputs Termo, run 3: 0.9 s, 2.6k inputs Termo, run 4: 0.5 s, 849 inputs Termo, run 5: 0.3 s, 17 inputs Termo, run 6: 0.9 s, 3.8k inputs Termo, run 7: 1.7 s, 8.3k inputs Termo, run 8: 0.8 s, 3.1k inputs Termo, run 9: 0.5 s, 1.4k inputs Termo, run 10: 1.3 s, 6.5k inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: 47 s, 583 inputs Termo, a process per input (before persistent mode), run 2: not found, 680 inputs Termo, a process per input (before persistent mode), run 3: not found, 676 inputs Termo, a process per input (before persistent mode), run 4: 29 s, 336 inputs Termo, a process per input (before persistent mode), run 5: 5.2 s, 58 inputs Termo, a process per input (before persistent mode), run 6: 10 s, 121 inputs Termo, a process per input (before persistent mode), run 7: not found, 687 inputs Termo, a process per input (before persistent mode), run 8: 57 s, 634 inputs Termo, a process per input (before persistent mode), run 9: 23 s, 262 inputs Termo, a process per input (before persistent mode), run 10: 9.3 s, 107 inputs libFuzzer libFuzzer, run 1: 9.9 s, 367k inputs libFuzzer, run 2: not found, 462k inputs libFuzzer, run 3: 1.6 s, 60k inputs libFuzzer, run 4: 2.6 s, 99k inputs libFuzzer, run 5: 2.0 s, 75k inputs libFuzzer, run 6: 3.5 s, 161k inputs libFuzzer, run 7: 25 s, 1.2M inputs libFuzzer, run 8: 4.3 s, 192k inputs libFuzzer, run 9: not found, 93k inputs libFuzzer, run 10: 1.0 s, 37k inputs AFL++ AFL++, run 1: 3.3 s, 20k inputs AFL++, run 2: 2.8 s, 16k inputs AFL++, run 3: 3.0 s, 21k inputs AFL++, run 4: 3.4 s, 35k inputs AFL++, run 5: 2.9 s, 16k inputs AFL++, run 6: 9.4 s, 230k inputs AFL++, run 7: 5.5 s, 102k inputs AFL++, run 8: 5.7 s, 107k inputs AFL++, run 9: 12 s, 331k inputs AFL++, run 10: 4.4 s, 64k inputs Random baseline Random baseline, run 1: not found, 0 inputs Random baseline, run 2: not found, 0 inputs Random baseline, run 3: not found, 0 inputs Random baseline, run 4: not found, 0 inputs Random baseline, run 5: not found, 0 inputs Random baseline, run 6: not found, 0 inputs Random baseline, run 7: not found, 0 inputs Random baseline, run 8: not found, 0 inputs Random baseline, run 9: not found, 0 inputs Random baseline, run 10: not found, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 10 of 10 0.8 s 2.3k Termo, a process per input (before persistent mode) 7 of 10 38 s 11 libFuzzer 8 of 10 3.9 s 37k AFL++ 10 of 10 3.9 s 12k Random baseline 0 of 10 > 60 s 0
Mini-XML 2.12 · crash · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 1: 24 s, 256k inputs Termo, run 2: 27 s, 284k inputs Termo, run 3: 10 s, 94k inputs Termo, run 4: 3.7 s, 42k inputs Termo, run 5: 27 s, 310k inputs Termo, run 6: not found, 506k inputs Termo, run 7: not found, 563k inputs Termo, run 9: 25 s, 266k inputs Termo, run 8: 41 s, 455k inputs Termo, run 10: 1.1 s, 13k inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: not found, 718 inputs Termo, a process per input (before persistent mode), run 2: not found, 680 inputs Termo, a process per input (before persistent mode), run 3: not found, 675 inputs Termo, a process per input (before persistent mode), run 4: not found, 694 inputs Termo, a process per input (before persistent mode), run 5: not found, 693 inputs Termo, a process per input (before persistent mode), run 6: not found, 693 inputs Termo, a process per input (before persistent mode), run 7: not found, 697 inputs Termo, a process per input (before persistent mode), run 8: not found, 673 inputs Termo, a process per input (before persistent mode), run 9: not found, 692 inputs Termo, a process per input (before persistent mode), run 10: not found, 687 inputs libFuzzer libFuzzer, run 1: 0.2 s, 713 inputs libFuzzer, run 2: 0.3 s, 1.6k inputs libFuzzer, run 3: 0.3 s, 7.2k inputs libFuzzer, run 4: 0.3 s, 12k inputs libFuzzer, run 5: 0.3 s, 4.2k inputs libFuzzer, run 6: 0.3 s, 12k inputs libFuzzer, run 7: 0.2 s, 1.3k inputs libFuzzer, run 8: 0.3 s, 3.5k inputs libFuzzer, run 9: 0.2 s, 410 inputs libFuzzer, run 10: 0.3 s, 8.2k inputs AFL++ AFL++, run 1: 2.6 s, 14k inputs AFL++, run 2: 2.4 s, 6.2k inputs AFL++, run 3: 2.6 s, 15k inputs AFL++, run 4: 2.6 s, 22k inputs AFL++, run 5: 2.4 s, 9.7k inputs AFL++, run 6: 2.6 s, 21k inputs AFL++, run 7: 3.6 s, 98k inputs AFL++, run 8: 2.4 s, 8.4k inputs AFL++, run 9: 2.4 s, 6.0k inputs AFL++, run 10: 2.6 s, 20k inputs Random baseline Random baseline, run 1: 0.4 s, 0 inputs Random baseline, run 2: 0.9 s, 0 inputs Random baseline, run 3: 0.9 s, 0 inputs Random baseline, run 4: 0.6 s, 0 inputs Random baseline, run 5: 2.5 s, 0 inputs Random baseline, run 6: 1.2 s, 0 inputs Random baseline, run 7: 0.3 s, 0 inputs Random baseline, run 8: 0.9 s, 0 inputs Random baseline, run 9: 0.8 s, 0 inputs Random baseline, run 10: 0.4 s, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 8 of 10 26 s 11k Termo, a process per input (before persistent mode) 0 of 10 > 60 s 12 libFuzzer 10 of 10 0.3 s 3.9k AFL++ 10 of 10 2.6 s 5.5k Random baseline 10 of 10 0.8 s 0
libxml2 2.9.2 · crash · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 1: 40 s, 110k inputs Termo, run 4: 16 s, 49k inputs Termo, run 2: not found, 142k inputs Termo, run 3: 49 s, 132k inputs Termo, run 5: 24 s, 79k inputs Termo, run 7: 0.6 s, 975 inputs Termo, run 6: not found, 141k inputs Termo, run 8: 18 s, 60k inputs Termo, run 9: 23 s, 70k inputs Termo, run 10: 25 s, 79k inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: not found, 683 inputs Termo, a process per input (before persistent mode), run 2: not found, 696 inputs Termo, a process per input (before persistent mode), run 3: not found, 692 inputs Termo, a process per input (before persistent mode), run 4: not found, 694 inputs Termo, a process per input (before persistent mode), run 5: not found, 697 inputs Termo, a process per input (before persistent mode), run 6: not found, 688 inputs Termo, a process per input (before persistent mode), run 7: not found, 713 inputs Termo, a process per input (before persistent mode), run 8: not found, 693 inputs Termo, a process per input (before persistent mode), run 9: not found, 692 inputs Termo, a process per input (before persistent mode), run 10: not found, 710 inputs libFuzzer libFuzzer, run 1: 1.0 s, 9.5k inputs libFuzzer, run 2: 0.3 s, 865 inputs libFuzzer, run 3: 0.3 s, 258 inputs libFuzzer, run 4: 0.7 s, 4.2k inputs libFuzzer, run 5: 0.4 s, 1.4k inputs libFuzzer, run 6: 1.1 s, 11k inputs libFuzzer, run 7: 1.4 s, 17k inputs libFuzzer, run 8: 0.6 s, 4.0k inputs libFuzzer, run 9: 2.0 s, 23k inputs libFuzzer, run 10: 1.0 s, 8.9k inputs AFL++ AFL++, run 1: 2.9 s, 5.0k inputs AFL++, run 2: 3.7 s, 12k inputs AFL++, run 3: 8.1 s, 79k inputs AFL++, run 4: 4.4 s, 24k inputs AFL++, run 5: 5.6 s, 41k inputs AFL++, run 6: 4.2 s, 22k inputs AFL++, run 7: 8.5 s, 86k inputs AFL++, run 8: 3.4 s, 8.8k inputs AFL++, run 9: 2.7 s, 2.8k inputs AFL++, run 10: 3.3 s, 8.4k inputs Random baseline Random baseline, run 1: not found, 0 inputs Random baseline, run 2: not found, 0 inputs Random baseline, run 3: not found, 0 inputs Random baseline, run 4: not found, 0 inputs Random baseline, run 5: 40 s, 0 inputs Random baseline, run 6: 3.5 s, 0 inputs Random baseline, run 7: 0.3 s, 0 inputs Random baseline, run 8: 24 s, 0 inputs Random baseline, run 9: 0.4 s, 0 inputs Random baseline, run 10: 23 s, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 8 of 10 25 s 2.9k Termo, a process per input (before persistent mode) 0 of 10 > 60 s 12 libFuzzer 10 of 10 0.8 s 6.5k AFL++ 10 of 10 3.9 s 4.2k Random baseline 6 of 10 32 s 0
Small languages Regular expressions, C++ symbol names and DNS host names: compact syntaxes whose memory errors hide behind exact sequences of characters.
c-ares 1.11.0 · CVE-2016-5180 · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 1: 1.0 s, 545 inputs Termo, run 2: 0.3 s, 451 inputs Termo, run 3: 0.3 s, 281 inputs Termo, run 4: 0.3 s, 151 inputs Termo, run 5: 0.3 s, 433 inputs Termo, run 6: 0.3 s, 236 inputs Termo, run 7: 0.3 s, 592 inputs Termo, run 8: 0.3 s, 124 inputs Termo, run 9: 0.3 s, 532 inputs Termo, run 10: 0.4 s, 1.4k inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: not found, 707 inputs Termo, a process per input (before persistent mode), run 2: 5.5 s, 61 inputs Termo, a process per input (before persistent mode), run 3: not found, 677 inputs Termo, a process per input (before persistent mode), run 4: not found, 699 inputs Termo, a process per input (before persistent mode), run 5: 48 s, 552 inputs Termo, a process per input (before persistent mode), run 6: not found, 696 inputs Termo, a process per input (before persistent mode), run 7: not found, 702 inputs Termo, a process per input (before persistent mode), run 8: not found, 675 inputs Termo, a process per input (before persistent mode), run 9: not found, 696 inputs Termo, a process per input (before persistent mode), run 10: not found, 690 inputs libFuzzer libFuzzer, run 1: 0.2 s, 358 inputs libFuzzer, run 2: 0.2 s, 256 inputs libFuzzer, run 3: 0.2 s, 831 inputs libFuzzer, run 4: 0.2 s, 3.7k inputs libFuzzer, run 5: 0.2 s, 1.8k inputs libFuzzer, run 6: 0.2 s, 1.7k inputs libFuzzer, run 7: 0.2 s, 664 inputs libFuzzer, run 8: 0.2 s, 3.7k inputs libFuzzer, run 9: 0.2 s, 631 inputs libFuzzer, run 10: 0.2 s, 752 inputs AFL++ AFL++, run 1: 2.5 s, 1.3k inputs AFL++, run 2: 2.5 s, 2.0k inputs AFL++, run 3: 2.4 s, 4.7k inputs AFL++, run 4: 2.5 s, 4.2k inputs AFL++, run 5: 2.5 s, 1.9k inputs AFL++, run 6: 2.4 s, 2.9k inputs AFL++, run 7: 2.4 s, 2.4k inputs AFL++, run 8: 2.4 s, 1.6k inputs AFL++, run 9: 2.4 s, 817 inputs AFL++, run 10: 2.4 s, 1.7k inputs Random baseline Random baseline, run 1: 0.2 s, 0 inputs Random baseline, run 2: 0.2 s, 0 inputs Random baseline, run 3: 0.2 s, 0 inputs Random baseline, run 4: 0.2 s, 0 inputs Random baseline, run 5: 0.2 s, 0 inputs Random baseline, run 6: 0.2 s, 0 inputs Random baseline, run 7: 0.2 s, 0 inputs Random baseline, run 8: 0.2 s, 0 inputs Random baseline, run 9: 0.2 s, 0 inputs Random baseline, run 10: 0.2 s, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 10 of 10 0.3 s 442 Termo, a process per input (before persistent mode) 2 of 10 > 60 s 12 libFuzzer 10 of 10 0.2 s 792 AFL++ 10 of 10 2.4 s 774 Random baseline 10 of 10 0.2 s 0
PCRE2 10.00 · crash · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 3: 2.6 s, 7.5k inputs Termo, run 1: not found, 167k inputs Termo, run 2: not found, 175k inputs Termo, run 4: 8.6 s, 30k inputs Termo, run 5: 37 s, 119k inputs Termo, run 6: not found, 179k inputs Termo, run 7: not found, 151k inputs Termo, run 8: not found, 226k inputs Termo, run 9: not found, 189k inputs Termo, run 10: not found, 203k inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: not found, 695 inputs Termo, a process per input (before persistent mode), run 2: not found, 696 inputs Termo, a process per input (before persistent mode), run 3: not found, 704 inputs Termo, a process per input (before persistent mode), run 4: not found, 701 inputs Termo, a process per input (before persistent mode), run 5: not found, 699 inputs Termo, a process per input (before persistent mode), run 6: not found, 690 inputs Termo, a process per input (before persistent mode), run 7: not found, 699 inputs Termo, a process per input (before persistent mode), run 8: not found, 688 inputs Termo, a process per input (before persistent mode), run 9: not found, 684 inputs Termo, a process per input (before persistent mode), run 10: not found, 689 inputs libFuzzer libFuzzer, run 1: 0.4 s, 8.9k inputs libFuzzer, run 2: 3.8 s, 288k inputs libFuzzer, run 3: 3.5 s, 303k inputs libFuzzer, run 4: 0.8 s, 40k inputs libFuzzer, run 5: 3.9 s, 298k inputs libFuzzer, run 6: 2.4 s, 187k inputs libFuzzer, run 7: 7.5 s, 517k inputs libFuzzer, run 8: 5.5 s, 425k inputs libFuzzer, run 9: 2.7 s, 203k inputs libFuzzer, run 10: 8.3 s, 531k inputs AFL++ AFL++, run 1: 9.4 s, 448k inputs AFL++, run 2: 17 s, 671k inputs AFL++, run 3: 9.3 s, 442k inputs AFL++, run 4: 7.9 s, 309k inputs AFL++, run 5: 14 s, 712k inputs AFL++, run 6: 13 s, 662k inputs AFL++, run 7: 9.4 s, 439k inputs AFL++, run 8: 11 s, 564k inputs AFL++, run 9: 15 s, 722k inputs AFL++, run 10: 18 s, 962k inputs Random baseline Random baseline, run 1: not found, 0 inputs Random baseline, run 2: not found, 0 inputs Random baseline, run 3: not found, 0 inputs Random baseline, run 4: not found, 0 inputs Random baseline, run 5: not found, 0 inputs Random baseline, run 6: not found, 0 inputs Random baseline, run 7: not found, 0 inputs Random baseline, run 8: not found, 0 inputs Random baseline, run 9: not found, 0 inputs Random baseline, run 10: not found, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 3 of 10 > 60 s 3.1k Termo, a process per input (before persistent mode) 0 of 10 > 60 s 12 libFuzzer 10 of 10 3.6 s 76k AFL++ 10 of 10 12 s 48k Random baseline 0 of 10 > 60 s 0
LLVM 3.9.1 C++ demangler · crash · vetted with libFuzzerMemory errors caught by AddressSanitizer.
0.1 s 1 s 10 s 60 s not found Termo Termo, run 1: not found, 147k inputs Termo, run 2: 58 s, 154k inputs Termo, run 3: not found, 158k inputs Termo, run 4: not found, 165k inputs Termo, run 5: 57 s, 145k inputs Termo, run 6: not found, 157k inputs Termo, run 7: 12 s, 51k inputs Termo, run 8: 3.0 s, 12k inputs Termo, run 9: 14 s, 51k inputs Termo, run 10: not found, 133k inputs Termo, a process per input (before persistent mode) Termo, a process per input (before persistent mode), run 1: not found, 701 inputs Termo, a process per input (before persistent mode), run 2: not found, 699 inputs Termo, a process per input (before persistent mode), run 3: not found, 711 inputs Termo, a process per input (before persistent mode), run 4: not found, 692 inputs Termo, a process per input (before persistent mode), run 5: not found, 705 inputs Termo, a process per input (before persistent mode), run 6: not found, 693 inputs Termo, a process per input (before persistent mode), run 7: not found, 710 inputs Termo, a process per input (before persistent mode), run 8: not found, 698 inputs Termo, a process per input (before persistent mode), run 9: not found, 701 inputs Termo, a process per input (before persistent mode), run 10: not found, 769 inputs libFuzzer libFuzzer, run 1: 4.5 s, 546k inputs libFuzzer, run 2: not found, 2.7M inputs libFuzzer, run 3: 3.1 s, 373k inputs libFuzzer, run 4: 3.4 s, 415k inputs libFuzzer, run 5: 4.0 s, 453k inputs libFuzzer, run 6: not found, 631k inputs libFuzzer, run 7: not found, 778k inputs libFuzzer, run 8: 6.8 s, 822k inputs libFuzzer, run 9: 8.0 s, 889k inputs libFuzzer, run 10: 4.8 s, 563k inputs AFL++ AFL++, run 1: 10 s, 469k inputs AFL++, run 2: 11 s, 515k inputs AFL++, run 3: 9.6 s, 439k inputs AFL++, run 4: 12 s, 655k inputs AFL++, run 5: 11 s, 609k inputs AFL++, run 6: 8.4 s, 422k inputs AFL++, run 7: 20 s, 985k inputs AFL++, run 8: 7.7 s, 347k inputs AFL++, run 9: 14 s, 779k inputs AFL++, run 10: 8.2 s, 409k inputs Random baseline Random baseline, run 1: not found, 0 inputs Random baseline, run 2: not found, 0 inputs Random baseline, run 3: not found, 0 inputs Random baseline, run 4: not found, 0 inputs Random baseline, run 5: not found, 0 inputs Random baseline, run 6: not found, 0 inputs Random baseline, run 7: not found, 0 inputs Random baseline, run 8: not found, 0 inputs Random baseline, run 9: not found, 0 inputs Random baseline, run 10: not found, 0 inputs Tool Runs that found it Median time to find it Inputs per second Termo 5 of 10 59 s 2.6k Termo, a process per input (before persistent mode) 0 of 10 > 60 s 12 libFuzzer 7 of 10 5.8 s 115k AFL++ 10 of 10 11 s 50k Random baseline 0 of 10 > 60 s 0