Consensus Protocol Simulation Results Simulated time: 1200s per run, seeds 1-100 3 nodes, 2 clients, fault injection enabled, network partitioning enabled Column descriptions: Seed - RNG seed used for the simulation run Proto - Consensus protocol (VSR or Raft) Invocations - Number of client requests initiated OK - Requests that completed successfully with a response Timeouts - Requests that timed out without a response Rejected - Requests explicitly rejected (e.g. sent to a non-leader) Checks - Linearizability checks performed by the checker Steps - Total simulation scheduling steps (ticks across all hosts) Seed Proto Invocations OK Timeouts Rejected Checks Steps ----------------------------------------------------------------------- 1 VSR 2244 2206 33 5 2244 105648 1 Raft 3276 1700 368 1206 3274 363190 2 VSR 2883 2839 39 5 2883 126828 2 Raft 3394 2761 285 346 3392 171163 3 VSR 592 497 94 1 592 42548 3 Raft 2789 2358 330 99 2787 150699 4 VSR 1274 1231 37 6 1274 78222 4 Raft 2068 1362 464 240 2066 88436 5 VSR 1405 1372 31 1 1404 75712 5 Raft 2304 1630 416 256 2302 131192 6 VSR 2025 1975 49 0 2024 169653 6 Raft 2182 1244 447 489 2180 378921 7 VSR 955 856 98 1 955 56039 7 Raft 3433 1609 311 1511 3431 297830 8 VSR 720 636 79 4 719 46945 8 Raft 2498 1759 436 301 2496 123015 9 VSR 859 780 77 2 859 56003 9 Raft 2778 1816 362 599 2777 225590 10 VSR 1486 1401 84 1 1486 95773 10 Raft 3114 2093 321 698 3112 341220 11 VSR 456 302 153 1 456 33396 11 Raft 3441 1209 375 1855 3439 345485 12 VSR 1220 1128 88 2 1218 66620 12 Raft 2555 1064 458 1031 2553 370909 13 VSR 863 753 108 1 862 52065 13 Raft 1965 1210 494 259 1963 162897 14 VSR 645 524 115 5 644 44976 14 Raft 2498 1918 399 179 2496 138682 15 VSR 690 638 50 1 689 48727 15 Raft 2541 1871 381 287 2539 200612 16 VSR 944 835 106 1 942 52517 16 Raft 2369 1451 466 450 2367 465559 17 VSR 647 564 80 2 646 40272 17 Raft 2446 1846 399 199 2444 124084 18 VSR 392 310 76 4 390 35414 18 Raft 1955 923 527 503 1953 218171 19 VSR 1165 1068 97 0 1165 60283 19 Raft 2987 1849 363 773 2985 230511 20 VSR 2229 2164 62 2 2228 108081 20 Raft 2996 1742 381 871 2994 450695 21 VSR 1390 1341 44 5 1390 78704 21 Raft 2441 1485 412 542 2439 120767 22 VSR 1844 1758 81 5 1844 96250 22 Raft 3561 1897 306 1356 3559 212082 23 VSR 1393 1335 55 3 1393 79177 23 Raft 2524 1496 434 593 2523 222489 24 VSR 971 951 18 0 969 56647 24 Raft 2177 1606 412 157 2175 177816 25 VSR 458 376 77 5 458 35323 25 Raft 2507 1898 374 233 2505 139076 26 VSR 1177 1117 60 0 1177 70344 26 Raft 2583 1978 365 238 2581 186689 27 VSR 1042 937 104 1 1042 70667 27 Raft 2794 2237 355 200 2792 171007 28 VSR 1118 1067 43 6 1116 67368 28 Raft 2790 1870 357 561 2788 257457 29 VSR 683 610 73 0 683 45166 29 Raft 2557 1439 408 708 2555 110388 30 VSR 1202 1134 63 3 1200 64864 30 Raft 3312 2297 316 697 3310 406253 31 VSR 1466 1399 65 2 1466 83025 31 Raft 2818 1612 377 827 2816 311506 32 VSR 1207 1161 41 5 1207 68520 32 Raft 2676 1141 416 1117 2674 255671 33 VSR 1219 1134 83 1 1218 65923 33 Raft 3260 2844 274 140 3258 191445 34 VSR 1255 1229 24 1 1254 71120 34 Raft 3311 1372 405 1532 3309 428477 35 VSR 1197 1142 50 4 1196 73779 35 Raft 2435 1793 418 222 2433 147736 36 VSR 1560 1500 55 4 1559 89849 36 Raft 2110 1186 515 407 2108 310505 37 VSR 1487 1424 58 4 1486 148383 37 Raft 3223 1407 335 1479 3221 242814 38 VSR 1397 1349 42 5 1396 76827 38 Raft 2466 1260 441 763 2464 352797 39 VSR 1304 1249 53 1 1303 78321 39 Raft 3027 2062 343 620 3025 334793 40 VSR 1299 1270 25 2 1297 72474 40 Raft 2183 1213 479 489 2181 229529 41 VSR 1091 1040 41 8 1089 65193 41 Raft 2856 2333 339 182 2854 162726 42 VSR 496 410 84 1 495 36493 42 Raft 2421 1797 400 222 2419 163015 43 VSR 658 562 92 2 656 46387 43 Raft 2834 2134 362 336 2832 161248 44 VSR 1372 1318 49 4 1371 75563 44 Raft 2654 2076 370 206 2652 262333 45 VSR 257 127 129 0 256 33593 45 Raft 3146 1319 366 1459 3144 395077 46 VSR 1515 1458 53 2 1513 105709 46 Raft 3320 1456 382 1480 3318 444523 47 VSR 1057 1017 39 0 1056 61117 47 Raft 2243 1351 467 423 2241 210836 48 VSR 1195 1140 51 3 1194 69487 48 Raft 2378 1708 422 246 2376 148188 49 VSR 950 876 71 2 949 55394 49 Raft 2984 2444 309 229 2982 153760 50 VSR 964 875 88 1 964 57668 50 Raft 2889 2295 344 248 2887 182648 51 VSR 1302 1250 49 1 1300 74028 51 Raft 2363 1734 415 212 2361 127568 52 VSR 1205 1111 91 2 1204 64727 52 Raft 2905 2380 303 221 2904 170346 53 VSR 869 744 124 0 868 95545 53 Raft 2203 964 444 794 2202 306208 54 VSR 408 333 72 3 408 36481 54 Raft 2113 1409 434 268 2111 103004 55 VSR 494 443 50 1 494 40161 55 Raft 2618 1937 375 305 2617 239299 56 VSR 1300 1231 66 2 1299 70686 56 Raft 3401 2723 282 394 3399 194017 57 VSR 238 145 93 0 238 34783 57 Raft 1941 1255 451 233 1939 90352 58 VSR 922 854 63 5 922 54772 58 Raft 2173 1303 448 420 2171 225395 59 VSR 1941 1853 84 3 1940 103258 59 Raft 2501 1237 420 842 2499 214547 60 VSR 1766 1645 114 5 1764 86384 60 Raft 2909 1062 437 1408 2907 446530 61 VSR 1630 1557 68 4 1629 76775 61 Raft 2956 2258 333 363 2954 199725 62 VSR 1077 1023 51 2 1076 107542 62 Raft 3418 1993 303 1120 3416 178317 63 VSR 2158 2107 47 3 2157 107086 63 Raft 2245 1039 473 731 2243 331394 64 VSR 1804 1743 53 7 1803 101345 64 Raft 2804 2152 325 325 2802 206594 65 VSR 934 825 106 1 932 77299 65 Raft 2279 1090 486 701 2277 266669 66 VSR 798 726 69 2 797 59313 66 Raft 2105 1135 444 524 2103 246688 67 VSR 965 874 91 0 965 71117 67 Raft 2268 1598 439 229 2266 103555 68 VSR 438 327 109 1 437 54528 68 Raft 2787 1755 395 635 2785 347905 69 VSR 922 869 52 1 922 61234 69 Raft 2588 1752 425 409 2586 218784 70 VSR 720 607 110 3 720 47228 70 Raft 2424 1495 414 513 2422 255104 71 VSR 1067 982 81 4 1067 62847 71 Raft 2207 1583 398 224 2205 165271 72 VSR 673 561 110 0 671 48927 72 Raft 2927 2052 348 525 2925 145377 73 VSR 1361 1270 88 2 1360 70464 73 Raft 2798 1976 353 467 2796 131273 74 VSR 1891 1842 43 5 1890 104058 74 Raft 2176 1640 405 129 2174 123942 75 VSR 970 879 91 0 970 86026 75 Raft 2456 879 491 1084 2454 380910 76 VSR 851 737 111 2 850 55131 76 Raft 3226 1945 343 936 3224 158287 77 VSR 610 474 133 2 609 40458 77 Raft 2492 1882 387 221 2490 134293 78 VSR 1269 1232 31 6 1269 69782 78 Raft 3411 1575 329 1506 3410 238137 79 VSR 921 859 62 0 921 55960 79 Raft 3008 2516 335 155 3006 176544 80 VSR 1271 1230 36 5 1271 77391 80 Raft 2605 1033 426 1144 2603 287940 81 VSR 835 708 124 2 834 52299 81 Raft 2582 1845 361 374 2580 140619 82 VSR 1024 913 109 1 1023 58016 82 Raft 2921 2264 330 325 2919 143004 83 VSR 922 802 120 0 922 51388 83 Raft 2600 1885 412 301 2598 129191 84 VSR 1533 1480 52 1 1533 79724 84 Raft 2344 1753 440 149 2342 129605 85 VSR 1650 1588 58 4 1650 88562 85 Raft 3366 1419 355 1590 3364 379641 86 VSR 884 763 118 1 882 49372 86 Raft 2736 1258 457 1019 2734 552128 87 VSR 1072 1003 68 0 1071 59323 87 Raft 1875 968 506 399 1873 253771 88 VSR 1493 1437 52 4 1493 92016 88 Raft 1902 1285 445 170 1900 109923 89 VSR 1294 1239 53 0 1292 69379 89 Raft 1922 1204 471 245 1920 91616 90 VSR 1215 1119 93 2 1214 67086 90 Raft 3440 2057 296 1085 3438 284840 91 VSR 2176 2142 28 6 2176 108769 91 Raft 2606 2025 358 221 2604 136452 92 VSR 594 550 42 0 592 43714 92 Raft 2563 1504 432 625 2561 370793 93 VSR 775 699 76 0 775 67757 93 Raft 1990 826 509 653 1988 320932 94 VSR 546 455 88 3 546 35972 94 Raft 2449 1686 399 362 2447 216855 95 VSR 420 326 94 0 420 33058 95 Raft 2506 1891 379 234 2504 141706 96 VSR 583 509 70 4 583 40050 96 Raft 2307 1263 473 569 2305 325134 97 VSR 1991 1965 21 3 1989 95473 97 Raft 2679 1360 397 920 2677 281323 98 VSR 1198 1123 73 2 1198 78181 98 Raft 2550 1467 467 614 2548 416874 99 VSR 954 884 67 3 954 72020 99 Raft 2051 1356 481 212 2049 102556 100 VSR 1426 1319 105 1 1425 76369 100 Raft 2817 1402 440 973 2815 474134 ----------------------------------------------------------------------- Summary Statistics VSR (100 completed runs, 0 violations): Avg invocations: 1132.8 Avg ok: 1057.4 Avg timeouts: 72.3 Avg rejected: 2.3 Avg steps: 69089.2 Total invocations: 113278 Total ok: 105742 Total timeouts: 7226 Total rejected: 234 OK rate: 93.3% Timeout rate: 6.4% Rejection rate: 0.2% Raft (100 completed runs, 0 violations): Avg invocations: 2645.8 Avg ok: 1664.9 Avg timeouts: 397.6 Avg rejected: 581.4 Avg steps: 234875.8 Total invocations: 264582 Total ok: 166491 Total timeouts: 39755 Total rejected: 58142 OK rate: 62.9% Timeout rate: 15.0% Rejection rate: 22.0%