Experiments on termination problems
General Information
Our termination tool employs the dependency pair method with cycle analysis of dependency graphs, reduction pairs, and rule removal by monotone reduction pairs.
- L
- lexicographic path orders (LPO) with argument filtering
- Ed
- echelon-form matrix interpretations on Nd with 0,1-matrix coefficients, equipped with the lexicographic order (Section 5)
- Sd
- matrix interpretations on Nd with 0,1-matrix coefficients, equipped with the standard order (by Endrullis et al. 2008)
- AProVE
- AProVE 2024
- NaTT
- NaTT (termCOMP 2024 version)
For instance, E1L stands for the lexicographic combination of E1 and L. Note that E1 and S1 are identical. Concerning heterogeneous combinations, (e.g.) E1 ⊆ E1L does not hold in general, as weak orientation by E1 does not guarantee weak orientation by L.
Y: YES | proved termination |
---|---|
N: NO | proved non-termination |
M: MAYBE | failed to prove |
T: TIMEOUT | exceeded time limit 60 seconds |
E: ERROR | tool terminated with some error |
Note
- L ⊆ LL ⊇ LLL. The last reverse inclusion is due to timeouts.
- E1 ⊆ E1E1 ⊆ E2 ⊆ E3 ⊈ E4. The non-inclusion is due to timeouts. |E3 ∪ E4| = 585.
- S2 ⊈ S2S2 ⊇ S2S2S2; The non-inclusion and the reverse inclusion are simply due to timeouts. |S2 ∪ S2S2| = 623.
- |L ∪ E1| = 512 and |L ∪ E1 ∪ LE1 ∪ E1L| = |L ∪ E1 ∪ E1L| = 537.
- |L ∪ E1 ∪ S2| = 625.
- |E1L or E2L or E3L or E4L| = 568
- The union of Ed, L, and their combinations amounts to 592.
- The union of all except AProVE and NaTT amounts to 649, which is covered by LL ∪ E3 ∪ E4 ∪ S2 ∪ S2S2 ∪ E1L.
- The 649 contains 3 problems that AProVE missed but they are merely due to a parse error and efficiency reasons.
- The 649 contains 8 problems that NaTT missed. Here 3 problems can be
shown by S2 and L, but the remaining 5 problems are handled by E3, E4, or
S2S2:
AG01_3.40, Transformed_CSR_04_Ex4_DLMMU04_iGM, Transformed_CSR_04_LengthOfFiniteLists_nokinds_noand_C, and Transformed_CSR_04_PEANO_nokinds_noand_C.
status | L | LL | LLL | E1 | E2 | E3 | E4 | S2 | S2S2 | S2S2S2 | E1E1 | E1L | E2L | E3L | E4L | LE1 | LE2 | LE3 | LE4 | E2L | E3L | E4L | E2S2 | S2E2 | AProVE | NaTT | total |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
YES | 372 | 389 | 387 | 477 | 562 | 566 | 564 | 596 | 619 | 617 | 506 | 496 | 559 | 565 | 563 | 406 | 410 | 411 | 409 | 559 | 565 | 563 | 595 | 615 | 1023 | 881 | 1073 |
(sec) | 73.83 | 166.67 | 143.18 | 60.92 | 120.36 | 366.21 | 580.03 | 271.50 | 460.35 | 724.95 | 60.31 | 75.59 | 186.07 | 366.61 | 682.95 | 92.25 | 109.28 | 205.78 | 260.93 | 186.07 | 366.61 | 682.95 | 332.17 | 469.70 | 1896.54 | 493.04 | |
NO | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 60 | 273 | 170 | 275 |
(sec) | 0.86 | 0.84 | 0.85 | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 0.85 | 0.84 | 0.84 | 0.84 | 0.83 | 0.84 | 0.84 | 0.85 | 0.85 | 0.85 | 0.84 | 0.83 | 0.84 | 0.84 | 0.84 | 0.84 | 1141.87 | 35.26 | |
MAYBE | 1083 | 1062 | 1054 | 983 | 892 | 874 | 818 | 848 | 809 | 788 | 954 | 959 | 895 | 880 | 825 | 1049 | 1045 | 1043 | 1028 | 895 | 880 | 825 | 841 | 819 | 1 | 441 | 1126 |
(sec) | 436.59 | 987.49 | 1235.63 | 213.73 | 513.18 | 1193.87 | 2670.08 | 802.40 | 1715.30 | 2073.38 | 314.62 | 539.80 | 788.02 | 1364.56 | 2835.05 | 506.75 | 636.70 | 1090.14 | 1717.72 | 788.02 | 1364.56 | 2835.05 | 1118.22 | 1455.36 | 33.24 | 968.02 | |
TIMEOUT | 13 | 17 | 27 | 8 | 14 | 28 | 86 | 24 | 40 | 63 | 8 | 13 | 14 | 23 | 80 | 13 | 13 | 14 | 31 | 14 | 23 | 80 | 32 | 34 | 229 | 35 | 283 |
(sec) | 780.00 | 1020.00 | 1620.00 | 480.00 | 840.00 | 1680.00 | 5160.00 | 1440.00 | 2400.00 | 3780.00 | 480.00 | 780.00 | 840.00 | 1380.00 | 4800.00 | 780.00 | 780.00 | 840.00 | 1860.00 | 840.00 | 1380.00 | 4800.00 | 1920.00 | 2040.00 | 13740.00 | 2100.00 | |
ERROR | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 1 | 3 |
(sec) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.22 | 35.79 | |
total | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 | 1528 |