BENCHMARK INFORMATION benchmark definition: /mnt/goblint-svcomp/goblint-bench/bench/concrat/race-challenges/goblint.xml name: goblint run sets: large-program.Race-Challenges, concrat-libs.Race-Challenges, concrat.Race-Challenges, svcomp.Race-Challenges date: Fri, 2023-11-03 09:51:13 UTC tool: Goblint heads/pldi-bench-0-gf52baee45 tool executable: ./goblint options: parallel runs: 2 resource limits: - memory: 15000.0 MB - time: 900 s - cpu cores: 8 hardware requirements: - cpu cores: 8 - memory: 15000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: goblint-new os: Linux-5.15.0-86-generic-x86_64-with-glibc2.35 cpu: AMD EPYC Processor (with IBPB) - cores: 16 - max frequency: 2250.0 MHz ram: 33649.393663999996 MB ------------------------------------------------------------ large-program.Race-Challenges Run set 1 of 4 with options '--conf conf/examples/large-program.json --enable ana.sv-comp.enabled --enable ana.sv-comp.functions --disable witness.graphml.enabled --set lib.activated[+] zlib --set lib.activated[+] pcre --set lib.activated[+] liblzma' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 0.12 0.12 None per-thread-array-index-race-2.yml unknown 0.12 0.12 None per-thread-array-index-race.yml unknown 0.12 0.12 None per-thread-array-index.yml unknown 0.13 0.13 None per-thread-array-init-race.yml unknown 0.12 0.12 None per-thread-array-init.yml unknown 0.13 0.13 None per-thread-array-join-counter-2.yml unknown 0.13 0.13 None per-thread-array-join-counter-race-2.yml unknown 0.13 0.13 None per-thread-array-join-counter-race-3.yml unknown 0.13 0.13 None per-thread-array-join-counter-race-4.yml unknown 0.13 0.13 None per-thread-array-join-counter-race.yml unknown 0.14 0.14 None per-thread-array-join-counter.yml unknown 0.12 0.12 None per-thread-array-ptr-race.yml unknown 0.11 0.12 None per-thread-array-ptr.yml unknown 0.13 0.13 None per-thread-index-bitmask-race-2.yml unknown 0.12 0.12 None per-thread-index-bitmask-race-3.yml unknown 0.12 0.12 None per-thread-index-bitmask-race.yml unknown 0.13 0.13 None per-thread-index-bitmask.yml unknown 0.12 0.12 None per-thread-index-inc-race-2.yml unknown 0.12 0.12 None per-thread-index-inc-race.yml unknown 0.12 0.12 None per-thread-index-inc.yml unknown 0.13 0.13 None per-thread-struct-in-array-race.yml unknown 0.12 0.12 None per-thread-struct-in-array.yml unknown 0.12 0.12 None per-thread-struct-race.yml unknown 0.12 0.12 None per-thread-struct-tid-join.yml unknown 0.12 0.12 None per-thread-struct-tid.yml unknown 0.12 0.12 None per-thread-struct.yml unknown 0.12 0.12 None semaphore-posix-race-2.yml unknown 0.12 0.12 None semaphore-posix-race.yml unknown 0.11 0.11 None semaphore-posix.yml unknown 0.11 0.11 None thread-join-array-const-race-2.yml unknown 0.12 0.12 None thread-join-array-const-race-3.yml unknown 0.12 0.12 None thread-join-array-const-race.yml unknown 0.11 0.11 None thread-join-array-const.yml unknown 0.11 0.11 None thread-join-array-dynamic-race-2.yml unknown 0.12 0.12 None thread-join-array-dynamic-race-3.yml unknown 0.12 0.12 None thread-join-array-dynamic-race.yml unknown 0.13 0.13 None thread-join-array-dynamic.yml unknown 0.12 0.13 None thread-join-binomial-race-2.yml unknown 0.12 0.12 None thread-join-binomial-race-3.yml unknown 0.11 0.11 None thread-join-binomial-race.yml unknown 0.12 0.12 None thread-join-binomial.yml unknown 0.12 0.12 None thread-join-counter-inner-2.yml unknown 0.10 0.11 None thread-join-counter-inner-3.yml unknown 0.12 0.12 None thread-join-counter-inner-race-2.yml unknown 0.12 0.12 None thread-join-counter-inner-race-3.yml unknown 0.12 0.12 None thread-join-counter-inner-race-4.yml unknown 0.12 0.13 None thread-join-counter-inner-race-5.yml unknown 0.11 0.11 None thread-join-counter-inner-race.yml unknown 0.11 0.11 None thread-join-counter-inner.yml unknown 0.12 0.12 None thread-join-counter-outer-race-2.yml unknown 0.12 0.12 None thread-join-counter-outer-race-3.yml unknown 0.11 0.11 None thread-join-counter-outer-race-4.yml unknown 0.12 0.12 None thread-join-counter-outer-race.yml unknown 0.10 0.11 None thread-join-counter-outer.yml unknown 0.11 0.11 None thread-local-pthread-value-cond.yml unknown 0.12 0.12 None thread-local-pthread-value.yml unknown 0.12 0.12 None thread-local-value-cond.yml unknown 0.13 0.13 None thread-local-value-dynamic.yml unknown 0.12 0.12 None thread-local-value-race.yml unknown 0.12 0.12 None thread-local-value.yml unknown 0.13 0.13 None value-barrier-race.yml unknown 0.13 0.13 None value-barrier.yml unknown 0.11 0.11 None --------------------------------------------------------------------------------------------------------- Run set 1 done 8.71 9.77 - concrat-libs.Race-Challenges Run set 2 of 4 with options '--conf /mnt/goblint-svcomp/goblint-bench/bench/index/conf/concrat.json --enable ana.sv-comp.enabled --enable ana.sv-comp.functions --disable witness.graphml.enabled --set lib.activated[+] zlib --set lib.activated[+] pcre --set lib.activated[+] liblzma' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 0.13 0.13 None per-thread-array-index-race-2.yml unknown 0.14 0.14 None per-thread-array-index-race.yml unknown 0.13 0.13 None per-thread-array-index.yml unknown 0.13 0.13 None per-thread-array-init-race.yml true 0.13 0.13 None per-thread-array-init.yml true 0.13 0.13 None per-thread-array-join-counter-2.yml unknown 0.16 0.16 None per-thread-array-join-counter-race-2.yml unknown 0.16 0.16 None per-thread-array-join-counter-race-3.yml unknown 0.15 0.15 None per-thread-array-join-counter-race-4.yml unknown 0.14 0.14 None per-thread-array-join-counter-race.yml unknown 0.15 0.15 None per-thread-array-join-counter.yml unknown 0.16 0.16 None per-thread-array-ptr-race.yml unknown 0.13 0.13 None per-thread-array-ptr.yml unknown 0.13 0.13 None per-thread-index-bitmask-race-2.yml unknown 0.13 0.14 None per-thread-index-bitmask-race-3.yml unknown 0.14 0.14 None per-thread-index-bitmask-race.yml unknown 0.13 0.13 None per-thread-index-bitmask.yml unknown 0.13 0.14 None per-thread-index-inc-race-2.yml unknown 0.14 0.14 None per-thread-index-inc-race.yml unknown 0.13 0.13 None per-thread-index-inc.yml unknown 0.13 0.13 None per-thread-struct-in-array-race.yml unknown 0.13 0.13 None per-thread-struct-in-array.yml unknown 0.14 0.14 None per-thread-struct-race.yml unknown 0.14 0.14 None per-thread-struct-tid-join.yml unknown 0.13 0.13 None per-thread-struct-tid.yml unknown 0.13 0.13 None per-thread-struct.yml unknown 0.13 0.13 None semaphore-posix-race-2.yml unknown 0.13 0.13 None semaphore-posix-race.yml unknown 0.13 0.13 None semaphore-posix.yml unknown 0.13 0.13 None thread-join-array-const-race-2.yml unknown 0.14 0.14 None thread-join-array-const-race-3.yml unknown 0.13 0.13 None thread-join-array-const-race.yml unknown 0.12 0.12 None thread-join-array-const.yml unknown 0.13 0.13 None thread-join-array-dynamic-race-2.yml unknown 0.13 0.13 None thread-join-array-dynamic-race-3.yml unknown 0.14 0.14 None thread-join-array-dynamic-race.yml unknown 0.13 0.13 None thread-join-array-dynamic.yml unknown 0.13 0.13 None thread-join-binomial-race-2.yml unknown 0.14 0.14 None thread-join-binomial-race-3.yml unknown 0.14 0.14 None thread-join-binomial-race.yml unknown 0.14 0.14 None thread-join-binomial.yml unknown 0.14 0.14 None thread-join-counter-inner-2.yml unknown 0.13 0.13 None thread-join-counter-inner-3.yml unknown 0.15 0.15 None thread-join-counter-inner-race-2.yml unknown 0.14 0.14 None thread-join-counter-inner-race-3.yml unknown 0.14 0.14 None thread-join-counter-inner-race-4.yml unknown 0.14 0.14 None thread-join-counter-inner-race-5.yml unknown 0.13 0.13 None thread-join-counter-inner-race.yml unknown 0.14 0.14 None thread-join-counter-inner.yml unknown 0.14 0.14 None thread-join-counter-outer-race-2.yml unknown 0.13 0.13 None thread-join-counter-outer-race-3.yml unknown 0.13 0.14 None thread-join-counter-outer-race-4.yml unknown 0.13 0.13 None thread-join-counter-outer-race.yml unknown 0.12 0.12 None thread-join-counter-outer.yml unknown 0.13 0.13 None thread-local-pthread-value-cond.yml unknown 0.15 0.15 None thread-local-pthread-value.yml unknown 0.14 0.15 None thread-local-value-cond.yml unknown 0.14 0.14 None thread-local-value-dynamic.yml unknown 0.15 0.16 None thread-local-value-race.yml unknown 0.13 0.13 None thread-local-value.yml true 0.13 0.13 None value-barrier-race.yml unknown 0.13 0.13 None value-barrier.yml unknown 0.13 0.13 None --------------------------------------------------------------------------------------------------------- Run set 2 done 9.74 10.15 - concrat.Race-Challenges Run set 3 of 4 with options '--conf /mnt/goblint-svcomp/goblint-bench/bench/index/conf/concrat.json --enable ana.sv-comp.enabled --enable ana.sv-comp.functions --disable witness.graphml.enabled' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 0.13 0.13 None per-thread-array-index-race-2.yml unknown 0.13 0.13 None per-thread-array-index-race.yml unknown 0.14 0.14 None per-thread-array-index.yml unknown 0.12 0.12 None per-thread-array-init-race.yml true 0.14 0.14 None per-thread-array-init.yml true 0.13 0.13 None per-thread-array-join-counter-2.yml unknown 0.15 0.15 None per-thread-array-join-counter-race-2.yml unknown 0.16 0.16 None per-thread-array-join-counter-race-3.yml unknown 0.16 0.16 None per-thread-array-join-counter-race-4.yml unknown 0.15 0.15 None per-thread-array-join-counter-race.yml unknown 0.15 0.19 None per-thread-array-join-counter.yml unknown 0.15 0.15 None per-thread-array-ptr-race.yml unknown 0.13 0.13 None per-thread-array-ptr.yml unknown 0.13 0.13 None per-thread-index-bitmask-race-2.yml unknown 0.13 0.14 None per-thread-index-bitmask-race-3.yml unknown 0.14 0.14 None per-thread-index-bitmask-race.yml unknown 0.14 0.14 None per-thread-index-bitmask.yml unknown 0.14 0.14 None per-thread-index-inc-race-2.yml unknown 0.13 0.13 None per-thread-index-inc-race.yml unknown 0.14 0.14 None per-thread-index-inc.yml unknown 0.14 0.14 None per-thread-struct-in-array-race.yml unknown 0.13 0.13 None per-thread-struct-in-array.yml unknown 0.13 0.13 None per-thread-struct-race.yml unknown 0.13 0.14 None per-thread-struct-tid-join.yml unknown 0.13 0.13 None per-thread-struct-tid.yml unknown 0.13 0.13 None per-thread-struct.yml unknown 0.13 0.13 None semaphore-posix-race-2.yml unknown 0.13 0.13 None semaphore-posix-race.yml unknown 0.13 0.13 None semaphore-posix.yml unknown 0.12 0.12 None thread-join-array-const-race-2.yml unknown 0.12 0.12 None thread-join-array-const-race-3.yml unknown 0.12 0.12 None thread-join-array-const-race.yml unknown 0.13 0.13 None thread-join-array-const.yml unknown 0.11 0.11 None thread-join-array-dynamic-race-2.yml unknown 0.13 0.13 None thread-join-array-dynamic-race-3.yml unknown 0.14 0.14 None thread-join-array-dynamic-race.yml unknown 0.12 0.12 None thread-join-array-dynamic.yml unknown 0.13 0.13 None thread-join-binomial-race-2.yml unknown 0.14 0.14 None thread-join-binomial-race-3.yml unknown 0.12 0.13 None thread-join-binomial-race.yml unknown 0.14 0.14 None thread-join-binomial.yml unknown 0.14 0.14 None thread-join-counter-inner-2.yml unknown 0.13 0.13 None thread-join-counter-inner-3.yml unknown 0.15 0.16 None thread-join-counter-inner-race-2.yml unknown 0.15 0.15 None thread-join-counter-inner-race-3.yml unknown 0.14 0.14 None thread-join-counter-inner-race-4.yml unknown 0.14 0.14 None thread-join-counter-inner-race-5.yml unknown 0.13 0.13 None thread-join-counter-inner-race.yml unknown 0.14 0.14 None thread-join-counter-inner.yml unknown 0.14 0.14 None thread-join-counter-outer-race-2.yml unknown 0.12 0.12 None thread-join-counter-outer-race-3.yml unknown 0.13 0.13 None thread-join-counter-outer-race-4.yml unknown 0.13 0.13 None thread-join-counter-outer-race.yml unknown 0.12 0.12 None thread-join-counter-outer.yml unknown 0.13 0.13 None thread-local-pthread-value-cond.yml unknown 0.15 0.15 None thread-local-pthread-value.yml unknown 0.15 0.15 None thread-local-value-cond.yml unknown 0.13 0.13 None thread-local-value-dynamic.yml unknown 0.16 0.16 None thread-local-value-race.yml unknown 0.13 0.13 None thread-local-value.yml true 0.13 0.13 None value-barrier-race.yml unknown 0.13 0.13 None value-barrier.yml unknown 0.13 0.13 None --------------------------------------------------------------------------------------------------------- Run set 3 done 9.79 10.51 - svcomp.Race-Challenges Run set 4 of 4 with options '--conf conf/svcomp.json' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 2.11 2.12 None per-thread-array-index-race-2.yml unknown 2.23 2.23 None per-thread-array-index-race.yml unknown 2.16 2.16 None per-thread-array-index.yml unknown 2.15 2.15 None per-thread-array-init-race.yml true 1.73 1.74 None per-thread-array-init.yml true 1.68 1.68 None per-thread-array-join-counter-2.yml unknown 1.70 1.70 None per-thread-array-join-counter-race-2.yml unknown 1.88 1.88 None per-thread-array-join-counter-race-3.yml unknown 1.87 1.87 None per-thread-array-join-counter-race-4.yml unknown 1.76 1.77 None per-thread-array-join-counter-race.yml unknown 2.14 2.14 None per-thread-array-join-counter.yml unknown 1.86 1.86 None per-thread-array-ptr-race.yml unknown 2.39 2.39 None per-thread-array-ptr.yml unknown 2.39 2.39 None per-thread-index-bitmask-race-2.yml unknown 0.86 0.86 None per-thread-index-bitmask-race-3.yml unknown 0.87 0.87 None per-thread-index-bitmask-race.yml unknown 0.97 0.98 None per-thread-index-bitmask.yml unknown 0.88 0.88 None per-thread-index-inc-race-2.yml unknown 2.28 2.28 None per-thread-index-inc-race.yml unknown 2.25 2.25 None per-thread-index-inc.yml unknown 2.29 2.29 None per-thread-struct-in-array-race.yml unknown 2.41 2.42 None per-thread-struct-in-array.yml unknown 2.24 2.25 None per-thread-struct-race.yml unknown 2.16 2.16 None per-thread-struct-tid-join.yml unknown 0.92 0.92 None per-thread-struct-tid.yml unknown 0.94 0.95 None per-thread-struct.yml unknown 0.96 0.96 None semaphore-posix-race-2.yml unknown 2.09 2.09 None semaphore-posix-race.yml unknown 2.15 2.15 None semaphore-posix.yml unknown 2.11 2.11 None thread-join-array-const-race-2.yml unknown 0.14 0.14 None thread-join-array-const-race-3.yml unknown 0.16 0.16 None thread-join-array-const-race.yml unknown 0.15 0.15 None thread-join-array-const.yml unknown 0.14 0.14 None thread-join-array-dynamic-race-2.yml unknown 1.71 1.71 None thread-join-array-dynamic-race-3.yml unknown 19.11 19.11 None thread-join-array-dynamic-race.yml unknown 2.17 2.18 None thread-join-array-dynamic.yml unknown 2.19 2.19 None thread-join-binomial-race-2.yml unknown 17.28 17.29 None thread-join-binomial-race-3.yml unknown 17.56 17.64 None thread-join-binomial-race.yml unknown 17.36 17.36 None thread-join-binomial.yml unknown 17.61 17.63 None thread-join-counter-inner-2.yml unknown 3.26 3.26 None thread-join-counter-inner-3.yml unknown 4.19 4.19 None thread-join-counter-inner-race-2.yml unknown 6.49 6.49 None thread-join-counter-inner-race-3.yml unknown 7.05 7.05 None thread-join-counter-inner-race-4.yml unknown 6.90 6.91 None thread-join-counter-inner-race-5.yml unknown 1.95 1.96 None thread-join-counter-inner-race.yml unknown 3.33 3.33 None thread-join-counter-inner.yml unknown 6.94 6.94 None thread-join-counter-outer-race-2.yml unknown 0.91 0.91 None thread-join-counter-outer-race-3.yml unknown 0.93 0.93 None thread-join-counter-outer-race-4.yml unknown 0.91 0.91 None thread-join-counter-outer-race.yml unknown 0.50 0.50 None thread-join-counter-outer.yml unknown 0.89 0.90 None thread-local-pthread-value-cond.yml unknown 4.35 4.35 None thread-local-pthread-value.yml unknown 3.51 3.52 None thread-local-value-cond.yml unknown 2.56 2.56 None thread-local-value-dynamic.yml unknown 14.69 14.69 None thread-local-value-race.yml unknown 2.92 2.92 None thread-local-value.yml true 2.32 2.32 None value-barrier-race.yml unknown 2.04 2.04 None value-barrier.yml unknown 5.15 5.15 None --------------------------------------------------------------------------------------------------------- Run set 4 done 233.08 121.90 - Statistics: 252 Files correct: 6 correct true: 6 correct false: 0 incorrect: 3 incorrect true: 3 incorrect false: 0 unknown: 243 Score: -84 (max: 356)