BENCHMARK INFORMATION benchmark definition: /mnt/goblint-svcomp/goblint-bench/bench/concrat/goblint.xml name: goblint run sets: large-program.Race-Challenges, concrat-libs.Race-Challenges, concrat.Race-Challenges, svcomp.Race-Challenges date: Wed, 2023-10-25 14:29:10 UTC tool: Goblint heads/pldi-bench-0-ge4bf5ac88 tool executable: ./goblint options: parallel runs: 7 resource limits: - memory: 4000.0 MB - time: 900 s - cpu cores: 1 hardware requirements: - cpu cores: 1 - memory: 4000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: goblint-new os: Linux-5.15.0-86-generic-x86_64-with-glibc2.35 cpu: AMD EPYC Processor (with IBPB) - cores: 16 - max frequency: 2250.0 MHz ram: 33649.393663999996 MB ------------------------------------------------------------ large-program.Race-Challenges Run set 1 of 4 with options '--conf conf/examples/large-program.json --enable ana.sv-comp.enabled --disable witness.enabled --set lib.activated[+] zlib --set lib.activated[+] pcre --set lib.activated[+] liblzma' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 0.11 0.40 None per-thread-array-index-race-2.yml unknown 0.10 0.40 None per-thread-array-index-race.yml unknown 0.11 0.39 None per-thread-array-index.yml unknown 0.10 0.36 None per-thread-array-init-race.yml unknown 0.09 0.35 None per-thread-array-init.yml unknown 0.10 0.33 None per-thread-array-join-counter-race-2.yml unknown 0.11 0.33 None per-thread-array-join-counter-race-3.yml unknown 0.09 0.09 None per-thread-array-join-counter-race.yml unknown 0.09 0.09 None per-thread-array-join-counter.yml unknown 0.09 0.09 None per-thread-array-ptr-race.yml unknown 0.08 0.08 None per-thread-array-ptr.yml unknown 0.07 0.08 None per-thread-index-bitmask-race-2.yml unknown 0.08 0.08 None per-thread-index-bitmask-race-3.yml unknown 0.09 0.09 None per-thread-index-bitmask-race.yml unknown 0.08 0.09 None per-thread-index-bitmask.yml unknown 0.08 0.08 None per-thread-index-inc-race-2.yml unknown 0.08 0.08 None per-thread-index-inc-race.yml unknown 0.08 0.08 None per-thread-index-inc.yml unknown 0.08 0.08 None per-thread-struct-in-array-race.yml unknown 0.08 0.08 None per-thread-struct-in-array.yml unknown 0.08 0.08 None per-thread-struct-race.yml unknown 0.08 0.08 None per-thread-struct-tid.yml unknown 0.08 0.08 None per-thread-struct.yml unknown 0.08 0.08 None semaphore-posix-race-2.yml unknown 0.09 0.09 None semaphore-posix-race.yml unknown 0.08 0.08 None semaphore-posix.yml unknown 0.08 0.08 None smtprc-tid.yml unknown 0.10 0.10 None thread-join-array-const-race-2.yml unknown 0.07 0.07 None thread-join-array-const-race-3.yml unknown 0.07 0.07 None thread-join-array-const-race.yml unknown 0.07 0.07 None thread-join-array-const.yml unknown 0.07 0.07 None thread-join-array-dynamic-race-2.yml unknown 0.07 0.07 None thread-join-array-dynamic-race-3.yml unknown 0.08 0.08 None thread-join-array-dynamic-race.yml unknown 0.08 0.08 None thread-join-array-dynamic.yml unknown 0.08 0.08 None thread-join-binomial-race-2.yml unknown 0.08 0.08 None thread-join-binomial-race.yml unknown 0.08 0.08 None thread-join-binomial.yml unknown 0.08 0.08 None thread-join-counter-inner-race-2.yml unknown 0.08 0.08 None thread-join-counter-inner-race-3.yml unknown 0.08 0.08 None thread-join-counter-inner-race-4.yml unknown 0.07 0.07 None thread-join-counter-inner-race-5.yml unknown 0.09 0.09 None thread-join-counter-inner-race.yml unknown 0.08 0.08 None thread-join-counter-inner.yml unknown 0.08 0.08 None thread-join-counter-outer-race-2.yml unknown 0.07 0.08 None thread-join-counter-outer-race-3.yml unknown 0.07 0.07 None thread-join-counter-outer-race-4.yml unknown 0.07 0.07 None thread-join-counter-outer-race.yml unknown 0.07 0.07 None thread-join-counter-outer.yml unknown 0.07 0.07 None thread-local-pthread.yml unknown 0.08 0.08 None thread-local-value-dynamic.yml unknown 0.08 0.09 None thread-local-value.yml unknown 0.08 0.08 None value-barrier-race.yml unknown 0.07 0.07 None value-barrier.yml unknown 0.08 0.08 None --------------------------------------------------------------------------------------------------------- Run set 1 done 5.49 2.78 - concrat-libs.Race-Challenges Run set 2 of 4 with options '--conf /mnt/goblint-svcomp/goblint-bench/bench/index/conf/concrat.json --enable ana.sv-comp.enabled --disable witness.enabled --set lib.activated[+] zlib --set lib.activated[+] pcre --set lib.activated[+] liblzma' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 0.09 0.17 None per-thread-array-index-race-2.yml unknown 0.09 0.17 None per-thread-array-index-race.yml unknown 0.10 0.17 None per-thread-array-index.yml unknown 0.09 0.13 None per-thread-array-init-race.yml true 0.10 0.12 None per-thread-array-init.yml true 0.10 0.11 None per-thread-array-join-counter-race-2.yml unknown 0.11 0.11 None per-thread-array-join-counter-race-3.yml unknown 0.12 0.12 None per-thread-array-join-counter-race.yml unknown 0.11 0.12 None per-thread-array-join-counter.yml unknown 0.11 0.11 None per-thread-array-ptr-race.yml unknown 0.09 0.09 None per-thread-array-ptr.yml unknown 0.10 0.10 None per-thread-index-bitmask-race-2.yml unknown 0.11 0.11 None per-thread-index-bitmask-race-3.yml unknown 0.10 0.10 None per-thread-index-bitmask-race.yml unknown 0.10 0.10 None per-thread-index-bitmask.yml unknown 0.10 0.10 None per-thread-index-inc-race-2.yml unknown 0.10 0.10 None per-thread-index-inc-race.yml unknown 0.10 0.10 None per-thread-index-inc.yml unknown 0.10 0.10 None per-thread-struct-in-array-race.yml unknown 0.09 0.09 None per-thread-struct-in-array.yml unknown 0.08 0.09 None per-thread-struct-race.yml unknown 0.10 0.10 None per-thread-struct-tid.yml unknown 0.11 0.11 None per-thread-struct.yml unknown 0.10 0.10 None semaphore-posix-race-2.yml unknown 0.11 0.11 None semaphore-posix-race.yml unknown 0.09 0.09 None semaphore-posix.yml unknown 0.08 0.08 None smtprc-tid.yml true 0.09 0.09 None thread-join-array-const-race-2.yml unknown 0.09 0.09 None thread-join-array-const-race-3.yml unknown 0.08 0.09 None thread-join-array-const-race.yml unknown 0.08 0.08 None thread-join-array-const.yml unknown 0.09 0.09 None thread-join-array-dynamic-race-2.yml unknown 0.09 0.09 None thread-join-array-dynamic-race-3.yml unknown 0.10 0.10 None thread-join-array-dynamic-race.yml unknown 0.09 0.09 None thread-join-array-dynamic.yml unknown 0.09 0.10 None thread-join-binomial-race-2.yml unknown 0.11 0.11 None thread-join-binomial-race.yml unknown 0.11 0.11 None thread-join-binomial.yml unknown 0.11 0.11 None thread-join-counter-inner-race-2.yml unknown 0.10 0.10 None thread-join-counter-inner-race-3.yml unknown 0.10 0.10 None thread-join-counter-inner-race-4.yml unknown 0.10 0.10 None thread-join-counter-inner-race-5.yml unknown 0.10 0.14 None thread-join-counter-inner-race.yml unknown 0.10 0.13 None thread-join-counter-inner.yml unknown 0.10 0.11 None thread-join-counter-outer-race-2.yml unknown 0.08 0.08 None thread-join-counter-outer-race-3.yml unknown 0.08 0.09 None thread-join-counter-outer-race-4.yml unknown 0.09 0.09 None thread-join-counter-outer-race.yml unknown 0.08 0.08 None thread-join-counter-outer.yml unknown 0.09 0.09 None thread-local-pthread.yml unknown 0.11 0.11 None thread-local-value-dynamic.yml unknown 0.12 0.13 None thread-local-value.yml true 0.09 0.09 None value-barrier-race.yml unknown 0.09 0.09 None value-barrier.yml unknown 0.10 0.10 None --------------------------------------------------------------------------------------------------------- Run set 2 done 6.36 2.85 - concrat.Race-Challenges Run set 3 of 4 with options '--conf /mnt/goblint-svcomp/goblint-bench/bench/index/conf/concrat.json --enable ana.sv-comp.enabled --disable witness.enabled' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 0.09 0.09 None per-thread-array-index-race-2.yml unknown 0.09 0.09 None per-thread-array-index-race.yml unknown 0.09 0.09 None per-thread-array-index.yml unknown 0.09 0.09 None per-thread-array-init-race.yml true 0.10 0.10 None per-thread-array-init.yml true 0.09 0.09 None per-thread-array-join-counter-race-2.yml unknown 0.11 0.11 None per-thread-array-join-counter-race-3.yml unknown 0.11 0.11 None per-thread-array-join-counter-race.yml unknown 0.11 0.11 None per-thread-array-join-counter.yml unknown 0.11 0.11 None per-thread-array-ptr-race.yml unknown 0.09 0.09 None per-thread-array-ptr.yml unknown 0.09 0.09 None per-thread-index-bitmask-race-2.yml unknown 0.10 0.10 None per-thread-index-bitmask-race-3.yml unknown 0.10 0.10 None per-thread-index-bitmask-race.yml unknown 0.10 0.10 None per-thread-index-bitmask.yml unknown 0.10 0.11 None per-thread-index-inc-race-2.yml unknown 0.09 0.10 None per-thread-index-inc-race.yml unknown 0.10 0.10 None per-thread-index-inc.yml unknown 0.10 0.10 None per-thread-struct-in-array-race.yml unknown 0.09 0.09 None per-thread-struct-in-array.yml unknown 0.09 0.09 None per-thread-struct-race.yml unknown 0.09 0.10 None per-thread-struct-tid.yml unknown 0.09 0.09 None per-thread-struct.yml unknown 0.11 0.11 None semaphore-posix-race-2.yml unknown 0.10 0.10 None semaphore-posix-race.yml unknown 0.11 0.11 None semaphore-posix.yml unknown 0.11 0.11 None smtprc-tid.yml true 0.09 0.09 None thread-join-array-const-race-2.yml unknown 0.08 0.08 None thread-join-array-const-race-3.yml unknown 0.08 0.09 None thread-join-array-const-race.yml unknown 0.08 0.08 None thread-join-array-const.yml unknown 0.09 0.09 None thread-join-array-dynamic-race-2.yml unknown 0.09 0.09 None thread-join-array-dynamic-race-3.yml unknown 0.09 0.09 None thread-join-array-dynamic-race.yml unknown 0.09 0.09 None thread-join-array-dynamic.yml unknown 0.11 0.11 None thread-join-binomial-race-2.yml unknown 0.11 0.11 None thread-join-binomial-race.yml unknown 0.11 0.11 None thread-join-binomial.yml unknown 0.12 0.12 None thread-join-counter-inner-race-2.yml unknown 0.10 0.10 None thread-join-counter-inner-race-3.yml unknown 0.12 0.12 None thread-join-counter-inner-race-4.yml unknown 0.10 0.10 None thread-join-counter-inner-race-5.yml unknown 0.09 0.09 None thread-join-counter-inner-race.yml unknown 0.10 0.10 None thread-join-counter-inner.yml unknown 0.11 0.11 None thread-join-counter-outer-race-2.yml unknown 0.08 0.08 None thread-join-counter-outer-race-3.yml unknown 0.09 0.09 None thread-join-counter-outer-race-4.yml unknown 0.08 0.08 None thread-join-counter-outer-race.yml unknown 0.08 0.08 None thread-join-counter-outer.yml unknown 0.09 0.09 None thread-local-pthread.yml unknown 0.10 0.11 None thread-local-value-dynamic.yml unknown 0.13 0.13 None thread-local-value.yml true 0.10 0.10 None value-barrier-race.yml unknown 0.09 0.10 None value-barrier.yml unknown 0.09 0.10 None --------------------------------------------------------------------------------------------------------- Run set 3 done 6.35 2.63 - svcomp.Race-Challenges Run set 4 of 4 with options '--conf conf/svcomp.json' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------- atomic-gcc.yml unknown 2.08 2.18 None per-thread-array-index-race-2.yml unknown 2.34 2.42 None per-thread-array-index-race.yml unknown 2.22 2.27 None per-thread-array-index.yml unknown 2.12 2.17 None per-thread-array-init-race.yml true 1.74 1.77 None per-thread-array-init.yml true 1.62 1.65 None per-thread-array-join-counter-race-2.yml unknown 1.79 1.79 None per-thread-array-join-counter-race-3.yml unknown 1.70 1.70 None per-thread-array-join-counter-race.yml unknown 2.13 2.14 None per-thread-array-join-counter.yml unknown 1.72 1.73 None per-thread-array-ptr-race.yml unknown 2.32 2.32 None per-thread-array-ptr.yml unknown 2.25 2.26 None per-thread-index-bitmask-race-2.yml unknown 0.83 0.83 None per-thread-index-bitmask-race-3.yml unknown 0.80 0.81 None per-thread-index-bitmask-race.yml unknown 0.90 0.90 None per-thread-index-bitmask.yml unknown 0.80 0.80 None per-thread-index-inc-race-2.yml unknown 2.31 2.31 None per-thread-index-inc-race.yml unknown 2.25 2.26 None per-thread-index-inc.yml unknown 2.60 2.60 None per-thread-struct-in-array-race.yml unknown 2.35 2.36 None per-thread-struct-in-array.yml unknown 2.27 2.27 None per-thread-struct-race.yml unknown 2.12 2.13 None per-thread-struct-tid.yml unknown 0.83 0.83 None per-thread-struct.yml unknown 0.85 0.86 None semaphore-posix-race-2.yml unknown 2.21 2.22 None semaphore-posix-race.yml unknown 2.14 2.15 None semaphore-posix.yml unknown 2.19 2.19 None smtprc-tid.yml true 0.15 0.15 None thread-join-array-const-race-2.yml true 0.11 0.12 None thread-join-array-const-race-3.yml true 0.13 0.13 None thread-join-array-const-race.yml true 0.12 0.12 None thread-join-array-const.yml true 0.13 0.13 None thread-join-array-dynamic-race-2.yml unknown 1.76 1.77 None thread-join-array-dynamic-race-3.yml unknown 19.03 19.04 None thread-join-array-dynamic-race.yml unknown 1.66 1.66 None thread-join-array-dynamic.yml unknown 2.19 2.20 None thread-join-binomial-race-2.yml unknown 19.66 19.66 None thread-join-binomial-race.yml unknown 19.54 19.55 None thread-join-binomial.yml unknown 19.95 19.95 None thread-join-counter-inner-race-2.yml unknown 6.51 6.51 None thread-join-counter-inner-race-3.yml unknown 6.84 6.85 None thread-join-counter-inner-race-4.yml unknown 6.65 6.65 None thread-join-counter-inner-race-5.yml unknown 1.83 1.83 None thread-join-counter-inner-race.yml unknown 3.35 3.36 None thread-join-counter-inner.yml unknown 6.87 6.88 None thread-join-counter-outer-race-2.yml unknown 0.90 0.90 None thread-join-counter-outer-race-3.yml unknown 0.97 0.97 None thread-join-counter-outer-race-4.yml unknown 0.86 0.86 None thread-join-counter-outer-race.yml unknown 0.45 0.46 None thread-join-counter-outer.yml unknown 0.84 0.84 None thread-local-pthread.yml unknown 3.48 3.48 None thread-local-value-dynamic.yml SEGMENTATION FAULT 12.28 12.51 None thread-local-value.yml true 2.34 2.34 None value-barrier-race.yml unknown 2.01 2.01 None value-barrier.yml unknown 4.84 4.85 None --------------------------------------------------------------------------------------------------------- Run set 4 done 196.09 34.62 - Statistics: 220 Files correct: 10 correct true: 10 correct false: 0 incorrect: 6 incorrect true: 6 incorrect false: 0 unknown: 204 Score: -172 (max: 300)