27.09.2013 Views

a modern C++ library for the manipulation of Boolean functions

a modern C++ library for the manipulation of Boolean functions

a modern C++ library for the manipulation of Boolean functions

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

5 Experimental evaluation<br />

5.1 Methodology<br />

Here we report <strong>the</strong> benchmark results obtained by testing China against all programs<br />

from <strong>the</strong> China Benchmark Suite, <strong>for</strong> which you can find more in<strong>for</strong>mations at<br />

http://www.cs.unipr.it/China/Benchmarks/. Each table shows <strong>the</strong> results obtained<br />

by using a specific internal representation and compares <strong>the</strong> per<strong>for</strong>mance <strong>of</strong><br />

China’s native implementation with <strong>the</strong> one obtained by integrating CORAL into China.<br />

The numbers shown are <strong>the</strong> user run-times in seconds that are required to per<strong>for</strong>m<br />

groundness analysis <strong>of</strong> each program. We discarded all programs <strong>for</strong> which <strong>the</strong> analysis<br />

always took less than a tenth <strong>of</strong> a second and marked all times greater than 300 seconds as<br />

TIMEOUTs; <strong>the</strong> indication <strong>of</strong> output differences is not significant if a TIMEOUT occurs.<br />

We also report whe<strong>the</strong>r <strong>the</strong>re are differences between <strong>the</strong> results <strong>of</strong> analysis <strong>for</strong> <strong>the</strong> two<br />

implementations: this is almost always caused by <strong>the</strong> fact that Too_Many_BDD_Nodes is<br />

thrown in different contexts, which leads to different applications <strong>of</strong> upward approximation<br />

(<strong>the</strong> new implementation usually approximates more). All results were obtained on a<br />

AMD Phenom 8650 machine running in 32-bit mode, with 2 GB <strong>of</strong> RAM and running<br />

Linux 2.6.27.<br />

Be aware that CORAL is still penalized by an incomplete integration with China and<br />

by a less efficient implementation <strong>of</strong> class Bit_Set that will be improved in <strong>the</strong> future.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!