Skip to main content

creating benchmarks

3 replies [Last post]
ateslin
Offline
Joined: 2005-11-04

As my final-year project I chose to build benchmarks to test java performance. I am relative beginner in Java (especially with JVM)

Reply viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
eileeny
Offline
Joined: 2005-07-13

There was also a good presentation at JavaOne in 2003 (I think) entitled "The Black Art of Benchmarking" about things to avoid when writing a benchmark. You might want to check if it's publicly available.

Eileen

eileeny
Offline
Joined: 2005-07-13

BTW, the key to writing a good benchmark is to make sure and profile your benchmark to ensure you're actually testing what you want to test.

Another source of benchmarks is the spec organization. www.spec.org. They publish some of the most well known benchmarks in the industry. The current jvm benchmark is quite old and in the process of being update, but it's still worth checking out if you're trying to do a survey of java benchmarks.

Eileen

biehl
Offline
Joined: 2003-06-19

Here are some links.

An extensive list of papers on virtual machine performance - almost all of them have benchmarks.

http://jikesrvm.sourceforge.net/info/papers.shtml

An online comparison of JVM's with some standard benchmarks.
http://www.shudo.net/jit/perf/

The guy - Shudo - appears to read this list
http://mail-archives.apache.org/mod_mbox/incubator-harmony-dev/

The DaCapo benchmarks - recently released under the Apache SoftwareLicense. (yay!)
http://www-ali.cs.umass.edu/DaCapo/