[prev in list] [next in list] [prev in thread] [next in thread] 

List:       opensolaris-discuss
Subject:    Re: [osol-discuss] Benchmarking OpenSolaris and Solaris 10?
From:       ken mays <maybird1776 () yahoo ! com>
Date:       2010-07-11 16:58:23
Message-ID: 76543.39314.qm () web111308 ! mail ! gq1 ! yahoo ! com
[Download RAW message or body]

--- On Sat, 7/10/10, Ken Gunderson <kgunders@teamcool.net> wrote:
> Of course performance is only one dimension of platform
> evaluation, but looking forward to your results. Especially
> if you decided to throw FBSD-8.1RC2 into the fray....;-)

Same for the performance tools used for evaluation as Phoronix Test Suite 2.8.0.a1 is \
the currently dev benchmarking tool - and v2.6.1 is the stable version used for most \
tests.

GCC versions seem to vary amongest distros (can there be only one GCC version used \
during the test???).

As for OpenSolaris/Solaris 11, I did these tests about a year ago to debate
the original Phoronix articles. But the Phoronix articles try to reflect \
'out-of-the-box' experiences versus 'finely-tuned' tweaked experiences. Point to \
mention, the FreeBSD soft-updates not being turned on or other performance tweaks. \
Odd thing is that most of the time, people debating the issue don't turn on these \
performance options and then post an updated review for debate. We are actually not \
supposed to do 'manual tweakages' to keep the 'out-of-the-box' experience valid and \
simplify testing.

Here is an example of the benchmarking review I did:

Phoronix Test Suite 
Latest Dev Release: 2.8.0 Alpha 1 (June 30, 2010)
Current Stable: 2.6.1

Main reference test OS: OpenSolaris 2009.06 snv_111b X86
OS: OpenSolaris 2009.06 snv_111b X86_64
Kernel: 5.11 (i686)
Desktop: GNOME 2.24.2
Display Server: X.Org Server 1.5.3 (Mesa 7.2)
OpenGL: 3.0.0 NVIDIA 185.18.36
Compiler: GCC 4.3.2
File-System: zfs
Screen Resolution: 1024x768
Java: Java SE 1.6.0_13-b03

Alternate OS Test:
OS: OpenSolaris Development snv_134 X86_64
Kernel: 5.11 (i686)
Desktop: GNOME 2.28.2 
Display Server: X.Org Server 1.7.4
OpenGL Display Driver: 3.2.0 Nvidia 190.53
Compiler: GCC 4.3.3
File-System: zfs
Screen Resolution: 1024x768
Java: Java SE 1.6.0_18-b07

Phoronix Test Suite 
Latest Dev Release: 2.8.0 Alpha 1 (June 30, 2010)
Current Stable: 2.6.1

Collection of most results based on this hardware: 
Lenovo ThinkPad T61 notebook with an Intel Core 2 Duo T9300 processor, 4GB of system \
memory, a 100GB Hitachi HTS72201 SATA HDD, and a NVIDIA Quadro NVS 140M.


LAME MP3 v3.98.2 (WAV to MP3)
44.07 - OSOL 2009.06
36.43 - FBSD 8.1-RC2
32.52 - Ubuntu 10.10

LZMA 256MB File Compression
257.62 - OSOL 2009.06
215.72 - FBSD 8.1-RC2
221.20 - Ubuntu 10.10 (*)

7-Zip Compression
3520 - OSOL 2009.06
4333 - FBSD 8.1-RC2 (*)
4155 - Ubuntu 10.10 

GZIP Compression (2GB file)
7-Zip Compression
18.15 - OSOL 2009.06
26.65 - FBSD 8.1-RC2
18.12 - Ubuntu 10.10 (*)
18.77 - Fedora 12/RHEL 6

GnuPg 1.4.9
17.53 - OSOL 2009.06 (*)
20.89 - FBSD 8.1-RC2
18.55 - Ubuntu 10.10 

Gcrypt Library 1.4.4 (Camellia256-ECB Cipher)
3750ms - OSOL 2009.06
> 11000000ms - FBSD 8.1-RC2
3487ms - Ubuntu 10.10 (*)

Pov-Ray 3.6.1 (secs)
1281 - OSOL 2009.06
1357 - FBSD 8.1-RC2
1146 - Ubuntu 10.10 (*)

C-Ray 1.1
863.13 - OSOL 2009.06
174.55 - FBSD 8.1-RC2 (*)
201.91 - Ubuntu 10.10 (178.11 best Linux Time reported)

dcraw (RAW to PPM)
45.53 - OSOL 2009.06
43.36 - FBSD 8.1-RC2 (43.00 best Time reported)
34.81 - Ubuntu 10.10 (*)

GraphicsMagick v1.3.7 (iterations/sec)
  ?   - OSOL 2009.06
81.00 - FBSD 8.1-RC2 
85.00 - Ubuntu 10.10 (*)

Himeno v3.0 (Poisson Pressure)
119.28 - OSOL 2009.06
167.49 - FBSD 8.1-RC2 (best time 172.x reported)
184.25 - Ubuntu 10.10 (*)

Threaded I/O test v0.3.3 (64 MB Random Writes/32 threads)
2.59 - OSOL 2009.06 
1.28 - FBSD 8.1-RC2
2.72 - Ubuntu 10.10 

Threaded I/O test v0.3.3 (64 MB Writes/32 threads)
48.62 - OSOL 2009.06 
36.67 - FBSD 8.1-RC2
58.39 - Ubuntu 10.10 (*) 

Threaded I/O test v0.3.3 (64 MB Writes/4 threads)
39.32 - OSOL 2009.06 
40.93 - FBSD 8.1-RC2
49.80 - Ubuntu 10.10 (*)

PostMark 1.51 (tps)
580 - OSOL 2009.06 
56 - FBSD 8.1-RC2
1895 - Ubuntu 10.10 (*)

Sudoku v0.4 (seconds)
53.69 - OSOL 2009.06 
69.16 - FBSD 8.1-RC2
36.95 - Ubuntu 10.10 (*)

MAFFT Alignment v6.706 (seconds)
N/A   - OSOL 2009.06 
43.19 - FBSD 8.1-RC2
34.12 - Ubuntu 10.10 (*)

Bullet Physics Engine v2.75 Test 3000 fall (seconds)
N/A   - OSOL 2009.06 
38.14 - FBSD 8.1-RC2
24.93 - Ubuntu 10.10 (*)

Bullet Physics Engine v2.75 Convex Trimesh test (seconds)
N/A   - OSOL 2009.06 
36.43 - FBSD 8.1-RC2
28.65 - Ubuntu 10.10 (*)

===============================================
Old tests (not truely valid, based on older OS build info)
Here for review analysis:

Bonnie++ v1.0.3d Seq Create (ops/sec)
61387 - OSOL 2009.06 (*)
56124 - FBSD 8.1-RC2 
34861 - Ubuntu 10.10 

Bonnie++ v1.0.3d Random Read (ops/sec)
60626 - OSOL 2009.06 (*)
56255 - FBSD 8.1-RC2 
50511 - Ubuntu 10.10 

Bonnie++ v1.0.3d Random Delete (ops/sec)
362.30 - OSOL 2009.06 (*)
145.40 - FBSD 8.1-RC2 
209.30 - Ubuntu 10.10 

Bork File Encryption
55.31 - OSOL 2009.06 (*)
79.36 - FBSD 8.1-RC2 
78.40 - Ubuntu 10.10 

BYTE UNIX Benchmark v3.6: Dhrystone (LPS)
7486935.60 - OSOL 2009.06 
12122380.50 - FBSD 8.1-RC2 (*)
8604934.50 - Ubuntu 10.10 

BYTE UNIX Benchmark v3.6: Register Arithmetic (LPS)
555089.50 - OSOL 2009.06 (*)
547974.30 - FBSD 8.1-RC2 
553949.00 - Ubuntu 10.10 

BYTE UNIX Benchmark v3.6: Floating Point Arithmetic (LPS)
933096.50 - OSOL 2009.06 
1271991.70 - FBSD 8.1-RC2 
1284795.00 - Ubuntu 10.10 (*)

Java SciMark v2.0 (FFT)
480.93 - OSOL 2009.06 (*) 
447.24 - FBSD 8.1-RC2 
455.53 - Ubuntu 10.10 

Java SciMark v2.0 (Monte Carlo)
167.89 - OSOL 2009.06 (*) 
160.53 - FBSD 8.1-RC2 
162.11 - Ubuntu 10.10 

Java SciMark v2.0 (Sparse MAtrix Multiply) (Mflops/s)
438.25 - OSOL 2009.06 
543.02 - FBSD 8.1-RC2 
549.16 - Ubuntu 10.10 (*)

OpenSSL 0.9.8.i (signs per sec)
342.12 - OSOL 2009.06 
81.45 - FBSD 8.1-RC2 
343.12 - Ubuntu 10.10 (*)

SunFlow Rendering System v0.07.2
6.57 - OSOL 2009.06 
5.62 - FBSD 8.1-RC2 (*) 
6.24 - Ubuntu 10.10

Tandem XML v1.0 (sec)
54.52 - OSOL 2009.06 
29.01 - FBSD 8.1-RC2 (*)
30.89 - Ubuntu 10.10  

Use for pure entertainment value only!
~ Ken Mays


      
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss@opensolaris.org


[prev in list] [next in list] [prev in thread] [next in thread]