List:Falcon Storage Engine« Previous MessageNext Message »
From:Hakan Kuecuekyilmaz Date:June 15 2009 10:39pm
Subject:Weekly Falcon/InnoDB DBT2 Overview 2009-06-15
View as plain text  
Hello benchmark fans,

News for this week:
* walldorf did not run DBT2 for ~5 weeks. Because I have to
give back the machine soon.
* lu0009 run is from 2009-06-01, because John is taking over the
machine and setting up his version of automated DBT2 runs.

Note: this is my last DBT2 report, as I my last working day at
Sun is June 25th, 2009. Have a nice time, guys!

caneland.mysql.com[1] numbers can be found here:
https://intranet.mysql.com/~hakank/caneland/weekly_dbt2_overview/weekly_dbt2_overview.php

lu0009.mysql.com[2] numbers can be found here:
https://intranet.mysql.com/~hakank/lu0009/weekly_dbt2_overview/weekly_dbt2_overview.php

nehalem-1.mysql.com[3] numbers can be found here:
https://intranet.mysql.com/~hakank/nehalem-1/weekly_dbt2_overview/weekly_dbt2_overview.php

walldorf@home[4] numbers can be found here:
https://intranet.mysql.com/~hakank/walldorf/weekly_dbt2_overview/weekly_dbt2_overview.php

Brief overview
****************
*** caneland ***
****************
-w10
      -c8      -c16     -c32     -c64     -c99
F/I    36.27%   26.12%   26.73%   27.59%   27.48%

-w20
      -c8      -c16     -c32     -c64     -c128    -c192
F/I    39.51%   29.64%   32.24%   28.66%   26.93%   27.05%

-w100
      -c8      -c16     -c32     -c64     -c128    -c192    -c256    -c499
F/I     0.00%    0.00%    0.00%    0.00%    0.00%    0.00%    0.00%    0.00%

**************
*** lu0009 ***
**************
-w10
      -c8      -c16     -c32     -c64     -c99
F/I    87.23%   49.06%   37.27%   38.38%   36.55%

-w20
      -c8      -c16     -c32     -c64     -c128    -c192
F/I    68.81%   57.15%   51.53%   47.87%   48.01%   50.64%

-w100
      -c8      -c16     -c32     -c64     -c128    -c192    -c256    -c499
F/I    80.46%   74.69%   66.25%   60.66%   62.39%   56.35%   60.26%   64.19%


*****************
*** nehalem-1 ***
*****************
-w10
      -c8      -c16     -c32     -c64     -c99
F/I    59.69%   55.74%   48.11%   46.62%   51.76%

-w20
      -c8      -c16     -c32     -c64     -c128    -c192
F/I    37.08%   40.78%   39.17%   40.03%   49.70%   56.74%

-w100
      -c8      -c16     -c32     -c64     -c128    -c192    -c256    -c499
F/I    71.81%   91.19%   90.58%   93.05%   91.54%   90.95%   94.04%   90.95%

****************
*** walldorf ***
****************
-w10
      -c8      -c16     -c32     -c64     -c99     
F/I    70.41%   64.10%   63.54%   62.59%   62.84%  

-w20
      -c8      -c16     -c32     -c64     -c128    -c192    
F/I    61.68%   56.57%   56.68%   60.25%   58.43%   61.80%  

-w100
      -c8      -c16     -c32     -c64     -c128    -c192    -c256    -c499    
F/I    94.12%  115.04%  121.29%  133.77%  137.09%  142.90%  145.12%  142.68%  

Todo:
  - Put temporary results directory of DBT2 to local disk
  instead of storing the data NFS.
  - Remove results from crashed runs in mean value calculation.
  - Add more information from INFORMATION_SCHEMA tables like Falcon's
  system memory usage or summary of active/pending_commit/pending_completion.
  Also talk to Ann to get more insight to Falcon metrics.
  - On walldorf put falcon_serial_log_dir to SATA disk to see
  whether the battery backed up RAID controller is the source of
  huge performance gain we saw lately.
  - Get a Solaris SPARC and Intel/AMD machine for DBT2.

Change set used:
revno: 2711
revision-id: john.embretsen@stripped
parent: vvaintroub@stripped
parent: vvaintroub@stripped
committer: John H. Embretsen 
branch nick: mysql-6.0-falcon-to-merge

Setup: datadir is on RAID10 and logdir is on separate disk (for InnoDB).

Configuration is:
MYSQLD_CONFIG_BASE="--no-defaults \
  --socket=/tmp/mysql.sock"
MYSQLD_CONFIG_GENERAL="$MYSQLD_CONFIG_BASE \
  --basedir=$FALCON \
  --datadir=$DATA_DIR \
  --tmpdir=/tmp \
  --language=${FALCON}/sql/share/english \
  --key_buffer_size=8M \
  --skip-grant-tables \
  --sort_buffer_size=2M \
  --read_buffer_size=1M \
  --table_open_cache=5120 \
  --tmp_table_size=67108864 \
  --thread_cache=1024 \
  --query_cache_size=0 \
  --query_cache_type=0 \
  --max_allowed_packet=512M \
  --max_connections=707 \
  --log-error"
MYSQLD_CONFIG_FALCON="$MYSQLD_CONFIG_GENERAL \
  --skip_innodb \
  --default_storage_engine=Falcon \
  --falcon_io_threads=10 \
  --falcon_record_memory_max=650M \
  --falcon_page_cache_size=1650M \
  --falcon_page_size=8k \
  --falcon_serial_log_dir=$DATA_DIR \
  --falcon_serial_log_buffers=100 \
  --falcon_consistent_read=off"
MYSQLD_CONFIG_INNODB="$MYSQLD_CONFIG_GENERAL \
  --skip_falcon \
  --default_storage_engine=InnoDB \
  --innodb_data_home_dir=$DATA_DIR \
  --innodb_data_file_path=ibdata1:10M:autoextend \
  --innodb_log_group_home_dir=$LOG_DIR \
  --innodb_buffer_pool_size=2300M \
  --innodb_additional_mem_pool_size=20M \
  --innodb_log_file_size=650M \
  --innodb_log_buffer_size=16M \
  --innodb_lock_wait_timeout=50 \
  --innodb_file_io_threads=10 \
  --innodb_flush_log_at_trx_commit=1 \
  --innodb_flush_method=O_DIRECT \
  --innodb_log_files_in_group=6 \
  --innodb_support_xa=0 \
  --innodb_doublewrite=0 \
  --innodb-status-file=0 \
  --skip-innodb-adaptive-hash-index \
  --innodb_max_dirty_pages_pct=70 \
  --innodb_thread_concurrency=0"


[1] caneland.mysql.com Fedora release 10
Quad HexaCore @ 2.9GHz. Intel Xeon with 16MB L2 cache, 32GB RAM, hardware
RAID 10 on 4 x 15k RPM SAS disks.

[2] lu0009.mysql.com Ubuntu 8.10
Quad DualCore @ 3.4Ghz. Intel Xeon (with hyperthreading) with 16MB L2 cache, 8GB RAM,
hardware RAID 10 on 4 x 15k RPM SAS disks. This machine has unofficial Intel CPUs.

[3] nehalem-1.mysql.com Ubuntu 8.10
Dual DualCore @ 2.4Ghz. Intel Xeon (with SMT) with 16MB L2 cache, 16GB RAM,
RAID10 on 4 x SATA disk.

[4] walldorf@home RHEL 5
Dual DualCore @ 2Ghz. Intel Xeon with 4MB L2 cache, 8GB RAM, hardware
RAID 10 on 4 x 15k RPM SAS disks.


Best regards,

Hakan

-- 
Hakan Küçükyılmaz, Senior Software Engineer DBTG/MySQL +49 160
98953296
Sun Microsystems GmbH     Sonnenallee 1, DE-85551 Kirchheim-Heimstetten
Geschaeftsfuehrer:  Thomas Schroeder, Wolfang Engels, Dr. Roland Boemer
Vorsitz d. Aufs.rat.: Martin Haering   HRB MUC 161028     49.011, 8.376



Thread
Weekly Falcon/InnoDB DBT2 Overview 2009-06-15Hakan Kuecuekyilmaz16 Jun