From: Hakan Kuecuekyilmaz Date: June 15 2009 10:39pm Subject: Weekly Falcon/InnoDB DBT2 Overview 2009-06-15 List-Archive: http://lists.mysql.com/falcon/765 Message-Id: <1245105545.10483.35.camel@lu0011> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8BIT Hello benchmark fans, News for this week: * walldorf did not run DBT2 for ~5 weeks. Because I have to give back the machine soon. * lu0009 run is from 2009-06-01, because John is taking over the machine and setting up his version of automated DBT2 runs. Note: this is my last DBT2 report, as I my last working day at Sun is June 25th, 2009. Have a nice time, guys! caneland.mysql.com[1] numbers can be found here: https://intranet.mysql.com/~hakank/caneland/weekly_dbt2_overview/weekly_dbt2_overview.php lu0009.mysql.com[2] numbers can be found here: https://intranet.mysql.com/~hakank/lu0009/weekly_dbt2_overview/weekly_dbt2_overview.php nehalem-1.mysql.com[3] numbers can be found here: https://intranet.mysql.com/~hakank/nehalem-1/weekly_dbt2_overview/weekly_dbt2_overview.php walldorf@home[4] numbers can be found here: https://intranet.mysql.com/~hakank/walldorf/weekly_dbt2_overview/weekly_dbt2_overview.php Brief overview **************** *** caneland *** **************** -w10 -c8 -c16 -c32 -c64 -c99 F/I 36.27% 26.12% 26.73% 27.59% 27.48% -w20 -c8 -c16 -c32 -c64 -c128 -c192 F/I 39.51% 29.64% 32.24% 28.66% 26.93% 27.05% -w100 -c8 -c16 -c32 -c64 -c128 -c192 -c256 -c499 F/I 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% ************** *** lu0009 *** ************** -w10 -c8 -c16 -c32 -c64 -c99 F/I 87.23% 49.06% 37.27% 38.38% 36.55% -w20 -c8 -c16 -c32 -c64 -c128 -c192 F/I 68.81% 57.15% 51.53% 47.87% 48.01% 50.64% -w100 -c8 -c16 -c32 -c64 -c128 -c192 -c256 -c499 F/I 80.46% 74.69% 66.25% 60.66% 62.39% 56.35% 60.26% 64.19% ***************** *** nehalem-1 *** ***************** -w10 -c8 -c16 -c32 -c64 -c99 F/I 59.69% 55.74% 48.11% 46.62% 51.76% -w20 -c8 -c16 -c32 -c64 -c128 -c192 F/I 37.08% 40.78% 39.17% 40.03% 49.70% 56.74% -w100 -c8 -c16 -c32 -c64 -c128 -c192 -c256 -c499 F/I 71.81% 91.19% 90.58% 93.05% 91.54% 90.95% 94.04% 90.95% **************** *** walldorf *** **************** -w10 -c8 -c16 -c32 -c64 -c99 F/I 70.41% 64.10% 63.54% 62.59% 62.84% -w20 -c8 -c16 -c32 -c64 -c128 -c192 F/I 61.68% 56.57% 56.68% 60.25% 58.43% 61.80% -w100 -c8 -c16 -c32 -c64 -c128 -c192 -c256 -c499 F/I 94.12% 115.04% 121.29% 133.77% 137.09% 142.90% 145.12% 142.68% Todo: - Put temporary results directory of DBT2 to local disk instead of storing the data NFS.  - Remove results from crashed runs in mean value calculation. - Add more information from INFORMATION_SCHEMA tables like Falcon's system memory usage or summary of active/pending_commit/pending_completion. Also talk to Ann to get more insight to Falcon metrics. - On walldorf put falcon_serial_log_dir to SATA disk to see whether the battery backed up RAID controller is the source of huge performance gain we saw lately. - Get a Solaris SPARC and Intel/AMD machine for DBT2. Change set used: revno: 2711 revision-id: john.embretsen@stripped parent: vvaintroub@stripped parent: vvaintroub@stripped committer: John H. Embretsen branch nick: mysql-6.0-falcon-to-merge Setup: datadir is on RAID10 and logdir is on separate disk (for InnoDB). Configuration is: MYSQLD_CONFIG_BASE="--no-defaults \ --socket=/tmp/mysql.sock" MYSQLD_CONFIG_GENERAL="$MYSQLD_CONFIG_BASE \ --basedir=$FALCON \ --datadir=$DATA_DIR \ --tmpdir=/tmp \ --language=${FALCON}/sql/share/english \ --key_buffer_size=8M \ --skip-grant-tables \ --sort_buffer_size=2M \ --read_buffer_size=1M \ --table_open_cache=5120 \ --tmp_table_size=67108864 \ --thread_cache=1024 \ --query_cache_size=0 \ --query_cache_type=0 \ --max_allowed_packet=512M \ --max_connections=707 \ --log-error" MYSQLD_CONFIG_FALCON="$MYSQLD_CONFIG_GENERAL \ --skip_innodb \ --default_storage_engine=Falcon \ --falcon_io_threads=10 \ --falcon_record_memory_max=650M \ --falcon_page_cache_size=1650M \ --falcon_page_size=8k \ --falcon_serial_log_dir=$DATA_DIR \ --falcon_serial_log_buffers=100 \ --falcon_consistent_read=off" MYSQLD_CONFIG_INNODB="$MYSQLD_CONFIG_GENERAL \ --skip_falcon \ --default_storage_engine=InnoDB \ --innodb_data_home_dir=$DATA_DIR \ --innodb_data_file_path=ibdata1:10M:autoextend \ --innodb_log_group_home_dir=$LOG_DIR \ --innodb_buffer_pool_size=2300M \ --innodb_additional_mem_pool_size=20M \ --innodb_log_file_size=650M \ --innodb_log_buffer_size=16M \ --innodb_lock_wait_timeout=50 \ --innodb_file_io_threads=10 \ --innodb_flush_log_at_trx_commit=1 \ --innodb_flush_method=O_DIRECT \ --innodb_log_files_in_group=6 \ --innodb_support_xa=0 \ --innodb_doublewrite=0 \ --innodb-status-file=0 \ --skip-innodb-adaptive-hash-index \ --innodb_max_dirty_pages_pct=70 \ --innodb_thread_concurrency=0" [1] caneland.mysql.com Fedora release 10 Quad HexaCore @ 2.9GHz. Intel Xeon with 16MB L2 cache, 32GB RAM, hardware RAID 10 on 4 x 15k RPM SAS disks. [2] lu0009.mysql.com Ubuntu 8.10 Quad DualCore @ 3.4Ghz. Intel Xeon (with hyperthreading) with 16MB L2 cache, 8GB RAM, hardware RAID 10 on 4 x 15k RPM SAS disks. This machine has unofficial Intel CPUs.  [3] nehalem-1.mysql.com Ubuntu 8.10 Dual DualCore @ 2.4Ghz. Intel Xeon (with SMT) with 16MB L2 cache, 16GB RAM, RAID10 on 4 x SATA disk. [4] walldorf@home RHEL 5 Dual DualCore @ 2Ghz. Intel Xeon with 4MB L2 cache, 8GB RAM, hardware RAID 10 on 4 x 15k RPM SAS disks. Best regards, Hakan -- Hakan Küçükyılmaz, Senior Software Engineer DBTG/MySQL +49 160 98953296 Sun Microsystems GmbH Sonnenallee 1, DE-85551 Kirchheim-Heimstetten Geschaeftsfuehrer: Thomas Schroeder, Wolfang Engels, Dr. Roland Boemer Vorsitz d. Aufs.rat.: Martin Haering HRB MUC 161028 49.011, 8.376