List:General Discussion« Previous MessageNext Message »
From:petya Date:June 6 2009 8:54pm
Subject:Re: high performance test data/test query generator
View as plain text  
That only works if the application is already in production and gets a 
certain load. For a new application (for example the database is 
designed but the application is not ready yet) this doesn't work.

Amr Mostafa wrote:
> I usually simulate the load of the whole stack, by benchmarking the
> application directly using a tool such as jMeter. Loading MySQL specifically
> with read/write patterns similar to those of the real application can be
> useful, but quite hard to accomplish.
> 
> One easy way of doing that is to enable logging in your server and capture
> the statements executed over a day or so, then extract the SQL statements
> into a separate file. You can use then use a tool such as mysqlslap
> (available since 5.1) to execute those statements in a number of iterations
> with a given concurrency on your benchmarking box.
> 
> On Thu, Jun 4, 2009 at 2:05 PM, petya <petya@stripped> wrote:
> 
>> Anyone else? You guys don't simulate realistic workload in benchmark just
>> do sysbench or something like that? If there were a tool for that (which can
>> handle data generation, initial database generation, and query generation,
>> maybe it's output will be a jmeter test case) would you do so?
>>
>> Peter
>>
>>
>> petya wrote:
>>
>>> I use jmeter too, but it can't generate the test dataset (if I have to
>>> write this, I plan that it will create a jmeter test case with the generated
>>> test data). Usually my ad-hoc script generates csv files (to load initial
>>> data) and jmeter test cases.
>>>
>>> Michael Dykman wrote:
>>>
>>>> On Wed, Jun 3, 2009 at 9:41 AM, petya <petya@stripped> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> We have lots of mysql servers, master-slave and sharded databases. A
>>>>> recurring task when a new feature/application comes in to test the
>>>>> database
>>>>> with real workload. This needs test data and test query generation.
>>>>> Until
>>>>> now I did this with ad-hoc scripts, I looked for tools to do this,
> so
>>>>> far I
>>>>> found nothing.
>>>>>
>>>>> The closest thing to this was benerator, but it doesn't generate
> test
>>>>> queries. I need to measure write performance too (or concurrent
>>>>> read/write
>>>>> performance), so it would be good if I can tell the tool to generate
>>>>> bulk
>>>>> inserts with n records or generate a csv file or generate single
>>>>> insert...
>>>>> statements, so I can simulate the application's workload (of course
> I
>>>>> can do
>>>>> this with the application itself, but in development stage it is
>>>>> important
>>>>> to see how the database itself performs).
>>>>>
>>>>> Does such a tool exists? No problem if it is mysql only. If not, I
> think
>>>>> I
>>>>> will write one.
>>>>>
>>>>> Peter Boros
>>>>>
>>>> It is by no means the only such tool, but I have often use JMeter as
>>>> an all-purpose load-generation tool.  It has good support for database
>>>> testing among other things..
>>>>
>>>> http://jakarta.apache.org/jmeter/usermanual/build-db-test-plan.html
>>>>
>>>>
>> --
>> MySQL General Mailing List
>> For list archives: http://lists.mysql.com/mysql
>> To unsubscribe:
>> http://lists.mysql.com/mysql?unsub=1
>>
>>
> 
> 
Thread
high performance test data/test query generatorpetya3 Jun
Re: high performance test data/test query generatorpetya3 Jun
  • Re: high performance test data/test query generatorpetya4 Jun
    • Re: high performance test data/test query generatorJohnny Withers4 Jun
    • Re: high performance test data/test query generatorAmr Mostafa6 Jun
      • Re: high performance test data/test query generatorpetya6 Jun