List:General Discussion« Previous MessageNext Message »
From:Brent Baisley Date:May 31 2002 4:24pm
Subject:Re: I need 50.000 inserts / second
View as plain text  
If HEAP table won't do because of memory constraints, why not use straight
flat files like typical Unix or Web logs? Start a new file at set intervals,
whether it be time intervals or "record" intervals. Then you can use the
LOAD DATA command to load the files.
Your situation seems similar to that of a web server, where you don't need
to analyze the data in real time. So a setup similar to that of web server
logs may be appropriate.

> Hello,
> 
>> You could maybe buffer the data in Your application
>> and then run inserts later... like this.
> 
> This is not a solution for me as the data acquisition can take hours without
> any break.
> 
>> I might be missunderstanding You since I don't get this together...
>>   You wrote:
>>   The following C++ code with mysql++ takes 5 seconds to
>>   execute in my Athlon 1.33 machine:
>> 
>>   And later on:
>>   I'm shocked with the performance of MySQL, a similar query
>>   to compute 1 million records takes 1.17 seconds in MySQL
> 
>> So , if "similar" query makes 1 million in about a second, how
>> come You have problems with "only" 50 K/s with another "similar"
>> query....
> 
> The code shown INSERTs 50.000 records in the database and takes 5 seconds to
> run. My comment later about the query is about
> the SELECT with a GROUP BY clause, it takes 1.17 seconds to compute 1
> million records.
> 
> Thank you anyway, I'll be testing Jeremy's idea when I arrive home at night.
> 
> Best regards,
> Cesar
> 
> ---------------------------------------------------------------------
> Before posting, please check:
>  http://www.mysql.com/manual.php   (the manual)
>  http://lists.mysql.com/           (the list archive)
> 
> To request this thread, e-mail <mysql-thread110635@stripped>
> To unsubscribe, e-mail <mysql-unsubscribe-brent=landover.com@stripped>
> Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
> 

-- 
Brent Baisley
Systems Architect
Landover Associates, Inc.
Search & Advisory Services for Advanced Technology Environments
p: 212.759.6400/800.759.0577

Thread
I need 50.000 inserts / secondCesar Mello - Axi31 May
  • Re: I need 50.000 inserts / secondJeremy Zawodny31 May
  • Re: I need 50.000 inserts / secondSteve Edberg31 May
  • Re: I need 50.000 inserts / secondHarald Fuchs31 May
  • Re: I need 50.000 inserts / secondMark31 May
    • Re: I need 50.000 inserts / secondBenjamin Pflugmann31 May
    • Re: I need 50.000 inserts / secondDan Nelson31 May
      • Re: I need 50.000 inserts / secondJeremy Zawodny1 Jun
  • Re: I need 50.000 inserts / secondMark31 May
  • Re: I need 50.000 inserts / secondCesar Mello - Axi31 May
    • Re: I need 50.000 inserts / secondmos2 Jun
  • Re: I need 50.000 inserts / secondRichard Clarke2 Jun
RE: I need 50.000 inserts / seconddomi31 May
  • Re: I need 50.000 inserts / secondCesar Mello - Axi31 May
    • Re: I need 50.000 inserts / secondT├Ánu Samuel31 May
    • Re: I need 50.000 inserts / secondBrent Baisley31 May