List:General Discussion« Previous MessageNext Message »
From:Michael She Date:December 18 2002 7:37am
Subject:Re: Can MySQL handle 120 million records?
View as plain text  
I agree.  MySQL is a great database, but I wouldn't call it enterprise 
grade.  Considering that the database is used to store billing 
information... one has to be weary about losing all the records due to a 
bug or deficiency in MySQL.  I was searching through some of the MySQL help 
documentation, and there have been more than a few examples in the comments 
where people have lost data due to wacky functions on databases greater 
than a couple of GBs...


At 08:43 PM 12/17/2002 -0800, Qunfeng Dong wrote:
>I am not sure. Does anyone know any real examples of
>mysql handling huge database and still perform well? I
>am having problems with the performance with the MySQL
>Left join recently. A big table (about 2.5 million
>records) left join a small table (about 350K records)
>takes generally 2 mins to finish. I check the
>"explain" and primary key index on the small table was
>indeed used for the joining. My system is Redhat Linux
>7.3 with 4 GB memory. I also tried replacing the
>default my.cnf with my-huge.cnf. It didn't help at
>all.
>
>Another thing, with some linux system, there is a size
>limit for file. MySQL seems to store each of its table
>as single file. You need to choose a file system
>without that limit.
>
>Qunfeng Dong
>--- "B.G. Mahesh" <bg.mahesh@stripped>
>wrote:
> >
> > hi
> >
> > We are evaluating few databases for developing an
> > application with
> > following specs,
> >
> > 1.    OS not very important. Leaning towards Linux
> >
> > 2.    Currently the database has about 5 million
> > records but it will grow
> > to 120 million records.
> >
> > 3.    The tables will have billing information for a
> > telecom company.
> > Nothing complex.
> >
> > 4.    Back office staff will use the data in the
> > database to create
> > invoices to be sent to customers. This data is not
> > connected to the
> > live telecom system [e.g. switches etc]. We get the
> > data every day
> > from the telecom company.
> >
> > 5.    Staff may perform queries on the database to get
> > reports like
> > "busiest hour of the day" etc etc. I don't see too
> > many concurrent
> > users using the system, however the system needs to
> > be stable.
> >
> > 6.    Need to create excel, pdf files from the data in
> > the database. This
> > I think has nothing to do with the database, however
> > this is a requirement.
> >
> > 7.    Needless to say, good security is a must which
> > will also be built
> > into the front end application.
> >
> > We are considering the following databases,
> >
> > 1.    MYSQL
> > 2.    Postgres
> > 3.    Oracle
> > 4.    MSQL
> >
> > If MYSQL or Postgres can do the job I prefer not to
> > spend the money on
> > Oracle/MSQL. However, if Oracle/MSQL are required
> > for getting good
> > reports and scalability, so be it. We will use
> > Oracle/MSQL.
> >
> > Any pointers/advice is appreciated
> >
> >
> > --
> > --
> > B.G. Mahesh
> > mailto:bg.mahesh@stripped
> > http://www.indiainfo.com/
> > India's first ISO certified portal
> >
> >
>---------------------------------------------------------------------
> > Before posting, please check:
> >    http://www.mysql.com/manual.php   (the manual)
> >    http://lists.mysql.com/           (the list
> > archive)
> >
> > To request this thread, e-mail
> > <mysql-thread127745@stripped>
> > To unsubscribe, e-mail
> >
><mysql-unsubscribe-dongqunfeng=yahoo.com@stripped>
> > Trouble unsubscribing? Try:
> > http://lists.mysql.com/php/unsubscribe.php
> >
>
>
>__________________________________________________
>Do you Yahoo!?
>Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
>http://mailplus.yahoo.com
>
>---------------------------------------------------------------------
>Before posting, please check:
>    http://www.mysql.com/manual.php   (the manual)
>    http://lists.mysql.com/           (the list archive)
>
>To request this thread, e-mail <mysql-thread127757@stripped>
>To unsubscribe, e-mail 
><mysql-unsubscribe-michael.she=binaryio.com@stripped>
>Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php

-- 
Michael She  : michael.she@stripped
Mobile       : (519) 589-7309
WWW Homepage : http://www.binaryio.com/

Thread
Can MySQL handle 120 million records?B.G. Mahesh18 Dec
  • Re: Can MySQL handle 120 million records?Jeremy Zawodny18 Dec
  • Re: Can MySQL handle 120 million records?Qunfeng Dong18 Dec
    • Re: Can MySQL handle 120 million records?Jeremy Zawodny18 Dec
    • Re: Can MySQL handle 120 million records?Michael She18 Dec
      • Re: Can MySQL handle 120 million records?Michael T. Babcock18 Dec
        • RE: Can MySQL handle 120 million records?Adam Nelson18 Dec
      • Re: Can MySQL handle 120 million records?Jeremy Zawodny18 Dec
        • RE: Can MySQL handle 120 million records?Joe Stump18 Dec
          • Re: Can MySQL handle 120 million records?Michael T. Babcock18 Dec
          • Re: Can MySQL handle 120 million records?Gerald Jensen18 Dec
            • Re: Can MySQL handle 120 million records?Aaron Clausen18 Dec
    • Re: Can MySQL handle 120 million records?Michael T. Babcock18 Dec
      • Re: Can MySQL handle 120 million records?Paul DuBois18 Dec
        • Database type questionRichard E. Perlotto II19 Dec
          • Re: Database type questionIikka Meriläinen19 Dec
      • Re[2]: Can MySQL handle 120 million records?Dyego Souza do Carmo19 Dec
    • RE: Can MySQL handle 120 million records?Wayne Lewis18 Dec
      • Excluding records?Eric Anderson19 Dec
        • Re: Excluding records?Adolfo Bello20 Dec
    • Re: Re[2]: Can MySQL handle 120 million records?Harald Fuchs19 Dec
      • Re: Re[2]: Can MySQL handle 120 million records?Paul DuBois19 Dec
      • Re: Re[2]: Can MySQL handle 120 million records?Paul DuBois19 Dec
  • Re: Can MySQL handle 120 million records?Muruganandam18 Dec
    • Re: Can MySQL handle 120 million records?Jeremy Zawodny18 Dec
      • Re: Can MySQL handle 120 million records?Michael She18 Dec
        • Re: Can MySQL handle 120 million records?Jeremy Zawodny18 Dec
          • Re: Can MySQL handle 120 million records?Michael She18 Dec
            • Re: Can MySQL handle 120 million records?Michael T. Babcock18 Dec
              • Re: Can MySQL handle 120 million records?Michael She18 Dec
                • Re: Can MySQL handle 120 million records?Michael T. Babcock18 Dec
            • Re: Can MySQL handle 120 million records?Jeremy Zawodny18 Dec
            • Re: Can MySQL handle 120 million records?Michael Bacarella18 Dec
              • Re: Can MySQL handle 120 million records?Michael T. Babcock18 Dec
            • RE: Can MySQL handle 120 million records?Joe Stump18 Dec
              • Re: Can MySQL handle 120 million records?Michael T. Babcock18 Dec
            • Can I build a web page to extract data?Gary Hostetler18 Dec
            • Re: Can MySQL handle 120 million records?Csongor Fagyal19 Dec
          • Re: Can MySQL handle 120 million records?Michael She18 Dec
        • Re: Can MySQL handle 120 million records?Jocelyn Fournier18 Dec
    • Re: Can MySQL handle 120 million records?Jocelyn Fournier18 Dec
      • Re: Can MySQL handle 120 million records?W. D.18 Dec
    • Re: Can MySQL handle 120 million records?Jocelyn Fournier18 Dec
    • Re: Can MySQL handle 120 million records?Csongor Fagyal18 Dec
      • Re: Can MySQL handle 120 million records?W. D.18 Dec
    • Re: Can MySQL handle 120 million records?Csongor Fagyal18 Dec
Re: Can MySQL handle 120 million records?B.G. Mahesh18 Dec
  • Re: Can MySQL handle 120 million records?David T-G18 Dec
    • RE: Can MySQL handle 120 million records?JamesD18 Dec
      • Re: Can MySQL handle 120 million records?David T-G18 Dec
RE: Can MySQL handle 120 million records?Peter Vertes18 Dec
  • RE: Can MySQL handle 120 million records? - Impressive! How do you guys do that?Qunfeng Dong18 Dec
    • Re: Can MySQL handle 120 million records? - Impressive! How doyou guys do that?R. Hannes Niedner18 Dec
    • Re: Can MySQL handle 120 million records? - Impressive! How do youguys do that?Michael T. Babcock18 Dec
      • Re: Can MySQL handle 120 million records? - Ok, If you guys really can handle tens of millions records, you have to help me to enjoy MySQL too :-)Qunfeng Dong18 Dec
      • Re: Can MySQL handle 120 million records? - Ok, If you guys really can handle tens of millions records, you have to help me to enjoy MySQL too :-)Qunfeng Dong18 Dec
        • Re: Can MySQL handle 120 million records? - Ok, If you guys really can handle tens of millions records, you have to help me to enjoy MySQL too :-)Jocelyn Fournier19 Dec
          • Thanks! Re: Can MySQL handle 120 million records? - Ok, If you guys really can handle tens of millions records, you have to help me to enjoy MySQL too...Qunfeng Dong20 Dec
        • Re: Can MySQL handle 120 million records? - Ok, If you guys really can handle tens of millions records, you have to help me to enjoy MySQL too :-)Ryan Fox19 Dec
        • Re: Can MySQL handle 120 million records? - Ok, If you guys really can handle tens of millions records, you have to help me to enjoy MySQL too :-)Brent Baisley19 Dec
  • RE: Can MySQL handle 120 million records?JamesD19 Dec
    • Re: Can MySQL handle 120 million records?Jeremy Zawodny21 Dec
      • Re: Can MySQL handle 120 million records?Michael She21 Dec
        • Re: Can MySQL handle 120 million records?Michael T. Babcock23 Dec
      • Re: Can MySQL handle 120 million records?Michael She21 Dec
      • RE: Can MySQL handle 120 million records?JamesD21 Dec
        • Re: Can MySQL handle 120 million records?Jeremy Zawodny22 Dec
          • Re: Can MySQL handle 120 million records?Michael T. Babcock23 Dec
            • Re: Can MySQL handle 120 million records?Jeremy Zawodny23 Dec
            • DELETE with no WHERE clauseGordon23 Dec
              • Re: DELETE with no WHERE clauseDennis Salguero24 Dec
              • re: DELETE with no WHERE clauseVictoria Reznichenko24 Dec
      • RE: Can MySQL handle 120 million records?JamesD21 Dec
        • RE: Can MySQL handle 120 million records?Dean Harding21 Dec
          • RE: Can MySQL handle 120 million records?JamesD21 Dec
RE: Can MySQL handle 120 million records?David Brodbeck18 Dec
RE: Can MySQL handle 120 million records?Greg_Cope18 Dec
Re: Can MySQL handle 120 million records?Paul DuBois18 Dec
RE: Can MySQL handle 120 million records?RBRoa19 Dec
RE: Can MySQL handle 120 million records?Dana Diederich19 Dec
RE: Can MySQL handle 120 million records?John Griffin19 Dec
Re: Excluding records?King_Henree@yahoo.com20 Dec