List:Cluster« Previous MessageNext Message »
From:Jonas Oreland Date:September 30 2010 5:19am
Subject:Re: MySQL Cluster -- Table Full
View as plain text  
On 09/30/10 07:13, Karl Kloppenborg wrote:
> Hi guys,
> 
> We initially didn't but we got this problem at 92 million rows,
> 
> After a lot of research we found a post that stated maybe increasing the max rows
> would help, however after reading more on max_rows with NDB it was found that it is not
> used by NDBcluster engine and ignored? is this true?

1) after you get "table full", issue "show warnings", this will show you exact error code

2) maxrows *should* help

3) are you using ndbmtd ?

/Jonas

> 
> However take note, that we require that it hold 600 million rows... challenge..
> 
> I will also add my create table syntax to show you what we're doing.
> 
> CREATE TABLE `my_ndb_awesome_large_table ` (
>   `user_id` int(4) NOT NULL,
>   `description` varchar(50) NOT NULL,
>   `type` varchar(64) NOT NULL,
>   `count` int(4) NOT NULL,
>   `after` int(3) NOT NULL,
>   `active` int(1) NOT NULL,
>   `lastactivity` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE
> CURRENT_TIMESTAMP
> )  ENGINE=ndbcluster DEFAULT CHARSET=utf8
> 
> Any thoughts on what this virtual "level" might be? because as you can see in my last
> email have not run out of index / data space?
>  
>  
> On 30/09/2010, at 14:59, Jonas Oreland wrote:
> 
>> Are you using "maxrows" in your table definition ?
>>
>> /Jonas
>>
>> On 09/30/10 06:15, Karl Kloppenborg wrote:
>>> Hi,
>>> We have setup a MySQL cluster (pretty standard two NDB nodes + two management
> servers)
>>> 2x cluster processing nodes (running the MySQL NDB daemon + MySQL server)
>>>      - 144GB ram
>>>      -  8x 300GB SAS - Raid 10 
>>>      - Data-Storage = 135GB Ram 
>>>      - Index-Storage = 5GB RAM
>>> However at 92Million rows in a table, it is returning the TableFull error?
>>>
>>> My config is as follows:
>>> [NDBD DEFAULT]
>>> NoOfReplicas=2
>>> LockPagesInMainMemory=1
>>>
>>> DataMemory=131G
>>> IndexMemory=10G
>>>
>>> TimeBetweenLocalCheckpoints=6
>>> NoOfFragmentLogFiles=500
>>>
>>>
>>> [MYSQLD DEFAULT]
>>>
>>> [NDB_MGMD DEFAULT]
>>>
>>> [TCP DEFAULT]
>>> SendBufferMemory=8M
>>> ReceiveBufferMemory=8M
>>>
>>> # Section for the cluster management node
>>> [NDB_MGMD]
>>> ID=1 #LB1 ID is 1
>>> Datadir=/var/lib/mysql-cluster
>>> HostName=#.#.#.# #PRIVATE IP OF LB1
>>>
>>> [NDB_MGMD]
>>> HostName=#.#.#.# #PRIVATE IP OF LB2
>>> ID=2 #ID of LB2 is 2
>>> Datadir=/var/lib/mysql-cluster
>>>
>>> # Section for the storage nodes
>>> [NDBD]
>>> # IP address of the first storage node
>>> HostName=#.#.#.# # PRIVATE IP OF DB1
>>> DataDir=/var/lib/mysql-cluster
>>>
>>> [NDBD]
>>> # IP address of the second storage node
>>> HostName=#.#.#.# #PRIVATE IP OF DB2
>>> DataDir=/var/lib/mysql-cluster
>>>
>>> # one [MYSQLD] per storage node
>>> [MYSQLD]
>>> [MYSQLD]
>>>
>>>
>>>
>>> Can anyone please shed some light on this matter?
>>>
>>> Cheers,
>>> Karl Kloppenborg 
>>> --
>>> MySQL Cluster Mailing List
>>> For list archives: http://lists.mysql.com/cluster
>>> To unsubscribe:    http://lists.mysql.com/cluster?unsub=1
>>>
>>
> 

Thread
MySQL Cluster -- Table FullKarl Kloppenborg30 Sep
  • Re: MySQL Cluster -- Table FullAdam Dixon30 Sep
    • Re: MySQL Cluster -- Table FullKarl Kloppenborg30 Sep
  • Re: MySQL Cluster -- Table FullJonas Oreland30 Sep
    • Re: MySQL Cluster -- Table FullKarl Kloppenborg30 Sep
      • Re: MySQL Cluster -- Table FullJonas Oreland30 Sep
        • Re: MySQL Cluster -- Table FullKarl Kloppenborg30 Sep
          • Re: MySQL Cluster -- Table FullJonas Oreland30 Sep
            • Re: MySQL Cluster -- Table FullJohan Andersson30 Sep
              • Re: MySQL Cluster -- Table FullKarl Kloppenborg30 Sep
                • Re: MySQL Cluster -- Table FullJohan Andersson30 Sep
                  • Re: MySQL Cluster -- Table FullKarl Kloppenborg1 Oct
                    • Re: MySQL Cluster -- Table FullAaron Weller // Crucial Paradigm1 Oct
                      • Re: MySQL Cluster -- Table FullJohan Andersson1 Oct
                        • Re: MySQL Cluster -- Table FullAaron Weller // Crucial Paradigm7 Oct
                      • Re: MySQL Cluster -- Table FullJohan Andersson1 Oct
                      • Re: MySQL Cluster -- Table FullJon Stephens1 Oct
  • Re: MySQL Cluster -- Table FullMoses28 Apr
    • Re: MySQL Cluster -- Table FullJohan Andersson28 Apr
  • Re: MySQL Cluster -- Table FullMoses6 May
Re: MySQL Cluster -- Table FullAaron Weller // Crucial Paradigm1 Oct
  • Re: MySQL Cluster -- Table FullJohan Andersson1 Oct