List:Cluster« Previous MessageNext Message »
From:Massimo Date:September 25 2008 8:27pm
Subject:Re: SQL node questions
View as plain text  
Hi Robby,

interesting setup, I'd like to understand better what kind of 
applications you are planning to run on cluster 6.3.

Regarding your questions:

1. SCI will give benefits also in the communication between sql and data 
nodes, there is a lot of data transmitted here. Usually the sql nodes 
are more cpu bound than i/o bound so your 2xquad cores are really enough.

2, Licensing: the license cost is per cpu in both sql and data nodes. 
There is no license for the management. In your set up you haven't 
mentioned the management. Where do you want to run it?

3. This ratio was before the introduction of the multiconnect between 
mysqlds and ndbds. Now you can set in the my.cnf of the sql nodes a 
variable called ndb-cluster-connection-pool that enables a 
multi-connection. Each connection is seen as 1 sql nodes. So if you have 
2 sql nodes and ndb-cluster-connection-pool is set to 3, then you need 
to have 6 sql node free in your config.ini. Regarding the data nodes, in 
the 6.3 you can lock the 2 threads (execution and maintenance thread) to 
different cores, so in your setup 3 ndbd daemons for each physical 
machine are enough (leave a couple of cores to the OS and other stuff).


If you are planning to use this set up for a critical application, I 
recommend also to use some days of our consultants to setup and tune 
everything.

Good luck
Massimo

Robby Dermody ha scritto:
> Hi guys,
>
>  
>
> Looking at provisioning a CGE 6.3 cluster in a few months here. In-line with
> best practices, I will have data nodes and SQL nodes running on separate
> physical servers. The data node machines will be 2x Quad core Xeons (12MB
> cache per chip), 64GB RAM, 8X 147GB 15K SAS, Dolphin SCI interconnects (fast
> things). I plan on using a 2D torus topology with the SCI.
>
>  
>
> With the SQL node machines, I have a few questions:
>
>  
>
> -Hardware requirements: I would think only CPU and network B/W is important
> here. Could I get away with 2x Quad core Xeons, 2 SATA drives (RAID 1 of
> course), 4GB RAM? I assume I'd need SCI interconnects as well, or are these
> only important between the data nodes?
>
>  
>
> -Licensing: For cost estimates, I'm assuming per CPU commercial licensing at
> 5K. Do I pay this price only on the CPUs of the data node servers, or must I
> pay it on the CPUs of the SQL node servers as well?
>
>  
>
> -Ratio: I was planning on running 1 ndbd instance per data node server core
> (so in this case, 8 data nodes per physical data node server).
>
> If I'm not mistaken, best practices I've seen by Mikael state to use 2x the
> number of mysqld processes per ndbd processes. Should this mean I should
> also run a mysqld on each core? Can I get a benefit from running 2 mysqlds
> on each core, or should I have twice as many physical SQL node servers per
> physical data node servers (e.g. so I'd have 2 SQL servers, 16 mysqlds each,
> per 1 data server with 8 ndbds each).
>
>  
>
> Thanks,
>
>  
>
> Robby
>
>
>   
Thread
SQL node questionsRobby Dermody25 Sep
  • Re: SQL node questionsMassimo25 Sep
    • RE: SQL node questionsRobby Dermody27 Sep
      • RE: SQL node questionsRobby Dermody27 Sep