List:Cluster« Previous MessageNext Message »
From:Hendrik Woltersdorf Date:June 4 2010 12:21pm
Subject:Antwort: Re: uneven data distribution
View as plain text  
Hi,

my next test: restart node 10, wich showed 5% data memory usage before.

Now both nodes show a data memory usage of 19% and an even distribution:

eti-dus-ha-cl1_root# ndb_desc -p -d hacom GLOBAL_ID
-- GLOBAL_ID --
Version: 1
Fragment type: 5
K Value: 6
Min load factor: 78
Max load factor: 80
Temporary table: no
Number of attributes: 4
Number of primary keys: 1
Length of frm data: 365
Row Checksum: 1
Row GCI: 1
SingleUserMode: 0
ForceVarPart: 1
FragmentCount: 2
TableStatus: Retrieved
-- Attributes --
ID_GLOBAL_ID Bigint PRIMARY KEY DISTRIBUTION KEY AT=FIXED ST=MEMORY
AUTO_INCR
ID_SERVICE Int NULL AT=FIXED ST=MEMORY
GLOBAL_ID Varchar(40;latin1_swedish_ci) NULL AT=SHORT_VAR ST=MEMORY
DATE_INSERT Datetime NOT NULL AT=FIXED ST=MEMORY

-- Indexes --
PRIMARY KEY(ID_GLOBAL_ID) - UniqueHashIndex
REFERENCE_3_FK(ID_SERVICE) - OrderedIndex
PRIMARY(ID_GLOBAL_ID) - OrderedIndex
IDX_STRING(GLOBAL_ID) - OrderedIndex

-- Per partition info --
Partition       Row count       Commit count    Frag fixed memory
Frag varsized memory    Extent_space    Free extent_space
0               1578180         1578409         839942144
42106880                0               0
1               1574362         3158478         835551232
42008576                0               0


NDBT_ProgramExit: 0 - OK

Strange things happen inside of a cluster...

regards

Hendrik Woltersdorf
XCOM AG
Tel.: 0375/27008-580
Tel. mobil: 0178/5710078
Email: Hendrik.Woltersdorf@stripped


                                                                           
             Hendrik                                                       
             Woltersdorf/DE/XC                                             
             OM                                                         An 
                                         Cluster <cluster@stripped> 
             04.06.2010 12:37                                        Kopie 
                                                                           
                                                                     Thema 
                                         Antwort: Re: uneven data          
                                         distribution(Document link: Mail) 
                                                                           
                                                                           
                                                                           
                                                                           
                                                                           
                                                                           



Hi,

here is the output for the largest table:

eti-dus-ha-cl1_root# ndb_desc -p -d hacom GLOBAL_ID
-- GLOBAL_ID --
Version: 1
Fragment type: 5
K Value: 6
Min load factor: 78
Max load factor: 80
Temporary table: no
Number of attributes: 4
Number of primary keys: 1
Length of frm data: 365
Row Checksum: 1
Row GCI: 1
SingleUserMode: 0
ForceVarPart: 1
FragmentCount: 2
TableStatus: Retrieved
-- Attributes --
ID_GLOBAL_ID Bigint PRIMARY KEY DISTRIBUTION KEY AT=FIXED ST=MEMORY
AUTO_INCR
ID_SERVICE Int NULL AT=FIXED ST=MEMORY
GLOBAL_ID Varchar(40;latin1_swedish_ci) NULL AT=SHORT_VAR ST=MEMORY
DATE_INSERT Datetime NOT NULL AT=FIXED ST=MEMORY

-- Indexes --
PRIMARY KEY(ID_GLOBAL_ID) - UniqueHashIndex
REFERENCE_3_FK(ID_SERVICE) - OrderedIndex
PRIMARY(ID_GLOBAL_ID) - OrderedIndex
IDX_STRING(GLOBAL_ID) - OrderedIndex

-- Per partition info --
Partition       Row count       Commit count    Frag fixed memory
Frag varsized memory    Extent_space    Free extent_space
0               1575951         3683447         90505216
42991616                0               0
1               1572050         1579967         835551232
41943040                0               0


NDBT_ProgramExit: 0 - OK

The restarted node does not use MORE memory. The amount is the same before
and after the restart.

And yes, this is a table, where we delete periodically lots of rows and it
contains a varchar field.

regards

Hendrik Woltersdorf
XCOM AG
Tel.: 0375/27008-580
Tel. mobil: 0178/5710078
Email: Hendrik.Woltersdorf@stripped





*** XCOM AG Legal Disclaimer ***

Diese E-Mail einschliesslich ihrer Anhaenge ist vertraulich und ist allein
für den Gebrauch durch den vorgesehenen Empfaenger bestimmt. Dritten ist
das Lesen, Verteilen oder Weiterleiten dieser E-Mail untersagt. Wir bitten,
eine fehlgeleitete E-Mail unverzueglich vollstaendig zu loeschen und uns
eine Nachricht zukommen zu lassen.

This email may contain material that is confidential and for the sole use
of the intended recipient. Any review, distribution by others or forwarding
without express permission is strictly prohibited. If you are not the
intended recipient, please contact the sender and delete all copies.

Hauptsitz: Bahnstrasse 37, D-47877 Willich, USt-IdNr.: DE 812 885 664
Kommunikation: Telefon +49 2154 9209-70, Telefax +49 2154 9209-900,
www.xcom.de
Handelsregister: Amtsgericht Krefeld, HRB 10340
Vorstand: Matthias Albrecht, Marco Marty, Dr. Rainer Fuchs, Dirk Werner
Vorsitzender des Aufsichtsrates: Stefan H. TarachAttachment: [text/html]
Attachment: [text/html]
Attachment: [text/html]
Thread
uneven data distributionHendrik Woltersdorf4 Jun
  • Re: uneven data distributionJohan Andersson4 Jun
    • Antwort: Re: uneven data distributionHendrik Woltersdorf4 Jun
Antwort: Re: uneven data distributionHendrik Woltersdorf4 Jun
  • Antwort: Re: uneven data distributionHendrik Woltersdorf4 Jun