From: Garot Conklin Date: August 21 2012 8:40pm Subject: Re: Machine Learning List-Archive: http://lists.mysql.com/mysql/228041 Message-Id: <1345581620.11893.YahooMailNeo@web140505.mail.bf1.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="1211670101-1625539848-1345581620=:11893" --1211670101-1625539848-1345581620=:11893 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable to elaborate:=0A=0AI would almost rather qualify from the OS perspective wh= at will work in advance, but take into consideration any failing condition.= =C2=A0 I may be getting a bit too specific at this juncture however as I am= already apply this logic to issues I see in MY environment rather than tot= al ambiguity, which is a best position here.=C2=A0 =0A=0AI am ultimately ex= pecting the learning algorithm to create new and excitingly effective ways = of stringing commands together to solve issues, this being a notable aspect= in and of itself, then creating some centralization based on what the mach= ine determines as a best solution. =0A=0ASeems a relative "snapshot of the = system" pre and post execution would be favorable as well so long as resour= ces are not taxed as a result.=C2=A0 This discussion is leading me to belie= ve that this will be a multifaceted db solution without a doubt comprised o= f multiple layers of abstraction ultimately rolling up into a single master= cluster for all the higher level analytics and internal testing cycles to = then roll out the new primary protocols, which may themselves take place in= a sub-instance of each possible scenario.=C2=A0 =0A=0AI have also though o= f populating a db or multiple db's with actual text=C2=A0 in the form of .p= df's of actual technical manuals... not certain the benefit of the written = language abstraction there but the thought process extraction might be an i= nteresting end indeed.=0A=0A=0A=C2=A0=0Agarotconklin@stripped=0A=0A=0A____= ____________________________=0A From: Garot Conklin =0ATo: "webmaster@stripped" ; 'Martin Gainty' ; "mysql@stripped" =0ASen= t: Tuesday, August 21, 2012 4:09 PM=0ASubject: Re: Machine Learning=0A =0AY= ES!=0A=0A=C2=A0=0Agarotconklin@stripped=0A=0A=0A__________________________= ______=0AFrom: "webmaster@stripped" =0ATo: 'Garot= Conklin' ; 'Martin Gainty' ; = mysql@stripped =0ASent: Tuesday, August 21, 2012 3:37 PM=0ASubject: = RE: Machine Learning=0A=0A=0AAh,=0A=C2=A0=0AGetting clearer and clearer.=0A= =C2=A0=0ASo these =E2=80=98nodes=E2=80=99 could =E2=80=98learn=E2=80=99 and= =E2=80=98teach=E2=80=99 at the same time =E2=80=93 right ? For instance, N= 1 runs a command in =E2=80=98domain=E2=80=99 D20 which it successful =E2=80= =93 it send information to node N20 that is the authority on domain D20 and= N20 records it as success; N5 runs a command in domain D20 which goes wron= g, and sends info to N20 and N20 records failure and sends a correct call t= o N5. Is this what you have in mind ?=0A=C2=A0=0AThere are a lot of variabl= es to be considered, for instance:=0A1)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Comma= nd A version 1 can run very happily on operating system version 2, but fail= s in OS version 1=0A2)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Command A version 1 ca= n run happily on OS version 2 on a 2G RAM, but fail on OS version 2 on 1G R= AM=0A3)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 etc=0A=C2=A0=0AI think the DB design = issues will become straightforward once the model is quite clear.=0A=C2=A0= =0AJustin=0A=C2=A0=0AFrom:Garot Conklin [mailto:garotconklin@stripped] =0A= Sent: 21 August 2012 17:14=0ATo: webmaster@stripped; 'Martin Gainty'; my= sql@stripped=0ASubject: Re: Machine Learning=0A=C2=A0=0A1)Refer to i= t for =E2=80=98knowledge=E2=80=99 (for instance, of what the latest=0Aversi= on of a command is)=0A=C2=A0=C2=A0=C2=A0 It would most likely end up being = "central" in this sense:=0A=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 A distribu= ted collection of systems; i.e. (possible defined in roles)=0A=C2=A0=C2=A0= =C2=A0 =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 DB's=0A=C2=A0=C2=A0=C2=A0 =C2= =A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 FE's=0A=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0= =C2=A0 =C2=A0=C2=A0=C2=A0 REPL's=0A=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 = =C2=A0=C2=A0=C2=A0 Cache's=0A=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 Each DB = would have its own collection of remediation's that would then be indexed t= o populate a central db for trending/correlation etc...=0A=C2=A0=C2=A0=C2= =A0 =C2=A0=C2=A0=C2=A0 The "Collective" itself would function as a single c= onceptual implementation. A VIP for example might be associated with a spec= ific role, say Web FE's and remediate only/all of them, but only have some = relative access to the core db of say the Network from a Primary index pers= pective to make/draw associations/conclusions to issues at hand.=0A=C2=A0= =0A=0A2)Send their =E2=80=98knowledge=E2=80=99 (for instance, of the latest= command=0Aversions) to it for storage and distribution to others=0A=C2=A0= =C2=A0=C2=A0Rather than "latest command versions" I envision this to be mor= e encapsulated as "latest successful invocation of the command string" and = it inverse as well (to trend/metric-ize the failures thus lending to perpet= ual optimization).=0A=C2=A0=0AI like how this is fleshing out... This is he= lping me to define what I am really trying to accomplish. Thanks very much = for everyone responding here, this is wonderful, please keep this going...= =0A=C2=A0=0Agarotconklin@stripped=0A=0A________________________________=0A= =0AFrom:"webmaster@stripped" =0ATo: 'Martin Gaint= y' ; garotconklin@stripped; mysql@stripped =0A= Sent: Tuesday, August 21, 2012 11:19 AM=0ASubject: RE: Machine Learning=0A= =0AHi Garot,=0A=0A=0A=0AOk, the concept is getting clearer, but let=E2=80= =99s bring this down to earth a=0Alittle bit more. I love DB design and pro= blem-solving and am quite curious=0Aabout this.=0A=0A=0A=0AIs the idea that= you have a central computer (not HAL J) somewhere so that=0Aother computer= s can:=0A=0A1)=C2=A0 =C2=A0 =C2=A0 Refer to it for =E2=80=98knowledge=E2=80= =99 (for instance, of what the latest=0Aversion of a command is)=0A=0A2)=C2= =A0 =C2=A0 =C2=A0 Send their =E2=80=98knowledge=E2=80=99 (for instance, of = the latest command=0Aversions) to it for storage and distribution to others= =0A=0A=0A=0AIf this is the model, then the knowledge base can build up orga= nically over=0Atime =E2=80=93 I think. Or is this too simplistic ?=0A=0A=0A= =0AThanks,=0A=0AJustin=0A=0A=0A=0AFrom: Martin Gainty [mailto:mgainty@hotma= il.com] =0ASent: 21 August 2012 00:25=0ATo: garotconklin@stripped; webmast= er@stripped; mysql@stripped=0ASubject: RE: Machine Learning=0A=0A= =0A=0AWhen I hear 'AI' I always imagine theres a HAL 9001 behind the scenes= that=0Ais running the show constantly admonishing its creator to "take ano= ther=0Astress pill"=0A=0ASounds like a fun project=0A=0AKeep us apprised,= =0AMartin Gainty =0A______________________________________________ =0AVerzi= cht und Vertraulichkeitanmerkung/Note de d=C3=A9ni et de confidentialit=C3= =A9=0A=0A=0ADiese Nachricht ist vertraulich. Sollten Sie nicht der vorgeseh= ene=0AEmpfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbe= fugte=0AWeiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nac= hricht=0Adient lediglich dem Austausch von Informationen und entfaltet kein= e=0Arechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von= =0AE-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen.=0A=0ACe m= essage est confidentiel et peut =C3=AAtre privil=C3=A9gi=C3=A9. Si vous n'= =C3=AAtes pas le=0Adestinataire pr=C3=A9vu, nous te demandons avec bont=C3= =A9 que pour satisfaire=0Ainformez l'exp=C3=A9diteur. N'importe quelle diff= usion non autoris=C3=A9e ou la copie=0Ade ceci est interdite. Ce message se= rt =C3=A0 l'information seulement et n'aura=0Apas n'importe quel effet l=C3= =A9galement obligatoire. =C3=89tant donn=C3=A9 que les email=0Apeuvent faci= lement =C3=AAtre sujets =C3=A0 la manipulation, nous ne pouvons accepter=0A= aucune responsabilit=C3=A9 pour le contenu fourni.=0A=0A=0A=0A=0A=0A=C2=A0 = _____=C2=A0 =0A=0ADate: Mon, 20 Aug 2012 13:50:04 -0700=0AFrom: garotconkli= n@stripped=0ASubject: Re: Machine Learning=0ATo: webmaster@stripped; mg= ainty@stripped; mysql@stripped=0A=0AYa the idea is not anything n= ew, but must be apparently quit difficult or=0Anot a priority as I have yet= to find it already implemented anywhere... Far=0Abe it from me to not make= some attempt here anyway...=0A=0A=0A=0AI am creating a fully automated fra= mework from which a distributed=0Ainfrastructure can be maintained.=C2=A0 I= have been writing automation=0Ascripts/code for some time now and the logi= cal progression is to embark on a=0Afull concept of systems health auto rem= ediation.=C2=A0 I have numerous=0A"monitoring" solutions under my control h= owever none that properly (in my=0Aopinion) implements any real learning al= gorithms from which to draw even a=0Aminimalists view of automation.=C2=A0 = I like mySQL therefor began thinking about=0Acreating the aspects (lobes) o= f the "brain" as a relational database(s).=C2=A0 So=0Athis is only one face= t of what I am trying to do, however leveraging a full=0Acommand set of she= ll utilities/commands/programs seemed to be a good=0Astarting point before = I get into the "hard" stuff ! =0A=0A=0A=0A-Garot=0A=0A=0A=0Agarotconklin@ya= hoo.com=0A=0A=C2=A0 _____=C2=A0 =0A=0AFrom: "webmaster@stripped" =0ATo: 'Martin Gainty' ; garotconklin@= yahoo.com;=0Amysql@stripped =0ASent: Monday, August 20, 2012 3:55 PM= =0ASubject: RE: Machine Learning=0A=0A=0AHi Garot,=0A=0A=0A=0AYou'll have t= o elaborate some more ... I understand you may want to protect=0Athe idea a= s well, so if you can narrow it down to some technical specifics=0Athen it'= ll help.=0A=0A=0A=0AWhat is the objective of this system, for instance ?=0A= =0A=0A=0AThanks,=0A=0AJustin=0A=0A=0A=0AFrom: Martin Gainty [mailto:mgainty= @hotmail.com] =0ASent: 20 August 2012 19:23=0ATo: garotconklin@stripped; w= ebmaster@stripped; mysql@stripped=0ASubject: RE: Machine Learning= =0A=0A=0A=0A=0A=0AFrom: garotconklin@stripped=0ASubject: Re: Machine Learn= ing=0ATo: webmaster@stripped; mgainty@stripped; mysql@stripped= =0A=0A=0AMy initial thought was to propagate the db with everything and all= ow the=0Aalgorithm to then begin to determin trends/patterns=0AMG>which tre= nds or patterns will you be modelling?=0A=0Aand begin either an indexing me= thodology=0AMG>which indexes are you considering: Unique index, primary ind= ex or foreign=0Aindex?=0A=0Aadditional table/db creation process or both to= further optimize the calls=0Abeing made=0AMG>optimize based on execution t= ime or diskspace allocated, EliminatingFTS=0Aor some other criteria?=0AMG>h= ttps://dev.mysql.com/doc/refman/5.5/en/optimization.html=0A=0Aand build in = some internal levels of redundancy.=0AMG>what about replication=0AMG>http:/= /dev.mysql.com/doc/refman/5.5/en/replication.html=0A=0AI am actually approa= ching this with some degree of biological conception in=0Athe multipathing = within our own brains however until I have something up and=0Arunning under= some substantial load however I may not get a complete=0Apicture. =0A=0ATh= anks,=0A=0AGarot=0A=0A=0AInteresting=0AMartin=0A=0A=C2=A0 _____=C2=A0 =0A= =0AFrom: webmaster@stripped ; =0ATo: 'Garot Conkl= in' ; 'Martin Gainty'=0A; ; =0ASubject: RE: Machine Learning =0ASent: Mon, Aug 20,= 2012 7:13:25 AM =0A=0A=0AHi Garot,=0A=0AThis sounds an interesting idea.= =0A=0AAre you looking to store all known commands and their options or are = you=0Alooking for a 'formula' for calling any unix command ?=0A=0AThe reaso= n for my question is that, at the end of the day, a unix command is=0Ajust = a program that is run in the operating system. Each program comes with=0Ait= s own options and acceptable inputs. I don't know if there is a rule or=0Ac= onvention for structuring these commands.=0A=0AAre you then looking to buil= d a system that 'knows' all commands and 'how=0Ato' call them ?=0A=0AThanks= ,=0AJustin=0A=0A-----Original Message-----=0AFrom: Garot Conklin [mailto:ga= rotconklin@stripped] =0ASent: 20 August 2012 03:39=0ATo: Martin Gainty; my= sql@stripped=0ASubject: Re: Machine Learning=0A=0AThe initial goal i= s to provide a working framework from which to call all=0AUNIX shell comman= d combinations as the underlying storage mechanism for a=0Amachine learning= algorithm.=C2=A0 I would like to build a completely self aware=0Ainstantia= tion that will maintain itself on all levels... I postulate that=0Athe firs= t place to start would be in determining a method for maintaining=0Aall pos= sible remediation combinations including the unknown to eventually be=0Alea= rned from and populate new knowledge into the database.=C2=A0 Thank you for= =0Athe reply,=0A=0AGarot --1211670101-1625539848-1345581620=:11893--