List:General Discussion« Previous MessageNext Message »
From:Steven Staples Date:August 20 2010 3:36pm
Subject:RE: Reduce dataset but still show anomalies
View as plain text  
On another thought,  what about if you group it by whatever, if the MIN()/MAX() is greater
than X times STDDEV(), show MIN() or MAX() ?

I just recalled a conversation with my boss the other week about the STDDEV()


Steven Staples



> -----Original Message-----
> From: Steven Staples [mailto:sstaples@stripped]
> Sent: August 20, 2010 11:32 AM
> To: bcantwell@stripped; 'mysql'
> Subject: RE: Reduce dataset but still show anomalies
> 
> I am not too good with charting (even though I would like to be), but what
> about getting the max, min and avg, if the max/min is greater than x% of
> the avg, show that... ?
> 
> Just throwing out ideas... prolly not useful... but may cause a better idea
> ;)
> 
> 
> Steven Staples
> 
> 
> > -----Original Message-----
> > From: Bryan Cantwell [mailto:bcantwell@stripped]
> > Sent: August 20, 2010 11:24 AM
> > To: mysql
> > Subject: Re: Reduce dataset but still show anomalies
> >
> > Yes, but I DON'T want eh spikes smoothed out
> >
> > On Fri, 2010-08-20 at 17:16 +0200, Jangita wrote:
> >
> > > On 20/08/2010 5:12 p, Bryan Cantwell wrote:
> > > > I am trying to produce charts for large amounts of data. I already
> > limit
> > > > the user to a smaller time frame in order to reduce the possible data
> > > > points, but still can end up with far more data points than are
> clearly
> > > > plottable on a chart.  Does anyone have an idea of how I can drop
> > > > insignificant points, or average the data or do something to end up
> > with
> > > > no more than about 3k points and still show spikes and dips in the
> > > > charts so my users can still clearly identify anomalies in their
> > charts?
> > > > I don't want to smooth out the spikes and dips if at all possible.
> > > > I considered running through the dataset and doing a compare of point
> 2
> > > > to point 1 and if it is close in value throw it away, otherwise keep
> > it.
> > > > That probably would not work on a 'noisy' chart however...
> > > >
> > > >
> > > > THanks,
> > > > Bryancan
> > > >
> > > Have you tried instead of showing per minute, show the average per
> hour,
> > > or per day; this will generally smoothen the points out a little; In my
> > > case if i show registrations per day i get dips every Saturday and
> > > Sunday so it looks all jagged, But per week doesn't show the
> > > Saturday/Sunday dips...
> > >
> > > --
> > > Jangita | +256 76 91 8383 | Y! & MSN: jangita@stripped
> > > Skype: jangita | GTalk: jangita.nyagudi@stripped
> > >
> >
> >
> >
> > No virus found in this incoming message.
> > Checked by AVG - www.avg.com
> > Version: 9.0.851 / Virus Database: 271.1.1/3023 - Release Date: 08/20/10
> > 02:35:00
> 
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:    http://lists.mysql.com/mysql?unsub=1
> 
> No virus found in this incoming message.
> Checked by AVG - www.avg.com
> Version: 9.0.851 / Virus Database: 271.1.1/3023 - Release Date: 08/20/10
> 02:35:00

Thread
Reduce dataset but still show anomaliesBryan Cantwell20 Aug
  • Re: Reduce dataset but still show anomaliesJangita20 Aug
    • Re: Reduce dataset but still show anomaliesBryan Cantwell20 Aug
      • Re: Reduce dataset but still show anomaliesPhilip Riebold20 Aug
      • RE: Reduce dataset but still show anomaliesSteven Staples20 Aug
        • RE: Reduce dataset but still show anomaliesSteven Staples20 Aug
      • Re: Reduce dataset but still show anomaliesJangita20 Aug