List:Eventum General Discussion« Previous MessageNext Message »
From:German Pizarro Date:September 12 2008 3:27pm
Subject:Re: SV: File Uploads larger than 1mb
View as plain text  
OK, here is the deal:

Files need to be attached to issues. Where to keep them?

First and Obvious, with such a topic, anyone will stand for their own personal
preferences and maybe argument "this is better beacause..."
Plz, let's not do that since I might take comments that differs from mine as a personal
attack and I'll find out where you live! :)
Let's keep it as objective as possible and debate the alternatives.

Databases were not originally designed to store files... but in practice actually they
do, an eventually large ones.

I don't endorse any, however, since file storing is not a database-design-feature but
instead a collateral feature, we are just taking advantage of it (the classic
hammer-screw metaphor). 

We can debate and do a lot of talking (and metaphors) on how good this approach could be
("today's hammers can handle screws just fine", "using screw drivers is the old way to
nail screws, use a hammer instead").

Some approach might even have advantages over the other ("it' easier to smash it than
screw it") however we'll have to deal with some minor "issues".

Assuming we NEED to store LARGE files within Eventum
(don't ask why, arguments could be Eventum versatility or whatever), let's discard that
subject (actually, I don't even store medium-size files in my Eventum).

In the theoretical suposition we could choose (who said we could vote anyway? ;) I see 3
alternatives for Eventum implementation:
-attachments stored in database (today's implementation)
-attachments stored in file-system (alternative implementation)
-attachment stored in one of the 2 previous, choose the one that fits best at install
time (ideal-world implementation).


Regards


----- Mensaje original ----
De: Faisal Siddiqui <faisal@stripped>
Para: German Pizarro <gpizarro1977@stripped>; eventum-users@stripped
Enviado: viernes, 12 de septiembre, 2008 9:17:10
Asunto: RE: SV: File Uploads larger than 1mb

Hi,

My vote is for file system as this makes Eventum possible to use on shared
server, otherwise limit of 1 or 2 mb file size is very low, having a file of
size between 2-8 mb is very normal (like screenshots).


Regards

-Faisal 

-----Original Message-----
From: German Pizarro [mailto:gpizarro1977@stripped] 
Sent: Friday, September 12, 2008 5:01 PM
To: eventum-users@stripped
Subject: Re: SV: File Uploads larger than 1mb

So far

Attachments in DB - PROS:
-Centralized content, single element contains data and files
-Files are backed up with the database (single spot)
-Less administrative tasks, easy to backup/replicate/recovery (when
feasible)

Attachments in DB - CONS:
-Possible DB timeouts
-Requires DB configuration for storing large files
-Best suited for localhost (LAN)
-Database being used as File System => Huge data file
-No good for non-Eventum-dedicated-database. Others db-applications possibly
affected.



Attachments in FileSystem - PROS:
-Small database => Small database backups
-Best for shared hosts
-Less traffic to DB, smaller workload ("detrimental for the Database?")
-No (database) restrictions uploading large files

Attachments in FileSystem - CONS:
Same as DB - PROS


Choosing any is a commitment...
Is this hot already?

Regards


----- Mensaje original ----
De: "Srivathsan, M IN BLR SISL" <M.Srivathsan@stripped>
Para: Bryan.Alsdorf@stripped; German Pizarro <gpizarro1977@stripped>
CC: Anders Klarström <anders.klarstrom@stripped>;
eventum-users@stripped
Enviado: jueves, 11 de septiembre, 2008 22:58:09
Asunto: RE: SV: File Uploads larger than 1mb

Hi,

With storage becoming cheaper and cheaper by the day, the only consideration
I would give is whether it would be detrimental for the Database to store
any large files.  If not, then I would very much have the DB as the single
place of storage.

IMHO, storing attachments separately in file systems and just storing a
reference to them in the DB, is the old-way of thinking.  I guess in those
times, the performance and the storage required by DB were greater concerns.
And file systems (I think) were faster than DB in retrieving files.

Today, there are thoughts of atleast conceptually merging the DB and the
File System (Microsoft's WinFS) and the modern DBs don't seem to bother
about large chunks of data stored in them.  That being the case, in my
opinion, we would rather have everything in the DB and the configuration /
settings alone separately in a Config file - which is already being done by
Eventum.

I have had enough of "Dangling References" and I really like the Eventum way
as it avoids many administrative headaches.  I have implemented a Grievance
Cell application by customizing Eventum and deployed it on an old Dell
PowerEdge server powered by PIII (I think).  Around 20,000 people have aired
their grievances with a significant number BMP / JPEG attachments (each
around 2MB on an average).  And till now (for 6 months) there has not been
any issue.  The only addition we made was to put a fast SCSI RAID disk for
300GB.

I think MySQL is a doing a very good job in handling such large chunks.  I
believe that other modern DBs (like PostgresQL) should also do the same.

Thanks and rgds,
Watson

-----Original Message-----
From: Bryan.Alsdorf@stripped [mailto:Bryan.Alsdorf@stripped] 
Sent: Thursday, September 11, 2008 9:32 PM
To: German Pizarro
Cc: Anders Klarström; eventum-users@stripped
Subject: Re: SV: File Uploads larger than 1mb

Hi,

German Pizarro wrote:
> For small sizes, files saved into the database are OK, but for filesbigger
than 1MB, 
> wouldn't it be better to save them in the file system (blocked direct
access via http, but accesed via php proxy for
authentication/authorization)?

This can be a hotly debated topic, I have gone back and forth on it many
times.  The 
problem I have with storing things on the filesystem is you then have an
additional set of 
data you have to back up. I like now that everything is in the database and
I can backup, 
replicate, etc all in one spot. The con is the database grows considerably.

Best Regards,
-- 
Bryan Alsdorf, MySQL Support Manager, Systems
MySQL @ Sun Microsystems, Inc., http://www.sun.com/mysql/

-- 
Eventum Users Mailing List
For list archives: http://lists.mysql.com/eventum-users
To unsubscribe:
http://lists.mysql.com/eventum-users?unsub=1





Important notice:This e-mail and any attachment thereto contains corporate
proprietary information. If you have received it by mistake, please notify
us immediately by reply e-mail and delete this e-mail and its attachments
from your system. Thank You.

--
Eventum Users Mailing List
For list archives: http://lists.mysql.com/eventum-users
To unsubscribe:
http://lists.mysql.com/eventum-users?unsub=1



____________________________________________________________________________
________
Yahoo! MTV Blog & Rock &gt;¡Cuéntanos tu historia, inspira una
canción y
gánate un viaje a los Premios MTV! Participa aquí http://mtvla.yahoo.com/



--
Eventum Users Mailing List
For list archives: http://lists.mysql.com/eventum-users
To unsubscribe:    http://lists.mysql.com/eventum-users?unsub=1


     
____________________________________________________________________________________
Yahoo! MTV Blog & Rock &gt;¡Cuéntanos tu historia, inspira una
canción y gánate un viaje a los Premios MTV! Participa aquí
http://mtvla.yahoo.com/
Thread
File Uploads larger than 1mbCurtis Von Lintel10 Sep
  • Re: File Uploads larger than 1mbGeorger Araujo11 Sep
    • Re: File Uploads larger than 1mbCurtis Von Lintel11 Sep
      • SV: File Uploads larger than 1mbAnders Klarström11 Sep
Re: SV: File Uploads larger than 1mbGerman Pizarro11 Sep
  • Re: SV: File Uploads larger than 1mbBryan Alsdorf11 Sep
    • Re: SV: File Uploads larger than 1mbCurtis Von Lintel11 Sep
    • RE: SV: File Uploads larger than 1mbM  IN BLR SISL Srivathsan12 Sep
Re: SV: File Uploads larger than 1mbGerman Pizarro12 Sep
  • RE: SV: File Uploads larger than 1mbFaisal Siddiqui12 Sep
Re: SV: File Uploads larger than 1mbGerman Pizarro12 Sep
Re: SV: File Uploads larger than 1mbGerman Pizarro12 Sep
  • RE: SV: File Uploads larger than 1mbFaisal Siddiqui12 Sep
    • RE: SV: File Uploads larger than 1mbAndrew Coghlan12 Sep
Re: SV: File Uploads larger than 1mbGerman Pizarro12 Sep
  • Re: SV: File Uploads larger than 1mbGeorger Araujo12 Sep
    • RE: SV: File Uploads larger than 1mbFaisal Siddiqui14 Sep
      • RE: SV: File Uploads larger than 1mbGeorger Araujo14 Sep