Re: question about chunking sql uploads

[SGreen]

Frank Bax <fbax@stripped> wrote on 04/25/2005 11:47:12 AM:

> At 10:44 AM 4/25/05, Art.M (Wikki) wrote:
> >I have a large .sql file to upload which is about 9 mb and I was
> >wondering if anyone knew of a program that could break it up into
> >chunks of 2 mb or under? So I can upload it to a shared web server.
> 
> 
> You can't upload a 9M file to webserver?  But you can upload 9x1M files? 

> Fix your webserver.  You didn't google for this did you?  You also 
didn't 
> mention OS, so we'll assume unix based.
> 
> You could try compressing file with zip, gzip, etc.
> Or simply use "split", default is 1000 lines, but can be changed via 
> command line.
> 
> man split 
> 
> 

I think the problem is that the default max_allowed_packet setting is only 
1M so the OP is looking for a way to split his SQL script into blocks of 
<1M. I haven't tested this but it MAY be possible to temporarily set the 
web server's max_allowed_packet to 9M (or bigger) so that the OP could get 
his entire file processed at once. Please check:

http://dev.mysql.com/doc/mysql/en/set-option.html
and
http://dev.mysql.com/doc/mysql/en/dynamic-system-variables.html?

Other than that, I remember a thread (sometime last year) in which someone 
recommended a product that chunks SQL files but I couldn't find it with a 
quick check. Here's a link to the archives for all of the MySQL lists, 
maybe you'll have better luck:

http://lists.mysql.com/

Shawn Green
Database Administrator
Unimin Corporation - Spruce Pine