Upload a shed load of files

tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Tue, 2005-11-15 12:37

My old gallery webserver died (RIP) sometime last year. Since then I haven't had a central location for my photos, which have been stored in a directory structure. I managed to recover about 35% of my photos (3,000) from the dead HD, and am wondering what is the easiest way to import them into the new gallery software?

I have uploaded them to a non-web accessable location on my server, preferably I'd like to build the new database using the directory names as the album names temporarily.
 
valiant

Joined: 2003-01-04
Posts: 32509
Posted: Tue, 2005-11-15 14:12

add items -> from local webserver

http://codex.gallery2.org/index.php/Gallery2:How_to_Add_Items#How_To_Add_Items_From_the_Local_Server
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 08:01

that will read in the directory structures too? Fantastic...
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 08:06

will that make a second copy of the files or will it leave them in their current location?

Here's the stats:

I have 5.4gig on my server available
I have 3.2gig of photos
I have 500mb of other content

leaving just over 1gb free

if it attempts to move the photos across, will I be screwed?
 
valiant

Joined: 2003-01-04
Posts: 32509
Posted: Wed, 2005-11-16 09:01

- it copies the whole structure including files
- it's got an option to use symlinks instead of cp for files, but then you must guarantee that you never move / delete this stuff, else g2 will break
- symlink is only available on unix/linux (read: not on windows)

the 1gb free will be used, it will generate thumbnails and resizes for your images which will eat up a part of that. it would be a good idea to get a little more harddisk space.
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 09:22

can't get more space as far as I know - the size of the host is fixed. I can clear out the other stuff (to a certain point)

but I am using Linux!

I think symlink would be the best idea, but how do I set that up? I don't need to move 'em
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 09:24

Just did a scan - it picked up all the directories quickly, but the symlink box is greyed out except for the last one at the bottom - does this mean symlink has been disallowed on my server or that I need to setup some kind of module within gallery?
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 09:28

Gallery version = 2.0 core 1.0.0
PHP version = 4.3.10 cgi
Webserver = Apache/1.3.33 (Unix) DAV/1.0.3 mod_fastcgi/2.4.2 mod_gzip/1.3.26.1a PHP/4.3.10 mod_ssl/2.8.22 OpenSSL/0.9.7e
Database = mysql 4.1.14-Debian_3-log
Toolkits = ArchiveUpload, Exif, ImageMagick, NetPBM, Gd
Operating system = Linux euro 2.4.29-grsec+w+fhs6b+gr0501+nfs+a32+++p4+sata+c4+gr2b-v6.189 #1 SMP Mon Feb 7 13:23:30 PST 2005 i686
Browser = Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8) Gecko/20051107 Firefox/1.5

 
valiant

Joined: 2003-01-04
Posts: 32509
Posted: Wed, 2005-11-16 09:54

first tick the checkbox to select a file / dir and then the greyed out symlink checkbox will be available. cmon! :)
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 10:06

*goes for broke*

lol - cheers - didn't even occur to me to tick the boxes. Stupid User Error.

Now lets see how gallery 2.0.1 will handle the import of 3550 pictures...
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 10:10

hehe - it's stopped!

Did about 30 albums and stopped dead. Unfortunately I left a cache directory in there and I think it's broken the add items procedure.

*fingers crossed*
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 10:24

yep - definately stalled. Now I'm just using my own stupidity to slow the process by deleting symlinked albums that I've accidently double added
 
valiant

Joined: 2003-01-04
Posts: 32509
Posted: Wed, 2005-11-16 10:25

if you can increase the apache timeout.. dot that.
also check if it's stopping after apache's timeout or sooner / later.
maybe check the apache error logs too.
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 12:08

no - it was definately leaving a previous galleries 'cache' directory in the upload. I've deleted that and tried again, no problem.

Lots of organising to do, but it's up. http://www.alt-gallery.net
 
fryfrog

Joined: 2002-10-30
Posts: 3236
Posted: Wed, 2005-11-16 12:25

Since you already have them organized by directory structure, I would create your root album first. Now, when you scan the directory instead of selecting all of them... only select a couple. This way, you don't need to use symlink (it could bite you in the ass later when you forget) and you can download/delete the albums as you do them a few at a time. You won't go over your limit either.
_________________________________
Support & Documentation || Donate to Gallery || My Website
 
tim_neo

Joined: 2005-11-15
Posts: 36
Posted: Wed, 2005-11-16 13:40

Unfortunately I've just spent a while organising them! but the symlink isn't exactly a problem - they're in a seperate directory that'll never be changed (so happy days will ensue)

At some point I'm considering moving my archive to shutterbook (20gigs free!) but in the meantime I'm making use of my alt-gallery site.