Large image store import
Helo
Joined: 2010-02-10
Posts: 2 |
![]() |
Hello, We have been working with gallery for a few years now with great success. This has led us to consolidating all of our image storage into gallery. Unfortunately the data set we are working with is rather large, 900GB, and the built in import and galleryadd were insufficient for our needs. Does anyone have any suggestions about what direction we should be looking in order to import this data? (We've done some preliminary work with the api but that is still early on) Additionally we would like to separate off the image storage and code into two locations. The image storage will be put on a san to allow for expansion. We are wondering if this is easy to do or will it require code changes? Thanks, |
|
alecmyers
Joined: 2006-08-01
Posts: 4342 |
![]() |
Quote:
The image storage will be put on a san to allow for expansion. We are wondering if this is easy to do or will it require code changes? The g2data directory needs to be part of the local filesystem within php. If you SAN can do that then there are no code changes necessary. |
|
nivekiam
![]()
Joined: 2002-12-10
Posts: 16504 |
![]() |
Beg and plead with http://www.care2.com/ to share their modifications? Other than what Alec mentioned, try searching the forums for Amazon S3 http://gallery.menalto.com/node/77816 So there's one option that may or may not work for you or you might be able to modify it to work for your environment. ____________________________________________ |
|
Helo
Joined: 2010-02-10
Posts: 2 |
![]() |
Thank you all for taking the time to give me your suggestions. The information was really helpful! Mark |
|
maryhit
Joined: 2010-12-23
Posts: 5 |
![]() |
Hi, I have a big amount of pictures on my server (hundreds of GB) and I would like to view them using Gallery3 without letting the import module of the gallery copy them again in a different folder. I would like to point the gallery folder to the folder where I already have the pictures and let the gallery process it in a way that would not duplicate the pictures. Maximum let gallery create some smaller versions of the pictures, and of course, create entries in the DB for the albums/pictures. Thanks. |
|
nivekiam
![]()
Joined: 2002-12-10
Posts: 16504 |
![]() |
G3 does not work like this. Perhaps someone will create a symlink option in the future, but it's not going to be a core feature. If you need this feature set, use G2 and use the symlink option when using the Add From Server method. |
|
maryhit
Joined: 2010-12-23
Posts: 5 |
![]() |
Thanks for your reply. I thank you for you time. PS. Is it easy to modify this plugin to allow the same nice feature on gallery3? |
|
nivekiam
![]()
Joined: 2002-12-10
Posts: 16504 |
![]() |
See Bharat's comment here: For G2, when using the Local Server there are checkboxes on the right of the table of files/directories to choose to import for using the symlink option. |
|
maryhit
Joined: 2010-12-23
Posts: 5 |
![]() |
You are too fast I thank you for you time. PS. Is it easy to modify this plugin to allow the same nice feature on gallery3? |
|
nivekiam
![]()
Joined: 2002-12-10
Posts: 16504 |
![]() |
a) No, each file needs a pointer. Gallery doesn't read directories, it needs to import the photos and do stuff. b) yes, write permissions by the server are needed, period. c) which version? In g2, g2data/cache/derivative and they are numbers and renamed and only the database knows what file belongs to what image. In G3 /var/thumbs and /var/resizes For G2, basically don't go poking around in g2data, if you start mucking around in there beyond just reading and looking, you will most likely break something. d) If using G2 and you don't have things cached, browsing G2 will be slow. Uninstall unused plugins, but if Gallery is just creating the thumbs and resizes most of those shouldn't be touched. 30 minutes is a long time, get a faster box PS, I sort of answered your question above, see Bharat's comment in that ticket. It might be easy, you'll need to dig into the code, or jump onto #gallery on IRC and see if someone is around more familiar with the code base than myself to give some quick pointers. Either way, you're not going to get around points a and b ____________________________________________ |
|