News for hackers. Stuff that matters.
Re:Open sourcing Grid, the Guardian’s new image management s... by edpichler on Wednesday August 12, 2015 @10:43AM (#10047939)
Same Idea of Globo (Brazilian TV conglomerate) https://github.com/thumbor/thumbor

About Grid, it seems the images are stored on FTP. Am I right?

I look for a solution like these, but more flexibe, where I could host my images on AWS, Azure, etc.

Re:Open sourcing Grid, the Guardian’s new image management s... by theefer on Wednesday August 12, 2015 @11:10AM (#10048113)
It has some similarities with Thumbor (incl. cropping and resizing assets, etc), but the two are quite different. Thumbor goes a bit further than Grid with features like face recognition, etc, which we are looking at for the future. Thumbor also supports dynamic resizing, whereas we prefer to generate static assets and use external services (ImgIx in our case) to handle dynamic resizing and optimisations.

Grid is more of a media management service, allowing quick search of indexed metadata, organisation and collaboration using labels, quick upload into the system, rights management, etc. It also has extensive APIs to allow various degrees of integration.

Grid stores images in S3 (could be abstracted to any storage system with a small amount of effort). FTP is only used as a source for ingesting images into the system, and we're looking to scrape that and replace with S3-based ingestion in the near future.

- Séb, Lead developer on Grid

Re:Open sourcing Grid, the Guardian’s new image management s... by UserRights on Wednesday August 12, 2015 @12:27PM (#10048727)
Thank you very much for open sourcing this powerful tool, very nice. I checked some open source DAM tools some time ago and from what I can see from the linked page this will easily be in the top 5.

Quick questions:

* are there some video features (like kaltura or youtube simple editing)?

* how does "Indesign integration" exactly work?

* is it possible to use local storage, not Amazon services?

* is there some ansible / salt / chef / whatever installation scripting available?

Also one special consideration, none of the tools I checked, no picture gallery and no web service that hosts pictures offers this simple but very important feature:

* picture approval workflow: please allow to upload pictures, show input fields for email(s) of person(s) visible on the picture and send them a link to a page where they can allow to publish the picture. This could be a (customizable) form with some specific text or some more details, however the user should be able to simply agree publishing the picture. Save the user agreement status in the datastore.

Every software / web service allowing to publish pictures online should have such a feature - the fact that this is not available anywhere shows that we are still in the very beginnings of the internets. One day, certainly, humans will laugh about the "non-privacy-by-default"-internetz of the early days...

Yes, I know, as a journalist usually you have rights cleared material, however this functionality would still be a great step forward, also for pro material a good rights management workflow would be very important to have. How to implement this, is there some developer documentation / plugin system available?

Re:Open sourcing Grid, the Guardian’s new image management s... by theefer on Wednesday August 12, 2015 @12:53PM (#10048911)
> are there some video features (like kaltura or youtube simple editing)?

Not at this stage, no. We're currently focusing on images.

> how does "Indesign integration" exactly work?

InDesign integration works by drag and dropping an image into InDesign. Associated metadata, including the canonical ID, are then read by an InDesign plugin so we can store a reference to the original asset.

Other integrations with other web-based editorial tools in our suite also use drag and drop (+ drag metadata). It's also possible to copy paste URLs.

> is it possible to use local storage, not Amazon services?

Not out of the box, but there is no reason why it couldn't be done with a few changes.

> is there some ansible / salt / chef / whatever installation scripting available?

I'm afraid not. We mostly use CloudFormation to spin up our infrastructure and inject the relevant configuration on each service. There is a lightweight CF script for development purposes in the Grid repo, but our main CF script is currently in a private repository.

> picture approval workflow

We had discussions with our picture desk about the level of permissions desired. Currently, we prefer the approach of keeping publishing open, so as not to introduce tedious barriers and slow down publishing (e.g. in case of breaking news, etc). There is a balance between the cost of publishing the wrong thing (e.g. not rights cleared) vs the missed value of publishing too late.

To balance the openness, we are focusing on providing high degrees of visibility to our picture editors, e.g. a feed of all images about to be published that aren't fully rights cleared. We also work really hard to get the information properly recorded (ideally automated) so the rights information is accurate about whether a picture can be used or not.

At the end of the day, we want to empower desks with the tools to come up with their own workflows and ways to limit risks associated with allowing all (or most) people to publish content, rather than imposing a rigid workflow.

- Séb, lead developer on Grid

Re:Open sourcing Grid, the Guardian’s new image management s... by ndufresne on Wednesday August 12, 2015 @04:02PM (#10050262)
I was actually just looking for ways to place images from a DAM into indesign to track the original source. I'm curious - is the plugin you use part of the project, 3rd party or closed source? I took a quick look through the github repo, but i wasn't sure if I missed it. Thanks!
Re:Open sourcing Grid, the Guardian’s new image management s... by UserRights on Thursday August 13, 2015 @09:50AM (#10054110)
yes, custom workflows would be the best solution, very good direction to go!
Re:Open sourcing Grid, the Guardian’s new image management s... by foolinaround on Wednesday August 12, 2015 @11:28AM (#10048226)
What are Grid's similarities and differences over a Digital Asset Management tool ( DAM )?
Re:Open sourcing Grid, the Guardian’s new image management s... by theefer on Wednesday August 12, 2015 @12:43PM (#10048849)
As other replies have said, this is functionally a DAM.

It is particularly adapted to the requirements of publishers, in that it supports large number of images (we have over 3M currently), can scale to ingest many new images continuously quickly (publishers often receive lots of images from agencies and wires), indexes all the metadata to power a very fast search, allows collaboration of various roles involved in the use of assets and production of content, etc.

Unlike most commercial DAMs, which can be quite costly to run and acquire, Grid is also Open Source. We didn't find any existing DAM (incl Open Source) that fit our requirements, in particular in terms of ease and speed of use, powerful Web-based interface, rich APIs, etc.

You will have to review alternatives to know which one is the best fit for your use case.

Hope this helps clarify what Grid is wrt other DAMs.

Best,

- Séb, lead developer on Grid

Re:Open sourcing Grid, the Guardian’s new image management s... by jackgavigan on Wednesday August 12, 2015 @05:57PM (#10050938)
To what extent did the old Picdar solution influence the design of Grid?
Re:Open sourcing Grid, the Guardian’s new image management s... by theefer on Thursday August 13, 2015 @12:55PM (#10055565)
As you can probably see yourself from the screenshot and video, not much.

There may be some subconscious influence from the old system and other image systems we have used (Lightroom, Picasa, Google Photos, Flickr, etc), but I can't think of particular features inspired from Picdar.

Re:Open sourcing Grid, the Guardian’s new image management s... by napoleond on Wednesday August 12, 2015 @12:08PM (#10048541)
It looks to me like it is a DAM, just... a lot better than the alternatives (at least as of ~5 years ago when I evaluated options and ended up with a smaller-scale in-house version of this).

EDIT: Better in the sense of discoverability, at least.

Re:Open sourcing Grid, the Guardian’s new image management s... by UserRights on Wednesday August 12, 2015 @12:30PM (#10048754)
You will need a lot of time to evaluate DAM solutions, but I recommend putting this quite on top of your list of candidates.

Here are some more to spend the winter with:

http://www.opensourcedigitalassetmanagement.org/

Re:Open sourcing Grid, the Guardian’s new image management s... by masom on Wednesday August 12, 2015 @01:00PM (#10048971)
Thumbor let's you store and retrieve your images anywhere. We use AWS S3 with a redis storage cache + another redis cluster to store the result cache.
Re:Open sourcing Grid, the Guardian’s new image management s... by Daviey on Thursday August 13, 2015 @06:02AM (#10053109)
My assumption was that the photographer uploaded via FTP, but were stored by the provider in S3.