News for hackers. Stuff that matters.
Re:Studio Ghibli releases 400 free-to-use images by ryankrage77 on Wednesday September 23, 2020 @07:53AM (#24565881)
You can bulk download these with wget like so;

  wget http://www.ghibli.jp/gallery/{ged,chihiro,karigurashi,ponyo,kokurikozaka,marnie,kaguyahime,kazetachinu}{001..050}.jpg
However they're low quality 1080p jpegs, so you're better off splitting out the frames of a blu-ray rip of the movie using ffmpeg or something.
Re:Studio Ghibli releases 400 free-to-use images by feross on Wednesday September 23, 2020 @11:30AM (#24568213)
Download them over WebTorrent directly in your browser:

https://instant.io/#e371e76f57923f555c0585910420137cd615911a

magnet:?xt=urn:btih:e371e76f57923f555c0585910420137cd615911a

Re:Studio Ghibli releases 400 free-to-use images by eh8 on Wednesday September 23, 2020 @01:13PM (#24569373)
Cheers, this is such a neat website.
Re:Studio Ghibli releases 400 free-to-use images by ivarv on Wednesday September 23, 2020 @11:55AM (#24568501)
once downloaded to the browser is there an easy to dump the images to disk?
Re:Studio Ghibli releases 400 free-to-use images by nicolaslegland on Wednesday September 23, 2020 @12:29PM (#24568804)
Look for the "Download all files as zip" link.
Re:Studio Ghibli releases 400 free-to-use images by rtkwe on Wednesday September 23, 2020 @07:23PM (#24573441)
Wow thanks that's impossible to see. It just blended in with the file list and I completely missed it.
Re:Studio Ghibli releases 400 free-to-use images by ivarv on Wednesday September 23, 2020 @12:37PM (#24568885)
Thank you! I had missed that.
Re:Studio Ghibli releases 400 free-to-use images by Santosh83 on Wednesday September 23, 2020 @12:01PM (#24568548)
Without addons, I suppose "Save Page" is your only option. Or tediously save each image manually.
Re:Studio Ghibli releases 400 free-to-use images by ivarv on Wednesday September 23, 2020 @12:11PM (#24568631)
In firefox the "Save Page" doesn't save the downloaded images. I'll have to investigate the addon options..

So far on Firefox neither "Down them all!" nor "Download All Images" recognized the torrented images.

Re:Studio Ghibli releases 400 free-to-use images by harlanji on Wednesday September 23, 2020 @12:23PM (#24568746)
Print to PDF and convert to web page? I’d be interested to know if the JPGs move through that one untouched.
Re:Studio Ghibli releases 400 free-to-use images by tk75x on Wednesday September 23, 2020 @12:16PM (#24568675)
bulk image downloader has worked really well for me in the past
Re:Studio Ghibli releases 400 free-to-use images by yummybear on Wednesday September 23, 2020 @08:23AM (#24566129)
...Found the guy who crashed the site ;)
Re:Studio Ghibli releases 400 free-to-use images by ape4 on Wednesday September 23, 2020 @09:27AM (#24566786)
You can add delays with -w 10 (10 seconds) or --random-wait says https://stackoverflow.com/questions/35771287/delays-between-...
Re:Studio Ghibli releases 400 free-to-use images by izietto on Wednesday September 23, 2020 @09:58AM (#24567112)
--random-wait with the default tries (20) is working for me
Re:Studio Ghibli releases 400 free-to-use images by yorwba on Wednesday September 23, 2020 @12:28PM (#24568791)
Don't forget --timestamping in case the command fails and you want to try again, but only download files you don't already have.
Re:Studio Ghibli releases 400 free-to-use images by arkitaip on Wednesday September 23, 2020 @08:26AM (#24566161)
It's really the tragedy of the commons and why we can't have nice things. Ghibli went out of their way and gave something nice, only to have it immediately abused by gluttonous data horders.
Re:Studio Ghibli releases 400 free-to-use images by hajhatten on Wednesday September 23, 2020 @08:32AM (#24566224)
Yeah, it's definetly the ~100 people using a shell script to download a couple of jpegs crashing the site. Not millions of regular people looking around.
Re:Studio Ghibli releases 400 free-to-use images by poopsmithe on Wednesday September 23, 2020 @08:43AM (#24566307)
This is a nice use case for IPFS.

People `ipfs pin` the images to satisfy their data lust, and instantly become part of the growing swarm of computers which are now serving the content to new visitors.

Re:Studio Ghibli releases 400 free-to-use images by throwaway8941 on Wednesday September 23, 2020 @08:47AM (#24566340)
Or just put it on a tracker, like we've been doing for 20 years.
Re:Studio Ghibli releases 400 free-to-use images by nicolaslegland on Wednesday September 23, 2020 @10:42AM (#24567658)
https://instant.io/#e371e76f57923f555c0585910420137cd615911a

magnet:?xt=urn:btih:e371e76f57923f555c0585910420137cd615911a

Re:Studio Ghibli releases 400 free-to-use images by feross on Wednesday September 23, 2020 @11:29AM (#24568200)
Thanks for sharing – 8 peers and downloaded in 30 seconds!
Re:Studio Ghibli releases 400 free-to-use images by dewey on Wednesday September 23, 2020 @11:53AM (#24568477)
This is a nice use case for a regular and boring CDN, caching images and making them available without crashing a web server is a solved problem.
Re:Studio Ghibli releases 400 free-to-use images by tyrust on Wednesday September 23, 2020 @02:09PM (#24570057)
You've described a solution that puts the cost/work on the provider. IPFS and BitTorrent shifts that to the consumers.
Re:Studio Ghibli releases 400 free-to-use images by fxtentacle on Wednesday September 23, 2020 @03:21PM (#24570857)
€50 per month for 50TB of traffic = 50 mio x 1MB file downloads. The costs are so low, that CDNs are practically free. Oh wait, CloudFlare IS free for such primitive use cases.
Re:Studio Ghibli releases 400 free-to-use images by tyrust on Wednesday September 23, 2020 @03:29PM (#24570933)
You ignored the costs of labor.

Not that it matters, my point stands. The cost exists and different solutions put it in different places.

Re:Studio Ghibli releases 400 free-to-use images by yupyup54133 on Wednesday September 23, 2020 @09:25AM (#24566759)
Or pin them on Skynet. Which is just a better implementation of IPFS.
Re:Studio Ghibli releases 400 free-to-use images by nicolaslegland on Wednesday September 23, 2020 @11:38AM (#24568305)
Re:Studio Ghibli releases 400 free-to-use images by aspenmayer on Wednesday September 23, 2020 @10:23AM (#24567411)
Are there metrics that indicate this, or is it better in other ways also?
Re:Studio Ghibli releases 400 free-to-use images by Taek on Wednesday September 23, 2020 @10:59AM (#24567891)
The big difference with Skynet is that you pay for professionals to pin the data on your behalf. It works better for unpopular files because you aren't relying on the uptime of people at home.

It also works better for popular files because the professionals generally have great bandwidth and good peering.

There are a bunch of other benefits as well, such as access to an api that allows skynet pages/apps to upload and download. For something like this you wouldn't use those endpoints but if you wanted to make say a decentralized blogger, you could use those endpoints to upload posts that users write.

Re:Studio Ghibli releases 400 free-to-use images by capableweb on Wednesday September 23, 2020 @02:47PM (#24570478)
> because you aren't relying on the uptime of people at home

IPFS doesn't automatically spread whatever you put into your client, so you should never rely on others to randomly host your content for you. In fact, if you start a default IPFS node, add your content then turn it off again, no one is gonna have the content you added.

Would have been interesting to hear a fair/impartial comparison between Skynet and IPFS but your misunderstanding of IPFS is now evident so maybe someone else can fill in the gaps?

Re:Studio Ghibli releases 400 free-to-use images by ekianjo on Wednesday September 23, 2020 @08:36AM (#24566258)
Out of their way? Releasing a few pictures they already stored digitally hardly seems like a lot of effort.
Re:Studio Ghibli releases 400 free-to-use images by foxhop on Wednesday September 23, 2020 @08:57AM (#24566444)
Or the studio could have provided a single zip/tar for the data archivist. ; )
Re:Studio Ghibli releases 400 free-to-use images by bo1024 on Wednesday September 23, 2020 @11:02AM (#24567935)
A torrent would be easiest on their servers.
Re:Studio Ghibli releases 400 free-to-use images by eejjjj82 on Wednesday September 23, 2020 @09:56AM (#24567091)
Check out https://letsenhance.io/ I've been using it for >year to get print quality images. Works great
Re:Studio Ghibli releases 400 free-to-use images by Rafael_Milcic on Wednesday September 23, 2020 @10:30AM (#24567501)
To piggyback off this - As a graphic designer, I've tried basically all publicly available upscaling tools, and Gigapixel AI is by far the best one.
Re:Studio Ghibli releases 400 free-to-use images by kixiQu on Wednesday September 23, 2020 @03:47PM (#24571101)
If anyone upscales this collection, can they send me a message (all modes of contact on https://maya.land/)? I'm happy to send you some $ to be able to download the higher res copies; seems like a waste to do it twice.
Re:Studio Ghibli releases 400 free-to-use images by lucascantor on Thursday September 24, 2020 @12:04AM (#24575134)
I've given this a shot using Pixelmator (https://www.pixelmator.com/blog/2019/12/17/all-about-the-new...)

Expect an email with the upscaled images sent via WeTransfer.

Re:Studio Ghibli releases 400 free-to-use images by kixiQu on Thursday September 24, 2020 @01:51AM (#24575658)
Thanks!! Appreciate it. :) Let me know if you've got a ko-fi or whatnot?
Re:Studio Ghibli releases 400 free-to-use images by combatentropy on Wednesday September 23, 2020 @10:47AM (#24567720)
> low quality 1080p jpegs

imagemagick reports their quality as 75, based on a few I picked at random:

  identify -format '%Q' marnie007.jpg
  75
--- which is not terrible but not great either. The thumbnails are PNG. It's too bad they didn't use that for the full-size ones.
Re:Studio Ghibli releases 400 free-to-use images by maple3142 on Wednesday September 23, 2020 @09:24AM (#24566740)
I know shell can expand, but this is my first time seeing somethings like this. I didn't know shell can do things like Cartesian product before.
Re:Studio Ghibli releases 400 free-to-use images by aidenn0 on Wednesday September 23, 2020 @09:54AM (#24567063)
That's a bashism, fwiw
Re:Studio Ghibli releases 400 free-to-use images by jeffbarr on Wednesday September 23, 2020 @10:03AM (#24567157)
This was in the BSD C Shell (https://en.wikipedia.org/wiki/C_shell) way back in the early 1980s!
Re:Studio Ghibli releases 400 free-to-use images by the_af on Wednesday September 23, 2020 @09:15AM (#24566643)
> However they're low quality 1080p jpegs

Good enough for me :) They look nice.

Thanks for the wget tip!

Re:Studio Ghibli releases 400 free-to-use images by rootsudo on Wednesday September 23, 2020 @08:13AM (#24566047)
I did not know I could do {001...999} with wget! wow!
Re:Studio Ghibli releases 400 free-to-use images by pxndxx on Wednesday September 23, 2020 @08:14AM (#24566058)
That's a shell feature, not wget's.
Re:Studio Ghibli releases 400 free-to-use images by jasonjayr on Wednesday September 23, 2020 @02:21PM (#24570182)
Curl has it built in:

    curl -O 'https://example.org/[2-4].jpg'
(quotes disable any kind of shell expansion)
Re:Studio Ghibli releases 400 free-to-use images by lohfu on Wednesday September 23, 2020 @08:19AM (#24566099)
Really? I thought the shell could only expand globs if it matches files on the local file system?
Re:Studio Ghibli releases 400 free-to-use images by lloeki on Wednesday September 23, 2020 @08:32AM (#24566212)
The feature is called brace expansion:

https://www.gnu.org/software/bash/manual/html_node/Brace-Exp...

You may also be interested in yet another powerful feature that is parameter expansion:

https://www.gnu.org/software/bash/manual/html_node/Shell-Par...

Filename expansion (nitpick: often mistaken for globbing) is performed last:

https://www.gnu.org/software/bash/manual/html_node/Filename-...

Re:Studio Ghibli releases 400 free-to-use images by account42 on Thursday September 24, 2020 @03:25AM (#24576189)
> nitpick: often mistaken for globbing

What exactly would you call globbing if not the feature that is controlled using the nullglob, failglob, nocaseglob and dotglob options as well as the GLOBIGNORE variable.

Re:Studio Ghibli releases 400 free-to-use images by lloeki on Thursday September 24, 2020 @04:03AM (#24576408)
Globbing has an ambivalent definition given that it’s mostly used for filename matches (especially given its origin as the glob command), but it’s really a specific form of pattern matching using wildcards such as * and ?, it need not apply only to filenames or paths on the filesystem: this matching is also used to match strings in case/in/esac constructs and test’s == !=

https://www.gnu.org/software/bash/manual/bash.html#Condition...

I guess one could say globbing is applying this pattern matching to filter a list.

Re:Studio Ghibli releases 400 free-to-use images by falcor84 on Wednesday September 23, 2020 @08:23AM (#24566134)
You're right regarding glob functionality, but the curly braces are a separate shell feature. The most useful idiom I use it for is renaming or copying, e.g.:

cp filename{,_backup}

Re:Studio Ghibli releases 400 free-to-use images by ses1984 on Wednesday September 23, 2020 @08:20AM (#24566114)
Thoae aren't globs, if you put an asterisk there it would not work.
Re:Studio Ghibli releases 400 free-to-use images by barrkel on Wednesday September 23, 2020 @09:46AM (#24566984)
Of course, this only works well with non-ancient bash, not the ancient version which ships with MacOS, which will do {1.999} but can't do the leading zeros (you can use printf '%.3d' as a separate step).
Re:Studio Ghibli releases 400 free-to-use images by kawera on Wednesday September 23, 2020 @10:26AM (#24567439)
brew is your friend here, it has the latest version. Works well.
Re:Studio Ghibli releases 400 free-to-use images by moonchild on Wednesday September 23, 2020 @04:49PM (#24571854)
Afaik macos ships with zsh now, which supports that feature.
Re:Studio Ghibli releases 400 free-to-use images by SparkyMcUnicorn on Wednesday September 23, 2020 @08:17AM (#24566084)
It isn't bound by command. You can use it everywhere!
Re:Studio Ghibli releases 400 free-to-use images by kazinator on Wednesday September 23, 2020 @08:15AM (#24566066)
You mean, you didn't know that wget can be given more than one URL argument it can fetch, and that Bash can generate arguments with interpolated numbers using {from...to}.
Re:Studio Ghibli releases 400 free-to-use images by scns on Wednesday September 23, 2020 @09:12AM (#24566603)
Could you upload an archive for the others since the site went down? With the note about usage preferrably.
Re:Studio Ghibli releases 400 free-to-use images by kotrunga on Wednesday September 23, 2020 @09:42AM (#24566940)
Dumb question but I'm getting 404 errors with the wget command (but the urls work fine in the browser). Any advice?
Re:Studio Ghibli releases 400 free-to-use images by happy_bear on Wednesday September 23, 2020 @10:16AM (#24567331)
I got the same error on zsh, but not on bash
Re:Studio Ghibli releases 400 free-to-use images by kotrunga on Wednesday September 23, 2020 @10:42AM (#24567664)
I was using fish, wasn't working there either. thanks :)
Re:Studio Ghibli releases 400 free-to-use images by jordache on Wednesday September 23, 2020 @11:15AM (#24568069)
good enough as photo reference!