A parallel implementation of gzip for modern multi-processor multi-core machines

Re:A parallel implementation of gzip for modern multi-proces... by abhishivsaxena on Saturday August 20, 2016 @05:02PM (#12328290)

Any ideas how this would compare to gzip while on a Microserver? I'm thinking of Atom C2750 bare metal from packet.

[ Parent | on HN ]

Re:A parallel implementation of gzip for modern multi-proces... by opcenter on Saturday August 20, 2016 @05:30PM (#12328370)

Looks like that has 8 cores? I would imagine it would make a huge difference depending on other loads on the system. I gave it a try on my file server at home that has an AMD E-350 processor with 2 cores and it shaved off a good 42% of the total time:

  > time gzip -v xubuntu-16.04-desktop-amd64.iso 
  xubuntu-16.04-desktop-amd64.iso:	  1.5% -- replaced with xubuntu-16.04-desktop-amd64.iso.gz
  gzip -v xubuntu-16.04-desktop-amd64.iso  119.07s user 4.66s system 98% cpu 2:05.22 total

  > time pigz -v xubuntu-16.04-desktop-amd64.iso           
  xubuntu-16.04-desktop-amd64.iso to xubuntu-16.04-desktop-amd64.iso.gz 
  pigz -v xubuntu-16.04-desktop-amd64.iso  128.19s user 6.64s system 184% cpu 1:12.97 total

[ Parent | on HN ]