News for hackers. Stuff that matters.
Re:Fred's ImageMagick Scripts by contingencies on Sunday March 25, 2018 @12:10AM (#16670707)
Seeing tools like this pop up periodically and get so many upvotes it seems a lot of people aren't aware of great tools. It would be interesting to see a gallery of Unix classic/modern tools presented in a structured course. Is anyone aware of one?

Something like images (imagemagick), video (ffmpeg/vlc), audio (sox), phone (asterisk/etc.), SMS (pdus/various), linguistics (various), classification (NNs), version control, snapshots, clustering (PXE/corosync/pacemaker), security (kernel toolkits), transaction systems and databases (sqlite/RDBMS/noSQL/time series), networking (filtering/firewall rules, intermittent connectivity, local multidrop protocols, tcpdump/wireshark), kernel security toolkits, CI/CD, etc.

Scope would be essentially everything except tools lying within the popular web stacks.

The goal would be that a student with interest could work their way through the syllabus and emerge a capable multi-domain unix hacker, rather than needing to encounter these problem domains over decades of career, rediscovering well worn approaches.

Re:Fred's ImageMagick Scripts by jypepin on Sunday March 25, 2018 @02:02AM (#16670990)
YES THIS PLEASE.

I learned programming through the web, so I lack a lot of knowledge in basic systems / bash / *nix / I'm not even sure how to call that.

I've googled so many time "learn bash" etc but it's never really what I'm looking for.

I regularly discover tools that are so basic yet so powerful (all things you mention) yet I feel there is a lack of (great) resources online to "learn the basic tools of your CL".

Re:Fred's ImageMagick Scripts by crowbahr on Sunday March 25, 2018 @03:47AM (#16671213)
You mean you don't just go read the man page for every bash command and intuitively understand it?

Sorry for the sarcasm, I just feel your pain. Learning even basic things in bash has been slow for me too. I love it. I prefer it to GUIs on most things I have figured out.

But there's so much to learn.

Re:Fred's ImageMagick Scripts by zwischenzug on Sunday March 25, 2018 @06:03AM (#16671522)
I spoke about bash and this exact thing here:

https://www.youtube.com/watch?v=pb3k0sGKrjQ

Plug for book that resulted:

https://leanpub.com/learnbashthehardway

Re:Fred's ImageMagick Scripts by dredmorbius on Monday March 26, 2018 @05:38AM (#16677714)
UNIX Power Tools, written in 1992, once filled much of this niche. It badly needs updating and augmenting, or a novel replacement.
Re:Fred's ImageMagick Scripts by acqq on Sunday March 25, 2018 @09:18AM (#16672046)
Re:Fred's ImageMagick Scripts by jypepin on Sunday March 25, 2018 @04:02AM (#16671252)
from a sibling comment: http://www.tldp.org/LDP/abs/html/ seems to be great :)
Re:Fred's ImageMagick Scripts by moviuro on Monday March 26, 2018 @09:59AM (#16678911)
It isn't as good as: https://mywiki.wooledge.org/BashGuide (which is the one that gets recommended on #bash @ freenode). Also: https://shellcheck.net
Re:Fred's ImageMagick Scripts by qiqitori on Sunday March 25, 2018 @05:32AM (#16671453)
Well, the way this person uses ImageMagick can hardly be described as "basic". In fact, he's a wizard. If you look through the bullet points at the top, he links to an impressive CV and PDFs with mathematical descriptions of how some of his scripts work.
Re:Fred's ImageMagick Scripts by ptr_void on Sunday March 25, 2018 @07:35AM (#16671739)
Re:Fred's ImageMagick Scripts by SSLy on Sunday March 25, 2018 @09:27AM (#16672066)
If you can spare the time read these two, the first one is free.

http://linuxcommand.org/tlcl.php/

https://www.amazon.com/UNIX-Linux-System-Administration-Hand...

Re:Fred's ImageMagick Scripts by paloaltokid on Sunday March 25, 2018 @02:38PM (#16673685)
The best way to learn in my opinion is to find someone who knows more than you and have them be your mentor. You don't even have to ask them directly, though many people I think are glad to teach.

Identify someone at your work or school who you feel always has a nice perspective and who you trust; then seek out their opinion and advice when you have questions. You can learn a lot in a fairly short amount of time by applying this practice.

You can also find what I've heard called "silent teachers" - there's no formal or informal relationship between the two of you, but you're always watching what they say, observing the things they care about, etc.

If you're in a situation where you're not employed full-time in a technical position it becomes a little harder but you can still do it. Much of it depends on your local context.

Re:Fred's ImageMagick Scripts by sureaboutthis on Sunday March 25, 2018 @07:11AM (#16671668)
You can scroll through /bin, /usr/bin/ and /usr/local/bin/ and find all the included basic tools and then read "man 'tool'" or google for it
Re:Fred's ImageMagick Scripts by linkmotif on Sunday March 25, 2018 @07:15AM (#16671685)
This is not practically useful advice.
Re:Fred's ImageMagick Scripts by jeremiep on Sunday March 25, 2018 @08:50AM (#16671962)
That's how I learned a lot of things; by literally scanning through everything it had to offer and googling what I didn't understand. I did that for linux utils, language references, most programs I use and most codebases I had to work on.

One notable example is the time I had to learn C# 4 years ago. It took an entire morning to scan through the entire language reference and then later I found out I already knew a lot more than "advanced" devs who would just look up stuff as they needed it, without knowing what actually is available in the first place.

I feel its the only sensible advice if you want to learn a lot on your own with limited time.

Re:Fred's ImageMagick Scripts by linkmotif on Sunday March 25, 2018 @03:49PM (#16674151)
My experience has been that it’s most important to get started. Then you can scan and read man pages etc.
Re:Fred's ImageMagick Scripts by Symbiote on Sunday March 25, 2018 @07:31AM (#16671730)
It's how I learned, back in dial-up days.

Coreutils is a good place to start.

http://www.gnu.org/software/coreutils/coreutils.html

Re:Fred's ImageMagick Scripts by linkmotif on Sunday March 25, 2018 @07:43AM (#16671760)
I’m not saying you can’t learn this way. I’m saying it’s not practical for most people. Many people who would fail this way would succeed other ways. Reading man bash as primary learning material will lead to failure for 999/1000 humans.
Re:Fred's ImageMagick Scripts by KC8ZKF on Sunday March 25, 2018 @08:41AM (#16671921)
Try 'info bash', it's a lot easier to browse. 'info' by itself gives you a menu of installed info documentation. 'C-h i' in Emacs.
Re:Fred's ImageMagick Scripts by ComputerGuru on Sunday March 25, 2018 @08:03AM (#16671803)
That just means the man page you're using sucks.
Re:Fred's ImageMagick Scripts by linkmotif on Sunday March 25, 2018 @03:51PM (#16674160)
I’ve wanted to read man bash, and believe me, I’d think I was the kind of person who would (I learned Go just reading the spec. It’s a great spec), but man bash and many other man pages have never worked for me. Maybe if I tried again now.
Re:Fred's ImageMagick Scripts by scbrg on Monday March 26, 2018 @04:17AM (#16677449)
bash, incidentally, has a man page that sucks. I've found that most larger GNU projects have pretty horrible man pages. Probably due to feature creep in said projects - so the manuals have to be large to cover all the features.

I spent 10 years avoiding awk, because every time I typed 'man awk' I was overwhelmed by the GNU monstrosity. Then I found the man page for the plan9 implementation of awk (http://man.cat-v.org/plan_9/1/awk) and learned the language in fifteen minutes.

Re:Fred's ImageMagick Scripts by jolmg on Monday March 26, 2018 @04:45PM (#16682417)
> I've found that most larger GNU projects have pretty horrible man pages. Probably due to feature creep in said projects - so the manuals have to be large to cover all the features.

Rather, info manuals are GNU's official (self-invented I think) documentation system. They make manpages only because of their popularity, but they direct you to the info pages for more info. When other projects have too much documentation for a manpage, they split it among several pages, like perl, openssl, zsh, git, borg, btrfs, etc. Personally, I like both, and wouldn't rank one above the other.

Re:Fred's ImageMagick Scripts by sureaboutthis on Sunday March 25, 2018 @07:33AM (#16671734)
It's far better than Googling or guessing for them. Looking in those places provides exactly what is on your system and the man pages exactly describe what they are for.

If there is a better source, I don't know it.

Re:Fred's ImageMagick Scripts by provost on Sunday March 25, 2018 @09:49AM (#16672146)
Yes, it is practically useful advice, especially when you’re on a flight with no WiFi.
Re:Fred's ImageMagick Scripts by linkmotif on Sunday March 25, 2018 @03:53PM (#16674181)
That’s a good use case. Believe me I’m into man pages. Every 6 months I check the Apple store to see if anyone has created a good man pages app. But as primary learning material for most people: not so sure.
Re:Fred's ImageMagick Scripts by justinsaccount on Sunday March 25, 2018 @11:58AM (#16672732)
That is exactly how I learned how things worked.
Re:Fred's ImageMagick Scripts by gm-conspiracy on Sunday March 25, 2018 @10:53AM (#16672425)
I never thought of that, and said to myself, "Hmmm... that is a good idea."
Re:Fred's ImageMagick Scripts by tenken on Sunday March 25, 2018 @02:51AM (#16671094)
Such galleries in my opinion already exist and simply require an afternoon hitting github for "* awesome (list)" with every topic you've listed. Then devoting enough self-teaching time to learn the material. These lists tend to be curated by domain experts and are already in a structured format suitable to the domain.

Here's 1 such example from the 1st result from a Google search for "github awesome security list":

https://github.com/sbilly/awesome-security

Re:Fred's ImageMagick Scripts by contingencies on Sunday March 25, 2018 @03:03AM (#16671118)
Hmm just tried it for audio and nothing I found in three audio-related lists off the curated awesome list of awesome lists even mentioned sox. I do think you suggest a good search strategy in very new areas, but I don't think it's quite the same thing as presented in the grandparent.

Personally I discovered a lot of great tools in my distribution's package management database.

Re:Fred's ImageMagick Scripts by newman8r on Sunday March 25, 2018 @05:49AM (#16671489)
You're right, not enough people know about sox. I can spend hours making random sounds with the synth just for fun. I've been contemplating making something like dwitter.net for sox as a side project. People would submit sox commands for various interesting sounds.
Re:Fred's ImageMagick Scripts by davidcuddeback on Sunday March 25, 2018 @09:58AM (#16672182)
> It would be interesting to see a gallery of Unix classic/modern tools presented in a structured course. Is anyone aware of one?

Back when I used Gentoo, I discovered a lot of interesting software by simply browsing their portage repository and installing packages that sounded interesting. It's organized into sections like you describe. There were (probably still are) web sites to browse the package database too. FreeBSD's ports are organized in a similar manner.

Re:Fred's ImageMagick Scripts by Faaak on Sunday March 25, 2018 @09:37AM (#16672106)
If you work in something related to physics (energy, maths, chemistry), I can not recommend `units` enough.

As a small example:

  You have: 10 kcal / g * 24 kg * .13USD/kWh
  You want: USD
  * 36.261333
It's so useful when converting between different units
Re:Fred's ImageMagick Scripts by Something1234 on Sunday March 25, 2018 @09:13PM (#16675803)
I want a tool that does that kind of conversion for me. I've been looking(not actively or with any sort of effort) for such a too since my friend showed me a mac only text based converter that did something like the above. I've been toying with writing one.
Re:Fred's ImageMagick Scripts by michelb on Monday March 26, 2018 @04:40AM (#16677521)
maybe this list has an option for you? https://alternativeto.net/software/soulver/?license=free&pla...

NaSC looks nice.

Re:Fred's ImageMagick Scripts by jrochkind1 on Sunday March 25, 2018 @03:16AM (#16671144)
have you tried vips as an alternative to imagemagick? it's pretty amazing.
Re:Fred's ImageMagick Scripts by contingencies on Monday March 26, 2018 @03:36PM (#16681756)
Never tried it, but it looks interesting where performance and memory use are issues. https://github.com/jcupitt/libvips Also it seems to have a GUI https://github.com/jcupitt/nip2 Thanks for sharing.
Re:Fred's ImageMagick Scripts by spapas82 on Monday March 26, 2018 @04:14PM (#16682117)
A good book for learning the Unix basics is "The unix programming environment" by Kernighan & Pike. This is an old book but the concepts it teaches are invaluable even today. We used it in our university around 20 years ago but I still recommend it to unix neophytes!
Re:Fred's ImageMagick Scripts by paradroid on Sunday March 25, 2018 @02:00AM (#16670986)
It would need to be automatically collated by an AI with access to the Internet Archive that is probably quite a bit more sophisticated than what we currently have. DMOZ is the closest curated thing I can think of.
Re:Fred's ImageMagick Scripts by jypepin on Sunday March 25, 2018 @02:22AM (#16671036)
DMOZ seems to have some good resources, going through it quickly I found http://www.tldp.org/LDP/abs/html/index.html which has a very good bash intro!
Re:Fred's ImageMagick Scripts by paradroid on Sunday March 25, 2018 @12:57PM (#16673069)
Not sure why I was downvoted. It's not as if the person downvoting me provided a better option than I did!