News for hackers. Stuff that matters.
Re:What programming languages are used most on weekends? by Cyph0n on Tuesday February 07, 2017 @07:54PM (#13594650)
> They use linux or OSX. But they don't know awk/sed/bash

Am I in the minority of developers then? I don't know awk and sed and I'm honestly not very interested in learning them. But bash I definitely agree with. I still use a cheatsheet to get the syntax right because it's weird as hell imo.

Re:What programming languages are used most on weekends? by rcdmd on Tuesday February 07, 2017 @08:33PM (#13594898)
I don't think you are in the minority, assuming you have a reasonable way to quickly parse text. I think most developers just Google for one-liners or throw something together in Python to solve text-parsing tasks at hand, rather then trying to remember which tool uses which type of regex with which argument.
Re:What programming languages are used most on weekends? by sokoloff on Tuesday February 07, 2017 @08:05PM (#13594720)
Worth reading "Area Number Three" on this blog post from Steve Yegge: https://sites.google.com/site/steveyegge2/five-essential-pho...
Re:What programming languages are used most on weekends? by Cyph0n on Tuesday February 07, 2017 @10:19PM (#13595400)
Isn't that just a `grep -R [regex pattern]`? Not sure where something like awk or sed fits in to solve such a problem.
Re:What programming languages are used most on weekends? by sokoloff on Tuesday February 07, 2017 @10:28PM (#13595447)
The primary point was one of mindset, but the second example in the cited section is a tailor-made sed example:

Let's say you're on my team, and I've decided I'm a real stickler for code formatting. But I've got peculiar tastes, and one day I decide I want to have all parentheses stand out very clearly in your code.

So let's say you've got a set of source files in C, C++, or Java. Your choice. And I want you to modify them so that in each source file, every open- and close-paren has exactly one space character before and after

Re:What programming languages are used most on weekends? by dgacmu on Tuesday February 07, 2017 @10:46PM (#13595541)
Y'know - after thinking about it a little, I'd argue that this is a question that could serve a second purpose. The obvious out-of-the box implementations of this in sed/perl/etc. would all fail to properly handle open and close parens in strings and comments. Particularly multi-line comments and strings with escaped quotation marks inside of them.

I like sed. I like perl one-liners. I would consider it a mistake to try to do this on a real codebase in a batch manner with just a regexp. You'd be far better off googling to find a source code formatter that includes a real parser, like clang-format.

Re:What programming languages are used most on weekends? by sokoloff on Tuesday February 07, 2017 @11:06PM (#13595656)
The question specification is such that you don't need special handling of comments, strings, etc. "every paren" isn't qualified as "that is part of the code".

The point of the question is more to gauge your understanding of/familiarity with available tools and ability to think laterally rather than immediately jump to "I've got to write some real code to solve this"

Re:What programming languages are used most on weekends? by kriro on Wednesday February 08, 2017 @02:28AM (#13596510)
I'd probably reach for ANTLR to write a quick parser since working with such a stickler is likely to require more code formatting changes in the future.

As an aside, the stuff I used sed/awk for in the past have pretty much been replaced by Python for me. These days it's pretty rare to not have a default Python install on any Unixy box one spins up and in the rare cases I use Windows I tend to install Anaconda so it's also slightly more cross-platform for my use cases.

Re:What programming languages are used most on weekends? by Cyph0n on Tuesday February 07, 2017 @10:43PM (#13595529)
Whoops, didn't notice that one. Thanks for linking that post by the way. Great read.
Re:What programming languages are used most on weekends? by sokoloff on Tuesday February 07, 2017 @11:06PM (#13595660)
Most Yegge blog rants are well worthwhile, IMO. I wish he wrote more of them.
Re:What programming languages are used most on weekends? by dsacco on Wednesday February 08, 2017 @01:34AM (#13596286)
If you're getting along fine without awk then by all means, don't learn it. But just today I had to quickly get a raw list of all US area codes (and only area codes). After a short Google search, I realized the fastest way of downloading and formatting it without having to do a secondary step was this:

  curl https://raw.githubusercontent.com/kedarmhaswade/cities/master/area-codes.csv | \
  awk -F, '{print $1}' \
  > ~/area_codes.txt
Now, could you use grep? Yeah, sure. But for really quick examples like this - things that lend themselves to it (e.g. a raw CSV with mostly crap you don't need but something you do), this is super fast. Anything more complicated and I'd break out a regex, though.
Re:What programming languages are used most on weekends? by robalfonso on Tuesday February 07, 2017 @08:05PM (#13594722)
awk and sed are fantastic for command line processing of text. You really should take a look at them. All that said, if you don't find yourself trying to do something in bash and thinking "there must be an easier way" then you're problem sets may just not need them.
Re:What programming languages are used most on weekends? by wruza on Wednesday February 08, 2017 @04:32AM (#13597010)
edit: comment was about perl, I didn't notice discussion below
Re:What programming languages are used most on weekends? by bootload on Tuesday February 07, 2017 @08:11PM (#13594772)
"I don't know awk and sed and I'm honestly not very interested in learning them. But bash I definitely agree with."

Awk/Sed are optimised for text/data processing.[0] While Bash might work, will the script work on all systems (and version)? [1] awk & predecessor sed are good for one liner programs and suitable for problems that need fast, reliable solutions.

reference

[0] Opening, closing files; reading, breaking and counting record fields.

[1] OS use Bash or Bourne? https://en.wikipedia.org/wiki/Bash_(Unix_shell)#Portability

Re:What programming languages are used most on weekends? by freehunter on Tuesday February 07, 2017 @09:02PM (#13595038)
Then again, sed works differently on different platforms, and awk is not the same as gawk or nawk, both of which have many more features than standard awk. If you're used to the GNU implementation, you might be surprised to find your script doesn't work on a system without the gawk implementation.

On Linux, I can use this sed command: sed -i ‘s/^”//’ example.txt

That deletes any quotation marks that are at the beginning of a line. It does it in-place, and while you have the option to rename the old file and replace it with a new file with the original name (using "sed -i.bak ‘s/^”//’ example.txt" would move the existing example.txt file to example.txt.bak and write a new one in-place), if you leave out the .bak, it just writes it in-place with no backup file.

On OS X, though, that command won't work. You have to specify a backup file, even if it's blank. "sed -i “” ‘s/^”//’ example.txt" would replace the text in-place without a backup. sed -i “.bak” ‘s/^”//’ example.txt would replace the file and move the original to "example.txt.bak".

Even with sed and awk, you still have to stop and wonder if it will work cross-platform.

Re:What programming languages are used most on weekends? by wcarron on Tuesday February 07, 2017 @10:21PM (#13595411)
This is why I have gripes about the OS X command line. I can't confidently use the scripts I do on Ubuntu/Mint/Debian. Like, get with the program, Apple. It infuriates me and I'm moving entirely off their platform as soon as my Mac kicks the bucket.
Re:What programming languages are used most on weekends? by johnmaguire2013 on Tuesday February 07, 2017 @11:45PM (#13595825)
OS X is not Linux. It's a BSD-derivative, and doesn't use the GNU toolchain. It isn't that it's "not with the program." It's that it's not the operating system, or toolchain, you're familiar with. Install homebrew and GNU tools[1] if you want them.

If you used an operating system that shipped with BusyBox, you'd be similarly frustrated. But operating systems are tradeoffs with pros/cons. Using a different set of tools makes it distinct, not "out of date".

1. https://www.topbug.net/blog/2013/04/14/install-and-use-gnu-c...

Re:What programming languages are used most on weekends? by wcarron on Wednesday February 08, 2017 @11:44AM (#13599666)
Oh, my mistake. I was under the impression that sed/awk/grep/ack/etc etc were part of the POSIX standard toolchain, rather than the GNU toolchain.
Re:What programming languages are used most on weekends? by bootload on Wednesday February 08, 2017 @04:30AM (#13596996)
"OS X is not Linux. It's a BSD-derivative, and doesn't use the GNU toolchain."

True, but I was thinking awk/sed was a good multi OS tool with minimal code effect.

Re:What programming languages are used most on weekends? by base698 on Wednesday February 08, 2017 @08:58AM (#13598172)
I have a script which installs and aliases all the equivalent GNU commands on OSX. You can fix a lot of the annoyances.
Re:What programming languages are used most on weekends? by bootload on Wednesday February 08, 2017 @04:27AM (#13596982)
"Then again, sed works differently on different platforms"

Well that kills my idea why to use awk/sed. What would you use @freehunter?

Re:What programming languages are used most on weekends? by pjmlp on Wednesday February 08, 2017 @08:34AM (#13598032)
Perl, Python, Ruby
Re:What programming languages are used most on weekends? by bootload on Wednesday February 08, 2017 @08:02PM (#13603720)
True, defeats the idea of a one liner in bash/awk/sed.
Re:What programming languages are used most on weekends? by freehunter on Wednesday February 08, 2017 @08:08PM (#13603751)
Well the beauty of one-liners is that they're quick and dirty. They don't need to be portable, you don't usually maintain a one-liner for years. If you need something portable, you should use a real cross-platform language like Perl, Python, etc. Something that's independent of the OS you're running.
Re:What programming languages are used most on weekends? by bootload on Thursday February 09, 2017 @07:25PM (#13612305)
"Well the beauty of one-liners is that they're quick and dirty. They don't need to be portable, you don't usually maintain a one-liner for years."

Given that description, I'd agree. Now I understand the crux of the problem, problem solved using disposable code in terse language or script.

Re:What programming languages are used most on weekends? by GFK_of_xmaspast on Tuesday February 07, 2017 @08:52PM (#13594989)
There's no reason to use awk or sed when perl exists (a2p and s2p have existed for decades)
Re:What programming languages are used most on weekends? by kazinator on Tuesday February 07, 2017 @08:58PM (#13595016)
There is no reason to use perl in situation when awk kicks its butt with clearer, shorter code free of distracting sigils and other line noise

Awk is also POSIX standard; a good remaining reason to use it (if it is a feasible alternative for a task) is that a script has to be portable outside of GNU/Linux.

Re:What programming languages are used most on weekends? by tripa on Tuesday February 07, 2017 @10:55PM (#13595590)
I like Perl a lot better than awk, buy I do agree with the general sentiment of using the language that makes for the clearest code for the task at hand, especially the smaller ones. Which makes me a frequent awk proponent.

So I'm surprised at the following part of your comment:

> There is no reason to use perl in situation when awk kicks its butt with clearer, shorter code free of distracting author and other line noise

In my experience, the shorter ask code tends to be the one with sigils.

Re:What programming languages are used most on weekends? by jhbadger on Tuesday February 07, 2017 @11:21PM (#13595725)
But in a lot of ways awk seems way more modern than Perl (Perl 5 at least). You actually have functions with parameters rather than having a weird @_ array that you need to shift values from. Honestly, if I didn't know otherwise, I'd think awk came after Perl.
Re:What programming languages are used most on weekends? by vgy7ujm on Thursday February 09, 2017 @04:01PM (#13610940)
Functions with parameters in a () is already in Perl 5. Search for subroutine signatures.

http://perldoc.perl.org/perlsub.html#Signatures