News for hackers. Stuff that matters.
Re:Huginn: Create agents that monitor and act on your behalf by tectonic on Thursday December 12, 2019 @12:07PM (#21773718)
It's fun to wake up to find a project that I started on the top of HN! These days, I'm no longer very involved with the day-to-day of the project.

Now that it's no longer a young project, here are some musings about Huginn and responses to people's comments in this thread, in no particular order.

I've found that Huginn excels as a scheduled web scraper with lightweight filtering. That's what I use it for. On the other hand, while you can write custom code in it, Huginn is pretty poor at implementing any sort of complex logic, and is even worse at bidirectional syncing between systems, which is something people often want it to do, but for which it wasn't designed.

If IFTTT or Zapier meet your needs, awesome! No need to run and monitor your own service. I personally choose to run Huginn on my own hardware in large part so that I'm comfortable giving it website cookies and passwords.

Some examples of what I use Huginn for these days:

- Watching Twitter in realtime for high standard deviation spikes in certain keywords, such as "san francisco emergency" or "san francisco tsunami warning", which then sends me a push notification, or "huginn open source", that goes to a digest email (and I imagine will trigger because of this thread).

- Watching Twitter for rare terms and sending me a digest of all tweets that match them. Also sending me all tweets from a few Twitter users who post rarely, but that I don't want to miss.

- Scraping a number of rarely updated blogs that don't have email newsletters and emailing me when they change. Some use RSS, most are just simple HTML scraping.

- Pulling deals from the frontpage and forums of slickdeals and craigslist and filtering them for certain keywords.

- Sending an early morning email if it's going to rain today.

- Watching ebay for some rare items.

- Sending my wife and me an email on Saturday morning with local yardsales from craigslist.

- Watching the HN and producthunt front pages for certain keywords.

Basically, anytime I find myself checking a website more then a few times, I spend 20min making a Huginn Agent to do it for me.

I think one reason Huginn has worked well for me is that I don't try to make it do too much. I use it for scraping data and gentle filtering, and that's about it. It's been super helpful for alerting me to interesting content for The Orbital Index, my current project, a weekly space-industry newsletter. (Last issue: http://orbitalindex.com/archive/2019-12-10-Issue-42/)

Re:Huginn: Create agents that monitor and act on your behalf by wpietri on Thursday December 12, 2019 @12:14PM (#21773811)
I'm excited to check this out, but I wanted to congratulate you on a truly excellent project name. Having spent many, many hours in naming struggles, I truly appreciate the perfection.

And for those unfamiliar, the (also amazingly named) historian Snori Sturluson explains: "Two ravens sit on his (Odin’s) shoulders and whisper all the news which they see and hear into his ear; they are called Huginn and Muninn. He sends them out in the morning to fly around the whole world, and by breakfast they are back again. Thus, he finds out many new things and this is why he is called ‘raven-god’ (hrafnaguð)." [1]

[1] https://norse-mythology.org/gods-and-creatures/others/hugin-...

Re:Huginn: Create agents that monitor and act on your behalf by fullwaza on Thursday December 12, 2019 @02:54PM (#21775653)
Norse Mythology by Neil Giaman is very good if you like such things. The audio book is especially good as it is narrated by the author.

https://www.audible.com/pd/Norse-Mythology-Audiobook/B01LWUJ...

Re:Huginn: Create agents that monitor and act on your behalf by monkeywork on Thursday December 12, 2019 @08:23PM (#21778310)
Can confirm just finished it on a 8 hr road trip last week. Very entertaining, found myself laughing out loud in the car at several points
Re:Huginn: Create agents that monitor and act on your behalf by rbradford on Thursday December 12, 2019 @02:28PM (#21775362)
There is a lovely two player board game called Odin's Ravens in which players acting as Muninn and Huginn race against each other by playing landscape cards. [1]

I wasn't aware of the full details of the lore so thank you for bringing that up!

[1] https://boardgamegeek.com/boardgame/192074/odins-ravens-seco...

Re:Huginn: Create agents that monitor and act on your behalf by aasasd on Thursday December 12, 2019 @02:02PM (#21775066)
Fittingly, Munin is a sorta-popular server monitoring tool: http://munin-monitoring.org
Re:Huginn: Create agents that monitor and act on your behalf by outworlder on Thursday December 12, 2019 @03:58PM (#21776385)
I actually thought the thread was about that. The Muninn/Hugginn association is engraved in my brain. I blame EVE online.
Re:Huginn: Create agents that monitor and act on your behalf by mr_woozy on Friday December 13, 2019 @11:08AM (#21782776)
Eve Online is produced here in Iceland and much of the language and norse mythology is worked into the game. Eve online uses ISK, we use ISK here.
Re:Huginn: Create agents that monitor and act on your behalf by PatrolX on Thursday December 12, 2019 @10:45PM (#21779004)
Haha, I was wondering when someone would bring up EVE.

Huginn is a fun ship to fly.

o7

Re:Huginn: Create agents that monitor and act on your behalf by codeduck on Friday December 13, 2019 @05:04AM (#21780416)
Sleipnir forever!
Re:Huginn: Create agents that monitor and act on your behalf by tectonic on Thursday December 12, 2019 @12:52PM (#21774282)
Thanks, I'm glad someone appreciated it! :)
Re:Huginn: Create agents that monitor and act on your behalf by tripzilch on Friday December 13, 2019 @07:26AM (#21780960)
... except that the first thing I thought was, did the open source panorama stitching project got ... different?

http://hugin.sourceforge.net/

I thought what a weird coincidence that they'd choose this very similar weird word ... but now that you point out it's the name of one of Odin's ravens, I guess it's not quite as uncommon of a word.

Re:Huginn: Create agents that monitor and act on your behalf by aliakhtar on Monday December 16, 2019 @10:11AM (#21803524)
I get it about naming struggles. I built something to solve this, https://naminator.io
Re:Huginn: Create agents that monitor and act on your behalf by PatrolX on Thursday December 12, 2019 @12:15PM (#21773825)
>I personally choose to run Huginn on my own hardware in large part so that I'm comfortable giving it website cookies and passwords.

This, exactly and all of the above.

It really is a fantastic project and kudos to you for starting it.

Re:Huginn: Create agents that monitor and act on your behalf by vincvinc on Thursday December 12, 2019 @02:35PM (#21775443)
Little known fact: this project is used widely by journalists who can't code (at The New York Times, among others) to do a variety of tasks, like eg. monitoring web pages like Trump's policy position, scraping press releases or filtering out very specific news alerts.

see Huginn for Newsrooms: http://albertsun.github.io/huginn-newsroom-scenarios/

It's been at least as useful as Yahoo! Pipes, and endlessly more reliable. Thanks a lot!

Re:Huginn: Create agents that monitor and act on your behalf by tectonic on Thursday December 12, 2019 @04:07PM (#21776473)
Yes! Albert's work using Huginn at the NYTimes (and contributing some changes back) was one of the big early successes for the project.
Re:Huginn: Create agents that monitor and act on your behalf by joegaebel on Thursday December 12, 2019 @06:24PM (#21777651)
Great to see you at the top of HN today tectonic! I'm at Pivotal in Sydney Australia now. Thanks again for the impromptu interview all of those years ago!
Re:Huginn: Create agents that monitor and act on your behalf by Wistar on Thursday December 12, 2019 @10:33PM (#21778959)
You, Sir, are why I read HN. It's as simple as that.
Re:Huginn: Create agents that monitor and act on your behalf by jimsug on Thursday December 12, 2019 @03:42PM (#21776211)
Firstly, thanks!

This has been immensely useful to me, and yes, my main uses have been primarily web scraping and then piping it into various channels.

Been running it on a cheapish VM for a couple years, very reliable and lets you monitor things more frequently and reliably than services like IFTTT.

Re:Huginn: Create agents that monitor and act on your behalf by tomcooks on Thursday December 12, 2019 @02:45PM (#21775561)
Nothing better than this kind of explanations to get convinced to try something, genuine passion seeps through your words.

You might just have fixed a couple of problems with your tool, thanks!

Re:Huginn: Create agents that monitor and act on your behalf by thisisbrians on Thursday December 12, 2019 @05:39PM (#21777359)
What funny timing! I'm a fellow space-nerd and just signed up for your newsletter a couple of weeks ago — it's fabulously done! Bravo.
Re:Huginn: Create agents that monitor and act on your behalf by carrozo on Thursday December 12, 2019 @01:18PM (#21774596)
Love your newsletter! Brilliant writing and I think I click on more of its links than most of the many I receive.
Re:Huginn: Create agents that monitor and act on your behalf by tectonic on Thursday December 12, 2019 @02:01PM (#21775054)
I'm glad you're enjoying it! Writing it weekly has been a great experience, and I've learned a ton about space science & industry in the process.
Re:Huginn: Create agents that monitor and act on your behalf by johnx123-up on Friday December 13, 2019 @05:39AM (#21780558)
If possible, can you please compare it against Flogo https://github.com/tibcosoftware/flogo ?
Re:Huginn: Create agents that monitor and act on your behalf by solstice on Friday December 13, 2019 @01:22AM (#21779523)
Thank you for making Orbital Index! Super interesting and well written!
Re:Huginn: Create agents that monitor and act on your behalf by babyyoda on Thursday December 12, 2019 @12:12PM (#21773778)
Awesome project! Super impressive and will check out later