News for hackers. Stuff that matters.

mwotton

Re:What was your "Oh Shit" moment with GenAI? on Monday June 08, 2026 @06:46AM (#48443657)
I had some code for the Servant type-level HTTP API library in Haskell that does type-correct property testing on arbitrary web apis without user input, then Servant changed their type structure from a basic list-based format to a record-based one. This was a good change for lots of reasons, but adding the type-level code to make my library (roboservant) compile was absurdly hard, i burned days on it.

GPT 5.something got it in two prompts.

I used sqlite as a backend for scraping 160 million websites a day. It works extraordinarily well if you hold it right - in my case, that meant devoting a database file to each thread. (Arguably in this context, it's competing with flat files, but it does a really good job there.)
Me too. Got its quirks (I wish it noticed stack-relevant changes and ran intero-restart itself) but I find it really valuable, especially with Anthony Cowley's suggestion-handling stuff.
Re:Command-line tools can be faster than your Hadoop cluster on Monday January 19, 2015 @02:34AM (#8910781)
I've implemented this. It isn't too bad up to a certain point. You have to be a bit careful about your filesystem/layout of files, lots of filesystems don't particularly like it when you have a few hundred million files in one directory.
Re:How I Start: Haskell on Monday November 17, 2014 @08:59PM (#8622001)
I have a crawler downloading 160 million websites a day, almost all in Haskell. It is a much more practical language than the alternatives.
yeah - worked on it a bit with Ollie Charles.

https://github.com/ocharles/Elasticsearch

it's not very principled, tbh. uses error etc rather than proper sum types for returning errors.

Re:Bloodhound – Elasticsearch client and DSL for Haskell on Saturday May 03, 2014 @08:57PM (#7692914)
as a contributor to the other ElasticSearch client - kudos. This is much nicer than ours in many ways :)
yes, I probably should have mentioned the other 90% of the project, hey :)
This is true :) been a great tool to write a spider in, fast native code, a strict type system and very cheap threads has made it much faster than it otherwise would have been. ZeroMQ has also been a great help in modularising it. I'll try to get a piece out on the technical architecture later. (I'm the CTO, btw.)
Re:Why the world needs Haskell on Tuesday July 09, 2013 @10:56PM (#6017179)
What benefit does that have over what's actually there?
Re:Why Concatenative Programming Matters (2012) on Saturday April 13, 2013 @05:29PM (#5544747)
Row polymorphism has something to say about this, doesn't it? Coming from Haskell, I'm still finding concatenative programming hard to handle.
Re:When Haskell Is Not faster than C on Tuesday January 22, 2013 @04:24PM (#5099682)
well, let's look.

map f (h:t) = f h:map f t

map f [] = []

member x (h:t) = x == h || member x t

member _ [] = False

I think the only difference is that you can't match for equality directly in the pattern.

Re:Haskell in Production: The good, the bad, and the ugly on Wednesday October 31, 2012 @10:04PM (#4725831)
My startup involved custom hardware and realtime messaging. I still would have been better off in the early stages writing it in Ruby.
Re:Haskell in Production: The good, the bad, and the ugly on Wednesday October 31, 2012 @07:25PM (#4725386)
ha. I didn't think that at all when I was writing it, but I can see how it's applicable. I'll be sure to analyse that more explicitly next time I write a presentation.
Re:Haskell in Production: The good, the bad, and the ugly on Wednesday October 31, 2012 @07:24PM (#4725384)
not caremad, just clarifying. I'm as baffled as you are.
Re:Haskell in Production: The good, the bad, and the ugly on Wednesday October 31, 2012 @07:19PM (#4725369)
It really depends on the type of risk. My assertion is that most startups have most of their risk in the market bucket rather than the technical bucket. If you can move some risk from the market bucket to the technical bucket, and compensate by using Haskell, that may be a good tradeoff.

in the case where your risk is in the market bucket, you may go through many just-barely-working prototypes before you hit product-market fit. at that point, if you've saved some time using Ruby (say) because of external factors like Heroku, Bundler, and ruby-friendly services, you're ahead of the game, even if your tenth prototype sucks and needs to be rewritten.

Re:Haskell in Production: The good, the bad, and the ugly on Wednesday October 31, 2012 @07:35AM (#4722298)
A lot of context is lost in a slideshow. I am very much a fan of the experience of developing in Haskell. My problem was tangential stuff like Cabal & the difficulty of operationalising Haskell. It's the reason I spent a few fruitless weekends trying to get a heroku haskell buildpack: if it was trivial to deploy prototypes, it would be a much more appealing target for time-poor startups.
Re:Haskell in Production: The good, the bad, and the ugly on Wednesday October 31, 2012 @07:24AM (#4722277)
It wasn't really intended to make much sense by itself. I find if I make slides that stand alone, the audience reads the slides and ignores me. I put the slides up as a courtesy to the people in the audience.

There was less than zero marketing involved - I gave this talk months ago and only just noticed this thread.

Re:Haskell in Production: The good, the bad, and the ugly on Wednesday October 31, 2012 @07:21AM (#4722267)
Copy-on-write.
http://jacquesmattheij.com/The+Starter+the+Architect+the+Deb... seems relevant here. I often have the same problem - once the crazy technical stuff is done, I lose interest in the mundane details of packaging, finish, promotion... you know, the boring 90%.
Re:Ask HN: Billing for atomized pricing? on Sunday February 19, 2012 @06:05AM (#3609125)
good idea - i might even manage a complete and coherent sentence.
Re:Ask HN: Billing for atomized pricing? on Saturday February 18, 2012 @11:21PM (#3608638)
I'm interested in this for ninjablocks, too - I think we're currently bundling a small number of resources (SMSes etc) with each account, but then perhaps more fine-grained tracking.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @06:30AM (#3517927)
Privacy is a legitimate concern, but there are useful things you can do that you might feel comfortable sharing with our servers. Zero-information computing is really hard, and we didn't feel it was worth the time it'd take to give that kind of strong guarantee.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @04:42AM (#3517729)
It's coming.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @04:10AM (#3517660)
no, it's a beaglebone and an arduino. we looked at the raspberry pi, but availability wasn't great.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @04:06AM (#3517648)
yes, we're mainly focused on plugged-in hardware. there'll probably be a battery pack made at some point, but it's not our first priority.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @02:27AM (#3517453)
Yep. But we're aiming this at beneath "Hello World" level electronics knowledge, and at people who _could_ do the work but appreciate being able to work with it at a more abstract level.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @02:06AM (#3517419)
yes, we're investigating this. arduinos are a bit tricky because the hardware either needs a general-purpose interpreter which can load new code at runtime, or needs to be able to reprogram itself wholesale over the net. It's doable, I think, but it's a lot harder than uploading some new code to a full linux machine.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @02:01AM (#3517406)
yes, exactly. there are a heap of markets that are expensive to target because they're so small - we're in talks with research labs to do experiment automation,for instance, and their equipment is usually priced in the hundreds of thousands. We're aiming at being the glue: geeks have always hacked their own stuff, this just makes it possible for everyone else to do the same.
Re:Ninja Blocks: Connect your world with the web on Friday January 27, 2012 @01:57AM (#3517395)
Hi - I'm one of the hackers behind Ninja Blocks. We're not actually getting funding from Kickstarter - we're just pre-selling the product.

Older »