News for hackers. Stuff that matters.
Re:Make HTTP requests from your browser by johns on Sunday January 08, 2012 @02:48PM (#3440327)
Hurl.it was originally created by Chris Wanstranth and Leah Culver at the 2009 Rails Rumble. We (Twilio) just took over maintenance of the project because it has some obvious utility when testing URL callbacks and webhooks. We want to make some improvements to it, so if you have any ideas or suggestions, I'd love to hear them. You can post them here or create an issue on the current home of the project on Github: https://github.com/twilio/hurl

And you can follow @hurlit for updates

Re:Make HTTP requests from your browser by aurelianito on Sunday January 08, 2012 @06:29PM (#3440876)
It would be great if instead of a website you port it to a browser plug-in. It would achieve several things:

* Better security for the user (the paranoid in me do not want to send my credentials through a third party site).

* It could use the credentials stored in the browser (cookies, basic-auth, etc).

* The IP of the requester would not be hidden, allowing IP filtering for development servers.

* It could run on a PC that is not connected to internet.

Re:Make HTTP requests from your browser by bgruber on Sunday January 08, 2012 @06:53PM (#3440926)
For chrome, I like using the "REST Console" extension (https://chrome.google.com/webstore/detail/cokgbflfommojglbmb...), which I believe has all of the benefits you listed. The "credentials stored in a browser" thing is the main reason for me to be using it.
Re:Make HTTP requests from your browser by mcherm on Monday January 09, 2012 @09:04AM (#3442500)
Re:Make HTTP requests from your browser by meow on Sunday January 08, 2012 @04:23PM (#3440554)
It will be gr8 if you can add OAuth signing support to hurl. Testing urls that need to be signed with OAuth is a major pain point.
Re:Make HTTP requests from your browser by thezilch on Sunday January 08, 2012 @08:29PM (#3441144)
You have may find MySpace's tool [0] or Google's OAuth Playground [0] or OAuth 2.0 Playground [1] helpful.

[0] http://wiki.developer.myspace.com/index.php?title=OAuth_Test... [1] http://googlecodesamples.com/oauth_playground/ [2] https://code.google.com/oauthplayground/

Re:Make HTTP requests from your browser by mountaineer on Sunday January 08, 2012 @04:13PM (#3440538)
It is a great utility, thanks for taking it over and giving it more stability.
Re:Make HTTP requests from your browser by huhtenberg on Sunday January 08, 2012 @02:17PM (#3440235)
> Make HTTP requests from your browser

Ironically, this is exactly what the browser is for.

Re:Make HTTP requests from your browser by tomblomfield on Sunday January 08, 2012 @02:37PM (#3440299)
Yes, but "Make HTTP requests with custom action, headers & body from your browser" isn't as snappy.
Re:Make HTTP requests from your browser by dools on Sunday January 08, 2012 @05:51PM (#3440781)
If you just put the word "custom" in there I reckon it would make a big difference ;)
Re:Make HTTP requests from your browser by lucisferre on Sunday January 08, 2012 @02:36PM (#3440291)
Yeah I had to read the title twice, just to make sure I read it correctly.
Re:Make HTTP requests from your browser by zalew on Sunday January 08, 2012 @06:59PM (#3440940)
exactly. I thought: uhm, isn't it what I'm doing right now?
Re:Make HTTP requests from your browser by stanleydrew on Sunday January 08, 2012 @02:37PM (#3440298)
Unless you want to make put or delete requests.
Re:Make HTTP requests from your browser by WA on Sunday January 08, 2012 @02:28PM (#3440264)
Hurl http://victim.org/index.php?a=;DROP DATABASE users --

What I want to say is that services like this have a security flaw by design which allows random people to execute strange statements in the name of Hurl.

There are certainly other ways to execute malicious HTTP requests (for example, let the Google Bot do it), but still, it should be pointed out.

Re:Make HTTP requests from your browser by tomblomfield on Sunday January 08, 2012 @02:50PM (#3440337)
By "services like this", I hope you mean websites that are vulnerable to SQL injection, and not Hurl itself?

Hoping that an attacker can't use curl probably isn't a good security solution...

Re:Make HTTP requests from your browser by WA on Sunday January 08, 2012 @03:05PM (#3440369)
Yes, not Hurl itself. But Hurl can be used to execute malicious statements.

It is a difference, whether an attacker uses his own IP address (or a setup with various VPNs and proxies) or uses Hurl for it so that the target website sees only Hurl's IP in its logs.

In times of free WiFi, the traceability of malicious requests is definitely reduced anyway, but Hurl could potentially add another layer that can be used by an attacker to obscure his/her origin. I'm not saying that this is a major security issue, it is just a flaw by design, which I wanted to point out.

Re:Make HTTP requests from your browser by ay on Sunday January 08, 2012 @05:32PM (#3440739)
Do you happen to know how translate.google.com deals with this problem ?
Re:Make HTTP requests from your browser by tlrobinson on Sunday January 08, 2012 @06:39PM (#3440893)
Meh, if abuse is really a problem Hurl could log requests and cooperate with law enforcement to trace it right back to you.

If an attacker is relying on using Hurl as their only source of anonymity they're not very competent.

Re:Make HTTP requests from your browser by evmar on Sunday January 08, 2012 @03:36PM (#3440441)
You can make a browser GET or POST to any arbitrary URL already via JavaScript.
Re:Make HTTP requests from your browser by moocow01 on Monday January 09, 2012 @02:01AM (#3441704)
Yeah they are potentially liable to the same sort of issues that proxies are which can make for a legally vulnerable service - unfortunate but true
Re:Make HTTP requests from your browser by ma2rten on Monday January 09, 2012 @05:47AM (#3442060)
There is a http header, which you can set as proxy which reveals the ip of the original requester. Maybe that would be a good first step.
Re:Make HTTP requests from your browser by gcb on Sunday January 08, 2012 @03:52PM (#3440488)
On mobile so i can't check myself: does The BROWSER makes the request by some clever way? Or simple server side script does it?
Re:Make HTTP requests from your browser by dmn001 on Sunday January 08, 2012 @06:35PM (#3440885)
Re:Make HTTP requests from your browser by lancefisher on Sunday January 08, 2012 @05:13PM (#3440672)
It's a ruby app, and uses curl on the server to make the request: https://github.com/defunkt/hurl/blob/master/app/app.rb
Re:Make HTTP requests from your browser by slig on Sunday January 08, 2012 @01:33PM (#3440146)
If you're on OSX, take a look on http://ditchnet.org/httpclient/
Re:Make HTTP requests from your browser by taf2 on Sunday January 08, 2012 @11:37AM (#3439861)
Very useful - to send a curl to someone - to explain why a response is incorrect or provide context about a service response... Sure you could use curl + gist - but there is something I nicer here - for example on my iPhone I could use hurl.it to explain a bad response via email without having to drop into a shell... Great service thanks!
Re:Make HTTP requests from your browser by secure on Sunday January 08, 2012 @11:40AM (#3439873)
So my browser will send an HTTP request to this website which in turn sends an HTTP request? We need to go deeper…
Re:Make HTTP requests from your browser by stanleydrew on Sunday January 08, 2012 @12:25PM (#3439986)
Source is here:

https://github.com/defunkt/hurl

It's a pretty thin proxy.

Re:Make HTTP requests from your browser by tlrobinson on Sunday January 08, 2012 @06:49PM (#3440915)
Sadly Hurl won't make requests to itself.
Re:Make HTTP requests from your browser by wavephorm on Sunday January 08, 2012 @12:03PM (#3439923)
What I want is a website that can now render that http response into a fully formed webpage and display that in my browser.
Re:Make HTTP requests from your browser by jgeralnik on Sunday January 08, 2012 @12:15PM (#3439955)
And use that newly generated website to make another http request!
Re:Make HTTP requests from your browser by bryanh on Sunday January 08, 2012 @12:10PM (#3439943)
I would pay for a better hurl.it (common templates, saved responses, etc, etc...).

It's been an absolutely indispensable tools for debugging (crazy) API's while developing https://zapier.com.

Re:Make HTTP requests from your browser by johns on Sunday January 08, 2012 @02:39PM (#3440308)
No need to pay, we (Twilio) are now actively maintaining it and going to be adding some new features. Common templates exists (not documented) yet. You can put values in URL parameters and the fields will autopopulate effectively giving you URL-based templates. Responses are already saved, click the permalink to get back to them later.

If you have any other feedback items, feel free to post them here or on https://github.com/twilio/hurl and we'll take a look at them. Pull requests are even better.

Re:Make HTTP requests from your browser by bryanh on Sunday January 08, 2012 @10:45PM (#3441381)
Had no clue this was open source. Wonderful.
Re:Make HTTP requests from your browser by sirn on Sunday January 08, 2012 @12:27PM (#3439988)
Have you considered using something like Charles Proxy[1] instead?

[1]: http://www.charlesproxy.com/

Re:Make HTTP requests from your browser by aw3c2 on Sunday January 08, 2012 @01:03PM (#3440089)
There is some FOSS alternative if I recall correctly but I forgot the name. I think it was written in Java.
Re:Make HTTP requests from your browser by 18pfsmt on Sunday January 08, 2012 @01:20PM (#3440126)
The Cocoa-specific app looks interesting, but I think the Java-based alternative you were referencing was Paros[1]?

[1]http://www.parosproxy.org/download.shtml

Re:Make HTTP requests from your browser by webandy on Sunday January 08, 2012 @01:13PM (#3440110)
Re:Make HTTP requests from your browser by jtchang on Sunday January 08, 2012 @02:17PM (#3440239)
Paros?
Re:Make HTTP requests from your browser by bryanh on Sunday January 08, 2012 @12:32PM (#3439998)
I have not. Brilliant link. Thank you!
Re:Make HTTP requests from your browser by suresk on Sunday January 08, 2012 @02:44PM (#3440316)
If you're on OS X, I sell one for $2 on the Mac App Store - http://www.uresk.net/httpclient/. I'm working on a major update, and I'd be interested in hearing some more details about the features that would make a tool like this useful to you.

If you (or anyone else on HN) want to check it out but don't want to shell out a few bucks for it, send me an email (<my username>@gmail.com) and I'll get you a coupon code for a free copy.

Re:Make HTTP requests from your browser by rhplus on Sunday January 08, 2012 @02:56PM (#3440348)
Fiddler is a very useful HTTP proxy debugger for Windows.

http://www.fiddler2.com/fiddler2/

Re:Make HTTP requests from your browser by aj on Sunday January 08, 2012 @10:22PM (#3441341)
Have you tried Firefox's Poster Addon? It's absolutely brilliant for simulating HTTP requests
Re:Make HTTP requests from your browser by sc00ter on Sunday January 08, 2012 @03:12PM (#3440383)
For specific APIs, apigee have a great tool: http://apigee.com/about/products/free

A hurl.it along those lines would be very useful.

Re:Make HTTP requests from your browser by FuzzyDunlop on Sunday January 08, 2012 @01:54PM (#3440188)
See also: XHR Poster (Chrome extension) [1]

I couldn't live without it.

[1] http://goo.gl/UFSdZ

Re:Make HTTP requests from your browser by Terretta on Sunday January 08, 2012 @04:42PM (#3440598)
Older and better (a point of opinion):

http://www.rexswain.com/httpview.html

Since October 1999, actually.

Re:Make HTTP requests from your browser by nuttendorfer on Sunday January 08, 2012 @01:06PM (#3440097)
This is useful if you are on systems where curl is not easily available. Helped a few times!
Re:Make HTTP requests from your browser by raesene2 on Sunday January 08, 2012 @12:27PM (#3439989)
Interesting idea, could be very useful. One thing with this kind of service is always how they handle validation of data from the 3rd party service (eg, in headers). So as an example http://hurl.it/hurls/db870b49c7203ec9acb47ba7769c126146b1768... executes javascript in the context of their site... (just a pop-up box with hi, but could be any script..)
Re:Make HTTP requests from your browser by johns on Sunday January 08, 2012 @02:45PM (#3440318)
A pull request or issue created on https://github.com/twilio/hurl would be fantastic :)
Re:Make HTTP requests from your browser by nbpoole on Sunday January 08, 2012 @05:54PM (#3440790)
Re:Make HTTP requests from your browser by obeattie on Monday January 09, 2012 @05:31AM (#3442030)
I've used this extensively before; brilliant little service, but I've recently started using the "REST Console" Chrome extension, which is bloody brilliant:

https://chrome.google.com/webstore/detail/cokgbflfommojglbmb...

Re:Make HTTP requests from your browser by maybemaybenot on Sunday January 08, 2012 @02:30PM (#3440269)
That's kind of handy for looking to see where irritating shortened links are redirecting - e.g. t.co or bit.ly
Re:Make HTTP requests from your browser by kami8845 on Monday January 09, 2012 @05:13AM (#3441994)
http://tools.pingdom.com/fpt/ gives you an image too :)
Re:Make HTTP requests from your browser by drp on Sunday January 08, 2012 @06:42PM (#3440900)
Something fun to point it at: http://httpong.com

Particularly http://httpong.com/response but the other parts can show you what hurl.it is sending.

Re:Make HTTP requests from your browser by johtso on Sunday January 08, 2012 @07:44PM (#3441056)
Re:Make HTTP requests from your browser by godDLL on Sunday January 08, 2012 @01:03PM (#3440086)
Do you have some limits in place, or can I just expect it to proxy all of my web traffic when I want it to (which I can do with one JS statement right on this page)? Magic WebKit Inspector is going to ruin your hosting bill.
Re:Make HTTP requests from your browser by mtrimpe on Sunday January 08, 2012 @12:59PM (#3440073)
Minor bug-report: when you keep clicking on the 'Send' button continuously it will occasionally show the JSON response in-browser instead of updating the UI.

And no, I'm not crazy. I was trying to test GitHub's rate-limiting. ;)

Re:Make HTTP requests from your browser by johns on Sunday January 08, 2012 @02:40PM (#3440309)
Thanks for the report, can you put this into the issues list on https://github.com/twilio/hurl?
Re:Make HTTP requests from your browser by ssfak on Monday January 09, 2012 @04:35AM (#3441927)
Somewhat similar but more useful for debugging "HTTP caching" by Mark Nottingham: redbot (http://redbot.org/)
Re:Make HTTP requests from your browser by Hunterhdolan on Sunday January 08, 2012 @02:34PM (#3440284)
Yeah... thats the funny thing about web browsers... the tend to do that
Re:Make HTTP requests from your browser by tomblomfield on Sunday January 08, 2012 @02:38PM (#3440305)
Useful service, but this has been around for many months now..
Re:Make HTTP requests from your browser by strags on Sunday January 08, 2012 @01:33PM (#3440147)
Homer: They have HTTP in browsers now?
Re:Make HTTP requests from your browser by pors on Sunday January 08, 2012 @11:07AM (#3439784)
Sooo, web based curl? Amazing! #not
Re:Make HTTP requests from your browser by ceejayoz on Sunday January 08, 2012 @12:29PM (#3439993)
I take it you've never had "What's curl?" as a response when trying to show someone an API is working fine?
Re:Make HTTP requests from your browser by pors on Sunday January 08, 2012 @12:33PM (#3440000)
Well, maybe you're right. I assumed that people programming against REST API's know basic tools like curl, but apparently I got that wrong.
Re:Make HTTP requests from your browser by ceejayoz on Sunday January 08, 2012 @12:41PM (#3440022)
Yep. I've encountered plenty of cargo-cult programmers who know how to copy-paste code examples but who are SOL when it comes to troubleshooting.