News for hackers. Stuff that matters.

groovyone

Ask YC: Outsourced sysadmin?

Hi thereWe're a small team and whilst we know a little about the server-side of things we're struggling a bit to look after our servers. We want to concentrate on building our apps and not managing the servers all the time so wondering if anyone has suggestions for outsourcing our server management? We've had some issues with load past few days and our own knowledge was exhausted. We...

( Read More... | 3 comments | 5 points | on HN )

Ask YC: Help with how to save data from crawler

Hi all!We are creating a web spider/crawler for experimenting with classification of sites. We are at a point where we can't make a decision and I was hoping someone out there who has done this kind of thing before might help us make a decision.Here's what we are doing as an experiment1. Taking 1-2 million domain names and crawling index page plus approx 10 internal pages based on whatever...

( Read More... | 6 comments | 5 points | on HN )
Re:Ask YC: Existing Crawlers in Python on Tuesday September 09, 2008 @11:16AM (#299465)
Thanks for these. They both look 'high end' rather than small and customizable, but I'll check them out. Thanks for the tips and links

Ask YC: Existing Crawlers in Python

Hi there. Hope you don't mind me posting. We're trying to create a system for analyzing web pages and classifying them. We have done the classification using CRM114 (thanks for this link which we were passed previously) but we're now looking to create a reliable, fast and robust crawler. We have gone through Twisted and created something basic, but the question has been raised of what is out...

( Read More... | 7 comments | 13 points | on HN )
Re:Ask HN: DIY storage or not? on Thursday August 28, 2008 @12:57PM (#289291)
I'd offer a hosted version. Most people will not want to go about setting up S3, dealing with private keys etc. Where's your market?
Re:Ask YC: What do you think of a .net domain? on Wednesday August 27, 2008 @12:53PM (#288204)
I (respectfully) don't agree with the fact that all the .com names have gone, but I do agree with creating a brand name. I've registered some great names after doing some serious searching. We created a domain name finding tool to mix and match names and one that does mix and match stuff with vowels and consonants. In addition, we've also purchased some .coms for reasonable money (hundreds of dollars, but not into the thousands) that have definitely been worth it and are memorable.
Re:"How to Get Rich": an anti-self-help book by Felix Dennis on Saturday August 23, 2008 @03:10PM (#284767)
Haha. Your true colours are showing
Re:ITunes is Anti-Web on Thursday July 10, 2008 @09:54AM (#242377)
Good points! Apple is a BUSINESS :) Hey, and guess what - it seems to be working for them
Interesting. I was thinking more of 'business' stuff, but there's always a correlation between business and topics such as rise and falls of empires. Thanks for that!
Re:Ask YC: What do you do about spam? on Wednesday May 14, 2008 @04:21AM (#189376)
Wow, this sounds awesome. I'll go check it out. Hopefully I can then re-distribute this cleaned email. Thanks for the tip though. I'll report my findings and a "How To" here if I get it to work

Ask YC: What do you do about spam?

Hi all. We're a small team (5 people) but are inundated by spam. We've all got iPhones or Blackberrys and so have been looking for online solutions which will filter the spam out before the email hits our server. We tried one company, but they're wanting to charge us over $2000/year for this as a service and I was wondering what you do about spam? Are there any low cost (but good) services...

( Read More... | 6 comments | on HN )
Re:Y Combinator Dataset Of Posts on Thursday April 24, 2008 @05:19PM (#172897)
Me too :)
Re:AWS Lowers Data Transfer Prices on Wednesday April 23, 2008 @07:04PM (#171991)
Some people just aren't satisfied :)
Re:Apple posts profit of $1.05B, ships nearly 2.3 million Macs on Wednesday April 23, 2008 @06:55PM (#171985)
Franky I can see why. I used Vista for the very first time today at a clients. All I was trying to do was set up some email accounts and I realised that Microsoft had gone crazy during the years of development. I moved from Windows to Mac (and Linux) and don't regret it one bit. Now I've seen Vista I wonder how a company of that size can get something so wrong
Re:Ask YC: How would you sell your business? on Thursday April 17, 2008 @02:04PM (#166554)
Thanks. I agree with you, though we've done 'ok' so far. Feel free to get in touch if its an area you're interested in. Email address is now in profile
Re:Ask YC: How would you sell your business? on Thursday April 17, 2008 @01:58PM (#166548)
Thanks to everyone for their input so far. I now have a few things to look at and research - the main thing is to move it forward. If I can sell it, then it will give me additional capital that will be useful, and another company who can market my existing product better than us can take it forward. Thanks once again - I really appreciate everyones comments
Re:Ask YC: How would you sell your business? on Thursday April 17, 2008 @11:48AM (#166416)
$120k is our turnover. Actual expenses are very minimal (hosting costs, $500 Adwords and a few others) as we do other things - time spent on it is around 1-2 hours a day between us. If we all pulled a wage purely from this though then it would be quite low. My main thing is its taking up brain space now and I want to be able to concentrate on my latest idea.

Ask YC: How would you sell your business?

Hi. We have an existing software business (provision of encryption software) that brings in a good level of regular revenue but the income at the moment isn't stratospheric (We're bringing in around $120k per year). In the right hands this business could increase, but my main goal is I'd like to concentrate on a new startup and don't feel I can do both. I appreciate that most people wish to...

( Read More... | 25 comments | 19 points | on HN )
Re:Psystar Mac clone story gets stranger on Wednesday April 16, 2008 @11:32AM (#165216)
Could this be someone testing the market? Set up a site, fill it with content and get the press releases out there....
Re:Ask YC: How would you do keyword classification on Sunday April 13, 2008 @05:40PM (#162620)
Hi there. I've not heard of Carrot. Do you have a link for it? My Google search brought up some orange things you grow and eat :)
Re:Ask YC: How would you do keyword classification on Sunday April 13, 2008 @10:47AM (#162424)
great! that does look interesting. I'll have a good look through it. You involved in this field yourself? If so, drop me a line as we're looking for a consultant to help us with something

Ask YC: How would you do keyword classification

I'm trying to automate the classification of documents that we are seeing from our crawler. I have done a google search for keyword classification using Python but I'm not getting any joy. Anyone here automatically tagging or classifying documents (Maybe after some teaching) ? Would be good to know how if you are

( Read More... | 20 comments | 15 points | on HN )
Thanks John. I'll do that. Your resume looks awesome mind. Not sure how much we'd be able to help you!
Hi there. I think I've decided we need to build our own, mainly as what we're wanting to do is quite specific - monitoring of sites for keywords and really we should understand,to a degree, this technology. Happy to share if you end up heading down the Python route. If there is anyone else on here who is doing crawling/data mining then maybe we could share ideas, help each other somehow :) My email is in my profile
Thanks for that suggestion. Will have a good look at it.
Thanks for this. Really appreciate the detailed response. This is basically what I was looking to do, but rather than re-invent the wheel was looking for something that already existed. Thank you for your time and thanks to everyone so far who has commented - it has really helped
I looked, but this is not distributed, so currently (whilst good) its limited to one server
Thanks. Still would like to use Python to be honest (any python suggestions?), but I'll give this a go. Going to do some more research and might post back findings if anyone would be interested in critiquing them. I'm creating this startup from scratch so if there is anyone interested in the crawler side of things I'd be happy to chat either about collaboration or sharing ideas.

Older »