News for hackers. Stuff that matters.
Re:The quick website launch checklist by ceejayoz on Sunday August 14, 2011 @11:34AM (#2883824)
> If you have a ton of user uploaded media (and such), you probably want to not want SE to index everything. (For example to save bandwidth).

Bandwidth is cheap. Ranking poorly in search engines is not.

If you've got a ton of user uploaded media, you've potentially got a ton of content for Google to pick up on and rank you for.

Re:The quick website launch checklist by cma on Sunday August 14, 2011 @12:24PM (#2883888)
If you aren't able to control user spam effectively, Google will think you are the spammer. (maybe another item should be: use nofollow on user links)
Re:The quick website launch checklist by jimmyjim on Sunday August 14, 2011 @03:17PM (#2884238)
For something like an image hosting or pastebin site, isn't that possible a privacy concern?

I'm curious, what is the standard practice for the storage of static media - where are the static files (text/images) stored on the server, and how are the appropriate config files that concern that media set up?

Re:The quick website launch checklist by mtogo on Sunday August 14, 2011 @04:03PM (#2884317)
If you don't want the world to see your files, actually stop them from being accessed instead of politely asking robots to not index them.