News for hackers. Stuff that matters.

advocate1

Re:Loading half a billion rows into MySQL on Tuesday June 05, 2012 @10:37PM (#4072126)
mmap. +1. 10MB source tarball. -1. Looks like it's worth a test. Thanks for the reference.
Re:Loading half a billion rows into MySQL on Tuesday June 05, 2012 @09:49PM (#4071979)
This discussion reminds me of non-technical users. They will tolerate incredible sluggishness. It is amazing what Oracle and the free alternatives get away with. People, including engineers/developers, not only tolerate sluggishness but when something actually works on the first try they think it's amazing.

I've witnessed this tolerance for mediocrity for years and it still continues to blow my mind.

Re:IT Consumerization: The end of IT is nigh on Tuesday June 05, 2012 @09:36PM (#4071948)
I have wondered how people discover Dropbox. It seems to have penetration into the realm of non-techies, but I am not sure. Is this true, in your opinion?

The iPad I completely understand the appeal. It does not look like a computer. It looks like an Etch-a-Sketch. It's basically a handheld game.

I would love to read more about what your users want. It is interesting and educational.

Re:IT Consumerization: The end of IT is nigh on Tuesday June 05, 2012 @06:23PM (#4071289)
If only they knew that Dropbox is cloud storage. It's Amazon S3 via python, the rsync library and a familar icon.
Re:Loading half a billion rows into MySQL on Tuesday June 05, 2012 @06:15PM (#4071259)
It's more work for the computer to process data stored as "rows" than data stored as columns.

Think of how a disk is organized.

If you abandon MySQL and store data as columns you can load a trillion rows.

But forget I mentioned this.

Internet VC's like bubbles.

I agree this trend the investor posited to pg is a good one. It will force startups to focus on profits not hype and VC. That will make for better startups that can perhaps become longlasting companies.

Facebook is all hype. That is not the formula for a longlasting company. As long as the hype is high, they are in good shape. How long does hype last? Our society is more deficient in sustained attention than ever thanks to the internet. Facebook needs to acquire any Facebook alternatives early and often. People are more than ready for the next new thing.

There is no value in data itself. You have to do something with it to produce income. You need a plan. Facebook lacks a plan. Facebook will stand as a good historical example for those who wantonly collect personal data and dream of its value. The amount of personal data Facebook has collected is unparalled. But that does not magicaly create a business. Unless the business is cold calling or some similarly annoying tactic to generate sales.

Facebook's business is running on hype, not data. If the hype slows. It traffic dies down, it's game over.

The idea that the sucess of Facebook is just a matter of flipping the switch and asking Facebook's users to buy things is unsupported by any evidence. However we have the dot com bubble as an example that just acquiring users without a solid business plan is not enough. Grow big, fast, is not enough. Facebook dreamers still think it is.

As investors see that the general public understands that Facebook has no plan, as reflected in the media, and that only have lots of users and personal data, investors will be more cautious. Investors read newspapers. And they believe what they read.

The hype wears off. People see that these companies are smoke and mirrors. And suddenly you can't pull another Groupon so easily.

Re:Steve Jobs on the File System on Tuesday June 05, 2012 @05:34PM (#4071052)
This is the smart approach. Keep everything as "format agnostic" as possible.

The only reason someone would not use this approach and opt for one of the services mentioned is marketing. There is no marketing for storing files in a "non-proprietary" format. It's simply a matter of not knowing how to do it.

What's funny is the proprietary approaches ultimately can make things more difficult for novices. At least it's more they have to learn: different rules for each service. How often I have heard novices wanting to know how to convert/export/transfer files to/from these services.

Compare this with learning the jpeg format, IPTC and EXIF. You only need to learn one set of rules. And every service uses jpeg. That's unlikely to change anytime soon.

It's a battle against the "lowest common denominator" in the interest of creating a strategic advantage via incompatibility and proprietary formats. But it seems always some compromise is necessary. All those services work with lowest common denominator formats like jpeg. They don't each have their own proprietary image formats, though they could. Compromise is made.

The entire web is built on "lowest common denominators": e.g., IP, UDP, TCP. To allow things to flourish you have to have some lowest common denominators that everyone can develop on top of. But let the battle continue. We the users all suffer inconvenience as a result.