http://www.bls.gov/cps/faq.htm
and, specifically,
http://www.bls.gov/cps/cps_htgm.htm
The United States federal definition of unemployment and labor force participation are
"Who is counted as unemployed?
"Persons are classified as unemployed if they do not have a job, have actively looked for work in the prior 4 weeks, and are currently available for work.
"Workers expecting to be recalled from layoff are counted as unemployed, whether or not they have engaged in a specific jobseeking activity. In all other cases, the individual must have been engaged in at least one active job search activity in the 4 weeks preceding the interview and be available for work (except for temporary illness).
"Who is not in the labor force?
"Persons not in the labor force are those who are not classified as employed or unemployed during the survey reference week.
"Labor force measures are based on the civilian noninstitutional population 16 years old and over. (Excluded are persons under 16 years of age, all persons confined to institutions such as nursing homes and prisons, and persons on active duty in the Armed Forces.) The labor force is made up of the employed and the unemployed. The remainder--those who have no job and are not looking for one--are counted as 'not in the labor force.' Many who are not in the labor force are going to school or are retired. Family responsibilities keep others out of the labor force."
http://www.bls.gov/news.release/empsit.t01.htm
there are 239,146 people aged 16 and over in the US who are civilians and not in institutions (like prisons or hospitals), of which only 139,674 are employed.
That leaves 99472 unemployed. Which is about a 42% unemployment rate.
In 2006, ~30 million people were enrolled in the final two years of HS, college, or graduate school: http://www.census.gov/prod/2008pubs/p20-559.pdf
Adjusted for demographic trends, that's probably higher now.
In 2009, about 12.9% of the population was over 65: http://quickfacts.census.gov/qfd/states/00000.html
Together that's roughly 70 million people who are mostly being counted in your "unemployed" figure that shouldn't be included.
That's not even including women who don't work. There is still a delta of ~13% b/w male and female labor force participation rates. They're 122 million women age 16 and over in the US. That's probably another ~10m who shouldn't be included in your unemployed figure.
The above estimates double-count: those enrolled in school who work, elderly who work, etc, but is much more realistic than your figure.
Another issue is that those counted as employed include a large number of underemployed, i.e people forced to work part time because they can't find more work.
For instance, you say, "women who don't work ... shouldn't be included in your unemployed figure." Why not?