News for hackers. Stuff that matters.
Re:More Americans Are Falling Behind on Student Loans, and N... by StanislavPetrov on Thursday September 28, 2017 @06:54PM (#15361463)
>But I keep hearing employment is great, productivity is great, stock market is great

The question you have to ask is, who are you hearing this from? The answer is: people with a vested interest in making you believe the economy is doing great, or people fooled into believing this by those with a vested interest.

I suggest you closely examine the metrics used by those who claim the "economy is great". First these metrics are usually comparing year-over-year changes to point to "positive changes" in the economy. What they fail to announce is that the formulas they use to calculate these metrics are "adjusted" regularly to ensure that the numbers they seek are reflected. CPI is a perfect example. The FED claims that inflation has been very low, if not non-existent for years (good for workers, since their wages have fallen or remained stagnant for decades). Some have noted, however, that prices for most of the things people need to survive (food, rent, education, healthcare, insurance) continue to rise dramatically. How can this be? Well one way the FED lies with their numbers is through a mechanism called the "hedonic adjustment". If you paid $2 for a roll 60-sheet roll of toilet paper last year. This year you paid $3 for a 60-sheet roll this year, that's some serious inflation, right? Not according to the FED. The FED claims that the quality of the toilet paper is better now. Even though you are paying 50% more, the FED says the toilet paper is 50% better, so there is no inflation. How are these "hedonic adjustments" calculated? Arbitrarily by FED functionaries, in a black-box.

Rising debt, falling and stagnant wages, higher prices, consolidation of wealth - these are the real conditions we face and why our economy is lagging. Many will look at you as if you are wearing a tinfoil hat if you question the "official numbers", but even casual scrutiny of the methods and metrics used (the ones they do release) will raise substantial doubts about their worth.

Re:More Americans Are Falling Behind on Student Loans, and N... by trts on Thursday September 28, 2017 @10:39PM (#15362365)
"Hedonic adjustment" is meant to control for the 'quality' of some (limited) products sampled in the CPI such as rent, computers and automobiles. 'quality-adjusted' means that they run a standard linear regression across the features of sampled items to normalize the variation in the sample. For example, the sampled rent of apartments would be modeled as (in the simplest example I can think of) :

y = rent, b = slope, x = sqft

y ~ b + x is the extent of the 'hedonic adjustment'

There don't really exist any control variables for 'better'. Nobody at CPI is subjectively saying toiler paper is better. What they will stochastically estimate is the per-unit price. So if for $10 you get 9 double roles, and last year you got 9 single roles for $10, then the price went down. But I assure you as someone who has looked at row-level data of what the CPI samples and does, there are no cases that are this extreme in the aggregate. They could drop the hedonic adjustments and it would make no practical difference. Private companies use similar sampling methods with better data and don't show wildly different headline inflation (see: Billion Prices Project http://www.thebillionpricesproject.com/)

There is no doubt however that the CPI data is inadequate, has a non-trivial lag, and does not capture true regional differences in prices. Just try using it to adjust your salary if you move from Birmingham to New York City and see how comfortable you'd be. But there is no conspiracy; that would presume far more competency than they have hired for.

Re:More Americans Are Falling Behind on Student Loans, and N... by LolWolf on Thursday September 28, 2017 @10:48PM (#15362397)
> But there is no conspiracy; that would presume far more competency than they have hired for.

This seems to be the case almost universally, but I guess it's easier to jump to the 'malice' conclusion than to attribute it to lack of competency.

Perhaps more succinctly: if you think the world is out to get you, then it is.

Re:More Americans Are Falling Behind on Student Loans, and N... by thephyber on Friday September 29, 2017 @12:44AM (#15362755)
> But there is no conspiracy

People want structure and simplicity in the world. They want to believe someone is in control, even if that someone is harming them.

Re:More Americans Are Falling Behind on Student Loans, and N... by intended on Friday September 29, 2017 @05:45AM (#15363948)
People assume structure and simplicity.

Therefore if something is wrong, someone is responsible.

Re:More Americans Are Falling Behind on Student Loans, and N... by StanislavPetrov on Thursday September 28, 2017 @10:49PM (#15362403)
I'm not claiming a conspiracy, its more a confederacy of dunces staffed by people who have a vested interest in reaching conclusions that affirm the wishes of their bosses. Any such system that includes a bunch of very complex algorithms filled with uncertain data and arbitrary variables that can be tweaked by the people crunching the numbers you are going to come out with a garbage result. The FED is literally engaged in voodoo economics. Scarily they even acknowledge this simple fact, but still people take their tea-leaf readings seriously.

https://www.federalreserve.gov/econresdata/feds/2015/files/2...

“It is difficult to get a man to understand something, when his salary depends on his not understanding it.” - Upton Sinclair

Re:More Americans Are Falling Behind on Student Loans, and N... by jjoonathan on Thursday September 28, 2017 @11:17PM (#15362502)
Difficult or not, you don't seem to be trying very hard. You didn't address the concrete argument you were presented with.
Re:More Americans Are Falling Behind on Student Loans, and N... by lern_too_spel on Friday September 29, 2017 @04:41AM (#15363699)
The result doesn't appear to be garbage. The BLS's CPI data is very close to MIT's BPP.
Re:More Americans Are Falling Behind on Student Loans, and N... by chiefalchemist on Thursday September 28, 2017 @11:06PM (#15362463)
Agreed. They all have the same incentive. There's no need to full conspire. The insentive is strong enough for most of those involved to act in a conspire-esque sort of way. Emergence, if you will.
Re:More Americans Are Falling Behind on Student Loans, and N... by traviscj on Friday September 29, 2017 @09:09AM (#15364876)
Your equation does not make sense to me. Is b really a slope (* instead of +?) or an intercept (seems simpler to have a "k*x" term than pretending that "k=1")?
Re:More Americans Are Falling Behind on Student Loans, and N... by ameister14 on Friday September 29, 2017 @01:57PM (#15367528)
Hanlon's Razor seems to be applicable here.
Re:More Americans Are Falling Behind on Student Loans, and N... by linkregister on Thursday September 28, 2017 @08:20PM (#15361853)
That is an interesting anecdote, delivered with lots of confidence. However, despite the just-so manner you delivered it, I don't see a compelling argument. For starters, the CPI isn't calculated in an opaque manner; it's explained here: https://www.bls.gov/news.release/pdf/cpi.pdf.

The costs that are increasing for most Americans are housing, healthcare, and education costs. Yet over 40% of American households own their primary residence. Then you can factor in the lack of rent growth away from urban centers, and you see that this metric isn't as pronounced when it comes to the median American. The costs of many goods are falling. Commodity prices are low despite the fact there is a healthy demand for them. It's strange that you're calling out toilet paper. Its price has fallen [1].

The directors of the Federal Reserve, if they had some secret interest in tricking everyone, wouldn't be flatly admitting they consider why inflation isn't hitting targets a "mystery." [2]

The unemployment numbers being released should be viewed with skepticism, and there are plenty of good articles explaining why the main unemployment rate should be viewed in context with the other unemployment metrics, such as U6. (The idea is that there are many people who want to work who aren't counted in the main unemployment statistic.)

Furthermore, certain localities are experiencing extremely high price increases in housing, such as the Bay Area. Anyone in such a locality is going to feel the squeeze. The problem is that these statistics represent the nation, not individual localities.

1. https://www.bls.gov/news.release/pdf/cpi.pdf, page 12; table 2: Household paper products.

2. https://www.bloomberg.com/view/articles/2017-09-26/yellen-kn...

Re:More Americans Are Falling Behind on Student Loans, and N... by StanislavPetrov on Thursday September 28, 2017 @10:29PM (#15362338)
Did you even read CPI information from the link you posted? Literally every page is riddled with opaque reference to arbitrarily defined values and modifiers inserted by the FED.

>In calculating the index, price changes for the various items in each location are aggregated using weights, which represent their importance in the spending of the appropriate population group.

What do you think "aggregated using weights" means? How does the FED determine what those weights are? Who decides how how much these "weights" should factor in deciding the proper "spending of the appropriate population group"? Where's a description of their formula? There is none - its made up.

> The CP I-U and CP I-W are considered final when released, but the C-CP I-U is issued in preliminary form and subject to three subsequent quarterly revisions.

In other words, they revise their ridiculous assertions months after the headlines to look less ridiculous in retrospect.

>Seasonally adjusted data are computed using seasonal factors derived by the X-13ARIMA-SEATS seasonal adjustment method. These factors are updated each February, and the new factors are used to revise the previous 5 years of seasonally adjusted data.

More arbitrary "seasonal adjustments". How would the IRS feel if you reported your taxes but you said that you reserved the right to adjust them up to 5 years later?

>Seasonally adjusted data, including the U.S. city average all items index levels, are subject to revision for up to 5 years after their original release.

Which they change up to 5 years later!

That's just from one page of their nonsense! Read the footnotes beneath each chart of "data" to see a slew of arbitrary adjustments that are made for every "calculation".

How many invented variables do you think it takes to invalidate their formulas? 1? 2? or the dozens they have?

Re:More Americans Are Falling Behind on Student Loans, and N... by YZF on Thursday September 28, 2017 @10:44PM (#15362385)
So what about this data: http://www.thebillionpricesproject.com/datasets/

I think to support the argument that CPI is cooked you need to show that you have some reasonable sampling of prices of some reasonable basket across the entire country. You can search online for rent prices, you can see real estate prices, you can see product/produce prices... You can find out what % of the population rents vs. owns and factor that in. Let's see that data that shows us that CPI is really wrong and not some anecdotes. I think there's enough data in the public domain to be able to form a pretty good estimate. Also we need to see that over a long period since some prices go through big cycles, real-estate can crash 40% and then go up, so we may want to reduce the impact of that...

Re:More Americans Are Falling Behind on Student Loans, and N... by StanislavPetrov on Thursday September 28, 2017 @10:57PM (#15362429)
A variety of organizations have already done this. One of the better known is Shadowstats.

http://www.shadowstats.com/

Re:More Americans Are Falling Behind on Student Loans, and N... by TheCowboy on Thursday September 28, 2017 @11:36PM (#15362568)
Here's a sample of Shadowstats: http://www.shadowstats.com/imgs/sgs-gdp.gif?hl=ad&t=

Shadowstats claims that real GDP growth has been negative for every year since 2000 with the exception of 2004. Nearly 2 decades of GDP contraction. Seriously?

It's better known as being completely unreliable. It's the post-truth version of econ stats. It builds its own reality, selectively choosing and omitting facts.

There are a lot of detailed and nuanced articles/posts on the Internet that debunk this site and point out serious flaws. I can't compete with the quality out there, but you must read more before feeling so confident in this site.

Re:More Americans Are Falling Behind on Student Loans, and N... by moe3 on Thursday September 28, 2017 @10:54PM (#15362421)
A mother who has cancer tells the kids what they need to hear. You tell the kids too much, and they grow up thinking there is no point to life. Which is not right or good for them. If you were in her position or the FED's you would do the same.
Re:More Americans Are Falling Behind on Student Loans, and N... by linkregister on Friday September 29, 2017 @12:53AM (#15362778)
This is a bizarre conclusion you invented whole-cloth from your tortured parable. It's not even how cancer is disclosed to children! A simple scroll through social media will show images of children "beating cancer" or missing a relative who died of cancer.

The idea that the Federal Reserve lies to the populace to keep them productive is absurd. Every recession has been addressed (eventually) by the Federal Reserve. There have been catastrophic blunders, such as the tightening of credit after the sustained bank failures in 1929-1933, and the vastly too-late raising of interest rates at the height of the housing bubble in 2007.

However, the directors were rightly castigated for their failures; Alan Greenspan is still mocked for failing to address reality. The Fed is blamed as a major cause of the severity of the Great Depression. Yellen et. al. have been criticized for their caution (financial news calls it "dovish" behavior). The Federal Reserve have every motivation to tell it like it is, lest they end up like Alan Greenspan.

Re:More Americans Are Falling Behind on Student Loans, and N... by candiodari on Thursday September 28, 2017 @10:11PM (#15362262)
> The directors of the Federal Reserve, if they had some secret interest in tricking everyone, wouldn't be flatly admitting they consider why inflation isn't hitting targets a "mystery." [2]

So you're saying these people with all the humility required to announce they have solved economic crises for at least a lifetime [1] wouldn't lie or deceive themselves ?

I wouldn't make that point. Seems unlikely that hubris like that would be limited in any way.

Central banks have a long history of ... well, either outright lying or incredible self-deception, including the federal reserve under this chair. [2] No sane person at this point believes the FED's economic predictions.

To make the difference I would put forth this point: finding analyses that defend the point that the US government (and indeed almost all governments with pension obligations) would be bankrupt in 2 year with a 4% funds rate and 6% inflation is easy. In other words, the FEDs predictions, if implemented, would blow up governments, make them bankrupt. Not just the US government (in fact the US government can probably last longer than the EU or Eastern European governments). I agree with that assessment. Maybe they can make it 3-4 years, but certainly no more.

So in order to believe the FED's predictions and stated reasoning are honest (same with ECB) you have to believe that somehow it escaped the attention of these finance industry 4, 5 and 6 decade veterans that this would cause a financial disaster worldwide. I find it hard to believe that these people are this stupid. I also do not believe the FED would destroy the government it's part of.

So I present to you: they are lying. They are lying about their reasoning, they are lying about their models, they are lying about their predictions. I understand why they're lying, but they're still lying.

They are lying about the CPI too. European inflation measures are similar, as they directly influence pension increases, and "surprisingly" they're very low.

[1] https://www.reuters.com/article/us-usa-fed-yellen/feds-yelle...

[2] https://mises.org/sites/default/files/styles/full_width/publ...

http://www.investmentoffice.com/show_image.php?file_id=2151

http://ei.marketwatch.com//Multimedia/2016/09/28/Photos/NS/M...

Re:More Americans Are Falling Behind on Student Loans, and N... by linkregister on Friday September 29, 2017 @01:04AM (#15362818)
Your argument about the so-called certainty of the Fed Chair and the other directors is disingenuous and not supported by the links you provided.

Link #1: She talks back this assertion in the very next sentence! She says she is probably exaggerating, but she has good reason to think there won't be another major crash of that magnitude, provided there are [list of conditions]. Furthermore, she at no point takes credit for this achievement during the interview.

Link #2: Yellen gets asked why she doesn't raise rates all the time. Far from unwarranted certainty, she admits that she expected the economy to to better, doesn't know why it hasn't, and has therefore revised predictions of when the rates will be raised! Any consumer of financial news over the past 4 years should be familiar with this. The fact you omit this is highly disingenuous.

The very last link summarizes my position pretty well. The experts, who admit that things can be a "mystery," change their minds and models based off of reality. Is that not humble enough for you?

I am curious why you continue to vigorously assert a view that you have failed to demonstrate. What is your personal connection to this, and why do you pursue it?

Re:More Americans Are Falling Behind on Student Loans, and N... by candiodari on Sunday October 01, 2017 @01:16AM (#15376514)
> Link #2: Yellen gets asked why she doesn't raise rates all the time. Far from unwarranted certainty, she admits that she expected the economy to to better, doesn't know why it hasn't, and has therefore revised predictions of when the rates will be raised! Any consumer of financial news over the past 4 years should be familiar with this. The fact you omit this is highly disingenuous.

I agree with you, to some extent. Yellen is actually one of the more humble central bankers. Not much competition there, of course. But I would still classify what she says, and doubly so what she does, as unwarranted certainty.

The net effect of what she does, incidentally, is an unprecedented redistribution of wealth in the US economy (and elsewhere) from the poor to the rich. The fact that she does this things like this while being unsure about the consequences ...

And of course, she is like all other central bankers. As you say, she doubts whether what she's doing is the right thing. So what does this person do when she doubts the effects of her unprecedented policies ? Why, more of them, of course. She errs on the side of making the rich richer yet again and sabotaging the poor even more ...

Let's just be glad this woman is not a pilot.

My personal connection to this is that, like all central bankers, Yellen is effectively spending (sorry "loaning") my own money back to me, enriching a lot of people in the process. Needless to say, I feel less than ecstatic. And please don't make the central banker's argument (that it's to "save me from an economic crisis that didn't happen", ie. a counterfactual argument. It's about as realistic and useful as the quintessential example of such an argument "why didn't they just kill Hitler/Stalin/...")

And, yes, I understand why she can't be really humble.

Re:More Americans Are Falling Behind on Student Loans, and N... by StanislavPetrov on Thursday September 28, 2017 @10:34PM (#15362353)
>So I present to you: they are lying. They are lying about their reasoning, they are lying about their models, they are lying about their predictions. I understand why they're lying, but they're still lying.

Some are no doubt lying, but never underestimate one's ability to delude themself.

Re:More Americans Are Falling Behind on Student Loans, and N... by taw55 on Friday September 29, 2017 @08:32AM (#15364648)
What if they are lying to spur market optimism? It could become self reinforcing.
Re:More Americans Are Falling Behind on Student Loans, and N... by jxramos on Thursday September 28, 2017 @07:09PM (#15361535)
I dream about the day when the CBO and the Fed lay out all their calculations in a Jupyter Notebook and some means of accessing the raw data used. I can smell the transparency there.
Re:More Americans Are Falling Behind on Student Loans, and N... by thadk on Friday September 29, 2017 @05:29PM (#15369391)
I haven't looked into this carefully but I believe the UK does this already in R: https://twitter.com/Rbloggers/status/846887304379744259