Like, the differences in the 1991 basket to the 1992 basket are pretty small (please, someone, double check this). But the differences in the 1991 basket to the 2019 basket are larger, for example.
So it would seem to me to be a bit silly to have to update the prices of the 1991 basket all the way to today, especially when you're updating the 1992 basket as well, and every other year.
I'm not a CPI expert person, so if there is someone that really does understand these things in depth, please chime in!
A "normal TV" now is a smart (spit) TV which compromises privacy and viewing experience and durability - but which is sold massively cheaper than a plain TV as defined perhaps 6 years ago. You have to dig hard to find a plain TV and it's more expensive. Do you count "smart" as a positive hedonic feature? Or do you count the effort necessary to find a plain TV in the price increase of a plain TV? Do you compensate for much other price increases just because a "normal TV" is now much less expensive and (allegedly) more hedonic?
Part of the challenge is with how frequently they decide to change the basket of goods. If the basket was largely stable over time we would have a pretty good estimate simply by aggregating annual data, especially if they focus on staple consumables that don't change drastically over time.
They provide their raw data [1]. You can reconstruct the index however you want. There is an entire industry of consultants who create custom benchmarks for planners.
For personal purposes, your metropolitan area's CPI is a better metric to watch than the national number.
At some point, even the long-term index can't be constant.
TVs dropped in price due to the benefits of adopting moores law. Look into a modern TV and you see a symphony of integration and cost reduction thanks to moores law. I'd imagine the same applies to anything else that jumped on the moores law bandwagon. We need to measure appliances that benefited from this vs appliances that didn't.
The BLS goes into excruciating detail about their methodology, which is not something often find scams doing.
The Consumer Price Index is just that, an index. It seeks to distill the complexities of the consumer economy into a single number, and to do so reliably over time. It's impossible to do this without a whole bunch of compromises and trade offs. It's trivial to rip apart any such methodology because of these trade offs - just find a trade off you don't agree with and argue it should be the opposite.
If someone attempted to make a t-shirt using the weighted dimensions of every American, the result would be a t-shirt size that would not fit any individual. But, over time, that t-shirt could be used to understand changes to the American physiology over time.
> For example, they attention to adjust the new price to account for what they consider to be added value.
They cover this in their FAQ [1]. But again, this is a trade off. If laundry detergent becomes more concentrated, thus can do 20% more loads for 10% more price, then how should that be handled? If $1000 Nike shoes become popular, does that mean that the price of shoes increased 10x even if cheaper alternatives are still the same price?
[1] https://www.bls.gov/cpi/quality-adjustment/questions-and-ans...
(And if it were an "independent" agency like statistics are in some countries, that would provide more shielding but not necessarily perfect either.)
Asking for specific evidence of a specific BLS personel filing a grievance or similar because of pressure is placing the bar way into the "blind" territory. This is not how influence works. I mean sometimes it is and we get to see it laundered in public, but that's not the common way. In the case of BLS it may be there, I haven't searched.
Oh hey, there is someone who got caught with his hand in the cookie jar: https://www.washingtonpost.com/archive/politics/1988/09/11/b...
As usual what would help is ever more work from the producers to justify their work. BLS comes short. They are not the only ones but still.
Except for e.g. the small print in an EULA, or the XXXX pages Congress spending bills. There is definitely a bureaucratic technique of 'obfuscate through sheer volume of irrelevant information'.
On top of my head:
* basic breakdown: grains, meat, veggies
* processed vs. unprocessed
* grocery sourced vs. eating out, largely fast food
* sourcing, binned by log distance travelled
* scenarios: Med diet? carnivore? vegetarian?
On reflection, the core objection is that there is a subjective hidden parameter: the relative weights of different components. See e.g. https://www.bls.gov/opub/hom/cpi/calculation.htm#item-replac... I'd rather use my own weights.
And you're free to use your own weights in your own calculations, since they provide all of the formulas and data that they use, including the breakdown of how they select the relative weights.
Yes [1][2].
[1] https://www.bls.gov/cpi/tables/
[2] https://www.bls.gov/cpi/tables/relative-importance/home.htm
Except it's not. It's how we calculate inflation, which in turns drives how we measure GPD growth. It's also how we measure productivity and purchasing power. This measure has a very big impact.
Off course there can be no absolute value for such a thing, but the problem is that economists[1] have been obsessed with “real” prices and disregarding “nominal” values (you'd notice the irony of naming the constructed thing “real”), and so almost every economic analysis includes CPI and now everything depends on it so its measurement become included everywhere indirectly. And it is in fact a big problem.
They actually do describe this "If the BLS data collector is forced to replace a short-sleeve cotton/poly shirt in the CPI sample with a long sleeve 100% cotton shirt..." but they provide no answer aside from [well the one on the shelf now is better].
So that the buyer of the "common" shoe, shirt or TV pays more.
It's easy to argue that it's possible to dig deep and find that "older" cheaper item but that doesn't change that the "basic basket" is now more expensive.
The second problem is one of perception - and perception really matters in this case. And CPI doesn't solve that problem.
While I do agree with many of the points you raised, for me those point to the uselessness of the CPI as a matric. If the dataset is so complex you can only boil it down so far before too much context is lost. The CPI is an attempt to create a single number of off the entire economy, a task that is impossible made only more clear by complaints over the obvious and egregious tradeoffs made.
Statistics can be useful, it can also be a pointless game of manipulating so much data that you can make it say whatever you want. I think you'd be hard pressed to find an average American that would feel like prices have only gone up by ~4-5% over the last few years.
Unless you're setting federal policy, it probably is useless to you. For personal forecasting, you're better off using the CPI calculated for your state or metropolitan area. (If you're procuring at a national scale, you're looking at a producer index.)
It may not be reliable over time, but it is reliable over shorter time periods. If the basket is not changed for a few years, then the month-by-month changes in CPI are generally judged as reliable, or as reliable as what is out there. It is when you try to look over a 10, 20, 30 year period where you begin to run into trouble.
Yes? Of course? They are based on spending surveys:
* https://en.wikipedia.org/wiki/Consumer_Expenditure_Survey
When people change their habits in life the CPI is changed to reflect what that life costs. Up here in Canada, the CPI is also adjusted from spending surveys:
* https://www.statcan.gc.ca/en/survey/household/3508
You can see the list of changes going back to 1913:
* https://www.statcan.gc.ca/en/statistical-programs/document/2...
Do you think coal and lard should be included, like they were in Canada pre-1956? Or do you think the CPI should try to model reality?
> […] meaning the data isn't reliable over time.
It is meaningful in that life now and life ten or twenty or more years ago was different in what people purchased. That should be reflected in measures that model consumer spending.
If people spend on item X less or no more, why would it be included in the index at the old weight? For any given period of time being measured, the basket of goods and their weights should reflect what people are actually doing. Why would you run a model that samples the wrong things?
This is one reason why (e.g.) StatCan went from updating their basket every 2-3 years, to annually in the last little while: spending habits shifted drastically in over the course of the pandemic.
* https://www.statcan.gc.ca/en/statistical-programs/document/2...
Substitution is a known source of (possible) error and there are attempts to take it into account:
> 9.22 The other potential source of error with respect to the basket weights is referred to as upper-level substitution bias. This bias arises because of the use of the Lowe formula, which is an asymmetrically weighted fixed-basket price index. Because the weights are obtained from a year that precedes the price reference period, the expenditures are not likely to be fully representative of consumer spending patterns in the price observation periods. This is because consumers tend to adjust their spending habits in response to changes in relative prices, buying more of the products whose prices have fallen or risen less rapidly, while reducing their purchases of products whose prices have increased the most. In other words, they substitute towards relatively cheaper products from relatively more expensive ones. The asymmetrically weighted fixed-basket formula of the CPI does not account for these types of changes in consumer spending until a basket update is performed.
> 9.23 Unlike the Lowe formula, there are five known symmetrically weighted price index formulaeNote which are theoretically free from upper level substitution bias. These index formulae use expenditures from both the price reference period 0 and the price observation period t and therefore account for product substitutions that consumers may make. In this regard they are representative of consumer spending for the periods in which price change is being calculated.
* https://www150.statcan.gc.ca/n1/pub/62-553-x/2023001/chap-9-...
Say ten years ago, hypothetically, everyone ate steak and wine every day for $100/week and today everyone can only afford to survive on ramen and tap water and it costs $100/week.
If you change the basket to say people today only want ramen, you will conclude that there has been 0% inflation in a decade. Everyone still spends $100/week on food, no change at all!
That does not seem like a useful measurement.
But on longer time scales it becomes a bit meaningless. Lifestyles were so different 50 years ago that very little is directly comparable beyond certain staple foods. People tend to interpret the CPI numbers based more on their preconceived notions of how things are going than on any objective reality.
Please show me an economy where the list of goods stay stagnant and don't constantly change.
Unless your CPI is comprised of raw commodities like Iron Ore and Salt and Copper - then you're not going to be able to keep a stagnant list of items.
If x% of consumer food spending was on milk in 1920 and now it's 1/10th x - it doesn't make sense to keep milk with the same weight as it did in 1920.
It's pretty hard to tell if people are drinking less milk now because they're poorer or because they just prefer almond milk (which is more expensive) instead.
So, please, find a better & more cost-effective way to measure inflation. If you do, the government will use it.
Contrary to popular belief, we don't live in the USSR - where our government provides us with blatantly crap data. We just have shill politicians that spin everything into a lie.
In which case it won’t be a Consumer Price Index at all, as those things in their raw forms (well, salt is close, I guess) aren’t exactly consumer goods.
Of course, we already have industry-specific Producer Price Indexes which cover the raw materials and other inputs used in those industries.
If you take steel as an input - you can make lower quality steel for a lower price.
Even something as seemingly mundane and simple as oil has a lot of variety.
They regularly modify the list of items in the cart, meaning the data isn't reliable over time.
They also include caveats where they can modify the Scritsmier price differences. For example, they attention to adjust the new price to account for what they consider to be added value. Say a product is 15% more expensive one year after a new model is released. When calculated the CPI, they can decide that the new model added 10% more value or benefit to the user, meaning the price only rose by 5%.
I wish I could find the study now, but around 2013 someone compared the CPI listed price increase of magazines to the actual change in the price listed on the cover over something like 20 years. The true value change was around 130% but the CPI had adjusted for value 30%.
Most people seem to be feeling this now when they notice that process have risen much higher than the claimed 4 or 5%.