Why wouldn't they? They can immediately raise prices by however many percent the tariff is. Probably a bit less because higher price causes lower demand. So let's say raise by half of the tariff.

Maybe it will partially offset the increased cost of everything they need to buy and sell olives.

Now when I think of it it might be a wash.

They still probably use equipment, packaging and other materials that come from overseas. Or they work with suppliers impacted by tariffs. Their costs are going up. Everyone's costs are going up, although some more than others.

I've put together a directory of olive oil producers from California:) https://www.californiaoliveoil.info/