If exposure to air is bad, it's possible that re-bottling wouldn't work well. I don't know if bottled olive oil is treated like many other packaged foods and sealed in with an inert(ish) gas, but I wouldn't be surprised if this were the case. I don't know how you could replicate that at home.