The whole thing is not GPL, someone can still just replace your changes with more MIT code and use the whole thing under BSD. You cannot change the license of someone else's code.