Yes, geologically they are part of the continent of Africa. I think Pantelleria is also part of Africa, but there's still some debate there as it's existence may predate Europe and Africa's breakup.