Alg is available to anyone (as everybody pays into the insurance). Foreigner might be required to leave the country at some point, depending on the kind of residence permit they hold.

Alg II is a bit more complicated: It is available to all persons that have their regular residence in Germany (with some restrictions). Again, foreigners may be required to leave the country based on the residence permit they have (and of course lose the benefit). For example, foreigners with a settlement permit (which is generally available after five years and allows unlimited residence) don't have any restrictions here.