Shebang specifically refers to using an exclamation point to define where data should be directed. Same as it is in Bash scripts, just a different context and slightly different syntax.

> In computing, a shebang is the character sequence consisting of the characters number sign and exclamation mark (#!) at the beginning of a script.

https://en.m.wikipedia.org/wiki/Shebang_(Unix)

The word "shebang" has different uses outside of computing, but I can't find any use of the word that refers to a ! without a #

Note the (Unix) part of the Wikipedia URL. This is an entirely different context.

So in which context does "shebang" refer to a ! without a # ? I can't find any definition like that online.

The "she" is specifically a phonetic clipping of the "#", otherwise it's just a bang - but oh well, even jargon doesn't mean shit anymore.

DDG generally calls them "bangs": https://duckduckgo.com/bang

Here I had assumed it was a Ricky Martin reference.