Amazing project! Here is a demo including an input for negative prompt. It's impressive how it works. You can try:

prompt: relaxing jazz melody bass music negative_prompt: piano music

https://huggingface.co/spaces/radames/spectrogram-to-music