It is never found out what the name of the band is in the film, nor is the name of their debut album.
'The Soup Song' was improvisation on the day of the set to give it a natural feel for the fictional band, but 'This Band is Done' was written and recorded beforehand.