The band performing at the club is The Shins. They are performing their song "So Says I" off of their "Chutes Too Narrow" album. This is coincidentally an album that Rory is seen borrowing from Lane in Season 3.
The Sea Sprite Motel featured in the episode is the same one featured in Veronica Mars and is actually located in Hermosa Beach, CA.