Hayley Williams seen in New York for The Late Show With Stephen Colbert