Tony Kaye has been in Yes twice, the first time he joined in 1968 and made three albums with them. He left in 1971. The second time he joined Yes for the 90125 album (in 1983), and stayed with them until 1995.

After he left Yes the first time, he formed a group called Badger with David Foster (someone who wrote with Anderson). After that he played with Detective and Badfinger and joined Yes again.