Foundation models (e.g. large language models) create exciting new opportunities in our longstanding quests to produce open-ended and AI-generating algorithms. In this talk I will share some of our recent work harnessing the power of foundation models to make progress in these areas. I will cover three of our more recent papers: (1) OMNI: Open-endedness via Models of human Notions of Interestingness, (2) Video Pre-Training (VPT), and (3) Thought Cloning: Learning to Think while Acting by Imitating Human Thinking. This research talk was given virtually as a keynote to the 6th International Workshop on Intrinsically Motivated Open-ended Learning (IMOL 2023) in Paris. For more, please see or @jeffclune on Twitter.