I prompted Midjourney to create this this image and animated it using Leiapix (mp4):

Wrote a quick python app to capture the recording (via microphone), called OpenAI’s Whisper API to convert the audio into text, transcribed the text using Narakeet’s API text to speech API. Downloaded Wav2Lip from github and sync up the audio (from Narakeet) and video (Leiapix).

I asked ChatGPT to 1) recite a few lines of poem via microphone 2) OpenAI's Whisper API to convert the audio into text. 3) Transcribe text using Narakeet's text to Speech API. 4) Created an image in MJ and used Leiapix to animate it. 5) Used Wav2Lip (github) to sync it all up. pic.twitter.com/IvECqaxWuo

— aymiee (@aymieelis) May 11, 2023