OpenAI has shared the first music video produced with Sora, its video-generating artificial intelligence. The video for August Kamp's Worldweight is as strange as it is unique.
Sora, OpenAI's jarring artificial intelligence tool, continues to produce impressive examples. Sora, which can produce videos of one minute or longer from a text command in natural language, recently made its first music video. Created for the song Worldweight by independent artist August Kamp, the 8:3 video clip looks surreal and strange in the simplest terms.
The video, which takes place mainly on the beach, in the forest, underwater and in strange places, can easily be recognised as hallucinatory when examined closely. Leaves turn into fish, shrubs appear out of nowhere, and flowers seem to have cameras instead of petals. However, when you turn up the sound and watch the video, a psychedelic experience emerges, the hallucinations overlapping with the nature of the music.
It is unclear what prompts were used in the linked video, or how many clips were required to create the 2 minute 19 second video (we assume multiple clips were combined). August Kamp, a musician, researcher and creative activist who was granted early access to Sora, describes Sora as a turning point for artists, noting that the only limitation on visuals is human imagination.
Of course, Kamp is not the only one who produces such impressive videos. Recently, OpenAI shared some videos produced by artists with the tool. Obviously, among these videos, my attention and the attention of many people was drawn by the short film "Air Head" by the production company Shy Kids. We will add the video at the end of the news for you to watch it. By the way, the film is about a man with a balloon instead of a head.
Sora's future
It is too early to say whether Sora will be used by major production companies or in mainstream art. In the videos shared, it is clear that Sora has problems with physics, human faces and continuity. Hallucination is a basic reality that is difficult to overcome. However, for "niche" art audiences that embrace these basic realities and bizarre scenes rather than pushing them away, Sora could make a big impact in storytelling.
However, it is unclear exactly when Sora will be generally available. OpenAI CTO Mira Murati hinted a few weeks ago that the tool would be released this year. There are also Runway and Midjourney, which have already entered this field. Therefore, as in ChatGPT, DALL-E and their analogues, we can see a very rapid development in video-producing artificial intelligence.