🎬 From image to text data... to image...to movie clip.

📰 About

I previously wrote an article that showed, how, for totally free of charge, and with 100% open source software, it is possible to analyze photos and produce textual analysis:

📸 Disaster reporting w/Open Source LLaVA/AI for photo analysis

adriens ・ May 21

#ai #datascience #showdev #opensource

👉 Today, I'll show, what can be achieved on top of these textual analysis.

📜 What we'll do

This time, we will enrich the previous pipeline with the following workflow:

1. 🎨 text2img: inject text analysis into an image with https://ideogram.ai
2. 🎬 img2video : Put resulting image into Gen-2 by Runway to get a movie clip with
3. 🎙️ Prepare a small storytelling
4. 🎶 Select a soundtrack
5. 🎛️ Put all the stuff into a single short movie clip

Enough talk, here is the resulting movie clip.

🎞️ Demo