The text-to-video-synthesis-colab from nofeetbird0321

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

Colab	Type
	zeroscope_video_webui_colab cerspense/zeroscope_v2_576w (576x320 txt2vid) cerspense/zeroscope_v2_30x448x256 (448x256 txt2vid) cerspense/zeroscope_v2_XL (1024x576 vid2vid denoise strength between 0.66 and 0.85) (Thanks to @cerspense ❤ for the model) (Thanks to @kabachuha ❤ for the text2video webui extension)
	zeroscope_v2_576w_video_webui_colab cerspense/zeroscope_v2_576w (576x320 txt2vid) (Thanks to @cerspense ❤ for the model) (Thanks to @kabachuha ❤ for the text2video webui extension)
	zeroscope_upscale_video_webui_colab cerspense/zeroscope_v2_XL (1024x576 vid2vid denoise strength between 0.66 and 0.85) (Thanks to @cerspense ❤ for the model) (Thanks to @kabachuha ❤ for the text2video webui extension)
	potat1_video_webui_colab (1024x576 txt2vid) (Thanks to lambda labs ❤ for the gpu)
	longscope_text_to_video_colab polyware-ai/longscope (Thanks to @polyware_ai ❤ for the model)
	zeroscope_v2_xl_text_to_video_colab cerspense/zeroscope_v2_XL (Thanks to @cerspense ❤ for the model)
	zeroscope_v2_576w_text_to_video_colab cerspense/zeroscope_v2_576w (Thanks to @cerspense ❤ for the model)
	potat1_exp1_text_to_video_colab (Thanks to lambda labs ❤ for the gpu)
	zeroscope_v2_dark_text_to_video_colab cerspense/zeroscope_v2_dark_30x448x256 (Thanks to @cerspense ❤ for the model)
	zeroscope_v2_30x448x256_text_to_video_colab cerspense/zeroscope_v2_30x448x256 (Thanks to @cerspense ❤ for the model)
	zeroscope_v1_1_320s_text_to_video_colab cerspense/zeroscope_v1-1_320s (Thanks to @cerspense ❤ for the model)
	potat1_text_to_video_colab camenduru/potat1 (Thanks to lambda labs ❤ for the gpu)
	zeroscope_v1_320s_text_to_video_colab cerspense/zeroscope_v1_320s (Thanks to @cerspense ❤ for the model)
	ms_1_7b_text_to_video_colab damo-vilab/text-to-video-ms-1.7b (Thanks to damo ❤ damo-vilab ❤ for the model)
	animov_512x_text_to_video_colab strangeman3107/animov-512x (Thanks to @bRuefiRe ❤ for the model)
	animov_0_1_1_text_to_video_colab strangeman3107/animov-0.1.1 (Thanks to @bRuefiRe ❤ for the model)
	animov_0_1_text_to_video_colab strangeman3107/animov-0.1.1 (Thanks to @bRuefiRe ❤ for the model)
	Watermark Remover
	text_to_video_synthesis (Thanks to damo ❤ damo-vilab ❤ for the model)
	text_to_video_synthesis_diffusers (Thanks to damo ❤ damo-vilab ❤ for the model)

🦒 Community Colab

Colab	Function	Author	Readme
	potat1_text_to_video_colab_ALM (Thanks to snydjos ❤)	snydjos AILostMedia	Readme

Tutorials

https://www.youtube.com/watch?v=WHcjD-uraUs (for zeroscope_video_webui_colab and zeroscope_upscale_video_webui_colab)
https://www.youtube.com/watch?v=E45AO1w9gRU (for Potat 1️⃣ and Zeroscope)
https://www.youtube.com/watch?v=b8D4am73e6I

Main Repo

https://www.modelscope.cn/models/damo/text-to-video-synthesis/summary
https://github.com/modelscope/modelscope
https://github.com/huggingface/diffusers

Models License

Apache License 2.0

Examples

Potat 1️⃣

out.mp4

out2.mp4

out3.mp4

out4.mp4

out27.mp4

waterfall.eb62844e.mp4

Base Model

A giraffe underneath a microwave.	A goldendoodle playing in a park by a lake.	A panda bear driving a car.
A teddy bear running in New York City.	Drone flythrough of a fast food restaurant on a dystopian alien planet.	A dog wearing a Superhero outfit with red cape flying through the sky.
Monkey learning to play the piano.	A litter of puppies running through the yard.	Robot dancing in times square.