AI Generated video is taking off 🎉 Diffusion TV helps you stay on top of the latest AI generated videos with a user experience inspired by Tiktok/Reels. Always see fresh content, discover your favorite artists, and keep up with the latest AI Generated videos.
This project was born out of a desire for me to stay on top of the cutting edge of AI video technology and to shine a light on the amazing work being done by many talented individuals. The best part is, it's open source so everyone can learn how to build this themselves.
My goal is to see if there is enough interest in this proof of concept to convert this from a PWA to a fully-fledged native iOS/Andriod application 📱
Note
The content in DiffusionTV based 100% on Civitai's API. None of the content is scraped from their website in order to remain compliant to their Terms of Service. All video content belong to their respective owners and creators.
The videos and engagement data comes from Civitai, however while Civitai is a great place to share models and images, video content is underserved. I wanted a way where I could follow my favorite creators, stay on top of the latest videos, and watch videos that aren't normally surfaced on Civitai by creating a unique recommendation algorithm based on clusters of video content using CLIP as a baseline.
| Features | DiffusionTV | Civitai |
|---|---|---|
| Mobile First using PWA | ✅ | ❌ |
| Video optimized using less memory than TikTok/Reels/Shorts Web | ✅ | ❌ |
| HD Mobile Videos (Civitai downscales to SD) | ✅ | ❌ |
| Recommended "Inspire" Feed | ✅ | ❌ |
| Push notifications when artists upload to Civitai | ⚒ | ❌ |
| Directly upload videos | ⚒ | ✅ |
| Like and bookmark prompts and videos | ✅ | ✅ |
| 3,000+ Videos | ✅ | ✅ |
Diffusion TV is a PWA or Progressive Web App. Meaning it will act and look like a native mobile application once saved to your home screen. Saving to home screen is simple:
iOS:
- Open application in Safari
- Select the Share icon
- Select "Save to Home Screen"
Andriod:
- Open application in Chrome
- Open Settings
- Select "Save to Home"
I am running this project out of pocket at the moment. Costs are daily transcoding, storage and serving images and videos, and CDNs for this content. If you appreciate what I'm doing start me ⭐ on GitHub, send feedback and share with friends. Thank you!
| Star Milestone | Feature | Status |
|---|---|---|
| 0 stars | 🎉 Serve application and open source | ✅ |
| 10 stars | 🤝 Claim profile feature 1 | |
| 15 stars | ⚡ Keep the party going for 30 days 2 | |
| 30 stars | 👀 Double dataset with fewer content filters3 | |
| 50 stars | ⚡Keep the party going for 60 days 2 | |
| 100 stars | 📀Improved loading time with better trancoder and CDN 4 | |
| 250 stars | 🚀Realtime update video and personal upload 5 | |
| 500 stars | 📱Create iOS + Andriod App 6 | |
| 1000 stars | 🔥 Open Source my updated Civitai API for Videos7 |
tl;dr NextJS front-end. Node and Python backend.
| Stack | Uses |
|---|---|
| NextJS/Typescript | Front-end |
| Vercel | Hosting |
| TRPC | jk |
| Prisma/Planetscale | Database and ORM |
| NodeJs/Python | Backend |
| Replicate | AI APIs |
| AWS Cloudfront | CDN |
| Qencode | Transcoder |
| AWS S3 | Data Hosting |
| Auth | Auth0 |
| Civitai | Civitai APIs |
| Cursor + Custom GPT4 | Code Buddy |
Diffusion TV is licensed under AGPL.
Your support and feedback are what drive this project forward. Please star on GitHub, report issues or share your thoughts and ideas.
Footnotes
-
The next feature on the roadmap is to enable Civitai users to "claim" their profiles. This is challenging because Civitai has no "Login with Civitai". I have found a couple of ways around this to securely claim and verify ownership but it will take a couple weeks. ↩
-
Costs include daily jobs for transcoding, serving, and recommendation algorithms. Serving video is very expensive. ↩ ↩2
-
Civitai's content filters are very aggressive and have many false positives. By loosening them I can double the video database but that also doubles costs. ↩
-
To reduce memory usage, the transcoder pipelines ensures that 90% of videos are <10MB. However, this can be reduced further and make for instant loading times. ↩
-
At the moment the video pipeline runs daily. It would be nice to run this more frequently and enable users who are not from Civitai to directly upload videos. ↩
-
PWA's are great but there are many limitations that I had to hack for it to work and be memory efficient. A nataive app would overcome many of these issues. ↩
-
Civitai's API is broken , so I fixed it. ↩
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent