Infinity

Hi Lina, Andrew and Sidney, this is awesome. My go-to for checking the edges of video and face identification LLMs are Personas right now -- they're rendered faces done in a…

Breathtaking! First, your (Lina's) intro is perfect in honestly and briefly explaining your work in progress. Second, the example I tried had a perfect interpretation of the text…

It's incredibly good - bravo. Only thing missing for this to be immediately useful for content creation, is more variety in voices, or ideally somehow specifying a template sound…

Have to say, whilst this tech has some creepy aspects, just playing about with this my family have had a whole sequence of laughs out loud moments - thank you!

oh this made my day: https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2-clips/f35d0dda-06aa-4e04-838d-77f02a370a04-Bc10YGY5SgVAcWdgPTZlFIZYvauaJl.mp4 !NWSF --lyrics by…

This is fun! https://6ammc3n5zzf5ljnz.public.blob.vercel-storage.com/inf2-clips/026845f6-6ec5-40fd-8350-10a3a779e545-XYtTJdrc9VRxMam8PeuRqYgr9jE8oO.mp4

quite slow btw

can this achieve real-time performance or how far are we from a real-time model?

I tried making this short clip [0] of Baron Vladimir Harkonnen announcing the beginning of the clone war, and it's almost fine, but the last frame somehow completely breaks. [0]:…

It completely falls apart on longer videos for me, unusable over 10 seconds.

Oh, this is amazing! I've been having so much fun with it. One small issue I've encountered is that sometimes images remain completely static. Seems to happen when the audio is…

Tried my hardest to push this into the uncanny valley. I did, but it was pretty hard. Seems robust.…

> It often inserts hands into the frame. Looks like too much Italian training data

I tried with the drake and drake saying some stuff and while its cool, its still lacking, like his teeth are disappearing partially :S

The actor list you have is so... cringe. I don't know what it is about AI startups that they seem to be pulled towards this kind of low brow overly online set of personalities. I…

I am actively working in this area from a wrapper application perspective. In general, tools that generate video are not sufficient on their own. They are likely to be used as…

It would be amazing to be able to drive this with an API.

Awesome, any plans for an API and, if so, how soon?

can this achieve real-time performance or how far are we from a real-time model?

Won't be long before it's real time. The first company to launch video calling with good AI avatars is going to take off.

can we choose our own voices?

It's incredibly good - bravo. Only thing missing for this to be immediately useful for content creation, is more variety in voices, or ideally somehow specifying a template sound…

I need to create a bunch of 5-7 minute talking head videos. What's your timeline for capabilities that would help with this?

Is there any limitation on the video length?

Does anybody know about the legality of using Eminem's "Gozilla" as promotional material[1] for this service? I thought you had to pay artists for a license before using their…

Putting Drake as a default avatar is just begging to be sued. Please remove pictures of actual people!

Say I’m a politician who gets caught on camera doing or saying something shady. Will your service do anything to prevent me from claiming the incriminating video was just faked…

Damn - I took an (AI) image that I "created" a year ago that I liked and then you animated it AND let it sing Amazing Grace. Seeing IS believing this technology pretty much means…

This is surprisingly very intelligent and awesome, any plan for research paper or full grown project with pricing or open source?

Any details yet on pricing or too early?

Yep for sure! EMO is a good one. VASA-1 (Microsoft) and Loopy Avatar (ByteDance) are two others from this year. And thanks!

No, not related. We just took some of Loopy's demo images + audios since they came out 2 days ago and people were aware of them. We want to do an explicit side-by-side at some…

There is prior art here, e.g. Emo from alibaba research (https://humanaigc.github.io/emote-portrait-alive/), but this is impressive and also actually has a demo people can try,…

Yep for sure! EMO is a good one. VASA-1 (Microsoft) and Loopy Avatar (ByteDance) are two others from this year. And thanks!