Hulu + Tokbox

I thought of the idea of being able to watch Hulu and tokbox at the same time. The key idea is that both people can control the video just like you already can with youtube. I'm not sure how to do this though. A simple idea is that at the least a web application can be created where hulu videos are embedded and tokbox parties are also embedded. That's the simplest mashup I can think of. But both people will have to start their video separately.

The way I think tokbox is able to synchronize youtube watching is that they buffer it on a separate server first. This is based on the different control one sees/uses when watching within a Tokbox party. So perhaps a more functional solution would be to have a server that routes the traffic to those in the party. Still not sure how to handle the video routing.