Okay this is absolutely amazing. I can't wait to see how this will work- things like buffering making your character stay in place while other stuff moves (kinda like the skipping but where the character can still be affected by certain things), the 'video' quality either making slopes into stairs- or making what appears to be walls into background objects... maybe even annotations that only appear when starting from a certain point but not backwards... there's lots of possibilities. Maybe even using captions as a platform for certain segments or changing the size of the video window to reveal things below the boundaries of the regular video. There's a ton of potential here and I hope we get to see it if there's more of this post-Kickstarter. I love the idea and I can't wait to see how it goes!
Good luck on everything here and I hope to see this game come to fruition!
And also I know you don't want the quality to be a gimmick. But I think it would make for amazing puzzles, as long as you can access them outside of the settings and have it only affect the 'video' and not the character or anything outside of the level.