I agree with almost everything you've said here - it would be cool to implement. Maybe lossy_loss will see this and be inspired
