Black frames have no piece of information in them so it is fine to (try to) substitute them, but I wonder if the same thing can be done with "white frames" or "only one color frames"
I don't know if the algorithm you use can do this and if you think it could be useful or may arise some problems.
Maybe you can add it as another option to choose