"The easiest solution may be to have separate albums each with their own access permissions and virtual albums which can hold photos from any albums with each retaining the permissions of the source album."
And if you want to CHANGE the permissions? Say give one friend access to one particular album but another friend access to a different one, each of which could hold a mix and match that has different contexts? At least offer an option to override if you're going to do this.