Unfortunately we can not support that case currently. We could look into adding a feature to disable classic if granted while private and then later made public, but without that there is a large hole that I’d rather not leave open. I will add this to our ideas list for consideration.
Your best bet for now is to bundle those dependencies and avoid the use of classic.