When the main key is used it creates 3 "minor" keys. Currently it seems those "minor" keys can bug out. The first set will take the whole party but the other two may not.