Peter Windsor believes Sergio Perez should be more concerned about losing his Red Bull seat to Alex Albon than Daniel Ricciardo.