Brexit can mean London loses even if the EU doesn’t gain