"...a local Indigenous population that for some reason loved British colonizers,"
But, your idea is not plausible. Oompa Loompas are too believable.