You need to configure the colors as presented by the terminal, and I haven't mucked with that yet. Given that you're working with variations based on the ANSI color set, your initial set of values is limited.
There's a similar trick for vim color highlighting, though I've found the different color settings all involve tradeoffs, not all favorable.