You can turn down the power on the 2.4GHz radio so it's not as overpowering.

I do, but I can only turn it down so much or I lose outdoor coverage.

Add outdoor AP, shrink all coverage areas. You should end up with better performance.