"Disable absolute volume" setting (in Developer options) might help. It separates the phone volume control from the headphones volume control so it's like a preamp.