I felt this way as well, but I was fortunate enough to be working in a large company that had a senior engineer track leading to Distinguished Engineer (DE) and then Fellow. I knew that I wasn't Fellow material, but being a DE meant that I could focus on technical issues and not on management issues. Of course, management being management, they tried to give me a project that was not going well, so I left to join an early stage startup.

I'm going to succeed in having my entire 40+ year career in software without ever having had to manage another person. I'm fortunate enough to have had a number of managers who can recognize my strong (and weak) points and then use me in the most effective manner.