For me, the iPhone is the primary device I unlock and use in short burst 10's of times throughout the day.
The iPad (Mini) is something I use more deliberately, like twice per day to read the newspaper and to watch some video.
For me the Duo seems like you're suffering a lot for the first use case, just to make the second use case possible.
I think I'll stick with separate devices.