Not having the hardware vertical integration until buying Nokia was a big limitation. As was the use of resistive touchscreens, which usually requires a stylus to achieve any accuracy.
CE wasn't too bad. It was nice having mostly the same API as desktop windows, so you can easily cross-test.