Your first example shouldn't have a comma at all.

IMO it will work better in some contexts than in others. If rhythm isn't a concern then yes, it could always be omitted.