We are just for a short span of time in this world. So it doesn't make sense taking yourself or your partner that much seriously.
If you are attracted to someone else while you are already in a relationship, its better to leave your previous love than ruining two lives altogether.