Like what buddhabar mentioned, it's clearly that it's just FwB relationship. He only treat you as a 'spare' or 'friends' only. Probably worst than friends, since friends won't insult each other in such a way.
Try to forget him (easy to said than done though), or at least, buried all the...