i think you handled it very well. you said you wernt interested and even went as far as to let him justify himself and save a little face. he overstepped, you reacted accordingly. well done
PS: You're done. No further contact is required (or encouraged).