Am I in the wrong

So….an old friend of mine was in town as he travels with work. I’ve known this guy for 30+ years and he was in my circle of friends at high school and I caught up with him quite regularly when I was at uni. He is married. When he comes to town (he lives interstate) I usually always catch up with him (maybe once every two years). So when he was coming I asked OH if he was ok if I caught up with him. OH said sure. I asked is it ok if we go out for dinner and invited OH along. OH does know this guy as we all went to the same high school we were just in different grades. OH didn’t want to join us …something about he didn’t want to be around if we discussed another person that was in our close group of friends as I had had a bit of a relationship with like years ago. After going out for dinner and coming home OH then told me he really didn’t want me to see this person (OH has been cheated on before …so I get that). Every time we get into an argument this comes up. OH and I have been together 5 years and married 3.
By same token I asked OH what was the difference between me going out with an old friend when his neighbour (female) from where he previously lived (don’t remember how long they’ve known each other but at least 10th SRS I think) stayed at our place (can’t remember how long for) when I was away in a trip with my mum. I had no concerns as I have met her. Apparently it’s different because she was a neighbour

Is it wrong for me to want to catch up with a friend I have known most my life? I had asked OH to join us and my friend even asked him (via me) to join us.