To the OP-
Have you noticed him projecting either positive or negatives feelings on you in the past? Does he have a history of blame shifting?
You know, not really. He has a history of being a bit paranoid and suspicious, but generally responsive to the idea he may not be correct. In retrospect he may have tried to bring this up before but was always vague and dropped it quickly when I asked more questions. Given I have not been unfaithful this did not seem odd. What does concern me is that his story of how things ended with his ex wife is similar and she reportedly never admitted to being unfaithful though he insists she was.
We are from two very different cultural backgrounds and we have had difficulties with misinterpreting each other during conflict; for example he doesn’t understand ‘ over dramatisation’ and my being quite expressive about my feelings and can misinterpret how strongly i feel about something and I have had times where I’ve interpreted him as controlling or demanding when he just dpesn’t have the language to couch things in a more nuanced way.