There is a flaw. It comes from the line:
I know you don't know what the numbers are
Any even number can be made from the sum of two primes. When two primes multiply together to make a product, the product can only have four factors: itself, 1, and the two primes.
Therefore, if the sum of the numbers was even, then there was a chance that both numbers could be prime numbers. However, this is not the case as he says with 100% certainty that he knows that the other person cannot know the two numbers. Therefore, the sum must be odd