Belong to me: 屬於我的
Belong with me: 和我在一起 (有一種親密, 承擔意義)
"Belong to" denotes ownership; "Belong with" means that things should be together
'You belong with me' suggests that destiny has thrown the two of you together, that you are a perfect match, made for each other like yin and yang. It's very romantic.
Belong with somebody/something: 應該在某處, 通常在某處
例子:
The hammer belongs with the rest of tools.
The child belongs with (ie should live with and be cared for by) his mother.
孩子應該和母親在一起 (應和母親一同生活, 以便得到照顧)
I do agree that every language evolves in many ways. But it's obvious that "oversea" is the mutated one and I'm so sure "oversea" is not chiefly used in British community, but the ESL one. You may consult any etymology dict to justify it