You can’t do ECDH from just a public address, cause right, it’s a hash not a public key. But you expose actual public key when you transact.
So every memo account has corresponding public key already exposed in the blockchain. You can fetch any transaction and extract public key from it. And than do ECDH with it.