BitcoinIsP2PC4$H The server in the scheme above is not involved in a handshake. The "handshake" is non-interactive, thus you only need to fetch your addressee's public key from tx