Going to post it as an issue to the Memo GitHub account to stir up some conversation. Hopefully someone a lot smarter and better at cryptography than me can red team the concept.