Bitcoin is fast when not used by spammers posting their cat gif links on the blockchain every few seconds.
I imagine that enforcing an unnecessary 1mb block limit would slow down a blockchain a LOT more than the occasional kitty cat. Have fun not being able to spend your "store of value"