OLE isn't any more "malware riddled" than anything else you install on your PC, at its core it is just a fancy plugin system for embedding stuff in a document without the document editor knowing about it. OLE is as susceptible to malware as any other plugin system - in other words unless you somehow[0] install malware, you wont get malware.

[0] "somehow" here includes said malware taking advantage of unrelated security holes but this is true for everything, not just OLE