Please specify what version of the library you are using: 2.0.0
Please specify what version(s) of SharePoint you are targeting: SharePoint 2013
The application can work well on Chrome, Firefox and Internet Explorer 11
The application can work well on Chrome, Firefox, but not on Internet Explorer 11, the error show as below:

Did you follow polyfills doc page instructions?
I tried to import it into all the files which are using @pnp, but it still did not work, the same error still show. Please let me know if I missed something.

Are you running this in SPFx and what if so what version? Also, did you enable ie11 mode?
No, I do not use SPFx.
About enabling ie11 mode, I missed it, but it seems not to work after I add it.

Might help https://github.com/pnp/pnpjs/issues/1002#issuecomment-572975881
You will need to make some modifications for use outside of SPFx solutions.
Was able to reproduce this - unsure why we didn't catch it. I have added the sumbol polyfill to the polyfill package. Just published a new polyfill package 2.0.1 - give that a try and things should now work.
Going to close this as resolved with the new version of the polyfill library. If someone has further issues please open a new issue and ref this one with the new details. Thanks!