Portable version of Edge Browser with high security is a bit of a misnomer. There's no official portable version that I'm aware of so you're going to be relying on builds created by others, which perhaps loses some of the 'high security' depending on how you view installing non-official builds of apps. In any case, you can just search Portable Edge Browser and find a version you trust.