I have to agree with drachen23 here. High contrast and text scaling are supported out of the box so people who can't see well have a pleasant experience even in third party apps.
--
Built in controls already support all of the themes automatically so high contrast should just work for built controls unless you modified them. As far as I know, there's no way to globally disable support high contrast mode for an app without re-theming all of the built in controls. Since high contrast mode usually only affects colors, you specify non-themed colors on a per-control basis though to make it consistent across different themes (high contrast is an OS theme just like dark and light themes from the perspective of the app).
Please elaborate on what specific issues you are having and for which controls and/or pages regarding high contrast mode. In most cases, it's relatively simple to fix this (usually through ThemeResources and/or ThemeDictionaries)
--
Text scaling is easier to disable across the board but I still don't recommend it. You can set IsTextScaleFactorEnabled on most, if not all controls to false, so it doesn't respect the phone's text scaling in the "ease of access" settings. Setting this also affects all children controls. So if you set this on a page, everything in that page will also no longer scale its text. I believe you can even do it on the app to do it at an app-level. Instead of unconditionally disabling it, I HIGHLY suggest you do it only on elements that doesn't make sense to scale or if it looks really bad. Check out the native/built-in apps and see how they're usually a mix of scale-enabled and scale-disabled elements. Basically, you want content to scale because that's what your users are trying to read.