Not sure if this is possible when using the FB app.. but you can always do it via the browser
If you need additional help or have more questions or details to share, please join the site so you can reply in this thread. See this link for instructions on how to join Windows Central.
We can change with the app. Open facebook->hamburger menu->click on your profile name->now you will see ✏ on your picture. Click on it to upload a new one.