Just use the Windows Insider app to swap to the "Production" ring and then leave the Windows Insider program if you want to.
Or just stay in the "Production" ring, which gives you the option of testing a development ring if you want to.
There shouldn't be a reason for you to go back to WP8.1.