If I stop or pause an album in the middle, then play other music, then go back to the first album from History, it always goes back to the beginning. Is there a way to go back to where it left off?
Nope. You'd need to go in the album and choose the song you want to start from.
The History is a list of things you chose to play. If it was an album, clicking it will play the entire album. If it was a song then it just plays that song. Podcasts will resume from the last point.