Is there a way of closing games/apps open on XBOX One ?

It seems every time after you press the Home button, go out navigate through Home/the main system and then comes back to the game is still open, which is good. 

However it seems it only closes, and the memory gets clean up, only after you open another game/app.

Does anyone have more background on this?

Thanks!