As they said, glue what you want as a single .wav files, and clean directory. Works like a charm, I do it all the time, and I check I didn't forget anything by renaming the final .wav files and check the directory for any forgotten .wav file somewhere in the project.
Terminus's way works too, but it doesn't "clean" the project itself (I mean, I use the cleaning function as a way to force myself intro making my project more organized), and you have to go back to the explorer and delete the previous folder too. You need to rename the folder too to not overlap. Once you are used to use the "clean directory" function, you don't even have to check, I do it sometimes from inside reaper without feeling the need to go check because it's pretty reliable. I do terminus' method when I want to go to the next step (recording > editing > mixing etc) because I like to keep the project in its current state and duplicate it before I alter it further.
EDIT : juste in case you don't know, to rename a file, you need to do it right on an object : right clic on an item, "item properties", "rename file". Change it to something more appropriate. Now if say you're done with editing and wanna get to a mixing stage, you can have one file per track with a clear name, drum tracks with names like "dr_kick.wav dr_snare.wav" etc and your project will be 100% clear even if you open it in 10 years.