Try changing the PDC preserve setting for either track and see if that helps. (Right click on the record arm button for the track, you'll see it as an option). It's a bit confusing, but depending on whether you are monitoring via Reaper with plugins on that track it creates a lag on the signal you hear when recording that part, however, as humans, we can auto-compensate for any latency when playing/singing. However, the problem comes that Reaper either tries to offset that part to match or (Depending on setting) keeps it as recorded, so if you've sub-conciously auto compensated yourself, this needs to be reversed, or it ends up putting you out of sync trying to help. I have to change that PDC setting for many of my guitar tracks to get them to come good, but really it depends on what you're focused on when playing as to which setting works best for you (i.e. are you sub-conciously listening to the music you're playing to, or the instrument that you're playing). The higher the buffer/latency with your setup the more of an issue this is.... Thankfully the PDC Preserve works a treat, and wish it was on more DAW's. I've not dived in on the entire mechanism behind it, but generally i preserve PDC on any track that i monitor via Reaper (i.e. using amp sims etc.) ... Any clean 'direct' monitoring is left as is (i.e. if recording direct from my guitar amp).