The day before yesterday I had 2010 rep, I got +5 yesterday, so now I'm at 2013. Makes sense, right? (I don't see anything about downvotes on my rep page.)
Your rep not being high enough to see deleted questions seems to make it so that you cannot see the affects from a deleted question. Here is a heavily cropped picture of your rep changes, I did my best to hide secret moderator buttons and such.
My mouse is highlighting the time of the removal event as a time stamp to give the picture more reference then yesterday and 2 days ago.
Sorry for the confusion, just another reason to work for 10k rep!