Maybe toward the end... I do end up getting sleepy after a few days without sleep, but it's not enough to affect my mind that rest is necessary until it's been about a week.

Have you been getting enough sleep?