I often tell my students that Integration by Parts is Applied Math Trick #1. I once had someone retort with “last year, you said Taylor Series was trick #1”.
Well, Taylor series is just really integration by parts… Forever! I was surprised that students hadn’t seen this before. It’s remarkably simple, and yields the remainder theorem quite nicely.