How do I politely tell someone, "That's not my job"?

Go ahead and tell your boss that. Maybe suggest being cut back to part-time so the hours you are there, you only have time to work on IT stuff.