Basic Arithmetic Skills Are All You Need