Numerophobia

Numerophobia, arithmophobia or mathematics anxiety is a anxiety disorder, where the condition is fear of dealing with numbers or mathematics. Sometimes numerophobia refers to fear of particular numbers.

...
Wikipedia