No. Any type of symbolic data can be represented using binary, not just numbers. At the electronic level, everything is a bit pattern (which some people call a "number"), so the statement is sort-of correct.
You may wish to review the following terms. Click on the hypertext phrase to go the page where the term was discussed.