The basis of the modernization of education laid competence-based approach, aimed at training professionals, competent in all areas, including mathematical, meeting the needs of modern society. Consequently, mathematical competence of the future specialist of middle level is to be formed while studying at the college, but at the same time the ways of its formation have not been determined yet. Moreover, this process is accompanied by a number of difficulties, among which the insufficient level of mathematical school traning, low motivation to learn, unconscious choice of specialty are. The purpose of this article is to establish the model of formation of mathematical competence of a college student in training of college students. Model presented in the article has some clear connection of elements, which implies a certain structure that reflects the inner, the essential relationship of reality and consists of four blocks. The main idea in the development of this model is professionally directed teaching of mathematics, whose implementation will let overcome the above mentioned difficulties and in complex to assess and adjust the process of formation of mathematical competence of college students. The analysis of the structure and content of the presented model allowed to identify pedagogical conditions, which must ensure the effectiveness of the formation of mathematical competence of future specialists of middle educational level through professionally directed teaching mathematics.