A contact model between a homogeneous half-space with a linearly graded layer and a rigid punch is proposed and studied in the present paper. The governing equation, which describes the relation of the displacements and the normal tractions at the contact interface, is obtained by means of Fourier transform and a transfer matrix method. Appropriate collocation methods are used in order to solve the equation numerically. Singular behaviors at the edge of a flat punch are revealed. Compared to the case with a graded surface varying according to an exponential law, stress concentration is relatively weaker in the case with the graded surface varying according to a linear law. Furthermore, stress distributions in cases of a flat or cylindrical punch are given for different varying graded laws, thickness of graded layer, ratios of stiffness, and frictional coefficients. All the results are helpful for the design of strong and wear resistance coating surfaces.