drum beats jerky

I have a problem with the kick drum in a piece of music. I have a measure of four beats and I want a 1/4 note on each count. Beats 1, 3 and four play perfectly, but the 2nd beat is not in time. It is like a split second in front of the 2nd beat. If I play the measure alone it is perfect but if I play from two or more measure before it, the problem is still there. Has anyone experienced this? I will be glad to hear from you. Thank you.