Ok so sometimes when I try to sharpen my pencil, the lead comes out and gets stuck in there, so i have to get ANOTHER pencil to pick it out. How do i stop this?

By the way, this happens almost all the time with colored pencils

P.S. Sometimes the lead in the colored pencils just come out after I sharpen them.