Omit the not in the contraction so as to avoid a double negative. Prefer can hardly to can't hardly (and can't scarcely). See also double negative.
Dictionary of problem words and expressions. Harry Shaw. 1975.
Dictionary of problem words and expressions. Harry Shaw. 1975.