Sounds like the valves are mis-adjusted.
It is a solid lifter roller cam is it not?

Small and intermittent backfires through the carb at idle indicate valves too tight even if everything else is in spec.

Do a compression test and see what you come up with.