I'm trying to see if my CCA is funtioning correctly. When the car idles and I look at the rod on CCA it is pulled in meaning the valve is only getting air from the primary but when I shut the car off the rod pulls out and the valve opens. Is this suppose to happen when you shut off the car or should the rod pull out only when you pull the vacum hose off the chamber?

yes, when you turn the key on, you can see the actuator move the other direction...