Cytoskeleton remodeling is important for the regulation of vesicular transport associated with exocytosis, but a direct association between granular secretory proteins and actin-remodeling molecules has not been shown, and this mechanism remains obscure. Using a proteomic approach, we identified the RhoA-GTPase–activating protein Gem-interacting protein (GMIP) as a factor that associates with the Rab27a effector JFC1 and modulates vesicular transport and exocytosis. GMIP down-regulation induced RhoA activation and actin polymerization. Importantly, GMIP-down-regulated cells showed impaired vesicular transport and exocytosis, while inhibition of the RhoA-signaling pathway induced actin depolymerization and facilitated exocytosis. We show that RhoA activity polarizes around JFC1-containing secretory granules, suggesting that it may control directionality of granule movement. Using quantitative live-cell microscopy, we show that JFC1-containing secretory organelles move in areas near the plasma membrane deprived of polymerized actin and that dynamic vesicles maintain an actin-free environment in their surroundings. Supporting a role for JFC1 in RhoA inactivation and actin remodeling during exocytosis, JFC1 knockout neutrophils showed increased RhoA activity, and azurophilic granules were unable to traverse cortical actin in cells lacking JFC1. We propose that during exocytosis, actin depolymerization commences near the secretory organelle, not the plasma membrane, and that secretory granules use a JFC1- and GMIP-dependent molecular mechanism to traverse cortical actin.