Microglia, the resident immune cells of the brain, have emerged as crucial regulators of synaptic refinement and brain wiring. However, whether the remodeling of distinct synapse types during development is mediated by specialized microglia is unknown. Here, we show that GABA-receptive microglia selectively interact with inhibitory cortical synapses during a critical window of mouse postnatal development. GABA initiates a transcriptional synapse remodeling program within these specialized microglia, which in turn sculpt inhibitory connectivity without impacting excitatory synapses. Ablation of GABA_B receptors within microglia impairs this process and leads to behavioral abnormalities. These findings demonstrate that brain wiring relies on the selective communication between matched neuronal and glial cell types.