Imagine driving on the freeway. A car passes you and holds your attention as you wait to see if it will cut in front of you. Even if you briefly close your eyes or shift your gaze elsewhere, you are able to maintain the car’s location in mind and are surprised if it changes unexpectedly. This relies on visual working memory (WM), the ability to maintain images in mind in their absence. Decades of evidence points toward prefrontal cortex (PFC) as a key node in the cortical network underlying WM (D’Esposito and Postle, 2015; Funahashi et al., 1989; Fuster and Alexander, 1971; Miller et al., 1996; Romo et al., 1999; Ungerleider et al., 1998; Voytek and Knight, 2010).