Mark D. O'Neill, 44, was wearing a mask and a glove on one hand ran into the Chase Bank on Franklin Lake Road on April 20, Detective Lt. John Bakelaar said.
Seeing all the tellers behind security glass, he ran out, Bakelaar said.
Employees described him as white, about 6 feet tall and wearing the mask, glove, a black hooded sweatshirt and black jeans.
O'Neill was being held in the Lowndes County Jail in Hayneville, Alabama, awaiting extradition to New Jersey to face attempted robbery charges.
Click here to follow Daily Voice Fort Lee and receive free news updates.