Reheat the oil to 350°. In a mortar, pound the garlic with the rosemary and a pinch of salt until a paste forms. Fry the potatoes in batches until golden and crisp, about 5 minutes.