The incident happened sometime between 2.30pm and 3pm on Thursday, October 18, outside the Grange Place shops in Stamford Road, Kettering.
The men in the car stopped to ask the woman if she was ok and officers are asking them to contact the police.
Anyone with information can contact Northamptonshire Police on 101 or Crimestoppers anonymously on 0800 555111.