The 19-year-old limped out of the Europa League encounter with the French side having been fouled winning Celtic a penalty to go 2-1 up.
The Dutch-born speedster was caught on the foot as he went to strike for goal and was in visible discomfort as he was helped from the field.
This could be a significant blow for the Scottish champions who already have their injury woes on the flank. Frimpong was playing right midfield in part due to the ongoing absence of James Forrest, who has yet to return to training after suffering a stress fracture on his ankle earlier in the campaign.
Celtic have a huge heavy run of fixtures coming up as they look to cut the gap at the top of the Scottish Premiership. They also face Hearts in the 2019/20 Scottish Cup final in ten days time.