Dysart Community Council in Fife erected the two banners last week to promote the fact that scenes from the second season of the hit series had been filmed in the area.
But in less than 24 hours the posters had disappeared and it was at first suspected the culprit was an overzealous Outlander fan.
However, the village council soon found out the mystery removers were actually Fife Council who removed the signage because they weren’t contacted beforehand.
They also claimed the well intentioned gesture had “contravened traffic regulations” as they were too close to fast moving traffic.
Eunice Cameron, secretary of the community council, said: “I understand that I may have contravened some law, but I think the law’s an ass in this case.
“I was extremely annoyed. They hadn’t contacted me to tell me they had removed them, even though even though it states quite clearly that they were put up by the community council.
“I made sure they were secure and wouldn’t be a disturbance to drivers by flapping about in the wind.
“The whole idea is to encourage visitors to visit the village, we want them to see what else Dysart has to offer.
“How can we advertise without signs? Can someone at the council explain that to me.
“I feel sorry for all the business owners who gave us £20 each to have their names on the sign. I feel like we’ve let them down and they’ve been conned.
“I didn’t think a couple of banners would cause all this bother. I’m really annoyed.”
Fans traveled from all over Scotland to Dysart last year after film crews moved into the area to begin filming the second series of Outlander.
The picturesque harbour was transformed into a film set by removing lamp posts, adding smoke machines and extra lighting to create the authentic looking scenes.
One of the community council’s banners was removed from Ravenscraig Park, near to where crews began their filming last June.
Dozens of delighted fans were able to watch Sam, who plays heart-throb Jamie and his wife Claire, played by Caitriona Balfe, filming a tender scene as they arrive in the French port of Le Havre.
The scene is set to be shown in the current season of Outlander which was aired earlier this month.
Fife Council now plan to return the banners which local businesses paid £20 each to feature on.
But they will be advising DCC where in the village they are allowed to hang them.
Councillor Kay Carrington said: “The Roads (Scotland) Act 1984 states no advertising banners can be erected within 15 metres of the highway, so unfortunately they contravened traffic regulations.
“I’ve now got the banners back from the council which i will return to the community council, and we can see where we go from there.
“There’s a correct way to do things and DCC needed to get permission so I think in this case lessons need to be learned.”
Councillor Neil Crooks, chairman of Kirkcaldy Area Committee, said: “We’re supportive of any initiatives to encourage visitors to our towns and villages and we have a tourism summit planned for later this month.
“I did not see the banners personally but council officers determined they were sited at inappropriate locations and without permission so they had to be removed.
“I am sure this was done with the best intentions but Fife Council had no option but to remove these banners.”