Before that match though, they have the chance to deliver another cup red-letter day tomorrow when they can secure a place in the Image Printers East of Scotland Qualifying Cup final if they can beat Tynecastle at Ferguson Park.
Reflecting on last weekend's 4-3 Scottish Cup victory over Wick Academy, Cavanagh said: "I am delighted for the players and backroom staff that we are in the next round because we knew it would be tough against very good Highland League opposition. We got ourselves into a commanding lead at 4-1 but Wick gave themselves a lift and got right back into the game and it was a battle to the end." Turning his attention to tomorrow's semi-final, Cavanagh said: "This is another huge game against tough opposition as they proved to be only a few weeks ago when we beat them 2-1. We don't expect anything different and we all must be up for the challenge. No doubt Tynecastle will feel that they have a point to prove after leading in that game but, if we stick to our game plan and play as I know we can, then we should be okay. The pitch could be very heavy which does not particularly suit us but we just have to get on with it.
"We were scintillating for the first 15 minutes of the second half last week against Wick and Daryl Devlin scored what was probably the best goal in Scotland that day." Cavanagh has slight injury concerns regarding Jordan Hall and Scott Gormley but is hopeful that both players will be available.
Meanwhile, the Tynecastle manager Murray Balloch was still savouring last Saturday's impressive 3-1 win away from home against high-flying Stirling University when they trailed 0-1 at half-time. "We had actually played quite well in the first half and created some good chances but unfortunately did not take them.
"I genuinely thought that we could improve in the second half by changing a particular tactic. We decided not to go through midfield as much and be a little more direct which meant we put Stirling under a lot of pressure. We then scored goals at the right times in what turned out to be a very hard fought game. We had to bring in a few young players because of injuries and everyone battled for each other."
However, it was not a youngster who had a major say in the game but 42-year-old coach David Bingham who was called into action and played the entire game as well as scoring the decisive third goal.
"Bingo had no intention of playing this season but we had only one recognised striker - Wayne McIntosh - available so we had to start Bingo. He adds that bit of quality and makes things out of nothing. He played really well and that is a credit to him.
"We now face Whitehill and all this week the players have been bouncing at training and tomorrow cannot come quick enough. My only headache, now that some of the injured players are available, is ‘do I change a winning side or stick with the one that did so well last Saturday? The league pressure is off us tomorrow and to get to a cup final would be very good and give everybody connected with the club something to look forward to.
"I asked Bingo at training last night if his legs were up to another 90 minutes and he just looked at me as if to say ‘you're mad' but it's hard to change a winning side."
Paul Devlin as available after missing last weekend while Steven McKenzie, Dale O'Hara, Eddie Mearns and Gareth Thom are all in the doubtful category.
The game kicks off at Ferguson Park at 1.30pm with extra time and penalties, if necessary. Admission charges are adults 4 and concessions 2.