William Robert Livingstone, 60, of Bathgate, West Lothian, appeared on petition at Livingston Sheriff Court.
In addition to the two alleged rapes he was accused of two charges of lewd and libidinous practices.
He also faced three charges under the Section 6 of the Criminal Law Consolidation Act 1995 which allege lewd and libidinous behaviour towards girls over the age of 12 and under 16-years-old.
Livingstone made no plea or declaration during the private hearing and was remanded in custody. His next court appearance is expected to be within eight days.