Quarrelwood Castle was a medieval castle located about north-west of Elgin, in the parish of Spynie, Moray, Scotland (OS ).
The castle was built in the 14th century by Robert Lauder of the Bass, Justiciar of Scotia. It passed by marriage of Robert's daughter Ann to Robert Chisholm. The castle later passed through the marriage of Muriel, daughter of John Chisholm and Catherine Bisset, to Alexander Sutherland, 3rd of Duffus in the 15th century. It was briefly held by William Duff of Dipple before passing by the marriage of his daughter to William Sutherland of Roscommon.
Quarrelwood was occupied until the mid 18th century, afterwards becoming ruinous and was dismantled and used for building materials in the area.