Head of Wallace Bay is a community in the Canadian province of Nova Scotia, located in Cumberland County .