A Little Madness to Be Free is the sixth album by Australian band the Saints. This time around, frontman Chris Bailey persuaded original members, Kim Bradshaw (bass) and Ivor Hay (drums), to rejoin the band. On the album tour, the bass player was Tracy Pew, formerly of the Birthday Party. The title of the album is a reference to the quote "A person needs a little madness, or else they never dare cut the rope and be free," by Kazantzakis. The album saw the Bailey moving further towards more ambitious arrangements including horns and strings. Bailey stated in a retrospective interview about this approach that he wanted to "make strings as powerful as Les Pauls and Marshalls".
Retrospectively, All Music gave the album a positive review writing "By this point in his career, Bailey had come into his own as an arranger and it really shows. Certainly one of their most obscure discs, but ultimately as rewarding as their classics I'm Stranded, Eternally Yours and All Fools Day.". The Guardian cited "Ghost Ships" in their The Saints: Their Five Greatest Moments retrospective.
In the Encyclopedia of Australian Rock and Pop, Ian McFarlane said the album was "more rock-orientated, with extensive use of acoustic guitar, brass and strings set among tightly-focussed arrangements. With Bailey's booming, bluesy voice in fine form, it may well constitute his most fully realised project."
All tracks composed by Chris Bailey
The French label New Rose released an alternate track listing included an extra track "Heavy Metal" and an omitting "Wrapped Up and Blue".