Bedelia Carrington is living happily, it appears, in Monte Carlo with her husband Charlie Carrington. But a cultivated young artist, Ben Chaney, begins probing into her past with curious concern. Chaney, who is really a detective, learns that Bedelia's obsession for money has led her, in the past, to husband-poisoning for the insurance money.

The year is 1880. On the outskirts of the fictional small Scottish town of Levenford there stands a strange building, half cottage, half castle, embraced with thick stone walls. The townsfolk nickname the fortress "Hatter's Castle", for James Brodie, the man who built it. Brodie is a hatter who keeps the members of the family in fear and submission; he is brutal, arrogant, selfish and cruel. His wife, who has long been ailing, and his daughter Mary, are in awe of him. His son Angus, aged 15, alone dear to his heart, suffers under his love as the others suffer under his sternness.

Set in an apartment building whose occupants include Arthur Earthleigh, a meek and mild type married to the beautiful-but-domineering Mae; a Bohemian artist, David Galleo and his always-there model, Deborah Tyler; and Olive Jensen, a Greenwich Village type who is always slightly-but-continuously inebriated, and whose motto is "love and let love." She calls on George while his wife is out, and when she passes out during his attempts to get her out before his wife returns, he thinks she is dead and deposits her on Galleo's terrace. Galleo takes advantage of the situation by using it in a blackmail scheme against Arthur, which is shaky, at best, as Olive refuses to stay dead.

Davey Fenwick leaves his mining village on a university scholarship intent on returning to better support the miners against the owners. But he falls in love with Jenny who gets him to marry her and return home as local schoolteacher before finishing his degree.