Nice place to visit...

but you wouldn't want to live there!

The Glass Castle
A Doll's House
Animal Farm
The Deep End of the Ocean
The Jungle

edited to fix touchstones

Behind the Scenes at the Museum by Kate Atkinson
The Fathomless Caves by Kate Forsyth
Ice Station by Matthew Reilly
Cathedral by Nelson DeMille
The Potato Factory by Bryce Courtenay

Molvania : a land untouched by modern dentistry, by Santo Cilauro
Highgate Cemetery, by Felix Barker (At least, not yet!)
Island Possessed, by Katherine Dunham
The Bloody Chamber, by Angela Carter
At the Mountains of Madness, by H.P. Lovecraft

Anywhere But Here with Anybody But You by Harlan Ellison
Where the Sidewalk Ends by Shel Silverstein
A Place of Safety by Caroline Graham
Aberystwyth Mon Amour by Malcolm Pryce
The Magic Toyshop by Angela Carter (as long as we go strictly by the title and not what it was in the book--then I wouldn't want to visit)

"But I wouldn't Want to Live There:" Wicked Wisdom From Seasoned Travelers
The Cardboard House
The Barnum Museum
The Heart of Darkness
The Last Days of Pompeii

Jurassic Park by Michael Crichton
The Lost World by Arthur Conan Doyle
The Shelters of Stone by Jean M. Auel
The Sands of Mars by Arthur C. Clarke
The California Deserts I actual did live in the high desert for 2 years. I absolutely hated it.

Streets of Laredo by Larry McMurtry
The Ice House by Minette Walters
A Desert in Bohemia by Jill Paton Walsh
At the Villa of Reduced Circumstances by Alexander McCall Smith
The Black Tower by P.D. James

The Restaurant at the End of the Universby by Douglas Adams
Northanger Abbey by Jane Austen
Jamaica Inn by Daphne Du Maurier
Bleak House by Charles Dickens
A Swiftly Tilting Plante by Madelein L'Engle

The Dead Zone - Stephen King
The Bad Place - Dean Koontz
Between Planets - Robert A. Heinlein
The Island Of Dr. Moreau - H. G. Wells
The House Without a Key - Earl Derr Biggers

The Bad Place by Dean Koontz
The Ruins by Scott B. Smith
Voodoo River by Robert Crais
Doorways in the Sand by Roger Zelazny
Mount Doom by Douglas Preston and Lincoln Child

The Birth House
Valleys of the Assassins
The Red Tent
The Fatal Shore
The Dominion of Wyley McFadden

Starting From San Francisco Lawrence Ferlinghetti
The Inner Voice Love Henri Nouwen
Zen Mind, Beginner's Mind Shunryu Suzuki
St. Petersburg: A Novel Andrei Bely
Sierra Nevada Natural History Tracy I. Storer
Trout Fishing in America Richard Brautigan

LOL...most of these places are definitely a "nice place to visit" but I wouldn't want to stay there. Here are mine:

Glass Houses by Rachel Caine
Gettysburg by MacKinlay Kantor
The Loch by Steve Alten
The Mists of Avalon by Marion Zimmer Bradley
Wuthering Heights by Emily Bronte

I could go on and on...

Dixie City Jam by James Lee Burke
Midnight Alley by Rachel Caine
Return to the Forbidden Planet by Bob Carlton
Canterbury Tales by Geoffrey Chaucer
The Telling Pool by Clement-Davies

Vinegar Hill by A. Manette Ansay
The Long Shadow of Little Rock by Daisy Bates
The Amber Room by Steve Berry
Grange House by Sarah Blake
A Complaint Free World by Will Bowen
I would like to be there!!

And a few more:
Love in Another Town by Barbara Taylor Bradford
Digital Fortress by Dan Brown
Tunnels of Terror by Patricia Edwards Clyne
The Narrows by Michael Connelly (Actually a name of a dangerous stretch of highway near Lewistown, PA)
The Body Farm by Patricia Cornwell

The Ice House by Minette Walters
Fun Home: A Family Tragicomic by Allison Bechdel
Home Girl: Building a Dream House on a Lawless Block by Judith Matloff
Bleak House by Charles Dickens
Middlesex by Jeffrey Eugenides

The Frozen Deep brrrr!
The Museum at Purgatory ...though, technically, you wouldn't actually live there
Tim Burton: A Child's Garden of Nightmares You probably wouldn't want to live in a garden of nightmares. Or in Tim Burton, for that matter.
The Willows in Winter again, brrrr!
The World of M.C. Escher Imagine the vertigo!

The Red Tent by Anita Diamant
Pet Semetary by Stephen King
Plum Island by Nelson Demille
The Jungle by Upton Sinclair
Harry Potter and the Deathly Hallows by J.K. Rowling