There's a book of atheist writings from HP Lovecraft I'm currently reading and have found it very interesting.

There's some very good quotes and essays in it.

It's really interesting reading Lovecraft's perspective on mysticism, especially since his stories are all written as Folklore & mythical tales that come about as a result of people going into the fringes.

His writing style draws you in, even when talking about philosophy and logic.