Lamma has some 'interesting' characters, none more famous than, Bobsy Gaia, who owns Mana! Cafe in Staunton Street Soho and has a number of environmental and earthy/spiritual things going on.
My younger self very nearly moved to Lamma, but I decided on Sai Kung instead due to practicality reasons and at the end of the day, the lifestyle between Sai Kung and Lamma back then ( and mostly still is ) was pretty similar, minus not having a ferry timetable etc. These days Sai Kung due to its rampant population growth over the past 10 years has made it a pain in the arse in regard to parking ( not to mention traffic) a car out front of shops on the weekend, like you used to easily do during the first few years I moved there, now it is always a bit of a bone of contention.
If you like Island hopping, shopping in a smallish town where shop keepers will know you by name, seeing native herds of buffalo wandering the streets etc and easy access to nature right on your doorstep, then Sai Kung will provide you a nice buffer from the hectic nature that is Kowloon or HK Island during your OFF time. Plus living in a village house be it a single floor, a duplex or a full stand alone home is much more preferable than any apartment in my opinion as living space always mattered to me. Also the expat community in Sai Kung is quite obvious with a large percentage of long termer pre 1997 handover family's although of late even some of those have started to leave Hong Kong. Overall though, Sai Kung town has everything that an expat would typically want/expect in regard to various eateries, bars and leisure space. We loved living there as it allowed us to live in Hong Kong on our own ( preferable ) terms.
Lots of various critters in Sai Kung, you'll come across the odd snake, feral cows, Bamboo Spiders, barking deer, monkeys, bats, wild boar and porcupines, which is all part of the experience.