I dont know how you feel about the 'moving wall' but by opening and closing a 'window' you can move the settlers back and forth. You can collect a dozen settlers on a good day then grab them all when you're ready.
It IS a bit of an exploit though....