Preheat oven to 325ºF and grease a 9x5 inch loaf pan very well.
In a medium bowl, whisk together the almond flour, coconut flour, baking powder, and salt.
In a large bowl, beat the butter and Swerve together until lightened and fluffy. Beat in the eggs until well combined, then beat in half of the almond flour mixture. Beat in the almond milk, lime juice and lime zest, then beat in the remaining almond flour mixture.
Transfer to the prepared loaf pan and cover with foil after 45 minutes. Bake at least 1 hour, or until edges are golden brown, the top is firm to the touch, and the middle is cooked through. Remove and let cool in the pan 15 minutes, then flip out onto a wire rack to cool completely.
Glaze
Whisk the confectioner’s Swerve and lime juice together until smooth (should be somewhat runny). Drizzle over the cooled cake.