Preheat the oven to 350 degrees F (175 degrees C). Grease a 9x5 inch loaf pan.
In a small bowl, mix together the white sugar, brown sugar, cinnamon, and nutmeg.
In a large bowl, whisk together the flour, baking powder, baking soda, and salt. Stir in the butter, buttermilk, and egg until just combined.
Spread half of the batter into the prepared loaf pan. Sprinkle with half of the sugar mixture. Layer the apples over the sugar mixture, then sprinkle the remaining sugar mixture over the apples. Top with the remaining batter.
Bake for 45 to 50 minutes, or until a toothpick inserted into the center of the loaf comes out clean.
Remove the loaf from the oven and let cool for 10 minutes before serving.
Interesting Facts
Apple fritters have been around since the 16th century, when they were a popular breakfast item.
The original apple fritters were filled with apples and spices, then deep-fried in lard.
Apple fritter loafs are a great way to use up any leftover apples that may be in the house.
Apple fritter loafs freeze and reheat well, making them a great snack for any time of the day.