In a blender, combine the peaches, banana, milk, yogurt, honey, cinnamon, and ginger, if using. Blend on low to break up the peaches, stopping to scrape down the sides of the blender, as needed.