Preheat the oven to 425°F. Line a standard muffin pan with muffin liners.
In a large mixing bowl, whisk together 3 cups of all-purpose flour, 1 tablespoon baking powder, 1 tablespoon ground ginger, 1 tablespoon ground cinnamon, ½ teaspoon nutmeg, ½ teaspoon cloves, and 1 teaspoon kosher salt.
In a separate large mixing bowl, whisk together 1 cup melted butter, ½ cup granulated sugar, and ¾ cup dark brown sugar. Add 3 eggs and whisk until combined. Mix in 1 cup sour cream, ½ cup molasses, ⅓ cup whole milk, and 2 teaspoons vanilla extract until smooth.
Gradually add the dry ingredients to the wet ingredients, gently folding with a spatula until just combined. Be careful not to overmix the batter.
Let the muffin batter rest for 10–15 minutes while you prepare the filling.
In a medium mixing bowl, beat 1 softened 8-ounce block of cream cheese until smooth. Add ⅓ cup powdered sugar, 1 teaspoon vanilla extract, 1 egg yolk, 2 tablespoons eggnog, and a pinch of salt. Mix until creamy and fully combined. Transfer the filling to a piping bag or a gallon-size Ziploc bag and snip off a small corner.
Divide the gingerbread muffin batter evenly among 18 muffin liners, filling each approximately ¾ full. Insert the tip of the piping bag into the center of each muffin and gently squeeze to pipe the eggnog cream cheese filling into the middle.
Bake at 425°F for 5 minutes. Without opening the oven door, reduce the temperature to 350°F and continue baking for approximately 13–17 minutes, or until the muffin portion is baked through. Avoid inserting a toothpick directly into the cream cheese filling.
While the muffins bake, prepare the cinnamon sugar coating by combining ¾ cup granulated sugar, 2 teaspoons ground cinnamon, and ½ teaspoon ground ginger in a shallow bowl.
Allow the muffins to cool slightly, then brush the tops and sides with 4 tablespoons melted butter. Roll each muffin in the cinnamon sugar mixture until generously coated.
Enjoy warm or at room temperature! Store leftover muffins in an airtight container in the refrigerator because of the cream cheese filling.