Start by brewing a strong cup of coffee or pulling two shots of espresso, whichever you have on hand. I like using a darker roast here because it holds up better against the cocoa and pumpkin spice. Set it aside while you work on the base so it stays hot and ready.
In a small saucepan over low heat, whisk together the cocoa powder, pumpkin puree, pumpkin pie spice, and brown sugar. Keep whisking for about a minute until everything turns into a smooth, glossy paste. This step is where all the dessert-like flavor actually comes from, so don't rush it.
Pour the milk into the same saucepan and whisk it into the pumpkin cocoa mixture until fully combined. Heat gently for 2 to 3 minutes, stirring often so nothing sticks or scorches at the bottom. Once it's steaming, use a frother or blender to give it a light, airy foam.
Divide the warm pumpkin milk mixture evenly between your two mugs, then pour the hot coffee or espresso on top. Stir in the vanilla extract so the flavors blend smoothly instead of sitting in separate layers. Give it a taste and adjust the sweetness if you like things a little richer.
Finish each mug with a generous swirl of whipped cream if you're using it. Sprinkle a pinch of cinnamon or a dash of extra pumpkin pie spice right on top for that bakery-style look. Serve immediately while it's still warm and the foam is fresh.