In a large mixing bowl combine dry cake mix, pumpkin pie spice, cinnamon, vegetable oil, and pumpkin puree. Stir together with a large spoon.
Place paper cups in a muffin tin pan and fill about 3/4 of the way with batter. Set aside.
In a separate mixing bowl combine flour, sugar, light brown sugar, pumpkin pie spice and melted butter. Stir to combine.
Spoon a generous amount of streusel crumb topping over the top of the muffins. Using the back of your spoon push the streusel down into the pumpkin cake mix a bit.
Place in the oven and bake at 350 degrees for 23-25 minutes.
In a separate bowl add powdered sugar and milk. Whisk to combine.
Remove muffins from the oven and allow to cool. Drizzle icing on the top and serve warm, or room temperature.