Preheat oven to 350ºF. Coat an oven-safe skillet with nonstick spray (see notes for size).
In a medium bowl, whisk together flour, salt, baking powder, and baking soda.
In a standing mixer with the paddle attachment, or with a hand-held electric mixer, cream butter and both sugars on medium-low until and pale and fluffy, about 5 minutes.
Add peanut butter and vanilla and mix until incorporated. Increase speed to medium. Add eggs, one at a time, and mix until uniformly combined.
Reduce heat to low. Add the flour mixture and mix until just incorporated.
Meanwhile, open both packages of TURTLES® Candies and unwrap individual candies. Reserve half in whole form and chop the rest.
Fold the chopped TURTLES® Candies into the batter. Scrape batter into prepared skillet. Bake 30 to 40 minutes or until Pizookie is lightly browned on top.
Cool 5 minutes before serving with ice cream and caramel sauce if desired, garnishing the Pizookie or individual servings with the remaining whole TURTLES® Candies.