Your math is a tad off. The average PSL may have been $3,000 in 1995, but some were a lot more than that. Additionally, not all PSL owners bough in 1995, so you can't really divide by 32 years. The team is still actively selling them and the minimum price is now $3,000. There is alsoa very active secondary market. So there are fans who as recently as last season paid several thousand dollars per PSL.
But the biggest issue with the math is it assumes the PSL fee is all that was paid. The Purchase of the PSL obligates the owner to pay whatever price the team decides to charge for tickets, regardless of the teams performance for all 10 home games (yes, we have to pay full price for the 2 preseason games as well). We paid for all 10 games during the 1 and 15 season in 2001, and the 2 and 14 season in 2010. All the while, the price of those tickets going up 10 to 20% per year. Prices have risen over 400% in the 22 years the team has played in Charlotte.
The Panthers like to brag about the sellout streak, but without the contractual captives of the PSL owners, it would never have happened. Abandoning them to build a new stadium would be a mistake for any new ownership group.