A young Tony Gonzalez or Antonio Gates he ain't. (Actually, Gonzalez has more yards, ypg and TDs, and by a significant margin.) He is also no Jason Witten or Jimmy Graham. New England has TWO guys better in Rob Gronkowski and Aaron Hernandez. Olsen is in that next tier, and that is fine, but that is not as good what the Panthers need. And even then, you have to consider that a good number of Olsen's catches and yards are due to his getting yards by default because the Panthers' WRs can't get open downfield.
Gronkowski and Hernandez put up huge numbers while coexisting with Wes Welker.
So, while other elite TEs are putting up over 700 yards on teams with 1 and possibly 2 WRs that are going to finish with over 1000 yards receiving, Olsen is putting up 600 yards where no WR is likely to get to 1000 yards (even if Steve Smith is putting on a late charge).
Instead of competing with several great options at WR for touches, Olsen gets a lot of balls thrown his way because no one is getting open or making plays downfield. Put Olsen on a team with better WRs (and a better OL that gives WRs time to finish their routes and separate downfield) and Olsen gets fewer looks and catches. The OL stinks, the defense has problems, but WR is still the biggest need for the Panthers this year. Fortunately, their draft position will give them plenty of options.