Just look at it from that perspective: he’s this older gentleman who’s fairly thin and frail. He’s fine with the political arena, but in the episode where Anakin had to save him from the Zillo Beast, he was helpless the entire time.
The other Jedi probably look down on him. Even Yoda was like “Jedi business, don’t worry about it.”
Are they ever worried about the Chancellor feeling inadequate because he’s a non-Force sensitive human? Did Yoda?