Asides from them being expendable to Palpatine and Vader, they were still a serious threat to most opponents. We see them obliterated by characters like Ahsoka and Maul as they were not powerful enough to counter opponents of that level.
However, they were still formidable threats to most other Jedi such as Ezra and Kanan. The Grand Inquisitor was a superior combatant to Kanan, but a fearless Kanan instilled so much fear on the Grand Inquisitor that he was overpowered and defeated. But before then, Ezra and Kanan constantly struggled to survive duels against the Grand Inquisitor. They later found the same issues fighting the Fifth Brother and Seventh Sister on multiple occasions.