Minecraft Server Connection Issue

I have very bad ping on one specific server in Minecraft. Usually it's an internet problem, but my ping is completely fine on other servers. It isn't the server's issue either, as the tps is not a 20, more of a 17-16ish, but other people on the server, even from the same region I am living in, and better ping and more stable ping. Anyone know what is happening here and suggested fixes? If any more details needed, I will provide what I can.