I suspect spam from competitive

I suspect spam from competitive

Hello everyone.
I have a website was in the first result in certain keyword in my country. I was always Compete with one website and result keep moving between first and second search result. after a period my result become the second and the third today the fourth one only during last  days.
I suspect spam from certain competitive. how I know for sure and how can I remove spam link if any?
Thanks.