I have a similar story, except I went to my father after getting beat up. His response astonished me..."do you know how to hit?" I was floored. I expected my father, a fine Christian man, to tell me to just simply ignore the bully, to turn the other cheek. Nope, he gave me a five minute lesson on punching and he went back to work. I only hit that bully one time and never had another problem in that group of friends ever again.
A few years after this we were playing football (American) and one of the older boys didn't like that I was better than him. The fact that my family's income was orders of magnitude less than his didn't make this easier for him (he was raise to think he's the best at everything). So he started leading his team in chants about killing me and other various things, trying to get the rest of the team to kill me no matter which way the ball went. So every time I touched the ball I ran straight at him trying my hardest to run him over. He quickly stopped leading the chants and sending his thugs after me after he got thumped a few times. After that, I just ran away from him...usually past him for a touchdown. The only way he could claim victory was by trying to get everyone to quit with him...didn't work.
Third and final story. So I'm playing basketball at the gym at Purdue University. A guy on the other team was a major cock who thought he was all that and a little more and enjoyed telling everyone that he was an awesome player. During the game he led a fastbreak and almost dunked, but his team ended up losing just barely. Trying to show that his team's failure was not his fault, after the game he does a one-handed dunk. I grab a ball, and do the same thing. He then does a two-handed dunk...I do the same. It's now a classic pissing contest. He then tries to do a two-handed reverse dunk and completely makes a hash of it...I calmly grab his brick and do a perfect two-handed reverse dunk. Everyone laughed him off the court. I have never been able to repeat those dunks ever again. I only pulled those dunks off because of my momentary hatred of this guy that thought he was better than everyone else.
Mind you, these are basically just examples of the classic knuckle dragging bully. They usually just need one quick knock on the head (in whatever way is needed) and they go away. Simple directed aggression (not always violence) works wonders. If they cannot assume a position of power, they will leave to find a simpler target.