Are they not the ones who blaspheme the honorable name by which you were called? (ESV)
There is a lot of talk these days about bullies. Most elementary schools have strict rules about bullying. Yet, with all of the rules in place, there will always be bullies. We see bullies in the political realm. We work with bullies. We encounter them in virtually every area of our lives. Truth be told, you and I have probably been bullied, and we have probably bullied others at some time.
James is describing some bullies that the church was dealing with. They were the rich ones mentioned a few verses ago that were being given preferential treatment in the church. Part of the reason why they were getting such treatment may have been because members of the church were afraid of them. They may have sought to appease them.
We get a better glimpse of what kind of bullies the church was dealing with as James talks about them blaspheming the honorable name of Jesus Christ. I can tell you that I can tolerate almost any kind of vulgarity that comes out of people's mouths. But when they blaspheme the wonderful name of Jesus it is infuriating to me.
Jesus was not surprised by this behavior that the church was having to deal with. He actually had given the church a warning about these kinds of bullies. Jesus himself had to deal with his share of bullies. The Pharisees were the bullies he had to deal with during his time on Earth. He gave a warning that the bullies would keep harassing the church just as they harassed him.
 They will put you out of the synagogues. Indeed, the hour is coming when whoever kills you will think he is offering service to God.  And they will do these things because they have not known the Father, nor me.  But I have said these things to you, that when their hour comes you may remember that I told them to you.
There will always be bullies. We should not give them preferential treatment. Fearing them only makes them stronger. Stand strong for truth and draw close to Jesus Christ. That is the solution.