Loud SilencesLoudSilences
← All articlesThe Slow No

The "Difficult" Label

9 min read

You find out sideways, which is how it always goes.

Maybe it’s in a review, buried in the soft language they use for the things they don’t want to defend. “Some people have found you a little difficult to work with.” Maybe it’s worse, a friend on the inside who tells you, carefully, that your name came up in a meeting and that word was attached to it. Either way, it lands in your chest like a stone, because you know exactly what it is and exactly what it does, and you know there’s no clean way to answer it.

Because here’s the thing about “difficult.” It’s never attached to an event. Nobody says “she was difficult when she pushed back on the timeline that was going to blow up the launch.” They just say she’s difficult, full stop, as a fact about you, floating free of anything you actually did. And a fact about you is much harder to argue with than a thing you did.

So you go home and you do the worst part. You start editing yourself in your own head.

You already know it’s not the behavior

Let’s start where you already are, because you’ve done this math a hundred times.

You’ve watched a man in your meeting say the exact thing you said, in the exact tone, and get called direct. Decisive. Someone who really challenges the team. You’ve watched a man send the blunt email, push back hard in the room, refuse to soften an unpopular truth, and walk away with his reputation not just intact but enhanced. He’s a straight shooter. He doesn’t suffer fools. He tells it like it is.

You did the same thing and became a problem.

The behavior isn’t what got labeled. You did.

This is the part that makes the label so maddening. If it were about what you actually did, you could adjust what you do. But it isn’t, so you can’t. You could match your calmest, most reasonable male colleague sentence for sentence and still walk out of the room as the difficult one, because the grading was never about the sentences.

Why it sticks to you and not to him

Here’s the mechanism, because understanding it is the first thing that loosens its grip.

“Difficult” is not a measurement of behavior. It’s a measurement of the distance between your behavior and what people expected from you. And the expectation is the part nobody says out loud.

A man being direct is meeting the expectation. People walk into the room already prepared for him to be assertive, to take up space, to push. When he does it, the prediction comes true, and a confirmed prediction reads as competence. He’s just being who he’s supposed to be. There’s no friction, because there’s no surprise.

A woman being direct is violating the expectation. The room walked in primed for warmth, for accommodation, for a lighter touch, and when you don’t deliver it, the mismatch registers as a problem. Not a problem with the expectation. A problem with you. The same assertiveness that confirmed his competence becomes evidence of your attitude, because it broke a rule you never agreed to and were never told about.

Researchers have a dry name for this. The likeability penalty. Study after study finds that as women are seen as more competent and more assertive, they are simultaneously seen as less likeable, and the two move together in a way they simply don’t for men. A man can be respected and liked at the same time. A woman is very often asked to pick one, and then punished for whichever she picks.

You’re not being graded against your peers. You’re being graded against a template you didn’t write and can’t see.

And once the label is on you, it becomes self-reinforcing, which is the cruelest part. Because now every direct thing you do gets filed under the story that already exists. He pushes back and it’s a data point. You push back and it’s a pattern. The label doesn’t just describe how they see you. It changes how they interpret everything you do next.

The label has a wardrobe

One of the reasons “difficult” is so slippery is that it rarely shows up wearing its own name. It has a whole closet of respectable-sounding outfits, and learning to recognize them is half the battle.

“Abrasive.” Applied to women roughly a hundred times more often than to men in performance reviews, and almost never tied to a specific thing you can fix.

“Not a team player.” Usually means you declined to absorb work that wasn’t yours, or you said no to something, or you protected your people instead of falling in line.

“A lot.” A whole personality reduced to a complaint. Too intense, too ambitious, too present, too much. Nobody has ever told a man in a strategy meeting that he was a lot.

“Lacks executive presence.” The most expensive one, because it sounds like a real, coachable gap, and it’s almost never defined. Ask five people what it means and you’ll get five answers, and every one of them will quietly describe a specific way of moving through the world that looks like the men already in charge.

“Rubs people the wrong way.” Which people? Rubbed how? It doesn’t matter, because the sentence is designed to be unanswerable. It’s a verdict wearing the costume of an observation.

None of these are feedback. Feedback points at a behavior you can change. These point at you.

Once you can hear the label under its disguises, it loses some of its power, because you stop trying to fix a thing that was never described to you in the first place.

Why softening is a trap

The instinct, when the label lands, is to make it go away by becoming smaller. Warmer. More agreeable. You start prefacing your points with apology. You add the smile, the “just,” the “I could be wrong, but.” You let the bad idea slide because dying on the hill isn’t worth the reputation cost. You dial yourself down, degree by degree, hoping that if you’re pleasant enough for long enough, the word will detach from your name.

It won’t, and here’s why. The problem was never your volume. It was the mismatch between who you are and what they expected. Shrinking doesn’t close that gap. It just makes you a smaller, quieter version of the same violation, and now you’ve paid twice, once in the label and once in the piece of yourself you filed down to escape it.

And there’s a hidden cost to the softening that nobody warns you about. The qualifiers and the apologies that you add to seem agreeable are the exact same words that make you easy to overlook, easy to talk over, easy to leave off the promotion list. You can spend years making yourself more palatable and discover at the end that all you did was make yourself easier to ignore.

You cannot shrink your way out of a bias you didn’t create. All you lose is the space you were standing in.

What it costs if you let it sit

Left alone, the label doesn’t stay a word. It becomes a ceiling.

It shows up in the review that caps your rating, in the promotion that goes to someone more “collaborative,” in the stretch project that goes to someone “easier to work with.” It shows up in the meeting you’re quietly left off, framed as protecting your time. And it shows up inside you, as a low hum of second-guessing that runs under every room, so that you’re never fully in the conversation because part of you is always monitoring how you’re landing.

And if you ever do get defensive about it, the defensiveness gets read as proof. See? Difficult. It’s a trap with the door on the inside.

What I learned to do about it

You can’t fix the expectation in other people’s heads on your timeline. But you are not helpless here, and I learned each of these the slow, expensive way, so you don’t have to.

Make the label specific, out loud, every time. It took me years to stop flinching when the word landed and start asking, calmly, “Can you give me a specific example?” Then waiting through the silence. Nine times out of ten there isn’t a clean one, and the asking is what exposes that. It isn’t combative. It’s the most reasonable thing in the room, and reasonable is the one thing the label can’t survive contact with. Vague accusations only live in the dark. I wish I’d started turning on the light a decade sooner.

Keep your own books. For a long time I absorbed every reaction as a fact about my character, and it quietly wrecked my confidence. What changed things was mundane. I started writing it down, privately, with dates. The same action, praised on him, penalized on me. Not to build a case against anyone. To prove to myself there was a pattern, so I’d stop believing the label. Belief is the only part of this that actually slows you down, and a written record is how you starve it.

Build the people who reframe you. I learned this one last, and I wish it had been first. For years I tried to fix the label myself, louder, then softer, then buried in evidence, and none of it moved the needle. What finally moved it was someone with standing saying, in a room I wasn’t in, “she’s not difficult, she’s the only one who’ll say the hard thing.” Reputations get rebuilt by other people’s mouths, not your own. So I stopped auditioning and started earning sponsors, and I became one for the women coming up behind me.

Choose the hill on purpose. Early on I pushed on everything, and all it did was feed the story. The lesson was to aim. Spend your directness where it actually matters and let the small things go, not to shrink, but to save your credibility for the fights that count. Mute the noise, keep the signal. A woman who’s pointed about the things that matter and easy about the things that don’t is very hard to file as simply difficult.

And read the organization itself. This is the one I paid the most for, because I stayed too long somewhere convinced I could earn my way out of the label. I couldn’t. If “difficult” is what a place calls every woman who leads, that isn’t feedback about you. It’s a map of who they promote and who they manage out, drawn before you ever walked in. Believe the map, and don’t spend years arguing with it the way I did.

The last lesson, and the hardest one

This is the one that took me the longest to make peace with, because a piece that told you it’s always bias would be lying, and you’d know it.

Sometimes the feedback is real. Sometimes we are sharp with people in ways that cost us and them, and the label is the clumsy, cowardly way an organization delivers a note it should have delivered cleanly years ago. The tell is specificity. Real feedback comes with an example, a moment, a behavior, and a path. “In that meeting, when you cut Sam off three times, it shut the room down,” is something you can hold, examine, and decide to change. “People find you difficult” is not. It’s a verdict with no evidence attached, and you’re allowed to treat it as exactly that until someone shows you the moment.

So take the specific and leave the vague. Grow where there’s a real edge to grow on, and refuse to sand yourself down for a phantom. Knowing the difference is the whole skill.

The goal was never to be liked by everyone. It was to be respected by the people who matter, and to stop paying a tax that was never yours to pay.

You are not difficult. You are direct in a room that was expecting something softer, and the gap between those two things was never your job to close by disappearing. Keep the edge. Aim it well. And spend your career, when you can, in the rooms where it reads as exactly what it is.

Comments

Say the quiet part. Alias optional. We review before it goes up.