Glassdoor Salary Data: Worse than useless

In the June 5, 2018 Ask The Headhunter Newsletter we shake up salary negotiations and take down the Glassdoor myth.

Question

glassdoorI know you don’t like Glassdoor’s salary survey data and employer reviews, but what are we supposed to use to base our salary negotiations on? I’m talking about job seekers.

Nick’s Reply

If you’ve ever used Glassdoor salary data to help you negotiate a job offer, did you wonder whether you might have under-sold yourself? According to a report in the June 2018 Wired magazine by Rachel Nuwer, Silicon Valley’s Exclusive Salary Database, you might have left an additional 69% on the table.

Wired tested samplings of self-reported Glassdoor salaries against Option Impact — a robust database of salaries reported directly by employers — and found glaring discrepancies. Option Impact is published by Advanced-HR for “elite users” — primarily venture capital firms and the tech companies they fund. These startups (and the investors behind them) can’t afford to make mistakes when competing for top talent, so they consent to share up-to-date salary information that Advanced-HR checks regularly.

In other words, unlike Glassdoor, which makes money off its data whether it’s accurate or not, Advanced-HR has a reputation to protect among VCs and the startups they run, and among the consultants and lawyers who serve them.

QA Engineer with 1 to 3 years’ experience

Option Impact: $101,955 (+43%)
Glassdoor: $71,004

Nuwer cites the example of a software engineer who got access to the database with his previous employer’s login. “Steve” turned down a handsome job offer of $180,000 that he says he would have gladly accepted — had he not learned from Option Impact that the reported market salary for that job was a lot higher. “His eventual starting salary: $205,000.”

The Glassdoor myth

I’m forever astonished at how easily people rationalize irrational behavior. Job seekers generally acknowledge that salary data and employer reviews on the popular Glassdoor website are biased and often phony. (See Can I trust Glassdoor reviews?) The salaries are questionable at best because they are self-reported. The web is rife with stories about HR managers and employers posting fake reviews to “balance” spiteful reviews from disgruntled employees.

Data Scientist with 4 to 6 years’ experience

Option Impact: $132,536 (+3%)
Glassdoor: $129,118

Yet I hear this all the time: “Well, I know all that, but you can still get a good idea about a company and what it pays by looking through all the information.”

No, you can’t.

Glassdoor admits it publishes, uh, crap

If you know some of the data are invalid but don’t know which, then it’s imprudent to trust any of it. Yet job seekers and employers peg their salary negotiations to anonymous Glassdoor “salary data” as if it’s a gold standard.

Glassdoor itself is clear in its Terms of Use that it doesn’t stand by anything posted by users or employers — that is, all its salary and company reviews:

“Because we do not control such Content, you understand and agree that: (1) we are not responsible for, and do not endorse, any such Content, including advertising and information about third-party products and services, job ads, or the employer, interview and salary-related information provided by other users; (2) we make no guarantees about the accuracy, currency, suitability, reliability or quality of the information in such Content; and (3) we assume no responsibility for unintended, objectionable, inaccurate, misleading, or unlawful Content made available by users, advertisers, and third parties.”

Sheesh. “Information” on Glassdoor is a myth. “Information” on Glassdoor is crap. What’s stupefying is that the company manages to survive and prosper by selling disclaimed “content” to suckers.

Glassdoor Salary Data: Worse than useless

The Wired report provides evidence suggesting Glassdoor’s salary data are worse than useless. The data are dangerous because they can actually cost you salary dollars when you decide how much to ask for. The job you’re negotiating for might be worth much more than the salary Glassdoor is “not responsible” for telling you it is.

Project Manager with 4 to 6 years’ experience

Option Impact: $137,000 (+66%)
Glassdoor: $82,403

Wired reports that the company behind Option Impact, Advanced-HR, doesn’t compile its salary data from employees who report it themselves — possibly fudging it. Advanced-HR gets it from the employers themselves.

“Companies share their employees’ anonymized salaries in exchange for access to the vault, which is searchable by job title, location, company size, revenue, and funding stage.”

Why would a company tell the truth about what it pays? Probably because Option Impact is an exclusive club and because these companies know venture capital (VC) firms rely on the data.

(Of course, not every job and industry is going to be in any salary database, including Option Impact, and all the general criticisms of survey data apply, including, Are we talking about the exact same jobs? I’m not suggesting Option Impact is the answer — just that it’s a fatal counter-example to Glassdoor’s swill pot of whatever anyone wants to pour into it. Advanced-HR demonstrates that there are other ways to do this.)

How can you get access to Option Impact?

Unless you’ve got access to some venture investment firm’s login, you’re not going to have access to the data that enabled Steve to get a 23% higher salary than he might have without Option Impact data at his finger tips.

Designer with 4 to 6 years’ experience

Option Impact: $126,125 (+69%)
Glassdoor: $74,591

So what’s my point, if you can’t get this data? It’s that if you trust your salary negotiations to salary data that you know is self-reported, unverified, untrusted, disclaimed and admittedly inaccurate (Thanks for the full disclosure, Glassdoor), you may be hurting yourself.

How can you get access to higher job offers?

Forget about getting your hands on valid salary data. It’s probably not going to happen. You’re not a VC or the CEO of a tech startup, and you probably can’t afford such exclusive insider data.

Instead, focus on the red meat of any job interview — be ready to show a hiring manager how you’re going to help drop additional profit to the bottom line if you get hired. Then you can ask for more money.

That’s a tall order, and there’s no short-cut. It’s why we’ve been talking about how to do it across hundreds of these Q&A columns. For example:

When a salary data vendor tells you it does not control the inaccurate, misleading information that it denies responsibility for, listen.

How do you know how much a job is worth? Does it really matter if you know how much you want? Do you use Glassdoor? How much would you pay for access to accurate salary data? What’s the secret to cracking the code of getting paid what a job is worth?

: :

 

 

 

Job boards say they fill most jobs. Employer says “LMAO!”

In the December 5, 2017 Ask The Headhunter Newsletter, an employer questions the claims job boards make about how often they fill jobs. 

Question

job boardsI’ve read many of your posts about job boards, including Job Boards: Take this challenge, but it was one about The Bogus-ness of Indeed.com that really got my attention because it has over 200 comments on it, and because now I’ve seen how Indeed works for employers — and I’m LMAO!

My wife runs a popular retail chain store and recently took to Indeed.com to find qualified applicants. In Los Angeles, at a high profile new location opening (it’s in the news), she received just three applicants, all of whom had simply uploaded their resume and clicked any title that closely matched their interests. None of the three even knew who the company was, or what the details of the job posted were, they simply clicked “send resume.”

Two didn’t speak high-school level English, the third had never heard of the company and wasn’t sure where it was located, but applied just the same.

I’m sure there are people really looking for work. Are they using the potential of Indeed? Glassdoor? Monster?

I know what you think of the job boards, Nick, but I doubt you’ve had to look for a job recently. I wonder what your readers think. Can you ask them what their experiences have been with the big job boards like the ones we’ve had such bad luck with?

Nick’s Reply

I’m happy to put your question to our community. They love red meat. (That’s a joke, vegans and vegetarians among us!)

Do job boards really fill most jobs?

Thanks for your story about your wife’s problems with job applicants from Indeed and other job boards. It would be interesting to hear from more employers, who don’t seem to say much (at least in public) about how effective the job boards are.

  • Indeed cites a report from SilkRoad (“the world’s leader in Talent Activation”) that claims “Indeed delivers 65% of hires and 72% of interviews from job sites.” (The actual report is free but must be downloaded from SilkRoad.)

What’s not to like? Game over. Problem solved.

  • A few years ago, while I was researching a story I wrote for PBS NewsHour (Is LinkedIn Cheating Employers and Job Seekers Alike?) a CareerBuilder spokesperson claimed the job board accounted for nearly 50% of all jobs filled by staffing and recruiting firms — but told me the study behind the numbers was not published.

So, what’s the problem with all those vacant jobs?

  • Year after year, job-board watcher CareerXRoads has reported that around 25%-30% of external hires come from job boards.

Closer inspection of the data suggests about 10% of hires were being made during those periods through all job boards combined. (I have not looked at CXR’s reports recently.)

Truth or tricks?

Now go back and read those claims about where employers find their hires one more time. I’ve been watching these numbers for over two decades and I’ve learned the code. Can you find the tricks in those claims?

I’m really glad to get a question from an employer (well, from her spouse) on this topic. And I’m glad you’re asking Ask The Headhunter readers for their experiences and opinions — rather than me.

Okay, employers — big and small — are job boards delivering the hires you need?

You don’t have to be an employer to play. What do you make of Indeed’s (and SilkRoad’s) claims? I think there’s a deft sleight of hand — and some clever word play — in how SilkRoad, Indeed, and other job-boards characterize their “findings.”

Let’s get at the truth about job boards, folks. And if you’ve got some expertise in big data analysis, I’d really love to know your take on these reports. Do job boards really fill most jobs?

: :

Giving & Getting Information: Mistakes Job Seekers Make

In the June 27, 2017 Ask The Headhunter Newsletter, we consider two mistakes job seekers make. One is about how much information readers give to employers, and the other is about how little information they expect to get.

mistakes

Question #1

One of the mistakes I think I make is I give employers too much of my information. How far back (in years) should you go when constructing your resume or your LinkedIn profile? For example, when you list dates and years, is it important to include the years that you attended each university?

Nick’s Reply

You can include as much as you want in your resume or LinkedIn profile. Some persnickety HR people want to see everything – and that just reveals incompetence. They don’t need everything.

Information mistakes

In fact, too much information on a resume easily leads to confusion, mistakes, and decision paralysis. Very often, personnel jockeys are so unfamiliar with the details of a job that they have no idea what information about the candidate is important and useful. So they ask for too much, which gives them more basis to reject the applicant. (See How HR optimizes rejection of millions of job applicants.)

If you think listing certain dates will hurt you, leave them out. Is that risky? With some employers, yes. But relying on your LinkedIn profile or resume to get you in the door is a fool’s errand, because it’s just one of millions floating in an ocean of job applicants. The chances that someone will even read it are slim — most of the time an algorithm will reject you with no human review. So when you’re deciding what to put on your resume, you’re gambling.

Summer SALE! Save 30%!

Take 30% off all Ask The Headhunter PDF books! This week only! Order now and save on every PDF book in the bookstore!

Use discount code SUMMER

Type SUMMER in the discount code box when checking out. Order now!

[This limited-time discount has EXPIRED.]

Help them ask you for more

Give an employer specific information about your skills and abilities — information you’ve carefully selected to show how you will help the employer tackle its problems and challenges. Tease the employer intelligently. That will trigger a request to learn more, so they’ll call you in for a meeting. No matter how much information you provide, if you don’t address the employer’s specific problems and challenges, they won’t see any reason to bring you in. So tease them with just enough of the right information to make them want the rest. That’s where interviews come from. (See Tear your resume in half.)

Please: Don’t count on your LinkedIn profile or resume to get you interviews. (Don’t help employers make mistakes about you.) Most interviews come from personal contacts that you initiate. There’s no way around that.

(Here’s my own teaser: I’ll share some interesting statistics about the value of personal referrals in the next edition — July 11. Ask The Headhunter will be on vacation for the July 4 holiday!)

Question #2

In Forget Glassdoor: Use these killer tips to judge employers, you give job applicants a list of questions to ask in interviews, including “What’s it really like to work here?” You also advise asking to meet people you’d be working with, as well as key managers in the company. But how many companies will allow you to make requests of that nature? Maybe in smaller towns, but certainly not in large metropolitan cities.

Nick’s Reply

“Allow you?”

Who cares what they allow you to ask? As the applicant, you can and should ask anything you want in an interview. A company reveals a lot in its response (or lack of one), and your goal is to learn all you can so you can make an informed decision about working there. Unfortunately, once most job seekers make their way into a job interview, they forget that. Suddenly, their prime goal is to get an offer — when it should be to vet the company.

From Fearless Job Hunting, Book 8: Play Hardball With Employers, p. 12:

“Job hunters don’t often think to check the boss’s (and department’s) reputation inside the company, or how that department interacts with the rest of the organization. Likewise, job hunters usually fail to carefully inspect a company’s reputation on the street. Investigate, and avoid disaster.”

A job interview is business

I find it troubling that job applicants are fearful of asking questions that any good business person would ask a prospective business partner, customer or vendor in the normal course of vetting a deal. This is your life and career we’re talking about! And a job interview is a business meeting.

Being in a big metro area doesn’t give an employer a pass. This is important stuff! Serious job applicants must realize a job interview is a two-way street. Hence the prefix “inter-“ as in “between.” It’s not a one-way interrogation where the employer holds the upper hand and unilaterally decides what’s allowed. (While vetting an employer is critical, as far as the job itself goes, I think there’s one general-purpose question both the employer and the applicant should ask — and not much more!)

Get the information you need

To make an informed judgment about an employer, ask anything you need to, and if you don’t get good answers — or if the employer gets annoyed — then tell them you’re not going to make them an offer to work there. They’ve been rejected. They made a mistake. They don’t meet your requirements.

Ever wonder why employers ask for the kitchen sink — your entire resume — rather than just certain, specific information they really need to determine whether you can do the job? Who cares what you did 15 years ago? How much information do you give to — and get from — an employer? Do employers go overboard, while job applicants don’t ask for enough? What information is reasonable to request?

: :

 

Forget Glassdoor: Use these killer tips to judge employers

In the April 18, 2017 Ask The Headhunter Newsletter, a reader needs to get past the Glassdoor company reviews to find the truth about an opportunity.

Question

I was recently asked to interview at a company that at first I was excited to have a chance at joining. Their industry is interesting and familiar to me, and the position itself is a great next step in my career.

glassdoorAfter my interview was scheduled I did my due diligence and started doing research to prepare. Sh*t hit the fan when I got to employment reviews on sites like Glassdoor and Indeed.

Except for the one or two company-planted positive reviews, the clear majority for the past four years have been scathing and disheartening. To summarize: Employees say upper management rules with an iron fist, takes credit for employees’ successes, and compensation is not competitive.

I can understand a couple of bad reviews that might be from disgruntled people, but with a consistent theme delivered on multiple websites spanning a few years, I’m beginning to second-guess my effort.

My big question to you is: What is the best way to bring up my findings to learn the truth? I feel I absolutely have to ask because I not only want to see how they answer, but I also want to see if they own up to the need to change. I’m worried they’ll blacklist me for bringing it up, and I’ll never know whether the environment is truly terrible or not. I want to approach this with respect and good manners so that I don’t look like a bad seed trying to be planted.

How do I look behind the curtain? Is this worth the effort or should I just run now?

Nick’s Reply

I wouldn’t trust Glassdoor to help me judge a company any more than I’d trust Indeed or LinkedIn to connect me with a job. (See Can I trust Glassdoor reviews?LinkedIn: Just another job board and The Bogus-ness of Indeed.com.) All those websites make money when you keep looking for jobs — not when you find one!

I’d invest more effort to get the truth about this company firsthand, but only if the company passes the first test. So let’s cut to the chase.

The first test

I doubt you’d take this job in if the compensation is not competitive. So let’s get this deal-breaker out of the way because it may save you further effort and later frustration.

Since they asked you to interview, it’s incumbent on them to provide information you need. I’d ask about compensation before taking any more steps. It’s best to ask the hiring manager this question, but if HR is the best you can do, that’s fine.

Make a phone call. (Do not use e-mail. This is too important.)

How to Say It
“What’s the pay like for this job?”

That’s it. Do not elaborate. This simple, off-the-cuff, obvious question says it all. It’s friendly and it’s clear.

If they won’t give you a salary range, I’d thank them for their interest (always be polite) and explain that you can’t invest your time in interviews if you’re not all on the same salary page. If they decline to state a range and instead ask you your current salary or your desired range, I’d politely reply that they’re asking you to interview — and they need to confirm the salary range. (See The employer is hiding the salary!)

If they won’t tell you, you’re done.

Glassdoor reviews are not enough

I’m not a fan of company reviews, especially the way Glassdoor presents them. There’s no accountability. Anyone can post anything anonymously. Nonetheless, when strong criticism spans lots of time and multiple websites, you’re right to be concerned. Just remind yourself that every bit of the criticism could be wrong. Could. It probably isn’t, given the extent of it. But you seem to want to find out for yourself, so take the next step.

Since you’re still excited about the job as you understand it, it’s worth going in to find out for yourself what’s up. You don’t need to confront them with the online reviews. In fact, I would not, because consider their best defense. If I were the employer, I’d respond that those reviews are not proof of a problem and the critics are all hiding behind anonymity.

The company can quickly render your question as a fact-less accusation, and you’ll come off like a person who makes decisions and judgments without solid evidence. Glassdoor is not solid because critics are not personally accountable.

If you had nothing else to go on but all you’ve read, and you had to make a choice right now about this company, the prudent decision is probably to walk away. But you can get firsthand evidence on which to base a sound judgment — and you should, because online reviews are not enough to make a defensible judgment.

Killer methods to judge the employer

Here’s what I’d do. Go to the interview. Answer their questions, and ask the normal kinds of questions you’d ask even a very good company. Then use one or more of these killer employer-vetting techniques. Here’s what to ask the employer (preferably the hiring manager):

How to Say It
“If you could change anything about your company instantly, what would you change?”

See how they handle that. If they’re aware of their online reputation, it gives them a chance to explain without you actually bringing it up.

How to Say It
“I’d like to meet some of the people I’d be working with if I were hired, and I’m willing to invest some extra time to do that. I’d also like to see where I’d be working. Can you give me a cook’s tour of your facility? If today’s not a good time, I’d be glad to come back.” If they let you do this immediately, that’s a good sign. If they put it off, do they quickly schedule that next visit, or do they never get back to you?

Ask the employees

If you get the tour and have a chance to meet other employees on the team, try to get a few minutes with each one privately. Ask this question.

How to Say It
“So, what’s it really like to work here?”

Do not share what you’ve read online. Let them talk. Their reactions will tell you all you need to know. Remember: Your goal is not to show how much you know, because that gains you nothing. Your goal is to confirm what you’ve read and to learn even more.

Leverage the job offer

This is the most powerful way to judge an employer. If you get an offer, they’ve demonstrated they want you — and they want you to say yes. They’re waiting. People don’t realize what incredible leverage they have at this point. It’s the most control you’ll ever have in negotiations. It’s time to vet the company.

Tell them you’re thrilled to get the offer – “Thank you!” Then take more control and learn the truth.

How to Say It
“Before I accept your offer, I’d like to meet some of your key people – managers of departments related to the department I’d be working in. I’d like to make sure I’m a fit for your team and I’d like to get the bigger picture of the work environment.”

For example, if you’d be working in manufacturing, you’d want to meet the heads of engineering and product development, because they create the products your team builds. You’d want to meet heads of sales and marketing, because their job is to make money from what manufacturing produces. If they’re not all great people doing great work, then your team (and you) will fail. Get the idea?

Find your own truth

Glassdoor and online company reviews are not the truth. They’re the partial, questionable truth. The best way to get the whole truth about a company is to talk to key people inside, and to talk with people you’d be working with every day. There is no need to bring up Glassdoor reviews. (You might find that the company’s reputation online is not deserved.) Get the facts for yourself.

Any company that declines to let you meet the people I’ve suggested – even though it’s an unusual request – probably has too many skeletons in its closet, or has a lousy attitude about transparency.

Formulate these questions in a way that’s comfortable for you. Don’t use my exact words. I like that you want to be respectful and well-mannered. Always assume the best, and politely ferret out the truth. Then deal with it, either way.

I hope this is helpful. It’s probably more work than you’d like to do, but consider what you’re investing here – the next several years of your work life. It’s worth the extra effort to find your own truth.

If you need more suggestions about how to vet this company, these two books will help. Check the tables of contents at these links:

Fearless Job Hunting, Book 5: Get The Right Employer’s Attention
(See especially, “How to pick worthy companies,” “Is this a Mickey Mouse operation?” and “Scuttlebutt: Get the truth about private companies.”)

Fearless Job Hunting, Book 8: Play Hardball With Employers
(See especially, “Avoid Disaster: Check out the employer,” “Due Diligence: Don’t take a job without it” and “Judge the manager.”)

Do you trust anonymous company reviews? How do you get the truth about a company?

: : 

Can I trust Glassdoor reviews?

In the September 2, 2014 Ask The Headhunter Newsletter, a burned employee sparks controversy about anonymous employer “reviews” on Glassdoor.com:

Have you ever written about Glassdoor reviews? Based in part on positive reviews I read about a start-up company on Glassdoor, I accepted a job. This company was nothing like it presented itself to be. It was terrible. Two months into my tenure, another position came up and I left. (My rule is never to shut down the job search process until I am sure I want to stay somewhere.) It still bothered me that this company was so crappy and I felt I had been taken for a ride.

I had lookeglassdoord at the reviews in Glassdoor prior to the interview and, though there were negative reviews, there were overwhelmingly positive ones as well. I was concerned about the negative reviews, so I brought it up in my interview. The recruiter stated that the office prided itself on being different from its corporate parent, and he felt I was a good fit. So I took the job.

Here’s why I’m asking about Glassdoor. After I quit the start-up, I continued to follow the company on Glassdoor and checked LinkedIn to see what kind of turnover they had. It turned out some of the people hired during my time have since left. Strangely, when a negative review shows up, an overwhelmingly positive one shows up within a week. Interestingly enough, two of the most current negative comments say that HR is posting its own positive reviews! The recruiter I worked with left after a year. So, are these reviews worth anything? What do you think?

Nick’s Reply

I’ve never written about Glassdoor.com because I think its business is worthless except as a generator of revenue. At best, this public database of anonymous reviews about employers is a curiosity. (I’m skeptical about any kind of anonymous reviews, even on Amazon.) The very idea of a website that encourages people to anonymously critique employers is ludicrous and irresponsible. I think its use is widespread because it makes money. That fact impresses HR executives and the public, leading them all to base business decisions on admittedly untrustworthy information.

Just think about it: Any disgruntled employee or job applicant can trash a company publicly. An HR department can spam Glassdoor, singing its own praises. (It seems this happened with the company you quit.) Honest comments will get lost. Meanwhile, Glassdoor has no incentive to keep it all clean by making participants accountable. (The argument for anonymity is that people wouldn’t post honest comments if employers knew who they were. Duh. That justifies graffiti?) They make money with every posting. That’s how Glassdoor is like the job boards.

In fact, Glassdoor is a job board. (Like LinkedIn, the site uses the honeypot of “community” to lure you into an ulterior revenue model. See LinkedIn: Just another job board.) Employers pay to post their jobs. Where does the job seeker traffic come from? Job seekers show up every day that Glassdoor dangles its clever bait: “Come share your reviews and salary information — anonymously. Then look at job postings!” The revenue model is built on unverified reviews and unverified salary data. (Imagine if Glassdoor’s business model were legitimate: It would pay you for your honest reviews and salary information.)

In other words, HR departments pay Glassdoor to subsidize anonymous ratings and salary surveys. You suggested that HR departments use fake IDs to give their own companies good reviews I don’t doubt it.

The obvious problem is that, when no one is accountable for praise or complaints, every comment on Glassdoor is suspect. Your experience with the terrible start-up highlights the problem. Anyone can create an account without anything but an e-mail address. If Glassdoor were to require true identities, it would be another story. But it’s not.

Along the same lines of Glassdoor is a new app created by the founder of TheLadders, Marc Cenedella. He basically lifted Glassdoor’s concept and made it more personal. Knozen.com lets people post anonymous comments about their coworkers’ personalities. That’s more of a bathroom wall than even Glassdoor. I can’t wait for more lawsuits.

Reading anonymous customer reviews when you buy a camera or a waffle iron is one thing — if you make a mistake, you’re out a few bucks. But when you’re checking out an employer, due diligence is crucial. We’re talking about your career and your income. Check credible sources. Your best bet is always to seek out current and former employees at a company to learn the truth — but make sure they have real names. In Fearless Job Hunting, Book 5: Get The Right Employer’s Attention, you’ll learn the powerful “scuttlebutt” method of researching even privately held companies — by talking to their competitors (pp. 22-24).

Here’s another important tip from the same book, in the section titled “How to pick worthy companies” (pp. 10-12):


Talk to the company’s customers and vendors
This is where you will find the hidden skeletons, and you will learn who are the real decision-makers in the company. This is also where you may find a hidden opportunity. It might not be with your target company, but with one of its customers or vendors, or with some other associated company. By extending your research and meetings to such companies, you’ll get a valuable, industry-wide view — not just of your target company, but of the work you want to do.


It’s not so hard to evaluate an employer. Invest the time to do it right next time, because anonymous reviews of employers can get you into serious trouble.

Is it real, or is it crap? The reader in today’s Q&A learned the hard way that, if information smells, it’s probably crap. Would you trust anonymous reviews and salary surveys to make a career decision?

: :