Glassdoor Salary Data: Worse than useless

In the June 5, 2018 Ask The Headhunter Newsletter we shake up salary negotiations and take down the Glassdoor myth.

Question

glassdoorI know you don’t like Glassdoor’s salary survey data and employer reviews, but what are we supposed to use to base our salary negotiations on? I’m talking about job seekers.

Nick’s Reply

If you’ve ever used Glassdoor salary data to help you negotiate a job offer, did you wonder whether you might have under-sold yourself? According to a report in the June 2018 Wired magazine by Rachel Nuwer, Silicon Valley’s Exclusive Salary Database, you might have left an additional 69% on the table.

Wired tested samplings of self-reported Glassdoor salaries against Option Impact — a robust database of salaries reported directly by employers — and found glaring discrepancies. Option Impact is published by Advanced-HR for “elite users” — primarily venture capital firms and the tech companies they fund. These startups (and the investors behind them) can’t afford to make mistakes when competing for top talent, so they consent to share up-to-date salary information that Advanced-HR checks regularly.

In other words, unlike Glassdoor, which makes money off its data whether it’s accurate or not, Advanced-HR has a reputation to protect among VCs and the startups they run, and among the consultants and lawyers who serve them.

QA Engineer with 1 to 3 years’ experience

Option Impact: $101,955 (+43%)
Glassdoor: $71,004

Nuwer cites the example of a software engineer who got access to the database with his previous employer’s login. “Steve” turned down a handsome job offer of $180,000 that he says he would have gladly accepted — had he not learned from Option Impact that the reported market salary for that job was a lot higher. “His eventual starting salary: $205,000.”

The Glassdoor myth

I’m forever astonished at how easily people rationalize irrational behavior. Job seekers generally acknowledge that salary data and employer reviews on the popular Glassdoor website are biased and often phony. (See Can I trust Glassdoor reviews?) The salaries are questionable at best because they are self-reported. The web is rife with stories about HR managers and employers posting fake reviews to “balance” spiteful reviews from disgruntled employees.

Data Scientist with 4 to 6 years’ experience

Option Impact: $132,536 (+3%)
Glassdoor: $129,118

Yet I hear this all the time: “Well, I know all that, but you can still get a good idea about a company and what it pays by looking through all the information.”

No, you can’t.

Glassdoor admits it publishes, uh, crap

If you know some of the data are invalid but don’t know which, then it’s imprudent to trust any of it. Yet job seekers and employers peg their salary negotiations to anonymous Glassdoor “salary data” as if it’s a gold standard.

Glassdoor itself is clear in its Terms of Use that it doesn’t stand by anything posted by users or employers — that is, all its salary and company reviews:

“Because we do not control such Content, you understand and agree that: (1) we are not responsible for, and do not endorse, any such Content, including advertising and information about third-party products and services, job ads, or the employer, interview and salary-related information provided by other users; (2) we make no guarantees about the accuracy, currency, suitability, reliability or quality of the information in such Content; and (3) we assume no responsibility for unintended, objectionable, inaccurate, misleading, or unlawful Content made available by users, advertisers, and third parties.”

Sheesh. “Information” on Glassdoor is a myth. “Information” on Glassdoor is crap. What’s stupefying is that the company manages to survive and prosper by selling disclaimed “content” to suckers.

Glassdoor Salary Data: Worse than useless

The Wired report provides evidence suggesting Glassdoor’s salary data are worse than useless. The data are dangerous because they can actually cost you salary dollars when you decide how much to ask for. The job you’re negotiating for might be worth much more than the salary Glassdoor is “not responsible” for telling you it is.

Project Manager with 4 to 6 years’ experience

Option Impact: $137,000 (+66%)
Glassdoor: $82,403

Wired reports that the company behind Option Impact, Advanced-HR, doesn’t compile its salary data from employees who report it themselves — possibly fudging it. Advanced-HR gets it from the employers themselves.

“Companies share their employees’ anonymized salaries in exchange for access to the vault, which is searchable by job title, location, company size, revenue, and funding stage.”

Why would a company tell the truth about what it pays? Probably because Option Impact is an exclusive club and because these companies know venture capital (VC) firms rely on the data.

(Of course, not every job and industry is going to be in any salary database, including Option Impact, and all the general criticisms of survey data apply, including, Are we talking about the exact same jobs? I’m not suggesting Option Impact is the answer — just that it’s a fatal counter-example to Glassdoor’s swill pot of whatever anyone wants to pour into it. Advanced-HR demonstrates that there are other ways to do this.)

How can you get access to Option Impact?

Unless you’ve got access to some venture investment firm’s login, you’re not going to have access to the data that enabled Steve to get a 23% higher salary than he might have without Option Impact data at his finger tips.

Designer with 4 to 6 years’ experience

Option Impact: $126,125 (+69%)
Glassdoor: $74,591

So what’s my point, if you can’t get this data? It’s that if you trust your salary negotiations to salary data that you know is self-reported, unverified, untrusted, disclaimed and admittedly inaccurate (Thanks for the full disclosure, Glassdoor), you may be hurting yourself.

How can you get access to higher job offers?

Forget about getting your hands on valid salary data. It’s probably not going to happen. You’re not a VC or the CEO of a tech startup, and you probably can’t afford such exclusive insider data.

Instead, focus on the red meat of any job interview — be ready to show a hiring manager how you’re going to help drop additional profit to the bottom line if you get hired. Then you can ask for more money.

That’s a tall order, and there’s no short-cut. It’s why we’ve been talking about how to do it across hundreds of these Q&A columns. For example:

When a salary data vendor tells you it does not control the inaccurate, misleading information that it denies responsibility for, listen.

How do you know how much a job is worth? Does it really matter if you know how much you want? Do you use Glassdoor? How much would you pay for access to accurate salary data? What’s the secret to cracking the code of getting paid what a job is worth?

: :

 

 

 

You can’t recruit for competitive advantage if everybody’s got the same algorithm

In the May 29, 2018 Ask The Headhunter Newsletter we take a look at how companies recruit the same and why it’s unwise.

Question

recruit

I run a sizable company. Like our competitors, we’re finding it difficult to recruit the people we need to grow our business. We all talk about competitive advantage being the crucial factor, and I’ve always believed a company’s competitive advantage comes from its people. But it’s easier said than done to find people with the skills we need. My vice president of HR gave me some of your articles and I find what you say troubling, that the tools we’re using to find talent are leading us astray. It’s easy enough for a headhunter to say that. Can you back up your claims that we’re doing it wrong?

Nick’s Reply

When I do presentations for Executive MBA (EMBA) programs at schools like UCLA, Wharton, Cornell, and Northwestern, I always take the opportunity to ask one of my favorite questions: How do you actually recruit the people you need to hire?

The managers in the audience — who are investing a lot of money to learn how to leverage talent into profits — almost always answer like this: “We create detailed job descriptions and post them, or we use headhunters.”

Then I make them nervous and ask why they pay a headhunter $30,000 to fill a $120,000 position, if they can just post jobs for five bucks apiece.

“Well, sometimes we need help.”

And how many candidates does the headhunter deliver?

“Usually four or five.”

Algorithms don’t recruit

Now I’ve got them. But I’m not trying to sell them headhunting services. I want them to realize that one recruiting method delivers just a handful of good candidates, while the other — automated, algorithmic recruiting — turns on a fire hose of applicants that all their competitors are looking at, too.

Why don’t they go off the beaten track and use a competitive recruiting advantage? I suggest that they should invest the time—personally—to go out into their professional communities and recruit as few candidates as possible, but make sure they’re all the right ones. (See Talent Crisis: Managers who don’t recruit.)

Their answer is embarrassing, and it usually goes like this:

“That’s incredibly time intensive! We have this model: We post a job description, and we get 2,000 applicants. But you want us to risk everything—all this time and effort—on four or five applicants? What about the other 1,995 applicants? What do we do with them?”

“You take a pass,” says Gilman Louie, a venture investor who rejects mass recruiting methods. And I think he’s absolutely right. Don’t listen to me. Listen to him.

What a VC knows about hiring

Gilman Louie is a founder of Silicon Valley VC (venture capital) firm Alsop Louie Partners, which invests in sectors including security and privacy, data and analytics, consumer products and services, and education technologies. In the 1980s Louie licensed the blockbuster video game Tetris from its developers in the Soviet Union. He’s also listed as one of 50 scientific visionaries by Scientific American.

You and your HR department would do well to consider that Louie is probably much more successful at hiring than your company is because he knows how to recruit. He doesn’t rely on LinkedIn, job postings, and the mass recruiting efforts HR departments use.

Employers love to proclaim their goal is to find the unusual, the star, the talent that will lead the organization into the future. So why does virtually every company rely on a recruiting method that’s designed to deliver staggering numbers of “candidates” that are all wrong?

You’re using the same algorithm

Gilman Louie: “Because of the competition for talent, employers are unfortunately using those typical HR filtering systems to put resumes in the right piles and to line up the interviews. The problem with that is, whether you’re an established company or a start-up, everybody has the same algorithm.”

I tested the question I ask EMBA students on Louie: “You can get 2,000 resumes online for about five bucks. Why not just get lots of candidates into HR’s pipeline?”

Louie: “You can’t go through 2,000 candidates! HR processes 2,000 candidates! They don’t look through 2,000 candidates! And at the end of the process, what they get is the same candidate that everybody else running PeopleSoft gets! So where’s your competitive advantage if everybody turns up with the same candidates?”

Eliminate the perfect resumes

You don’t review lots of resumes to find the best candidates?

Louie: “I put a job description out and all this stuff starts flowing in. I lay out those 100 or 1,000 resumes, or those LinkedIn files—and, all the things that everybody has that are the same, I just draw a line through them. What’s left over is what I look at because I’m trying to find the thing that distinguishes one candidate from another candidate. I’m not looking for the perfect resume. The perfect resume is vanilla.”

Louie spends a lot of time in his professional community meeting people. (See The Manager’s #1 Job.) That personal investment in face time yields the best hires for the startups he funds.

Go where your competitors are not looking

For example, Louie teaches MBA classes at Vanderbilt and Stanford Universities. He explains why it’s so important to go out into the wild and recruit in person.

Louie: “I recruited a kid who was a high-school dropout during a presentation we did at MIT. He was clearly different from all the other students. So I went and asked the admissions department about him. They said, when we interviewed him, one of our admission officers recognized the custom bikes the kid made when he lived on the wrong side of the tracks in Glasgow. He said, ‘We need this kid; he’s entrepreneurial! He doesn’t look like any of the other kids. He has a mediocre GPA, doesn’t have straight As, didn’t go to a private school, didn’t have any of the things MIT kids have. The resume popped.’ So he got in because he was different. We hired him, and he’s phenomenal.”

Employers look for their hires on LinkedIn, via job postings, and through the mass recruiting efforts of their HR departments. Louie refers to the kind of thinking that’s behind such hiring methods as too conventional, or “on the line.”

Get off the line

Louie: “The question that Steve Jobs always asked was not about the way the world is going to be, but the way the world should be, based on his point of view, based on his distorted reality. It’s some place off that line. So the trick is to get off the expected path line. It turns out, by the way, if you do the actual analysis, the world never turns out to be on that line. And the reason for that is, all the incentives go to the guy who figures out how to move off that line!”

If that sounds like natural selection—survival of the winner—it is.

Louie: “All the value that you create between the line you are on and the line everybody else is on is yours. When you’re selecting people, you can’t select people who are going to be on that line. You’ve got to select people who are off that line.”

Competency is not competitive advantage

Let’s get back to your question about whether the algorithmic recruiting tools your company uses are leading you astray. Your company’s HR department is not recruiting in some pool of rarefied talent, like Gilman Louie does when he sits in on a seminar comprising unusual participants. (See Smart Hiring: How a savvy manager finds great hires.)

Your HR department is drowning in the same rush of job applicants fed through the same fire hose every other HR department subscribes to — Indeed, LinkedIn, ZipRecruiter, Taleo, and a raft of other undifferentiated keyword-matching systems. Worst of all, you’re paying dearly for their services.

Louie: “Here’s the problem with the algorithms. The algorithms are all looking for the same. Everybody is fighting for a handful of talent that the algorithm brings up. This jacks up the price, and it communicates that employees are kind of fungible. Employees are not fungible. I’m not saying those tools aren’t helpful. They will get you to competency. But competency is not competitive advantage. Competitive advantage is finding the unusual that everybody else missed.”

It’s personal

Gilman Louie makes it very simple when I ask him to summarize how he hires for competitive advantage.

You just told us three crucial things. One, you recruit by watching people in their native habitat. Two, you find people others missed. Three, you don’t rely on resumes, you go ask someone.

Louie: “Exactly.”

None of those steps have anything to do with traditional or automated recruiting.

Louie: “You’ve got to get there, and it’s personal. And personal is not digital.”

(Gilman Louie’s comments are from a discussion I had with him a few years ago while working on another project. If I thought he was prescient about “digital recruiting” back then, now I think Gilman’s advice is timeless wisdom.)

What does this venture investor’s advice about hiring tell us about the state of recruiting in today’s economy? Can these methods work in normal company settings? If you’re an employer — a hiring manager or an HR exec — can you “get off the line?” How can you put these ideas to work if you’re a job hunter?

: :

WTF! Inflatable Interviewer Dolls?

In the July 29, 2014 Ask The Headhunter Newsletter, a reader doesn’t feel like doing a solo job interview:

What do you think of an employer that uses a video service such as Montage to conduct its pre-screening of job candidates? I was recently asked to do this and found the experience awful. You don’t get to hear responses played back before submitting them, and there is no conversation with the interviewer.

Nick’s Reply

inflatable_manI think it’s bulltarkus. Any company that asks you to do an interview by yourself on video might as well hire an inflatable doll. If an employer asks you to invest your time to apply for a job while it avoids investing time in you, think twice before doing it.

In fact, I think the decision to interview you by yourself on video was made by an HR doll that was inflated by a very lonely venture capitalist who will end up unsatisfied. It’s all overblown.

The Journal Sentinel reported that Montage — the Talk To The Doll App you’ve encountered — was funded to the tune of $4 million by Baird Venture Partners and — get this — the State of Wisconsin Investment Board. All you need to know is this comment posted to the article: “Very simple technology that will have little value in the future. It’s a groomed Skype with recording abilities.”

Montage is a “solution” that only a puffed-up HR executive with too big a budget could love. Next time, insist that a human show up to interview you.

WTF is up with venture capitalists (VCs), anyway? Didn’t we just cover a bunch of venture embarrassments in the recruiting space? The Stupid Recruiting Apps just keep coming, and you need to watch out for them.

Montage is just one notch up from another new app, Yo. According to The New York Times, Yo raised $1.5 million from Betaworks and other investors. Yo makes a “new smart phone app whose sole purpose is to let people send text messages saying ‘Yo.’”

“People think it’s just an app that says ‘Yo.’ But it’s really not,” said Mr. Arbel, one of Yo’s founders.

Rumor is that several Fortune 500 employers will be notifying job applicants whether or not they were hired with one word: Yo. “We like to call it context-based messaging,” says Arbel. “You understand by the context what is being said.”

Ask The Headhunter readers will be relieved to get any sort of feedback after their job interviews. (See Question 4 in 4 Tips for Fearless Job Hunters.) But, can’t we send one-word Tweets without having an app that sends only one word? Yes?

cenedellaThis is not to suggest there aren’t some seasoned recruiting industry veterans getting funded today. The former CEO of TheLadders, Marc Cenedella, has what’s probably the winning entry in the Totally Useless Apps category — Knozen. Business Insider says it’s “a new iPhone app that lets coworkers rate each other’s personalities anonymously… it’s like Yelp is for restaurants.”

I’d rather have an employment app that’s like OpenTable — it would guarantee me a place at the table! VCs including FirstMark Capital, Lerer Ventures and Greycroft Partners gave Cenedella $2.25 million. And here’s where you — the job seeker — come in. Business Insider reports that, “Eventually, Cenedella wants his app to become a ‘personality API’ that businesses can tap into during the recruitment process.”

Uh-oh — Cenedella is talking tech: API. So’s Yo investor John Borthwick: “over time [Yo] has the potential to become a platform.”

You can’t make this stuff up. “Cenedella feels Knozen is an extension of the work he was doing at The Ladders, a career site that matched executives with job opportunities that paid six-figures.”

And how’s Cenedella’s last start-up faring? Today TheLadders is fighting a consumer class action in Southern New York District Court for breach of contract and deceptive practices. Word is his lawyer dolls are keeping Mr. C. out of breath.

“The Ladders was about showing the intangible qualities of yourself to employers,” says Cenedella. Yah — actually, it was about letting you lie about your salary to employers so they’d interview you for “$100K+ jobs.” (See TheLadders: Job-board salary fraud?) Does Knozen somehow guarantee honesty?

How does Cenedella explain that TheLadders is now a Hazbeen while Knozen is new and cool? “I got more interested in how people present themselves when they’re already in a job, not hunting for it.” No shit. One Business Insider comment sums up this start-up: “Stupid app. Nark app.”

I usually limit the levity and try to rise above all this. But when:

  • We start talking about a single word “that over time has the potential to become a platform;”
  • Employers want to snooze while you talk to the hand about a job; and,
  • A discredited recruiting entrepreneur gets over $2 million from venture capitalists…

Then it’s impossible to keep a straight face. We’re talking about a total of about $8 million worth of phony “recruiting technology” that you might face when you apply for a job.

So what’s my advice? Do what my mentor Harry Hamlin taught me: Use your judgment, and do the best you can. Then remember what my other mentor, Gene Webb, said: “Never work with jerks.” And don’t talk to inflatable doll interviewers.

Are new recruiting apps helping you land a job? Who’s become more stupid — venture capitalists, or employers? Want to buy an inflatable doll from me — to send to your interviews?

: :