How HR optimizes rejection of millions of job applicants

In the June 23, 2015 Ask The Headhunter Newsletter, Nick responds to readers who want to know what he thinks of a Time magazine cover story about employers that use “XQ” to assess job applicants.

Your XQ: More HR B.S.?

Readers have been peppering me with questions, asking my reaction to a recent Time cover story: How High Is Your XQ? It’s about “strange questions you need to answer to get a job in the era of optimized hiring.”

Translation: It’s about employers’ new-found love for letting third-party personality-testing companies decide whether to reject you before the employer even meets you.

I give the author of the article, Eliza Gray, credit for dealing with “optimized hiring” candidly and critically. The article is worth reading. (If you don’t subscribe to Time, you can’t read the full story online. Everyone, however, can read an online companion piece, Find out if your personality fits your job.)

In this week’s newsletter, I’m going to tell you what I think, and suggest how you might deal with this latest effort by HR executives to abrogate their responsibilities for hiring.

But what really matters in all this is what you think, because that’s what will rattle these employers. Read on, then join me in the discussion below. We’ll talk.

A $2 Billion Industry

Time reports: “Convinced by the gurus of Big Data that a perfect workforce can be achieved by analyzing the psyche and running the results through computers, hundreds of employers now insist that job candidates submit to personality tests.”

stuffed-animalA $2 billion testing industry, funded by your friendly neighborhood HR department, “evaluates” job applicants even before an employer decides they’re worth interviewing. Yes, you too can get rejected before you’re even considered.

What does all this entail? “Tests that can take anywhere from 20 minutes to several hours,” says Time.

Why does HR do this? It’s simple. HR doesn’t want to recruit, judge job applicants, hire, or be held accountable. So HR execs farm their work out to third parties that are not regulated — but who control whether you get a job.

What it means: HR has left the building. There’s a stuffed animal in the HR VP’s chair signing contracts, outsourcing hiring to clowns wearing psychologists’ hats. These employers consider their employees fungible commodities. (See An insider’s biggest beefs with employment testing.)

My advice: Strike back, especially if you’re gainfully employed. “Sorry, my policy is not to take tests or fill out voluminous forms until the hiring manager and I decide there’s good reason to continue talking. When can I meet the manager?”

I realize that if you’re unemployed, you might hesitate to be so assertive. But consider that after you invest your time, odds are very high that you’ll be rejected by an algorithm — time you could spend interviewing with a human who really wants to hire you.

Bottom line: Any employer that won’t take the time to meet you before rejecting you operates without integrity and is not one to work for.

The No-See-Um Assessment

What are HR departments looking for?

algorithmTime reports: “It isn’t an IQ rating or even EQ, the emotional intelligence quotient that came into vogue in the 1990s. There’s no name yet for this indispensable attribute. The qualities are so murky that often not even the employers chasing it are able to define it; they simply know that an algorithm has discovered a correlation between a candidate’s answers (such as an expressed preference for classical music) and responses given by some of their most successful workers. So let’s call it the X quotient… your XQ test, an exam that no one has prepared you for.”

What it means: You apply for a job. HR has no time to interview you. (See 7 Mistakes Internal Recruiters Make.) It makes you take a test instead, saving its time and money, while you play outsourced psychological games, spending your time like it’s free. These tests reveal correlations, which reflect nothing about your skills or ability to do a job.

Your answers to useless questions like, “Do you understand why stars twinkle?” correlate with the answers of successful employees. But statistical correlations don’t prove anything. They merely suggest you’re similar to someone else. If you’re not, it doesn’t matter that you can do the job better than any other current employee. You lose.

My advice: Don’t play the No-See-Um Game, in which no one interviews you. Insist on being seen by a hiring manager in person. There are many companies that respect job applicants and assess them face to face. (See Kick the candidate out of your office.) Don’t feed the $2 billion racket. Find an honest employer instead.

Meet Andy Biga

If hiring decisions that are based on test correlations are really not a good thing, why do employers rely on them?

jet-blueTime tells about a JetBlue HR executive named Andy Biga who “optimizes hiring.” He processes 150,000 job applicants for the airline, and hires 3,000 of them after they “get past the battery of tests Biga’s team designed.”

Biga says, “I believe this is really the future for hiring.”

Oops: It seems Andy Biga is full of baloney. I know, because I spoke with Dr. Arnold Glass, a leading researcher in cognitive psychology at Rutgers University. Glass adds a measure of Real Science to Biga’s claims about Big Data in the service of HR:

“It has been known since Alfred Binet and Victor Henri constructed the original IQ test in 1905 that the best predictor of job (or academic) performance is a test composed of the tasks that will be performed on the job. Therefore, the idea that collecting tons of extraneous facts about a person (Big Data!) and including them in some monster regression equation will improve its predictive value is laughable.”

The Time reporter “called Biga and his protege, another 30-something data wiz named Ryan Dullaghan, after the conference to see if they’d talk me past the buzzwords and through what they’re really looking for in a new hire. No dice. After all, if the traits they wanted in an employee were printed in TIME, they said, job applicants might be able to game the test.”

What it means: JetBlue and companies like it don’t hire you for what you can do. They hire you because you correctly agree or disagree with statements like, “I feel stressed when others rush me.” What that means is a secret. That’s how they game you.

ftcMy advice: Buy a lottery ticket instead. Because, can you imagine how Andy sorts through 150,000 applicants? BZZZT! That’s a trick question! He doesn’t. Nobody at JetBlue does. If JetBlue had any idea how to recruit the right people, it wouldn’t throw 150,000 strands of spaghetti at the wall.

Andy has a big problem: The FTC is looking into how these hiring algorithms promote bias and discrimination. Ashkan Soltani, the FTC’s chief technologist, says, “We have little insight as to how these algorithms operate, what incentives are behind them or what data is used and how it’s structured.” CIO magazine reports that the FTC has formed a new Office of Technology Research and Investigation to look at bias in hiring algorithms.

Soltani cautions: “A lot of times the tendency is to let software do its thing. But to the degree that software reinforces biases and discrimination, there are normative values at stake.”

Oops. There goes Andy Biga’s future.

Meet Charles Phillips

This racket is so corrupt that I couldn’t make up what Time disclosed.

Time reports: “One of the bigger outfits is Infor, a New York–based software company that claims to assess a million candidates a month–a number that translates to 11% of the U.S. workforce.”

b-s-buttonHertz, Boston Market and Tenet Healthcare outsource candidate testing to Infor. The company “concocts a job applicant’s ‘Behavioral DNA,’ a measure of ’39 behavioral, cognitive and cultural traits,’ and compares them to the personality traits of the company’s top performers.”

What it means: “Behavioral DNA” is a B.S. marketing term with no scientific meaning. Now for the good part. Says the Time reporter: “Infor CEO Charles Phillips admitted he’d never taken the test when we spoke, adding, ‘I’m scared of what I might find.’”

My advice: A CEO who admits he won’t eat his own company’s dog food — but wants to feed it to you — has no business rejecting you for a job at arm’s length. Kudos to Time for exposing Infor. Look up the list of Infor’s clients. Would you apply for a job at any of them, knowing how you’ll be “assessed?” Find employers who don’t serve Charlie Phillips’ dog food to people who apply for jobs.

Correlation Is King

What is Infor selling to gullible HR executives who couldn’t recruit a dog to bite a mailman? Correlations, reports Time.

Phillips and his testing chums sell “a mostly unchallenged belief that lots of data combined with lots of analytics can optimize pretty much anything–even people. Thus, ‘people analytics,’ the most buzzed-about buzzword in HR circles at the moment. Included in people analytics is everything from looking at the correlation between compensation and attrition to analyzing employees’ email and calendars to see if they are using their time effectively… Correlation is king, even when causation is far from clear. So it’s only natural that data worship would take hold in hiring.”

Remember what Rutgers’ Dr. Glass said: “The idea that collecting tons of extraneous facts about a person (Big Data!) and including them in some monster regression equation will improve its predictive value is laughable.”

Meet Ray Dalio, animal wrangler

According to Time, one employer that does its own “people analytics” is Bridgewater Associates, the world’s biggest hedge fund. The company’s founder, Ray Dalio, expresses a belief that HR execs are quickly adopting:

wild-animal“Without data, we are no better than cavemen he says. ‘Society is in its animal, emotional state that is the equivalent of the dark ages. We are in this transition period where all that is hidden in darkness will come out through statistical evidence,’ he says.”

What about all this testing, correlation and prediction to assess candidates for jobs? Peter Cappelli, a leading HR researcher at the Wharton School of Management, cuts to the chase: “Nothing in the science of prediction and selection beats observing actual performance in an equivalent role.”

But none of the executives cited by Time select candidates by observing them actually performing a job.

The Science Of Snake Oil

dissedIt’s no accident that Andy Biga, Charles Phillips, and Ray Dalio are not scientists. They’re snake oil salesmen using fake technical lingo (Behavioral DNA? Jump, Spot, jump!) to impress lightweight HR executives. “Big Data” impresses HR charlatans who hide behind other charlatans to whom they outsource their own jobs — recruiting and hiring.

The bunch of them love to pontificate about “evidence based” assessments. Yet real HR researchers, cognitive psychologists, Time magazine, and the FTC tell us there’s no evidence, no science, and possibly no integrity in any of this.

(There are ways to apply for a job by going around these obstacles. See Fearless Job Hunting, Book 3, Get in The Door (way ahead of your competition)).

We Have Met The Enemy

Job seekers at every level — including some of the smartest, most educated people in America — have met the enemy on the jobs battlefield. And the enemy is job seekers themselves. They’ve let themselves be suckered.

As long as job seekers consent to be treated like commodities, as long as they let their teeth be checked like horses at auction, as long as they subject themselves to imperious bureaucrats who hold up hoops to jump through, then they’ll be abused.

Job seekers are their own biggest enemy. Folks, you have to grow some integrity of your own and refuse to be abused.

So, how do I get a job?

Job seekers tell me all the time that they’re terrified to buck the system. So, how can they possibly land a job in this miasma of phony science, trumped-up hiring technology, and HR bullying?

It’s simple. Please pay attention.

Time reports that job seeker Kelly Ditson finally landed a job after subjecting herself to demeaning online applications and personality tests. She stayed up “as late as two in the morning to finish just four applications.”

In one case, “she made it to the 95th question on the Chili’s [restaurant chain] application only to have [the] wi-fi connection cut out. She had to start all over. Chili’s had no comment for Time. Ditson said she was exasperated… In the end, she got her job the old-fashioned way: calling the manager at the Olive Garden until she hired her. She started in March.”

Ditson went and talked to the manager she wanted to work for. One on one, not one in 150,000.

No one can make a fool out of you if you don’t let them. (See Employment In America: WTF is going on?) When will HR wise up and realize it’s losing the respect of job seekers every day? When will HR realize it’s being played for the fool by software companies masquerading as scientists? When will HR realize that “the people game” is played with real, live people — not phony “evidence” derived from “Big Data” by tech wonks working for stuffed animals in the HR suite?

HR will realize it when job seekers stop rolling over.

My Advice

HR execs say there’s a talent shortage. That puts you in the driver’s seat, folks — it’s a seller’s market!

keep-calm-and-have-integrityThroughout Ask The Headhunter — the website, blog, newsletter, books — I talk (write) myself blue in the face about how to demonstrate that you’re the profitable hire. (For example, Fearless Job Hunting, Book 6, The Interview: Be The Profitable Hire.) The best employers hire those that can do the job — they don’t diddle databases to find people who hate opera singing, know why stars twinkle, or would like to be the color red.

If you don’t say no to employers who treat you like a dog begging for a bone, you’re going to wind up in the dog house. There are good employers and managers who respect talented workers. They will meet you and judge you in person. They will introduce you to their teams and assess whether you can do the work, get along with others, and contribute to the bottom line.

HR executives and the employers they work for should be ashamed of themselves — outsourcing hiring, the most proprietary edge a company has. Ray Dalio is wrong. You are not an animal in an emotional state. Tell any employer or testing company that treats you that way to shove it. And go work for one of their better competitors.

That’s the only way to end the optimized rejection of millions of job applicants.

Is there an end to this? Have you been abused by employers and subjected to “evidence-based hiring” that relies on phony “science” and made-up “tests?” Are you ready to say NO and move on to employers that respect people enough to talk to them rather than “analyze” them blindly? Let’s hear about employers that are worth applying to!

: :

 

Big HR Data: Why Internet Explorer users aren’t worth hiring

In the February 4, 2014 Ask The Headhunter Newsletter, we’re catching up on the TV news segment I told you about recently…

Ask The Headhunter Video

This space is normally devoted to Q&A: A “live” problem faced by a reader, and my advice. But two weeks ago, in the January 20 edition, I asked for your input about how employers use “Big Data” when recruiting and hiring.

I was preparing for an appearance on Brian Lehrer’s TV news magazine. Your comments and suggestions were very helpful — many thanks! I promised I’d share the program with you after it aired, and I’m devoting this week’s edition to it.


.

In this segment, we’re joined by The Atlantic columnist Don Peck, whose article, “They’re Watching You At Work,” is a deep dive into the use of people analytics in hiring. Thanks to CUNY TV and to Brian for his pointed questions. (Brian’s main gig is on New York City’s NPR affiliate, WNYC radio. I’ve enjoyed being his guest many times.)

Corporate HR departments and recruiters have been misusing Big Data — online resumes, applicant tracking systems, job application forms — to recruit and hire for almost two decades. They solicit millions of applicants, then claim none fit the bill. Is it your fault for playing the cards they dealt you in a game they rigged?

According to Peck, it’s no surprise that now employers are doubling down on technology and Big Data, and buying oodles of information about you — so they can correlate it to their fantasy of the perfect job candidate.

For example — no kidding — the browser you use correlates to how successful you will be if you’re hired. Internet Explorer users are “less apt” — no jobs for them! In this data-rich recruiting approach, people analytics render a “decision” about whether to hire you.

What do you think of the ideas discussed in the video? Is HR just getting dumber? Check it out, and post your comments!

: :

Big Data, Big Problems for Job Seekers?

In the January 21, 2014 Ask The Headhunter Newsletter, Nick asks readers for help with an upcoming TV news interview:

There’s no question from a reader this week. Instead, I’m asking all of you readers a question. May I have your help?

I’ve been asked to appear on a TV news show to discuss how HR is using Big Data to watch you at work — and to process your job application without interviewing you. I’d like your input on the topic so I can frame my comments with your interests in mind. I’ll share a link to the program after it airs, and we can discuss it further then.

[UPDATE: Here’s the link that includes video from the TV program: Big HR Data: Why Internet Explorer users aren’t worth hiring]

Nick’s Question for You

Big-Data-KittyAre you frustrated because employers reject your job application out of hand without even talking to you? Tired of online application forms kicking you out of consideration because you took too long to answer questions, or because you failed to disclose your salary history?

Wait — America’s employment system is getting even more automated and algorithm-ized. According to a new report in The Atlantic, the vice president of recruiting at Xerox Services warns that:

“We’re getting to the point where some of our hiring managers don’t even want to interview anymore.” According to the article, “they just want to hire the people with the highest scores.”

The subtitle of that Atlantic column (They’re Watching You At Work by Don Peck) reads: “The emerging practice of ‘people analytics’ is already transforming how employers hire, fire, and promote.”

Does that worry you?

If all goes according to plan (hey, this is TV — all schedules are subject to change), Atlantic columnist Don Peck and I will talk about the rise of Big Data in the service of HR — and I want your input in advance, because I’m worried about the conclusions Peck draws in his article. It’s a very long one (8,600+ words), but it illuminates some of the technology that’s frustrating your job search. Please have a look at it, and post your suggestions to help me frame my comments for this TV program.

Here are the Big Problems I see with this Big Data approach to assessing people for jobs and on the job:

The metrics are indirect.

The vendors behind these “tools” don’t directly assess whether a person can do a job. Instead, they look at other things — indirect assessments of a person’s fit to a job. For example, they have you play a game and they measure your response times. From this, they try to predict success on the job. That determines whether you get interviewed.

The problem is that we’ve known for decades that this approach doesn’t work. Wharton researcher Peter Cappelli throws cold water on indirect assessments:

“Nothing in the science of prediction and selection beats observing actual performance in an equivalent role.”

All that’s being thrown into the mix by these “assessment” vendors is Big Data. But more data doesn’t change anything. In fact, it makes things worse if the data are not valid predictors of success. It’s worse because indirect assessment leads to false negatives (employers reject potentially good candidates) and to false positives (they hire the wrong people for the wrong reasons).

The conclusions are based on correlations.

These tools predict success based on whether certain characteristics of a person are similar to characteristics of a target sample of people. For example, Peck’s article says that “one solid predictor of strong coding [programming] is an affinity for a particular Japanese manga site.” (Manga are Japanese comics.)

Gild, the company behind this claim, says it’s just one correlation of many. But Gild admits there’s “no causal relationship” between all the Big Data it gathers about you and how you perform on the job.

In what can only be called a scientific non sequitur, Gild’s “chief scientist” says “the correlation, even if inexplicable, is quite clear.”

The problem: A basic tenet of empirical research is that a correlation does not imply causality, or even an explanation of anything. Data tell us that people die in hospitals, and that correlates highly with the presence of doctors in hospitals. All jokes aside, that correlation doesn’t mean doctors kill people. Except, perhaps, in the world of Big HR Data: If you’re selling “people analytics,” then playing a game a certain way means you’ll work a certain way.

When we pile specious correlations on top of indirect assessments (What animal would you be if you could be any animal?), we wind up with no good reasons to make hiring decisions, and with no basis for judgments of employees.


INTERMISSION: There’s a hidden lesson for recruiters in Big Data.

Hanging out at a manga site doesn’t improve anyone’s ability to write good code — nor does it predict their success at work. But, it might mean that a recruiter can find some good coders on that manga site — the one reasonable conclusion and recruiting tactic that none of the people Peck interviewed seem to have thought of!


I don’t think Peck wrote this article to promote “people analytics” as the solution to the challenges that American companies face when hiring, but he does seem to think the Kool-Aid tastes pretty good. I think Peck over-reaches when he confuses useful data that employers collect about employee behavior to improve that behavior, with predictions based on silly Big Data assumptions.

To entice you to read the article and post your comments, I’ll share a couple of highlights in the article that kinda blinded me. Well, the assumptions behind them were blinding, anyway:

Spying tells us a lot.

In further support of indirect assessments of employees and job applicants, Peck cites the work of MIT researcher Sandy Pentland, who’s been putting electronic badges on employees to gather data about their daily interactions. In other words, Pentland follows them around electronically to see what they do.

“The badges capture all sorts of information about formal and informal conversations: their length; the tone of voice and gestures of the people involved; how much those people talk, listen, and interrupt; the degree to which they demonstrate empathy and extroversion; and more. Each badge generates about 100 data points a minute.”

Peck notes that these badges are not in routine use at any company.

It’s just a game.

A lot of the “breakthroughs” Peck writes about come from start-up test vendors like an outfit called Knack, which creates games “to suss out human potential.” Knack continues to seek venture funding, and the only Knack client mentioned in the article is Palo Alto High School, which is using Knack games to help students think about careers.

“Play one of [Knack’s games] for just 20 minutes, says Guy Halfteck, Knack’s founder, and you’ll generate several megabytes of data, exponentially more than what’s collected by the SAT or a personality test.”

The big dbig-dataata gathered, writes Peck,

“are used to analyze your creativity, your persistence, your capacity to learn quickly from mistakes, your ability to prioritize, and even your social intelligence and personality. The end result, Halfteck says, is a high-resolution portrait of your psyche and intellect, and an assessment of your potential as a leader or an innovator.”

Let’s draw a comparison in the world of medicine; it’s an easy and apt one: If more megabytes of game data can be used to generate more correlations, could doctors diagnose patients more effectively by collecting bigger urine samples? Because that’s the logic.

No sale.

I don’t buy it. I want to know, can you do the job?

Some Big Data about employee behavior can be analyzed to good effect. For example, Peck reports that Microsoft employees with mentors are less likely to leave their jobs, so Microsoft gets mentors for them. But he seems to easily confuse legitimate metrics with goofy games of correlation. And the start-up companies he profiles don’t seem to be on any leading edge — they’re mostly trying to sell the idea that Big Data in the service of questionable correlations makes those correlations worth money.

(To learn the ins and outs of legitimate employment testing, see Erica Klein’s excellent book, Employment Tests: Get The Edge.)

Big Deal.

We know that what Peter Cappelli says about the science of prediction is correct. But I think Arnold Glass, a leading researcher in cognitive psychology at Rutgers University, says it best:

“It has been known since Alfred Binet and Victor Henri constructed the original IQ test in 1905 that the best predictor of job (or academic) performance is a test composed of the tasks that will be performed on the job. Therefore, the idea that collecting tons of extraneous facts about a person (Big Data!) and including them in some monster regression equation will improve its predictive value is laughable.”

It seems to me that HR should be putting its money into teaching HR workers and hiring managers to hang out where the people they want to hire hang out, and into teaching them how to get to know these people — and how good they are at their work.

In the meantime, is it any surprise to any job seeker today that employers mostly suck at recruiting the right people and at conducting effective interviews?

If you have questions or thoughts you’d like me to raise in this forthcoming TV program, please post them. I’ll try to use the best of the bunch. I wish I could tell you that hanging out on my blog causes employers to hire you. Thanks!

[UPDATE: Here’s the link that includes video from the TV program: Big HR Data: Why Internet Explorer users aren’t worth hiring]

: :