top | item 19290743

(no title)

acslater00 | 7 years ago

I ask most candidates to write code on a whiteboard in front of me and I’m not apologizing for it!

The problem is usually fairly easy and if the candidate cannot get to a “describe solution in words” milestone then I will guide them to one. After that I ask them to write code. I will also tell them “the code is the part I care about”.

The specific competency I am evaluating here is “can you turn thoughts into code”. I repeat that phrase in interview training so much I think people make fun of me for it.

Imagine I give you a python list with 100 elements and I ask you to write code that will find all instances of the number “5” and move them to the front of the list. I don’t care about performance.

You know you have to write a loop and whenever you see a 5, remove it and put it at the front. Easy. Not even really an “algorithm”. Some people can make code happen very easily and accurately. But some people really need to really think about it - what control flow to use, off by one errors, bounds issues - and make mistakes. Some people don’t see their own bugs. Some people do weird stuff that makes me think they haven’t seen a lot of code before.

I teach interviewers to evaluate the act of the writing as much as the end product, kind of like when airport security asks you “where did you stay in New York” and doesn’t really care about the answer so much as how shifty you look when answering it. It doesn’t mean you have to materialize perfect code on the board to pass - not even close! But this exercise provides information, and when other exercises corroborate that information we use it to make a hire/nohire decision.

Anyway, bottom line is whiteboard code is a completely reasonable technique to deploy in an interview setting and if you do this you shouldn’t feel bad about it. Much more depends on (a) whether the interviewer is trained and calibrated and (b) whether the company knows what it is even trying to evaluate than the question format.

discuss

order

pmikesell|7 years ago

Thank you for writing this post. Whiteboard code interviews get a lot of hate on HN and I suspect that folks who have come to rely on them for part of their hiring signal have simply stopped posting.

I've done a lot of lower level systems work and the fact is that even with a long career and history of very successful product I get whiteboard coding interviews when I look for a job ... and it's just fine. Yes it's not the same as day to day work, but it's related, and I have to admit that I find them kind of fun.

Maybe there are 2 types of "programming jobs": 1) you will have to implement data structures and algorithms, or 2) everything will be provided for you in a language or framework. For job type 2) CS is not needed - it's not a computer science related position ... it's "frameworking". I'm guessing that a lot of the whiteboard hate comes from type 2) people applying for type 1) jobs, OR type 2) companies asking type 1) questions.

For more history around whiteboard coding, there's the excellent "Why Can't Programmers Program" post: https://blog.codinghorror.com/why-cant-programmers-program/

I would like to actually figure out what is the bet way to do interviewing for coding positions but it's super hard to actually have these kinds of discussions on HN now without people getting upset at even suggesting whiteboard coding interviews.

creato|7 years ago

> Thank you for writing this post. Whiteboard code interviews get a lot of hate on HN and I suspect that folks who have come to rely on them for part of their hiring signal have simply stopped posting.

It seems like there's a population of engineers that is perpetually interviewing. I think the people that post significantly about this are people that are struggling with frequent interviews, and correctly or not, lash out at whiteboarding as why they are having trouble.

Maybe there's some large pool of otherwise qualified people that just can't pass interviews and are being passed over because of it, but I really doubt this is significant.

My personal opinion: I don't mind white board interviews. I'd do a take home test, but I would prefer a traditional interview. And being a short term contractor (also comes up frequently in these threads) as an interview process is obviously impractical.

skwb|7 years ago

You forgot to mention the permutation of companies "wanting" 2), but using the search strategy optimized for 1) approach due to:

- poor HR communication

- poor ability of hiring managers to know what the job entails

- hiring managers past experience hiring primarily for 1), but assuming projects that now need 2)

onlyrealcuzzo|7 years ago

As a hiring manager, I agree wholeheartedly with the root comment.

I love whiteboard interviews. Really. I do.

The problem is -- most start-ups are terrible at them. And most people interviewing at FAANG don't understand the reason those companies ask these types of questions.

Top tech companies ask hard interview questions for a few reasons.

They're not necessarily trying to hire the best people. They're trying to ensure the people that they do hire aren't incompetent. Hardly anyone incompetent is going to pass Google's interview process. Period.

Why are they so focused on not hiring incompetent people? It's not easy to fire people for being incompetent (or even worse -- toxic).

So if they're just trying to not hire incompetent people, why are the algorithms questions MUCH harder than the problems you face on an average day?

Two reasons. One, they have so many people interviewing, why would they not set the bar arbitrarily high? Two, the amount of people willing to cram and do almost anything for the job means they HAVE to set the bar high.

Now let's talk about the beef with start-up whiteboard interviews. Most of these interviewers have never been formally trained. They're just winging it. They ask questions that don't lend themselves well to a whiteboard. And they don't know what to look for during the interview!

A good whiteboard question does not rely on a trick or an obscure data structure. It doesn't have any gotchas that if you "get it" make it much easier.

A good question is slightly difficult to solve, but has many possible ways to solve it -- each with it's own trade offs. Ideally, none of them are much easier or harder than the others.

It's MUCH more impressive if a candidate can come up with 2-4 ways to solve a hard LeetCode easy problem or an easy LeetCode medium problem -- then for a candidate to happen to know the right combination of obscure knowledge to solve 1 LeetCode hard problem.

If you have 2-3 whiteboard interviews, and a candidate can come up with 2-4 totally different ways to solve the problem, and he materialize those thoughts into code -- there's a very slim chance s/he's bad.

The ideal candidate can discuss the tradeoffs of different solutions, and ask clarifying questions about the usage to figure out an optimal solution.

When you get to performance tweaks for edge cases, can the candidate weigh the pros and cons of adding the complexity for a certain gain.

Is it worth it to add some complexity to class to take an algorithm from 2n to n? Maybe. It depends on a lot of things...

I once worked with a guy who would ask a question that could be solved in O(N) time and O(N) space somewhat easily. But the question could also be solved in O(N) time and O(1) space IFF you knew some (discreet) discreet math. Almost everyone who didn't get the O(1) space solution he would say was a no hire.

Probably less than 10% of the engineers I've worked with have taken discreet math...

Another guy would ask a question that MOST candidates couldn't even comprehend, let alone come up with a solution. Most of the people that solved it would solve it O(n!) Or O(n^3). Occasionally, people would solve it O(n^2). But there is an O(n) solution. And that's what he was looking for. Literally NO ONE ever got it.

These are not good interview questions!

ummonk|7 years ago

If you're testing for their coding process, why do you make them write it out on a whiteboard? Why not provide them a code editor or at least text editor?

I like whiteboard interviews, but they should be testing high level design ("describe solution in words / detail in pseudocode"), not coding skills.

isoskeles|7 years ago

How is providing a code editor or text editor different than writing it out on the whiteboard?

I do a similar process and don't care if their syntax is exactly correct. I, maybe different from the person you're responding to, don't care if they use exact libraries in the precisely correct way. But I do care that they're able to come up with a plausible solution.

At a point, I see people gripe about whiteboard interviews and "specific answers" to questions enough that I'm all in on whiteboard interviews. If someone has an attitude problem over it, I don't want to work with them. God only knows how unwilling they'll be to do something simple like look into the source code of some library they're using. "The job description didn't say I had to do this!"

I realize I am being overly-emotional here, but the HN and broader attitude problems around something as simple as writing a for loop on a whiteboard irk me so much at this point, babying and coddling people, apparently older people who I thought knew how to adapt to whatever life sends their way since they weren't the everyone-gets-a-trophy generation.

black-tea|7 years ago

I give whiteboard interviews. Believe it or not, I am intelligent. I am not going to disregard you because you got some minor syntax wrong on the whiteboard. I can tell the difference between a fundamental misunderstanding and a mistake that happens due to using a language that wasn't designed to be written on whiteboards. If you, the candidate, don't understand that, then I guess you are not fit for the role anyway.

programmarchy|7 years ago

I don’t really understand the whiteboard hate either. Take home tests don’t reveal how a person communicates or collaborates. Maybe it’ll predict competency for siloed heads down work, but even for those positions you need to be able to explain solutions, get feedback on the approach, and be able to incrementally adapt to new requirements quickly. Even when programming solo I’d wager most people are using pen and paper to sketch out solutions so it’s not like it’s an implicitly unreasonable request to then do this on a whiteboard in a group setting.

And to address the OP more directly, are loops, maps, trees and graphs really “CS trivia”? They seem more like fundamentals to me, and those are usually the subjects whiteboard tests revolve around.

hector_vasquez|7 years ago

As a manager, finding folks who can turn thought into code is certainly required. However, a whiteboard does not and cannot measure that. The only effective way to measure the ability to turn thought into code is for them do it for real. Writing on a whiteboard is simply not coding nor is it an adequate proxy.

switchbak|7 years ago

Hiring people is also about portraying your company in a positive light. Your allusions to the TSA security screen, and how you have to be "trained and calibrated" seem to imply a robotic kind of detachment that would probably be very off-putting to me.

Often employers seem to be of the mind that they have the treasure and it's up to them to filter out the best candidates (sellers market I suppose) regardless of how they appear in the process. I would imagine that a lot of brilliant people get turned off by this. Which (oddly enough) is also fine by me - like dating, I'd rather spend my time finding an open minded/humane place to work, and I find hiring practices are often a rough initial proxy for that.