(no title)
xraystyle | 4 years ago
One of the biggest problems with it is that an average person, unaware of what NPS is, doesn't understand that giving any rating less than a 9 is essentially giving a rating of zero.
If I have what I would consider to be an average interaction with a business, e.g. I just buy something and leave, no need for support, no problems to deal with, etc., that seems average to me. Based on a non-NPS understanding of a 0-10 scale, I'd say that's what, a 7? But the business now considers this as a failure on the part of the person that helped me at that store.
This is why sales people and phone reps are constantly now asking you to give them a 10/10 rating if you receive a survey, because even if they literally just took your money and handed you change, their jobs depend on you acting as if you had a heart attack and they saved your life by performing CPR or something.
It's honestly a terrible system that produces no meaningful feedback for the company and causes employees to do whatever they can to game the numbers. All you're measuring with NPS is how good your employees are at juking the stats, nothing more.
5evOX5hTZ9mYa9E|4 years ago
I would get so many 10s for the rep (which does not count at all) and 1s for the company which would obliterate my stats. And, only the last person who spoke to the customer was rated, so this encouraged meaninglessly transferring people around like a hot potato.
Number of times I would get a customer who had issues for weeks, and then I take a look at their issue, resolve it in 15 minutes, they would be ecstatic on the call and then the NPS survey comes back, 10 for me and 1 for the company. Then I would get a tap on my shoulder from the supervisor asking me to explain the detractor.
I almost got fired after about 6 months due to my NPS being too low, until I made friends with one of the vets, and one evening in the pub with couple beers too many in him he explained to me that the only way to survive is to game the system. He told me how to crash the call client to prevent it from sending surveys to angry callers, how to transfer people to infinite hold queue which does not result in survey when they hang up, and how to trick the system into thinking that I had and inbound call when I did not (which gave me time to actually do my work, like performing relocations and resolving complex provisioning issues since any time not spent on inbound call was considered to be not adhering to schedule). I went from less than +40 NPS to +90 NPS in one month, so most of the NPS feedback was fake anyway.
LordAtlas|4 years ago
sixdimensional|4 years ago
I like to look at this kind of thing as the one of the dark sides/dark patterns of using data for decisionmaking.
Qualitative measures are important, as is maintaining as much humanity as possible, to have a balanced and healthy culture. Being solely metrics/data driven can lead to cold, heartless, damaging culture (might be efficient or make profit, but very dehumanizing).
afarrell|4 years ago
“The first step is to measure whatever can be easily measured. This is OK as far as it goes. The second step is to disregard that which can't be easily measured or to give it an arbitrary quantitative value. This is artificial and misleading. The third step is to presume that what can't be measured easily really isn't important. This is blindness. The fourth step is to say that what can't be easily measured really doesn't exist. This is suicide.”
erik_seaberg|4 years ago
Sometimes they require writing something to justify a bad score (but not a good score!)
jldugger|4 years ago
Well, at least its not a negative number!
actually_a_dog|4 years ago