Personally I think it would be crazy not to start with putting fake screenshots in front of users to get feedback before you invest development time and energy on what is likely to be the wrong thing. Iterations with a graphic designer are a lot cheaper than iterations with a development team, and are nearly as effective for identifying large usability issues.
The trouble with user feedback normally is that people can't get a sense for how it would work unless they can see it. Sure you can make them put it in writing, but if they haven't seen it they almost surely asked for the wrong thing. So you really need to get them something they can see before you get useful feedback. And you want to do that in the fastest way possible. (Albeit while generally making it clear that actually getting it will take time.)
Back in the 90s, when I worked in consulting, it was business as usual to have a meeting with the client and the next day be back with a mock-up of the application features or interface discussed the day previously. It might have been VB, just GUI with nothing behind it, but clickable. It might be a few flat HTML pages (that would be connected to a database if it were real). There would be no graphics or "polish", it might be literally just black and white and maybe a little line drawing or clip art. The user could play with it and say yes, build this for real and make it look pretty, or let's change this bit, and we would and be back the next day. We even had a fancy name for it, which I can't remember offhand, like Rapid Prototyping Workshop or something. Competitors of ours did this by sending it offshore and having it worked on overnight but we never did 'cos it was as much work specifying it in enough detail to do that that we might as well just hack it up on laptops ourselves in a hotel room.
Anyway, not only is this approach nothing new, but at no point was it ever claimed that anything existed that didn't, and clients were very happy with this approach (esp. if they'd been used to "business analysts" drawing "data flow diagrams" on paper then coming back a year later with a steaming pile of crap that did nothing anyone actually wanted).
It makes sense to show potential customers pre-development screenshot mockups but I find it mildly sleazy to deliberately lead them to believe that these are screenshots of an actual working system.
It's surprising to me that in that entire thread, not one person expressed any misgivings about the fact that the author actively deceived his/her customers (indeed practically brags about having done so). This despite the fact that the OP added:
There has been a lot of discussion about what the anonymous poster did right. How about some things that he/she could have done better?
I just joined the group to post that surely he/she could have done better by not lying. But the thread is old and there was no Reply link, which is just as well: it would have been rude to butt in like that.
I've been vaguely aware of this group for a while. I've read several of Eric Ries' posts, I have Steve Blank's book, and I like Steve Blank's blog a lot. The ideas of customer development make a lot of sense. But the above makes me think there's something wrong with this community. I'd rather surround myself with people whose first reaction to something like that is WTF.
Edit: Obviously if the message to the customer had been, "these are just mockups as we figure out what you need," there would be no ethical objection. That's part of what I can't understand. What would have been the problem with just telling the truth?
OP did tell the truth. Your interpretation adds judgment.
The relevant facts to the listener (prospective customer) are:
- "This is a picture of software to buy"
- "This software to buy will solve your problems."
Here is what you added:
- "These are just..." we ourselves do not believe that this software to buy is valuable despite we are here to convince you that this is software to buy is valuable
- "figure out..." we ourselves do not believe that this software to buy will solve your problems despite that we are here to convince you that this software to buy will solve your problems
Except the LOIs in this case are utterly meaningless. I've been on the customer side of LOIs that were signed on request, knowing that it obligated us to nothing.
Starting with prototypes and mockups? Great idea. Definitely the only way to go. Deliberately misleading customers into thinking those are actual screenshots instead of mockups? Ugh.
Part of the reason it's so hard to sell software is that so many people have historically sold vaporware, which makes life harder for those of us that go out of our way to be honest with customers about what's implemented, what's a mockup, what's planned, and what's promised. Customers don't trust us because they've been screwed over by decades of shady sales guys.
Please, let's not contribute to the horrible, shameful record of software companies lying to customers in order to get sales. (And yes, I personally count "deliberately misleading" and "outright lying" as approximately the same thing: if lying about X is unethical, so is deliberately misleading someone about X.)
This is possibly the sleaziest way to describe what most people would describe as a great paper prototyping session. Everyone should be doing this, it's super easy, you don't even need to photoshop anything, just draw out your interface on paper or use balsamiq.
Would have anything changed if he hadn't been shady about it? No, except he wouldn't have come off soundingly like a d-bag.
"BUT it definitely does NOT have the super-duper-hyper-ultra-cool Web 2.0 spit and polish about it because we haven't been able to find a good, dependable designer who works at
reasonable rates."
Couldn't he have just said: "But it doesn't look good because we can't afford a good designer."
A lot of commentary about whether this is lying/unethical.
Have you ever played poker?
Salient quote:
we told our potential customers that we were
actively developing our web app (implying that code was being written) and wanted to get potential user input into the dev process early on.
Does paper prototyping fall inside of your dev process or outside of it? It's definitely inside mine.
If you bet on every round of poker based solely on the cards in your hand, you'll lose.
I have started working on something similar. I have 3-4 ideas of apps I would like to do. I figure it would be far easier and way cheaper to launch landing pages for each, with mocked up "screenshots" of the apps. I plan to include on each of the apps a form to provide your email address in exchange for an invite. Then, I would do some simple SEO and word-of-mouth marketing and see what kind of response rates I would get back through this form. I figure in the end, this would help identify which application has the lowest barrier to adoption (e.g. easier discoverability, more user interest).
...he had spent the last 6 months in a cave writing a monster, feature-rich web app for the financial sector that a potential client had promised to buy, but backed out at the last second
Wait a minute, because one of you got burnt and lost 6 months of work, now you won't do any work? With today's technology, I have to think there's a good middle ground between 6 months of dev work and paper prototype only.
If I was one of your prospects, I would never sign a letter of intent based on drawings only. I'd make you come back later with something, anything I could play with for 2 reasons:
1. I'd want to see that you can actually produce something, no matter how limited.
2. There's a huge difference between playing with something and talking about something. We'd arrive at a real functional requirement much faster with a working model. Anything less is just waterfall analysis and design, and we already know how well that works.
Come back when you have something real to show. Until then you're no different from any other poser.
Don't most industries work with prototypes? As long as no lying is involved it seems okay.
Besides, most of the projects I've worked on don't actually begin until after the first delivery (when the customer finally looks at the software and starts deciding what they _really_ want!).
Like some of you, I disagree with the idea of propping up stuff for the purpose of making your prospects believe that you're up to something helpful. I call it "the feel good factor" entrepreneurship is supposed to be hard work nothing simple.
Like the guy who used markups in the 90's, I come from the school that seeks a point of pain and then start working your way into solutions.
I learned this from the advertising agencies where I worked a few years ago. Client came in with a problem, specified the problem and the particular need for a solution and wrote this out in something called "a creative brief" we took this info, worked our way into sketches, prototypes and then convinced the client that we had a solution.
Convincing the client meant conducting independent customer research and validation.
Lots of iterations where done but at no point did we push, shove or even seek to misled clients for the sake of validating our ideas without hard work done.
I like customer validation. I use it everyday. But I want to do my research and some hard work and then let the customer guide my way. Real MVP and real customers and then we can do all the supper stuff. But you have to be willing to do the hard work and the phony part makes me uncomfortable.
Awesome case study. Totally what we did with our new pivot
(same market B2C Customers - Saas), that is now in the works (didn't do this first time around, and paid for it). Only difference, we told the customer that these were just high fidelity screen mockups for the product we will eventually be building.
Get your screens in front of customers before you ever code. It is mind BLOWING!
Wonder how well this would work for consumer web... thoughts?
Seems so to me, and somewhat pointlessly, too. You're working closely with companies who are willing to sign letters of intent and stick with you after a botched install, but you think you have to lie about having code written? There's a disconnect there...
i don't think so, no, as long as money isn't exchanging hands until a product is actually available for sale/use.
the letter of intent isn't legally binding, so its just a way to gauge business interest.
i mean, i'd be willing to sign a non-binding LOI if it meant someone would make use of it to independently develop an application that i would find beneficial.
Is selling any unrealized concept unethical? Is pitching you an idea for a company in trade for your money wrong?
I think it becomes unethical when you begin lying: "Production of the app is coming along nicely! Here are a few more screenshots from development this week."
So the question might be more accurately: do you position this so you don't have to lie to a potential customer, but have them assume it exists? Is that positioning unethical? What do you say if they ask you point blank?
This is very interesting when working with B2B style consulting, but the real trick is to apply these MVP practices to the creation of entire new B2C markets.
[+] [-] btilly|16 years ago|reply
The trouble with user feedback normally is that people can't get a sense for how it would work unless they can see it. Sure you can make them put it in writing, but if they haven't seen it they almost surely asked for the wrong thing. So you really need to get them something they can see before you get useful feedback. And you want to do that in the fastest way possible. (Albeit while generally making it clear that actually getting it will take time.)
[+] [-] gaius|16 years ago|reply
Anyway, not only is this approach nothing new, but at no point was it ever claimed that anything existed that didn't, and clients were very happy with this approach (esp. if they'd been used to "business analysts" drawing "data flow diagrams" on paper then coming back a year later with a steaming pile of crap that did nothing anyone actually wanted).
[+] [-] NathanKP|16 years ago|reply
[+] [-] uuilly|16 years ago|reply
[+] [-] gruseom|16 years ago|reply
There has been a lot of discussion about what the anonymous poster did right. How about some things that he/she could have done better?
I just joined the group to post that surely he/she could have done better by not lying. But the thread is old and there was no Reply link, which is just as well: it would have been rude to butt in like that.
I've been vaguely aware of this group for a while. I've read several of Eric Ries' posts, I have Steve Blank's book, and I like Steve Blank's blog a lot. The ideas of customer development make a lot of sense. But the above makes me think there's something wrong with this community. I'd rather surround myself with people whose first reaction to something like that is WTF.
Edit: Obviously if the message to the customer had been, "these are just mockups as we figure out what you need," there would be no ethical objection. That's part of what I can't understand. What would have been the problem with just telling the truth?
[+] [-] motoko|16 years ago|reply
The relevant facts to the listener (prospective customer) are:
- "This is a picture of software to buy"
- "This software to buy will solve your problems."
Here is what you added:
- "These are just..." we ourselves do not believe that this software to buy is valuable despite we are here to convince you that this is software to buy is valuable
- "figure out..." we ourselves do not believe that this software to buy will solve your problems despite that we are here to convince you that this software to buy will solve your problems
[+] [-] nobody_nowhere|16 years ago|reply
1. You're not your customer/user
2. Identify the minimum viable product
3. Incur technical debt wisely
4. Get feedback early and often
Pursuing angel financing with those signed LOIs is a completely different ballgame from showing up with an idea, or even working code.
[+] [-] ams6110|16 years ago|reply
[+] [-] akeefer|16 years ago|reply
Part of the reason it's so hard to sell software is that so many people have historically sold vaporware, which makes life harder for those of us that go out of our way to be honest with customers about what's implemented, what's a mockup, what's planned, and what's promised. Customers don't trust us because they've been screwed over by decades of shady sales guys.
Please, let's not contribute to the horrible, shameful record of software companies lying to customers in order to get sales. (And yes, I personally count "deliberately misleading" and "outright lying" as approximately the same thing: if lying about X is unethical, so is deliberately misleading someone about X.)
[+] [-] bjclark|16 years ago|reply
Would have anything changed if he hadn't been shady about it? No, except he wouldn't have come off soundingly like a d-bag.
[+] [-] lupin_sansei|16 years ago|reply
[+] [-] jimbokun|16 years ago|reply
Couldn't he have just said: "But it doesn't look good because we can't afford a good designer."
[+] [-] nobody_nowhere|16 years ago|reply
Have you ever played poker?
Salient quote:
we told our potential customers that we were actively developing our web app (implying that code was being written) and wanted to get potential user input into the dev process early on.
Does paper prototyping fall inside of your dev process or outside of it? It's definitely inside mine.
If you bet on every round of poker based solely on the cards in your hand, you'll lose.
[+] [-] zacman85|16 years ago|reply
[+] [-] edw519|16 years ago|reply
Wait a minute, because one of you got burnt and lost 6 months of work, now you won't do any work? With today's technology, I have to think there's a good middle ground between 6 months of dev work and paper prototype only.
If I was one of your prospects, I would never sign a letter of intent based on drawings only. I'd make you come back later with something, anything I could play with for 2 reasons:
1. I'd want to see that you can actually produce something, no matter how limited.
2. There's a huge difference between playing with something and talking about something. We'd arrive at a real functional requirement much faster with a working model. Anything less is just waterfall analysis and design, and we already know how well that works.
Come back when you have something real to show. Until then you're no different from any other poser.
[+] [-] alain94040|16 years ago|reply
[+] [-] percept|16 years ago|reply
Besides, most of the projects I've worked on don't actually begin until after the first delivery (when the customer finally looks at the software and starts deciding what they _really_ want!).
[+] [-] edw519|16 years ago|reply
A screen shot != a prototype
A prototype = code that runs
[+] [-] dskhatri|16 years ago|reply
[+] [-] bulkeb|16 years ago|reply
Like the guy who used markups in the 90's, I come from the school that seeks a point of pain and then start working your way into solutions.
I learned this from the advertising agencies where I worked a few years ago. Client came in with a problem, specified the problem and the particular need for a solution and wrote this out in something called "a creative brief" we took this info, worked our way into sketches, prototypes and then convinced the client that we had a solution.
Convincing the client meant conducting independent customer research and validation.
Lots of iterations where done but at no point did we push, shove or even seek to misled clients for the sake of validating our ideas without hard work done.
I like customer validation. I use it everyday. But I want to do my research and some hard work and then let the customer guide my way. Real MVP and real customers and then we can do all the supper stuff. But you have to be willing to do the hard work and the phony part makes me uncomfortable.
[+] [-] ebloch|16 years ago|reply
Get your screens in front of customers before you ever code. It is mind BLOWING!
Wonder how well this would work for consumer web... thoughts?
[+] [-] sachinag|16 years ago|reply
[+] [-] Shamiq|16 years ago|reply
[+] [-] jfager|16 years ago|reply
[+] [-] noodle|16 years ago|reply
the letter of intent isn't legally binding, so its just a way to gauge business interest.
i mean, i'd be willing to sign a non-binding LOI if it meant someone would make use of it to independently develop an application that i would find beneficial.
[+] [-] bprater|16 years ago|reply
I think it becomes unethical when you begin lying: "Production of the app is coming along nicely! Here are a few more screenshots from development this week."
So the question might be more accurately: do you position this so you don't have to lie to a potential customer, but have them assume it exists? Is that positioning unethical? What do you say if they ask you point blank?
[+] [-] unknown|16 years ago|reply
[deleted]
[+] [-] jorgem|16 years ago|reply
It's important to validate the pricing and business model -- and you can only do that by selling it (charging for it).
But, a good read.
[+] [-] joej|16 years ago|reply
I found this to be a really tough part of my project as well.. Good designers are often really hard to find and charge a shitload..
[+] [-] dominiek|16 years ago|reply
[+] [-] chanux|16 years ago|reply