Ethical Dilemmas in Product Management: A candid conversation with Rich Mironov


It's not often that we get to talk about Product Ethics in such a candid way. But, recently I sat down with Rich Mironov to explore the topic. And there were basically three topics that emerged: Products built that purposely crossing ethical lines, products built with no intention of being unethical but end up being used that way, and the responsibilities we have as product managers and leaders to prevent them both.

You can watch the video or read the full transcript below, but here is the tl:dr version.

  1. Whenever we talk about ethical dilemmas and what actions a person is responsible to take, it is key to recognize that often taking those actions are unavailable to everyone and we need to check our privilege.

  2. There are two big types of ethical issues when developing products -- those which are intentionally designed to harm (most often discovered by how money is made) and those which are being used in ways which weren’t intended and are causing harm (surfaced by utilizing devil’s advocate techniques, diverse teams, and groups responsible to pretend to act maliciously).

  3. It is everyone’s responsibility to speak up (see point 1 about privilege) when they realize a product can cause harm. A good test is to ask yourself if you’d be ok telling your friends, parents, or partner about what is happening. This is especially true for product leaders who need to create environments where raising one’s hand is encouraged even if it is to share bad news and potentially ethical guidelines to help start the conversation.

Below is the transcript of the full conversation with outside participants listed as “guest”. Enjoy!

----------------

Tami: Let’s start with the topic of privilege.

Rich: I mentioned the word privilege, I think this is really important. There are a lot of people who have to work to put food on the table for their kids or they are on h1 visas in the US which is a horrible system and punishes the people in it, you got a sick kid who needs the health insurance that comes from your company or you don't have money in the bank. There's a lot of reasons why you may be working at a job on a product that you may not love.

So we want to acknowledge first that this is going to be about people who have the freedom to stand up and say, “I don't want to do that”, and maybe risk firing or losing their job or getting sidelined in some way because it's never, never a popular discussion. We're talking about folks who have a little range of movement here.

And the other is there's no governing body for what we do. There's no official license or certificate that comes from the State Board of Product Management approvals. There's no Bar Association equivalent. It's pretty hard to figure out how you're going to get in trouble just for doing something that other people don't think is appropriate. So, I think this is much more about how we approach the world individually. And as product managers it is not about some rules and regulations that say there's some product management code of ethics, that there's some board that's going to enforce. I haven't seen it. I don't believe in it. I don't think we're in a job where that works.

So I’m framing those as much more of a personal discussion, I think, and how we face the world and whether we're doing things we're proud of. 

Tami: Let’s keep in mind that as people work in technology, part of our ethos is to challenge the status quo. And to say rules need to be broken, and therefore you're probably involved in some sort of culture that's encouraging you to look the other way around something. The question is, where are those lines being drawn?

How do we get better at establishing for ourselves, for the companies we work for, and for the teams we work with where it's not okay? 

Rich: I think that's right. I think we end up drawing lines for ourselves and the people we care about and the folks we respect, but there's going to be a lot of people out there who are taking jobs for a lot of money in companies or doing things that I personally think are abominable, and hateful. And, you know, I may call them out in private, but I probably won't call those individuals out in public.

Product Built with Malicious Intent:

Tami: Let's talk about malicious intent. So, we think about product ethical problems, there are the bad outcomes that actually come as intended, and then those that were unintended. So let's talk about bad outcomes that actually harm products. Someone has bad intentions. Do you think this happens?

Rich: It happens all the time. The way I think of it is, the company itself is in a business that if you inspect how they make money, you should be suspicious. If you look for instance at financial products, there's a bunch of companies who are in the business of at least claiming to be in the business of helping you improve your credit rating, and they have apps and they have all these things and worksheets and stuff.  

But at least several “clean up your credit” companies that I know if you ask where their source of revenue is, they make their money by referral fees from credit card companies for people applying for credit cards. And it's very likely if you have bad credit, and you're maxed out, the last thing you need is another credit card. So, they're setting themselves up to a place where in order to achieve the revenue goals, they're going to take the users of their application to a place that the users probably shouldn't go. Because the folks that are paying them and the folks who are using them have opposing objectives here.

Tami: Like check cashing stores, like a digitized version of them, payday loans, etc. Where they act like they're your savior when in fact, they're going to charge you predatory rates and you're never going to get out of the hole. That's actually their intention.

Rich: That's right. And for folks who don't know there's a couple of brilliant women, Nandini Jammi and Claire Atkin run Check My Ads Institute (https://checkmyads.org/ ), which is taking on the ad tech companies that say that they promote brand safety for major consumer brands. But in fact, those exchanges end up putting lots and lots of those paid ads on hate sites and disinformation sites and things selling Nazi memorabilia – against the ad exchanges’ own stated policies.

And so, these two women have figured out that if they take snapshots of the ads appearing on all these hateful sites, and then send them to the brand managers who didn't know they were paying for hate and disinformation, this is a way to de-platform some of the bad actors. Because in the AdTech space, there's a tremendous incentive to push out ads to more and more places, even if you think they stink. And the dirty secret is a lot of the tech companies say that they're all about brand safety, but when you watch how they behave, the money flows. They're funding all the folks on election disinformation.

Tami: In the nature of ads, there's so many parts of the web, which was never learned about. And randomly one of my jobs, I worked for a web arbitrage company, in 2008. So, web arbitrage for those of you that are unfamiliar, if you've ever Googled for something and landed on a page, because you just type something, and that page is pretty much just a combination of ads that lead you to where you really wanted. That's called web arbitrage, and they pay for that google click at 30 cents a click and then they get paid 60 cents a click for whatever you're actually clicking on.

What was amazing to me was that Yahoo was funding us, Yahoo wanted their ad network ads to be shown on sites and they gave us this premium pipe. I only worked for them for like a month before I fully understood what's going on. And luckily, talking about privilege, I was 26. And I wasn't really involved in product management yet. And I was lucky enough to be invited to Cornerstone On Demand through my connections to join that company. But I definitely would  have stayed at the web arbitrage company there longer at $15 an hour because I didn't have the ability to pay rent otherwise.

Rich: So I'm just thinking about some other things where we know we're likely to get in trouble and I usually think about the financial sector and the whole crypto meltdown of course is horrible but completely predictable. In order to make those kinds of returns, you have to do immoral or illegal or highly risky things and then guess what, you get bankrupt. Let’s go back, for instance, to the bond rating agencies. Companies pay the bond rating agencies to rate the bonds that they are going to bring to market. That payment comes from the company's floating bonds. So, the bond rating agencies have a lot of incentive to put in higher scores than the bond buyers would like. Finance markets are rife with these kinds of mixed incentives.

We'll throw one more out before we let the category go – the company that used to be called Facebook, whatever it's called today. They are in the business of capturing as much of your personal information as they possibly can and selling it to advertisers who want to know all about you, that you don't want to tell them. At every step, we've seen that the safeties that they apply there and others in the market (like everything happening in Twitter) is half-hearted.  It's window dressing. It's spam washing or whatever, because they're really trying to maximize revenue at the expense of the user’s data. If you didn't think that's what they were doing, then I think you're not a product manager who understands your own economic model.

Tami: As we say, follow the money.

Rich: The other category we’re going to get to is bad outcomes that we didn’t intend, but let’s open for questions. Someone called out that Insurance companies incentivize their salespeople to sell insurance or warranties that you don’t really need. 

Guest: I work in finance and we’re utilizing people’s personal data to aid in machine learning and I think it’s a gray area. Even if it’s anonymized.

Rich: I think so too and I might ask what the use case is and whether it’s used for good things.

Bad outcomes not intended

Tami: It’s the sort of thing that Rich and I were talking about are certain employee groups that have stood up against when a new client shows up. Whether it's the government who's using a product or otherwise, employees say “We don't want the NSA using our technology because they're going to do things that are not we intended to do.”

Rich: And how did that end? Most of those people got demoted or left the company. And they signed the contract anyway. It’s a good example anyway. 

Let’s pick on AI for a second, because I think there's a couple of good examples here. I know that a bunch of banks want to automate approvals of mortgage applications, which makes perfect sense. If we can take good applicants out of the loop and approve them in 16 seconds would be great. The 60 years worth of mortgage data they use just accidentally happens to be real historical data. And anybody in the mortgage business knows that until recently (maybe still) there's a lot of redlining in mortgages, where people in poor neighborhoods or have the wrong ethnic group or their names don't sound right, they get their mortgages turned down, even though they have the same finances as people in richer parts of town. And so when we use that 60 years worth of AI historical data to automate mortgages, what we do is we can now Redline and break the law for people who should get mortgages in16 seconds, instead of having somebody spend a whole day doing that. 

Tami: There’s nothing like a computer that propagates bias. 

Rich: That's right. Propagates bias. You know, we've seen a lot  in the vision systems of folks with different complexions who either are or aren't recognized, because mostly training data was white men. 

FDA drugs were for years new drugs were not tested on women. We only tested them on men. And turns out that sometimes women are different from men in the way that they react to drugs. So there's some structural things here that maybe we didn't notice. 

Tami: But then what do you do when you do that? A non malicious intent but all of a sudden you realize that the seatbelt you design doesn't protect pregnant women? 

Rich: This is a different problem. If you're at a company that's doing something that you believe is immoral and unethical, and you're able to leave, I think you might want to do that. If you're a company that's got some really interesting products that really have a use in the world but we haven't thought through how the baddies are going to do this or where the trolls are gonna take us?

Like 23andme… You sent in your DNA, and you didn't think about the fact that some police department picks up DNA from some crime scene. And it turns out one of your relatives left DNA at the site, they get a warrant and they match YOU.. so they know it's somebody in your family.  It wasn't really what the 23andme folks had in mind, but here we are. 

Tami: And is that ethical or not? If you think about the positives of finding a mass murderer or serial rapist which has happened, that's a good thing to put those people behind bars. But then there's the invasion of privacy issues.

Rich: You know, that this one feels complicated and that the folks who have Nest door doorbell cameras that are capturing things in the neighborhood are invading someone's privacy, but maybe it catches a crime? Apple Find My Phone is being hacked by stalkers, but it's useful if you're trying to find your kids. 

There are products that it's not so clear. What I see on social platforms is that the trolls always figure out a way to bend the system, especially if we're not paying attention – if we're not doing what’s called the red team exercise.  Where we have a team that tries to hack our own product, we bring in some outsiders who know how to manipulate systems and people to see where we can get in trouble.

Tami: Anyone here have a Red Team? A group of people who try to break the product you’re working on.

Guest: I work for a Tax software company and we work with a third party who identifies security vulnerabilities, and we implement many of their suggestions. We’re trying to advance, but we’re making progress.

Tami: The third party's mainly concerned with hacking into your database.

Rich: Yeah. And I didn't see any other yeses. I think that's of course what we should all be doing, but it rarely happens and it's expensive and in theory we should pay more attention. I think there's an equivalent exercise where we get some smart folks who have thought a lot about how to twist systems. By now we know that on hotel and travel review sites the majority of the posts are actually paid posts by folks who don't get paid very much and live in Southeast Asia somewhere. They give the paying hotel five stars. If you're gonna be in the reviews business, you have to think about how folks are gonna manipulate your system, and whether that behavior is OK or not.

Tami: To a certain degree, you could explore your terms and conditions and how somebody would violate them.

Rich: Yeah. But, you know, to the extent that we hide behind terms and conditions. I have a slightly different test I would apply, which is if you told your parents or your kids what people are using your product for, would you be embarrassed? Assuming they understood. Or if you're out for drinks with a bunch of friends who you really want to still be friends with over time and are you willing to say, “here's what somebody's doing with our system that we didn't anticipate.” without utter embarrassment. I think that's, that's a much more honest test than in paragraph #411 where we wrote that it was okay to sell all of your personal data and locations in real time to people who don't like you. 

Tami: Agreed. Each team should have a checklist of things that could go wrong, and maybe start with your T+Cs and things that you're not supposed to do. 

Rich: That at least gives you a place to stand if you say we don't accept hate speech and we don't accept videos of people doing things where they haven't agreed to be in the videos. You know at least there you have, you have a way to start canceling some of this out, but then you have to look forward too. 

Tami: Yeah. Let's talk about one of the most public ethical issues of the moment, which is everything going on at Twitter. 

Who feels bad for this crew that is left there? I feel so bad for the people that are left, because I'm sure some of them believe that they're gonna to protect something and I can't imagine they're going to be able to. 

Rich: That's right. I think some people are there because they've worked for years to build really good systems and they don't want the systems to fall apart. And that's both moderation and back office. I think a lot of people are there because they can't leave. So back to the H1B issues. There's a lot of people there who, if they quit or if they're fired, have 60 days to find a new job or they have to move back to where they're from. Indentured servitude is supposed to be illegal in the U.S. but, but there you go. 

It was interesting, I read there's an 11 or 12 page document somebody shared out, from the team that had done all the analysis of what would happen if you let people pay the $8 for the blue check instead of actually doing the verification. Every single thing that was on that page was exactly what happened, but that whole team got fired and nobody cared. We argue about the definition of free speech, but the terms and conditions are being violated all day long. 

Tami: All right. So someone says, yes, Red teams are popular with engineering teams trying to break a product. Yes, we called that Exploratory testing. That's one of the things which Rich and I were talking about in advance. What we really need is red teams deciding whether a product or feature should be built. I've seen this sometimes with UX teams trying to execute design thinking exercises. This is where a product management function can make an impact. 

Rich: So if you go to the very beginning of the process, before we're writing code, before we're interviewing users, you know, whatever, we're chartering this new thing, that's a really good time to decide if this is a bad, a bad product to build. Now, unfortunately, if you're at that place, it's likely that the founders of the company have taken money or the executives have taken money to build this thing and have told the investors already. So I think it's a really hard sell to go to your management and say, we shouldn't build the thing we've announced or raised money for. I do think depending on the situation, I would feel an obligation to do that. 

But you know, you have to understand your organization and whether that's how that's gonna go over because you need to have a plan for yourself. 

Tami: But I think that there's also the option of figuring out how to prevent that poor use, once you surface it. Part of what we do as product managers is we think about a problem. We think about a market, a group of users that has this problem and how we're gonna solve it. I think after we get to that point, we should also say, what else could this possibly be used for?

Rich: How could this be misused? Where else could apply? And by the way, there may be some really good use cases we haven't thought of that are good for the company, good for the planet, make money, you know, take the tech we've done and apply it to a bunch of other really cool things.  So tho those are both the same sort of thinking. But, back to this point, I think we really need to take some time out and ask how somebody with malicious intent would abuse the thing we love in our building. Then, can we fill in some of those cracks? Can we fill in the holes so it's way harder for somebody to abuse our product and embarrass us? 

Tami: Let’s talk about some more examples.

Rich: There’s somebody I worked with years and years ago named Randy Farmer put out a book in 2010 called Web Reputation Systems, which is all about upvotes and all these things that people do on and many of the ways that trolling folks can abuse your systems. His conclusion is that we have to try. It will never get there completely, but that we have to at least take the easy steps. 

One of his great examples, and I dunno if anybody's old enough to remember Farmville. But one of the things that some folks did on Farmville, if you remember, you could get a tractor and you could plant different plants on your field. And so, so there's some folks who figured out what the pixel layout would be on a field full of two different colored plants. So they could put curse words and bad language and things. Basically, they planted plants in the field so that when the plants grew up, the two different colors would spell it out. Of course it wasn't text so no text engine would ever identify that these plants were words in the same way that when you look at those captcha things. The point of the book is there's always ways to work around the system, but there's 10 or 20 obvious things you might do to reduce the volume and make it harder for folks to abuse your system. Now that's what 12 years old and, and it was a couple years in their writing, so not new stuff, but gosh, this has been around for a long time. 

Tami: I feel like every team, when you're coming up with ideas, should ask somebody to play devil's advocate. So similarly, play villain.

Rich: Fun, that's fun. 

Tami: Let them wear the hat, let them rotate responsibilities across your team, play villain. What would you do with our stuff that isn't so kosher?

Rich: That's right. Sometimes you find some outsiders who are just good at this and you can rent their brains for a couple hours and have them entertain you with the ways that they're gonna twist your system in knots. Maybe we can't fill all of the holes, but let's fill some of the easy ones. 

Tami: I just realized that there's a business opportunity here to hire a whole bunch of ex-cons to do that. People who think out of the box in a different way. 

Rich: Yeah. You want to be careful who you hire, but yes. It’s threat modeling, but it's not about security so much, it's about bad behavior. 

Tami: Something you and I were talking about in prep for this with Rich was the nature of video filters against child pornography and it worked backwards?

Rich: Yeah. I don't know if anybody knows the story, for brief time, I don't know if it's still in place, Apple put a filter in place on whatever photos you uploaded to iCloud from your iPhone. They searched them and used an AI video search thing for child pornography. Now, it also turned out to catch all kinds of other things. Like I'm a parent of a small kid who's got a rash on his or her bottom, and I've taken a picture and sent it to my doctor.  And suddenly those folks are locked out of all their accounts. So unintended consequences. These are hard problems, but do we take the time to think them through? 

Tami: This is a good time to jump into what should we do about it? We've been talking about a few different ideas, and something that I think is important, especially for the scenario that we were just talking about with the baby butts is Diversity on your team. There have been a number of studies about how so much of AI and I programming is done by white males, and all the data, and how, as you were talking about with the mortgage situation, that there's a lot of bias that the data just surfaces without you even realizing it was there before. 

The importance of having diversity on your team when it comes to working on the problems, and not just thinking about women or people of color, but socioeconomic status, educational background, et cetera, to help you, just get rid of your group. Think  there are lots of initiatives to hire veterans and otherwise, like, I don't know how many of you know that when fireworks go off on July 4th, it puts a lot of people into P T S D, and if you start shooting off fireworks the day before, or at not 9:00 PM when they're expecting it, it's even worse. And so developing empathy for different groups by having representatives of those groups on your teams could be really helpful. 

Rich: Yeah. It's hard enough to hire product managers, let alone, you know, get 'em across the spectrum. I’ve found that folks who are parents turn out to bring an awful lot of skills to product management that the non-parents don't have. That's an illegal question to ask in the interview, so of course I wouldn't. But, if you haven't tried to negotiate with your five-year-old why we're gonna have our vegetables before we have desserts and sweets, then you're really not equipped to argue with the executives at your company about why we're not gonna take a deal that has a lot of money, but it's gonna crash all your systems. I mean, it's the same set of skills, but I find that folks who've, who've been in different settings, who've worked in different industries or raised kids bring interesting points of view that I might not have. 

Tami: Yeah. Anyone else? I have a question or ideas about how you could prevent it.  

Rich: All, yeah, it’s wide open. Let's do it. Everybody's too quiet. 

Tami: Way too quiet. 

Speaker 5: Yeah. I actually read  a book called Technically Wrong. Uh, for some of you who may have read it, it's a great book, where the author actually says, go ahead and hire Misfits into your organization  just, just to get that diverse perspective. I experienced it, I used to be an engineer and joined a team that had no engineers in it. My way of communication was very different from how the team was communicating. So it took me a while to figure out, okay, what's the lingo? How can I get less structured in how I present information and so on. So you're absolutely right, Tami in that it's not just about the typical race or gender or the typical attributes. 

Rich: What do we do when we've got a product team of seven and four of them are misfits and can't get along with any of our stakeholders? 

Speaker 5: Hey, that's a culture problem. I think that's a culture problem that you can address differently. 

Tami: I also think that as you noted, there aren't that many product manager slots out there in any individual company. But when you're coming up with your product decisions in the same way, you should be incorporating different inputs. Find those misfits on the customer success team or on the sales team or otherwise to join the conversation. One of the participants says one of her best hires was a person who was on the verge of being let go because they wouldn't work within the rules. Do you want to tell us more about that?

Rich: What kind of rules were they breaking? 

Speaker 6: Sure. I can say a little bit about it. This person was in a non-programming role where they weren't supposed to access the system, but he was really clever about accessing areas that he really wasn't supposed to access and get things done for his team. Rather than go through channels. He had been told several times “you can't just do that”. I was managing a development and a support team and I thought that kind of resourcefulness and initiative is what I want on my team. So I hired him into my team and he was kind of an internal hacker, I guess. I knew him and I knew his intentions were good, kind of a purehearted person. And he, and then he went on, I think he worked for that company in a development capacity. He might still be there. 

Rich: Very sweet. Good. If you all don't mind, I'm gonna shift a little bit cuz I want to change it up slightly, which is for me, one of the core skills of product folks, particularly product leaders. Everybody in the product organization should be able to explain to our executive team, particularly the less technical folks, in money terms why something is important. I have the belief that at least for some of your executive team, any sentence that comes outta your mouth that's not denominated in currency won't be listened to and doesn't matter. But, if for instance, you were gonna talk about what advertisers are going to do on your social media when you reintroduce all this hate speech and all this other horrible stuff, you're able to have a discussion that's about money, not just about behaviors or ethics. 

And if we're in a place where, when bad things happen, it hurts the company's bottom line. That's a really very strong argument. So rather than saying, “I have to quit”, go to the executive team and say “if this series of things happens, if people get into our system and steal all the personal data of our customers, if we're flooded with bots that all vote up some crazy thing we now promise to do, cuz we say we're gonna do the number one thing that's voted up, here's how it's gonna cost us money and public relations and embarrass us in the world.” I think that's a really strong argument to make rather than I'm uncomfortable, because a lot of it depends on your company culture, but in a lot of places, your being uncomfortable is not a problem of the execs. 

Tami: I was just gonna add that execs don't want to be embarrassed. 

Rich: That's most of them, yeah. 

Tami: They don't want to be caught with their tail between their legs. Oh, we weren't thinking about that. Your job as an officer of your company is to have fiduciary duties and protect the brand, the company, the revenue, et cetera. And I'm telling you, you're not protecting it right now. And so in not those exact terms, help them have a realization that their name is on the line. 

Rich: If you can go down a list of bad behaviors or bad actors and say, we have this opening where some bad actors could do X, they haven't done it yet, but they're smart, they're gonna figure it out. I want to make sure that our team fixes this before you guys as an executive team have a headline on page three of the New York Times that says, oops, another credit agency has accidentally leaked all of the credit histories of 50 million folks to people who are gonna sell it on the dark web. Or whatever the thing is. Because I think most executive teams, most companies will react well if you can explain it in terms that are less technical and more painful. 

Tami: Yeah. I remember actually one of my projects of Pivotal Labs  we were working with JP Morgan Chase and Jamie Dimon had come up with the realization, this was before the Equifax leak, that if one of the credit agencies had a leak, he wanted to be able to turn off Chase's pipes immediately. That if there was a leak and they found out about it, he no longer wanted Chase to be providing credit information to those companies. In reality, it's not something that really helps because the data is already there. But I liked the idea of saying, we're not going to continue doing bad if we find out something is wrong. 

Rich: This is about thinking and anticipating as best we can. I gotta tell you that some of the smartest folks in the world are on the other side of this line and they're thinking of things that we haven't conceived of or we're not smart enough, or we're just not experienced enough. And so there's no perfect system here, but you know, we gotta try. 

Tami: Yeah. And I think, something we were talking about, as a responsibility of leadership is to create an environment and safety for your employees so that they can surface these problems. That if someone feels like when they raise their hand, they're going to get fired. That's not good. So how do we distribute our privilege to the people who work for us so that they can know how to surface a problem, how to raise their voice and their hand when something doesn't sit right.

Rich: To be their umbrella, right. To be, to be their semipermeable membrane. I'm lucky enough to have been in the C-suite a bunch. I've been in the room where it happens instead of getting the news afterwards.Being able to walk in and say, we as a group have uncovered this potential problem and I will own it. Psychological safety. As a product leader, how do we set this up so that our teams trust us to give them the resources and the time and the thinking and the little bit of cover to do the right things. 

Tami: Something Matt Barcomb and I were talking about is how do we give them the sense that they could leave. How do we help them speak in conferences? How do we give them connections, et cetera, the privilege and the mobility that we feel. They should also feel.

Rich: It's double edged, back to the parental thing. Every parent wants their kid to graduate and go off and do great things in the world without us. I'm terrifically proud of all the folks who've worked for me over the years who've gone on to be better and smarter and more successful than me.  That's a source of pride In the short term. You really want to keep the best folks on your team if you can, because they do really good work for you. There's this trade off between am I helping my folks build their visibility and career and long play? But I don't really want them to go yet. The other half of that, anybody who's been a product leader, I think has been in this chair, if somebody on my team comes to me and says, “I need to leave or I have to resign, or I'm gonna take a job somewhere else.”

We have to check our emotions on that and say “I'm sorry to lose you, but what can I do to be of help? Can you and I plan how we're gonna backfill your job? Can you and I plan how we're gonna do this gracefully and cover the work? How do we position this in a way that's positive for you and the company? Can I help?” Because the day that somebody tells me that they're leaving my group is the day that for me and them, they're gone. Right now, there may be three weeks or six months or whatever your local employment requirement is, but they are mentally checked out. But, at that moment, I think it's our obligation to help people do the thing they need and want to do unless we think it's dangerous or illegal in some way. To send them off with a good farewell and our best wishes. We don't want to put our folks in a situation where we're forcing them to do that. So again, this is about choice. How do we raise the kids? Well, how do we teach 'em everything we know and make 'em big and strong and great product leaders so they can go on and be great product leaders somewhere else? Maybe not today if I can keep 'em for another year. But that's the career arc. Anybody who takes the other approach, such as “you can't leave, I'm not gonna let you transfer to a better job within our company. I'm gonna block your career advancement” has a different set of ethical issues. 

Tami: Switching back to ethical issues, I think that as a leader you can also create guidelines for ethics in the same way we have design guidelines or otherwise that if someone sees a problem, they can say “this is a violation of number three”. “I think this is a problem based on question number five” or something like that. This then elevates the conversation to we've agreed on a set of principles and this doesn't feel right about one of them. Help me create a case financially and otherwise that we can escalate to say we shouldn't go down this path because it's in violation of this and also has financial reputation, et cetera, impacts down the line. 

Rich: Yeah. I think that's great. I don't have such a list. If somebody else does, that would be a great thing to share out. 

Tami: Maybe we can create one.

Rich: Together, maybe we can create one together. There's a blog post.

Tami: Would you want to tell your parents about it? 

Rich: That's right. I think that's a really good test. You know, do you want it written in the newspaper and published to everybody that you know? And if not…. aside from some things we do which are intellectual property or secret sauce. Bottom line, I want to be proud of the work I do. 

Tami: Yeah. Money shouldn’t be earned from bad actors.

Rich: Now again, that assumes you have enough money. But, I want to be able to come home and tell my kid what I did at work today and not have her back away and hide in the bathroom.

Tami: Or at a PTA meeting.

Rich: Good. There you go. We got a couple minutes  Wide open on this or anything? Anybody got an interesting question to throw out or point of view? 

Speaker 5: I'll just say this has been a great discussion and thanks. If you start working on the blog or the, you know, the best practices guide, I'm happy to chime in. I have some materials that I can potentially contribute, but send, we don't have one yet and we need one desperately, 

Tami: Please send it over. We'd be happy to include it. The only thing I wanted to add is that yesterday I learned that Airbnb has a Chief Ethical Officer and that this might become a trend. I want to emphasize to everybody, this is something that everybody needs to own. That if you put one person in the title of them being in charge, it often means that they're the only one who feels responsible and that's not okay. So think about what you as an individual, you as a leader can be doing to, to enable more ethical decisions to be made in your org.

Rich: Products. Sure. Big companies sometimes have somebody who's the advocate. The whistleblower goer to person, the ombudsman. Oh, cool. So they have one at Dell too. Ifyour company has such a person, then you may not have to be the person who carries that burden, but you know, that's a good signal.

Tami: Well, thank you all for joining. Thanks again, Rich. I'm really glad you were able to have this conversation.
-----

Product ethics is an interesting topic and this only skims the surface of a greater conversation we need to be having as product teams. If you can raise your voice safely to point out things of an ethical nature that your company needs to be considering. You are likely at a company that cares about the intended and unintended consequences of its products' use, like all ethical companies should. 

Some additional resources:

https://www.mindtheproduct.com/how-to-make-ethical-choices-when-developing-software-common-questions-answered/

https://ethicalos.org/wp-content/uploads/2018/08/EthicalOS_Check-List_080618.pdf

https://ethicalos.org/wp-content/uploads/2018/08/Ethical-OS-Toolkit.pdf

-----------------

Rich coaches product executives, product management teams and revenue software organizations.  He has also occasionally parachuted into software companies as interim VP Products/CPO.  A seasoned tech executive and serial entrepreneur, Rich has been the 'product guy' at six start-ups including as CEO and VP Product Management.  He is a relentless blogger, speaker, teacher and mentor on software strategy, product management, and aligning “what-we-can-build” with “what-markets-will-pay-for.”


Tami is the founder of The Product Leader Coach where I work with product leaders and teams to realize their potential by focusing on their strengths.

If you enjoyed this post, I am available for product leadership coaching or team training. Learn more about my services and upcoming children’s book.

How to Shine as a Product Leader during Annual Planning

As product people, we love to build great things that delight our customers. Wouldn't it be great if that was our only responsibility? An important part of a product leader's role is annual planning; establishing a great vision and strategy for the coming year. I know it can be one of the most annoying, time-consuming, and painful parts of the duties but it is also a very important, high-stakes part. Why?

A compelling product vision and strategy are what differentiates good product leaders from great ones. Becky Flint writes “A strategic plan requires big picture mission and vision, data, team input, and creative solutions. This is why strategic planning typically involves almost half of the company, from execs to directors, managers, and teams.” “To avoid chaos,” she continues, “a common solution we see companies apply is to remove teams from the process. This can simplify the planning, however, it often results in out-of-touch plans that lack creativity and are harder to execute.” She offers a four step process for the process of creating a strong annual plan in her blog How to Lead Strategic Annual Planning to Achieve More With Less.

A compelling product vision and strategy are what differentiates good product leaders from great ones. Strategic planning typically involves almost half of the company, from execs to directors, managers, and teams. As Becky Flint, CEO of DragonBoat, notes in How to Lead Strategic Annual Planning to Achieve More With Less it’s important to involve individuals where they can have the highest impact. When the process is done right, it builds confidence with the board, other execs, your product teams, and frankly the entire company by providing direction and alignment. 

Need some tips and tricks to do this successfully? I’ve got you covered! 

Keep reading for what I believe are the important steps to craft an inspiring strategy and how to evangelize it throughout your company.

Where to start Data or Vision?

Well, the answer depends on where you are as an organization with establishing a growth strategy and tracking metrics around it. If you don’t have robust data, start small; if you do, be intentional and focused on which metrics you choose to inform your strategic decisions. Either way, you need a strong sense of where you want to go before you dive deep into data about where you are now. A strong combination of both will lead to understanding your options for achieving your goals.

 This seems to be the right time to remind everyone that a vision is 3-5 years out and that there are three levels of vision related to the product. Each of them has different core metrics to monitor which inform annual planning.

  1. Company Vision is measured by your North Star metric as well as ARR, NRR, EBITA, and overall NPS. Reviewing how the company performed last year against those will help set new goals for getting closer to the vision in the coming year.

  2. Product Portfolio Vision is created by considering your annual product portfolio goals. How did the product portfolio perform last year? LTV, CAC and Churn could be good starting points to assess performance. 

  3. Individual Product Vision helps with focus. By narrowing  in on the individual products that can help increase adoption, engagement, or NPS for example, and based on how the individual product performed last year.

I’ll assume you have a strong company vision and North Star metric (if you don’t read this and listen to this) When you are ready to set your Product Portfolio vision... Start here:

Steps to creating your vision:

  1. Clarify and get alignment on how the product portfolio vision should help drive the company vision. 

  2. Create a product portfolio vision in collaboration with the CRO, CMO, and CSO with associated North Star.

  3. Select the biggest problems standing in your way of achieving your vision which you can potentially improve in the upcoming year.

Read Steps to Setting a Vision for more tips and concrete examples to guide you in this process. 

Steps to Understanding your Current State with Data:

  1. Define the key metrics which will surface strengths and opportunities for improvement.

  2. If you’re focused on revenue it should be new business ARR, net retention revenue, close rate, and time to recognize revenue

  3. If churn and retention are the focus, be sure to deep dive into how product engagement metrics are associated with customer satisfaction and churn. 

  4. Segment all data based on geography, customer groups, tenure of the customer, size of the customer, and anything else which is crucial to the way your company thinks about grouping its users.

  5. Leverage the data to identify the biggest opportunities to include in your overall portfolio and individual product strategies.

Read Defining your Current State for more tips and concrete examples of evaluating the current state.

Steps to Choose a Strategy:

  1. Review the 16 Strategies for Growth to ensure you explore all options.

  2. Establish a scoring and voting protocol to evaluate the different options available.

  3. Prioritization-Area of Focus: Work with leaders in your organization for alignment around the top priority problems including what not to focus on. 

  4. Choose which strategy is aligned with your vision, goals, and current state.

Read for more tips and concrete examples of Generating Ideas and selecting an Overall Strategy.

Steps to Deploy/Evangelize Your Strategy:

  1. Establish themes related to the set vision, goals, and focus areas for this year and share them with the individual product teams. You may be using OKRs for this, but product key results are often delayed.

  2. Allow the product managers to create more precise goals for their teams and to generate outcome and feature-driven roadmaps for their products for the upcoming year.

  3. Consolidate the most strategic items into a portfolio-level roadmap for the exec team and internal stakeholders. Share it with smaller groups so that you can iterate based on feedback and get buy-in before sharing widely with the board and customers. (This is important!)

  4. Evangelize the established goals and themes throughout the company and make sure to communicate this will continue to be revisited throughout the year as progress is made.

Read more about Outcome and Feature Driven Roadmaps as well as How to Broadcast Them. 

What's Next???

Now that you’ve established and promoted your annual plan based on the set vision and current state, it’s up to you as a Product Leader to empower the product team to reach the goals you’ve set. Ensure that they have enough time to invest in customer discovery, building prototypes for testing, and solution validation and that they are involving the whole balanced team in these activities. 

Remember, annual planning is a snapshot in time…then the real work of execution starts! During the coming year, it is your responsibility as a Product Leader to push the product managers to always be working on the most valuable items and to help them navigate when plans need to shift based on market changes or new information. Good luck and stay tuned for more helpful tips on how to do that.

Hi! I’m Tami, the founder of The Product Leader Coach where I work with product leaders and teams to realize their potential by focusing on their strengths.

If you enjoyed this post, I am available for product leadership coaching or team training. Learn more about my services and upcoming children’s book.

5 Steps to Interview and Hire a Great Product Manager

As a Product Leader, a big part of your job will be building your team. Sometimes it's because the company is growing and other times the trigger is someone leaving. Either way, it's an opportunity to find a great Product Manager who will add value to your organization.

If you're looking to hire a product manager, it's important to know what to look for in order to find the best fit for your team. In this post, we'll outline five steps that will help you interview a product manager and assess whether they are the right fit for your company. Keep in mind that the best product managers are not only great with strategy and planning, but also excel at execution, so be sure to ask questions that will help you gauge these skills as well. Thanks for reading!

1) Know your goals: Define what kind of Product Manager you are looking for such as their level of experience, their knowledge of the space, their technical skills, their growth experience, their management skills, etc. and establish a scorecard to assess each candidate in a standardized fashion. Iterate on it over time as you see which qualities you might have been over indexing for or others you forgot to highlight.

2) Ensure the right people are involved: Product Managers will interface and collaborate with engineering, design, marketing, support, sales, legal and other teams. Round out the interview loop with representatives from key stakeholder groups who you will want buy-in from. This will allow you to have different perspectives on the candidates, generate goodwill internally, and set the PM up for success. Have the outline of the interview stages available to provide to the candidate if they want to know what the next steps are.

3) Divide and conquer: Don't make the candidate answer the same question over and over again, it makes your team look unprofessional and undesirable. Inform each interviewer of the part of the ideal profile you want them to evaluate and share some sample questions with them for assisting in screening. A full set of questions around skills and experience is available here, but please adjust them to your company. Try and encourage people to start questions with "Tell me about a time when..." AND "What would you do if..." to encourage open ended responses and allow for people without the perfect experience but the right mindset to explain what they would do in similar scenarios. Also, add some fun questions in like "Teach me something" or "What blog/podcast really caught your attention recently?" to let them show their personality too.

4) Provide an IN PERSON Case Study: There has been a movement towards case studies over the past few years, and it's great to see someone in action, but steer clear of a few things. First, DON'T use your own company as an example; it's unfair to ask for free consulting. Second, DO have it be a LIVE experience, so you see how the person works and aren't allowing them to have unlimited time and resources to get the project done. What you're looking for here is the PM's ability to problem solve, realized when assumptions are being made, and collaboratively ask questions to get to the best answers. Provide a board enough case study but one that can be solved in an hour or so. This will be a big time commitment, so it should be reserved for top candidates.

5) Know perfection doesn't exist: It's great to have goals for what the ideal candidate should have, but nearly all of the time you'll have to compromise on some of your "requirements". Treat it like a product and figure out which qualifications you listed are actually "Nice to Haves" and prioritize accordingly. Remember that if someone already has everything you need they'll probably get bored pretty quickly because there isn't much for them to learn and then it'll be back to recruiting time for you. It's better to hire someone who is hungry for knowledge and growth than someone complacent.

Hiring a product manager role can be daunting, but if you go in prepared with solid goals and the right strategy, you'll set yourself up for success. Remember to set your interview goals, ensure the interview panel is composed of people who will inform your decision, be selective of who will ask different questions, provide an IN PERSON case study so they can demonstrate their skills, and don't strive for perfection because it doesn't exist.

You've got this! Now I want to hear from you. What are some of your favorite interview questions?

Hi! I’m Tami, the founder of The Product Leader Coach where I work with product leaders and teams to realize their potential by focusing on their strengths.

If you enjoyed this post, I am available for product leadership coaching or team training. Learn more about my services and upcoming children’s book.

Turn Your Video OFF

Last week while taking part in the CPO Series for Dragonboat I was asked about the nature of the more hybrid workplace and what product leaders should do. One of the suggestions I provided was to setup some zoom calls where turning on your camera is OPTIONAL or encouraged to only happen if you are speaking.

Why? Because Zoom is exhausting!!! Especially in our current back to back 30 min increment work that many product folks find themselves in. So here are a few things you can to to minimize Zoom fatigue for the product organization (and everyone else because let's be serious we talk to EVERYONE!)

1) Take a look at the meetings on your calendar which you lead and see which of them would be fine without video. These are probably team meetings or status updates (which maybe you can eliminate all together and do asynchronously via a dashboard, email, or Slack), but in reality a lot of one-on-one meetings could also be done as voice only. When I mentioned my no video idea to Tad Martin, he told me that he has started scheduling calls with some of his team members instead of video chats.

2) Evaluate if everyone really needs to be part of the meeting. Some of the best companies have strict rules about how to minimize extra people in meetings. Periodically review the list of attendees and ensure that everyone is both receiving and providing value. Be honest that some participants could probably be just fine if they received an email update after the meeting and only attended larger strategic discussions on a less frequent basis.

3) Setup cultural norms for how people with their videos off still need to be engaged. It cannot be that their camera is turned off and then they walk away or allow themselves to be engrossed in another task. This may be through using in app gestures like thumbs up, or responding to group questions via chat functionality, or something else you come up with but do something ensures they are paying attention. And per #2 above... if you don't get enough value out of the meeting, question why you are there to begin with.

Zoom can be exhausting, but there are ways to make it less so. By evaluating which meetings don't need video, minimizing the number of attendees, and establishing cultural norms, you can make Zoom more manageable for yourself and your team.

So... what are you doing as a leader to minimize Zoom/Teams/Hangout burnout??

Hi! I’m Tami, the founder of The Product Leader Coach where I work with product leaders and teams to realize their potential by focusing on their strengths.

If you enjoyed this post, I am available for product leadership coaching or team training. Learn more about my services and upcoming children’s book.

Everything is a Product, Even You

When I tell product leaders to think of themselves as a product, sometimes they give me a confused look. I get that we’re people not products which are bought and sold. But when I say everything is a product, even you, I mean it to help product folks realize that they already have all the tools they need to skyrocket their careers. I believe the steps to launch and advance a successful product, can be applied to a software suite or a person’s own career trajectory.

Let’s take a step back to how I came to this conclusion. I’ve spent nearly twenty years working in product at tech companies in the US, and served as an advisor for companies around the globe. Time and again I’ve seen talented product leaders make missteps in their own careers, including myself. There are variations of course, but the main problem I’ve seen boils down to this: people don’t leverage their strengths as product managers to advance towards their own career goals.

To make my point, I’m going to draw parallels to the activities product managers are already familiar with and discuss how those actions can be applied to their career. As a coach, I love to help other product leaders develop their individual growth trajectories with this product mindset. If you like what you’re reading and want to schedule some time to chat, you can reach out to me here.

Setting the Product Vision = Where Do You See Yourself in Five Years?

Whenever I teach about Product Strategy, I emphasize the importance of starting with a vision. Product Strategy is a system of goals and related choices that work together to accomplish the mission and vision of the organization (-Melissa Perri). The mission and vision represent where you are going, and the strategy is the framework that guides decisions to get there together.

Similarly, you should have a vision for where you want to go which guides your own specific near term goals and choices.

Some people have an established path but many of us aren’t clear about what we desire as an outcome, only that we want a change. When establishing a vision for yourself, you must ask similar questions that you would when setting one for a product. How do you want the future to look different? Which customers (in this case company types or stages) do you want to serve? What are the values you want to be embodied in the vision? What is your role in enabling that future state?

Answering these questions will help build a path forward that will align with both your career and personal goals. You’ve potentially heard of the famous V2MOM’s that Salesforce uses when setting strategic directions for products, but you may not be aware that every employee also has their own personal V2MOM which summarizes their vision and goals for the future as well.

Your personal vision should be three to five years out, and it will provide guardrails for what interim goals you will establish.

Understanding the Current State = Where are you NOW?

When you use Google Maps to get somewhere, you need to set your starting point as well as your destination.The same goes for setting your vision; you can’t achieve your desired goal without knowing where you are RIGHT NOW. Likewise, once there is a clear vision for the product, the product manager steps back and evaluates the current state. We ask things like: What customer segments are happy or churning? Where are deals being won and lost? Which features of the product have high adoption or are ignored? What are the most common complaints from customers and prospects?

If YOU are the product, those questions would be transformed into: What do my peers and managers appreciate about my work? Where have I been successful or failed? What skills do I have that are shining through or are underutilized? What experience am I lacking that impacts my ability to advance my career?

A big part of assessing the current state is doing research. The steps are familiar: check out your competitors, do an honest assessment of capabilities, identify the missing pieces in the core product or the whole offer, talk to stakeholders and customers. Assessing YOUR current state and capability gaps may involve looking at the people who currently have your next dream job and see what roles they had prior to getting there. It will definitely require talking to people who hire and collaborate with people in that future role.

Developing empathy for stakeholder needs helps you develop a product that’s more likely to resonate with your market. When thinking of yourself as the product, that means talking to other team leads, executive leadership, and your peers to develop a better understanding about their roles and what they expect of a product leader. This 360 feedback loop will help you know which actions you can take to get them excited about you being promoted to a higher position.

Now that you understand the current state, you can figure out the gaps to fill which will help you accomplish your goals.

Setting a Strategy = Where will you focus?

You have a vision of where you want to go and understand where you are now. It’s time to assess the obstacles in the way and create a plan to overcome them.

Review the capability gaps, prioritize which of them are most important to solve, and then figure out what you need to improve to get to an improved state. While this is standard when working on a product, this might feel more challenging when thinking about your career. Remember that any growth strategy includes who you will serve and how you plan to serve them. The strongest strategies use competitive advantages to grow in ways others cannot.

Therefore, think about what are YOUR unique selling propositions that only you can bring to an organization. Focus on how you can leverage those skills and experiences to launch yourself into the next step. Joao Moita describes how he utilized Teresa Torres’s Continuous Habits Opportunity Solution Tree for evaluating your own career in this awesome post.

Executing the Strategy : What should you do next?

There is no big red button that says “LAUNCH”. The process of getting towards launch is an iterative one. If you’re going to be presenting to senior leadership about why you should be promoted, think LEAN. Talk to stakeholders, get feedback in loops while building the story of why you deserve this. Tweak your message, reduce risk of wasting time on the wrong focus areas, build your own confidence, and win advocates within the company. Help people see how your accomplishments and progress make you uniquely suited for new responsibilities.

The development of empathy that I mentioned earlier goes both ways here. Share with your peers that you’re looking to advance in your career and that you are actively looking for ways to improve. If they are quality leaders themselves, they should respond positively to your openness. Beyond the feedback you receive through a 360 process, you will also gain support within your organization for the next step.

Years ago, I had a coaching client who was pitching their CEO that they should be CPO instead of SVP of product. With that clear goal in mind, we assessed the barriers ahead which included that their company had never had a CPO and that the CEO wasn’t really sure what the value of that role would be in their organization. Together, we worked to develop a deck that showed what a CPO does, what they currently were doing, and the minimal gaps between the two.

Before presenting the deck, my client networked with some board members, the CRO, and Head of Support to get them on board with this new role and them being the person to fill it. They worked to get their feedback on what they would appreciate in a CPO and we incorporated that into the presentation. When it came time to share with the CEO the PowerPoint, the idea of promoting the individual to CPO had been socialized and supported by many key contacts and it was approved without hesitation.

You don’t have to work with a coach to do this. You can work within your existing network, both within your company and elsewhere, to get the feedback you need to best position yourself.

Monitor Progress = When will you know you’re done?

As you know, a product launch is never the last step. Once a product or feature is out there in the world, we always monitor whether it is reaching the intended targets. For a product, we have telemetry to provide data around our success metrics. For your career, this means both having honest follow-up conversations with leadership… and yourself. This process is iterative and should be revisited regularly.

Are you accomplishing the goals you set for yourself? Are your peers satisfied with your performance in the new role? What more do they wish you were doing? Do those things fit within your vision for your career growth?

By now you’ve established a pattern of communicating around the organization, keep doing that. Check in with the people you spoke to along the way to ensure that the problems you’d discussed helping them solve are still the right problems to work on. Talk to your higher ups about interim goals (some people like the 30–60–90 day timeframe), and communicate your progress. Reach out to those who helped you along the way to say thanks.

One thing which I can’t emphasize enough, is keeping track of your accomplishments. The only guarantee is that things will change, in life, in business, everywhere. Find ways to highlight your achievements in your new role so everyone knows you deserve to be there and potentially be given more responsibility. This shouldn’t be the last time you advocate for yourself, nor your last promotion. Maintaining a list of your successes will provide you the confidence to self-promote and always be growing.

Now, Get to Work!

My hope in laying out the above is that product leaders realize that they already have the tools they need to manage their own professional trajectory. You’re already doing many of these actions EVERYDAY. Think about the ways you can apply the tools you have, and get started on your vision. You don’t have to work with a coach, maybe there are people in your office or broader network that you can ask for help. If you want to set up some time to chat, ask questions and see if we’d be a good fit to work together, reach out to me here. And remember, you’re not the first person, nor are you the last person who will go wants a promotion… the difference is in the actions you take to reach your goals.

3 Tips for Getting a Big Investment from Your Board of Directors

If you’re a Product Leader, then you know that getting a big investment from your board of directors can be a difficult process. It’s important to make sure that you have a clear plan and can communicate the value of the investment in terms for the board to understand. In this blog post, we will discuss three tips for getting your board to approve a big investment!

First, you need to be able to communicate the value of the investment in terms that the board will understand. This means being able to show how the investment will impact key metrics such as revenue growth, churn reduction, and expansion of the total addressable market. It’s important to have a clear plan and firm numbers to back up your case.

Second, you need to build consensus around your plan among your peers and CEO. This is essential in order to get the buy-in from those who control the purse strings. Make sure that you are on the same page with your sales or revenue counterpart before presenting to the board.

Finally, you need to understand your board’s perspective and timelines. Board members, especially investors, will have their own ideas about where to spend money. It’s important to be able to understand their concerns and what they are looking for in an investment.

By following these tips, you’ll be well on your way to getting board approval for your next big investmentץ If you find yourself struggling to do any of the above, it may be worthwhile to reconsider your plan to ensure it is value-oriented, accepted by your peers, and appealing to the board. Thanks for reading!

Do you have any other tips for getting board approval? Let me know in the comments below!

Hi! I’m Tami, the founder of The Product Leader Coach where I work with product leaders and teams to realize their potential by focusing on their strengths.

If you enjoyed this post, I am available for product leadership coaching or team training. Learn more about my services and upcoming children’s book.