Menu

Posts tagged “product strategy”

Google Search's Death by a Thousand Cuts

Matt Rickard reminds us that it’s worth considering the long-term effects that putting public APIs behind paywalls might have on search engines:

Large models are trained on public data scraped via API. Content-heavy sites are most likely to be disrupted by models trained on their own data. Naturally, they want to restrict access and either (1) sell the data or (2) train their own models. This restriction prevents (or complicates) Google’s automatic scraping of the data for Search (and probably for training models, too). Google will lose results, site by site—it will be Google Search’s death by a thousand cuts.

Airbnb and the future of product management

I am finally catching up on the big “Airbnb canceled PMs” debate of 2023, and like most online arguments the whole thing seems pretty silly to me. First, here’s a good overview from Aatir Abdul Rauf, in which he publishes the full quote from CEO Brian Chesky:

“…The designers are equal to product managers. Actually, we got rid of the classic product management function. Apple didn’t have it either.

5-second applause

(smiling) Let’s be careful. Hold on.

We have product marketers. We combined product management with product marketing and we said you can’t develop products unless you know how to talk about the products. We made the team much smaller and we elevated design.”

Aatir does a great job of putting the quote in context of the entire talk, so it’s well worth reading. The TL;DR is this: “Airbnb didn’t kill PM. They relabeled it and consolidated their team roles.” That seems like a completely reasonable organizational change to make within the context Airbnb is in, and considering the thought they clearly put into that decision. It definitely won’t work for every organization, but it’s also clearly not some kind of thought leadership mandate that they want to force on the entire industry.

I say good for Airbnb for making a decision that aligns their organizational design with the way they believe they can design and develop products most effectively. One last plug for Aatir’s post: he does a great job explaining the Product Marketing function, and what product managers can learn from it.

Now, the real topic I want to get to with this post is this idea of merging PM into other roles. That concept has been around as long as the profession itself. As with so much in product, it’s not inherently good or bad, it’s about the context of the change. Here’s another example (that I happen to agree with). In Melissa Perri’s response to the controversy she made a slightly different case that the PM role will start to merge with the GM role:

Product Management has always firmly sat between business, tech, and the user/customer. In SAAS companies, the Product Management role has always been about figuring out how to grow the business by solving customer problems with the right software. In other companies that are not software-native, you saw this same act being done by GMs of the business, but just with the tools available to drive the business at the time - sales, marketing, and human operations. What does a GM look like in a product-led business? Someone overseeing the teams that build the things you sell.

As more and more companies become predominately software companies, I believe the Product Management role and GM roles are going to merge. You won’t be a great GM unless you deeply understand software, along with understanding your domain. Product Management was never purely about “tech” and if companies were treating it so, of course, they didn’t see the value of the role.

The point is that organizations will always need someone who understands the product, customers, technology, and the broader market—and guides conversations towards what that all means for priorities and what to work on to help the business grow. In the current SaaS environment we’ve settled on that role being filled by product managers. That’s great, but it might not always be so, and that’s ok too. It doesn’t mean we’ll lose our jobs. It just means we’ll keep evolving.

How to optimize your pricing page

Good advice here from Kyle Poyar on how to optimize your pricing page, including a reminder to emphasize benefits, not features:

Did your feature matrix get dumped on your pricing page as-is, leading to confusion and eye-rolls across your target buyers? Don’t do that. Tell a story about what the customer can do with the feature.

Managing feature requests from stakeholders

It might be controversial, but I tend to agree with Kax Uson point about managing feature requests from stakeholders:

I have learned that it’s perfectly alright for stakeholders to have solution requests. And to expect them to bring problems to us is unrealistic.

The post gives some good advice on how to translate solution requests into problems/opportunities that teams can solve:

Speak the language they speak. Talk about the benefits and impact of their requests. If you do build the feature they’re asking for, what value would it provide for the customers/users and the company? Speak in outcomes.

Metrics to check when evaluating a company as a job seeker

There’s some really good advice for job seekers in Carilu Dietrich’s post 10 Most Important Metrics For Evaluating a Company:

Net Dollar Retention (NDR) is one of the best ways to see if a tech company is healthy and growing. It measures the expansion or contraction of a company’s existing customer revenue over a given period. NDR takes into account the revenue lost from churn and increased revenue from upselling, cross-selling, and renewals from existing cusomers.

I would also add Gross Revenue Retention to that list. It describes how much revenue a company keeps from its existing customers over a specific period, not including any new revenue from new customers. So, if a company started the year with $100 from its existing customers and ended the year with $90, even if they lost some customers but upsold others, the gross revenue retention would be 90%. It helps guage how good a company is at keeping its current customers happy and continuing to spend money, without taking into account any new business they’ve gained.

How generative AI might change the product profession in the future

I promise this isn’t going to become an AI blog, but Marty Cagan’s latest on Preparing For The Future has some solid points on how generative AI might change our profession. Here he talks about the impact on QA:

The new generation of AI-based test automation tools has the promise to revolutionize our approach to ensuring the product is behaving properly. On the other hand, our current approach to quality is largely based on deterministic products.  This means that given a set of inputs we can predict what the appropriate output should be, and we can count on that being true indefinitely.  

Yet for many new products built on generative AI, our products are no longer deterministic, but rather probabilistic.  We can no longer count on the same inputs generating the same outputs.  For many contexts, this is not a problem.  But for other contexts, especially when safety is involved, this will require different approaches to ensure appropriate behavior.

Also, yes please:

For those product managers of empowered product teams, the time spent creating artifacts such as written narratives, roadmaps, PRD’s, and acceptance criteria, as just a few examples, should be significantly assisted by the new generation of tools, some of which are already starting to appear. Even at the very rudimentary level, if the new generation of tools can significantly reduce the time a product manager (or engineer) spends dealing with tools like Jira, that will be a substantial win.

Evaluating AI product opportunities by plotting them on a “Survival Curve”

Aniket Deosthali (Head of Product for Conversational Commerce at Walmart) provides a great framework for evaluating AI product opportunities in How to Build AI Products People Want:

The most efficient way to evaluate AI opportunities and unlock the advantages of AI is by using the Consideration x Context framework. Let’s start with some baseline definitions.

Y-Axis = Consideration: The amount of effort required to make a decision.

The more thought you put into a decision, the higher consideration it is. For example, choosing a dish detergent is “low consideration” for most shoppers, compared to buying a car which is “high consideration.” Consideration can be represented as a function of the number of compelling alternatives and the stakes - users’ tolerance for errors, for example.

X-Axis = Context: The volume of abstract concepts AI needs to know. 

Context refers to how many abstract concepts a model needs to know in order to provide a useful response. Does it only need to understand a small batch of data points (like a product catalog), or does it need to understand the entire internet (like ChatGPT)?

He goes on to explain how to plot different solutions on a “Survival Curve.” If you work on AI products this is one of the rare actually helpful articles for PMs in the area of AI and LLMs.

Product-led growth and micro-conversions

The first part Sara Ramaswamy’s Product-Led Growth and UX is just a summary (a good one!), but the “How UX Can Help” sections has some really great insights and ideas, like this one:

While macro conversions (high-level conversion tied to the primary purpose of the site) are often the first success indicators considered, it is, however, important to define and revisit micro conversions, which measure incremental improvements to the user experience. In product-led growth, products are competing at the micro-conversion level. Analyze the conversion user journey and create milestone micro conversions that capture progress toward primary macro conversions. Also identify secondary user actions on site that are correlated with macro conversions.

“Compete at the micro-conversion level” is a really good lens to keep in mind as we improve our products.

On the dangers of vanity metrics

I saw two deeply personal posts this week, each related to the dangers of chasing after vanity metrics. First, Justin Andersun tells us about The Ski Lesson, and concludes with this:

We should not lose touch with the spirit of what we’re doing. A job’s essence is to serve the needs of others, and friendship is to support the people we love. Metrics become vanity when they lose touch with that spirit.

Second, fio dossetto writes this about being mindful of vanity metrics:

Vanity metrics are easy to pick and hard to let go of. They can subtly but significantly damage the system for a long time before you spot them, at which point you’ll need to take a hard look at your actions and decide how to course correct. Fast.

Both posts highly recommended!

A good definition of “product sense”

I think this is the best definition I’ve seen so far of that elusive term “product sense”:

I define great product sense as the ability to do two things without having extensive data (i.e. without running lengthy research upfront):

  • Generate many solid, highly profitable ideas for ways to make money
  • Intuit whether a product is likely to be successful with a high degree of confidence

The detail of having this sense without extensive data is important. Anyone can get to a great product via guess-and-check. The best product minds reliably take a more direct path.