Menu

On the dangers of vanity metrics

I saw two deeply personal posts this week, each related to the dangers of chasing after vanity metrics. First, Justin Andersun tells us about The Ski Lesson, and concludes with this:

We should not lose touch with the spirit of what we’re doing. A job’s essence is to serve the needs of others, and friendship is to support the people we love. Metrics become vanity when they lose touch with that spirit.

Second, fio dossetto writes this about being mindful of vanity metrics:

Vanity metrics are easy to pick and hard to let go of. They can subtly but significantly damage the system for a long time before you spot them, at which point you’ll need to take a hard look at your actions and decide how to course correct. Fast.

Both posts highly recommended!

How to spend your life force as a product manager

I’ve been spending lots of time recently thinking about and working with my team on what I can only refer to as “how we should spend our life force.” If that sounds weird, hold on to your hats because I’m going to make it even weirder by (and I apologize in advance) throwing a 2x2 matrix into the mix. So. Come with me in this post as we discuss how our biggest strength as product managers can easily become our biggest weakness, and how we can protect our health and sanity in the midst of all the turmoil in our companies and the world at large.

First, without getting too deep into the metaphysical or get myself in trouble about things I don’t know enough about, I do think it’s import for each of us to make conscious decisions to spend our “life force” on things that make us generally feel fulfilled and bring us closer to the person we want to be. That can take many forms—a bike ride, a fun side project, a bad action show (The Night Desk is so bad good!), an interesting problem at work… those can all be good ways to spend our life force! Being on the internet too long, on the other hand, is rarely that:

This is true at a macro level in our daily lives, but also when we zoom into how we spend our time at work. PMs in particular have this annoying habit where we tend to gravitate towards the wicked problems—a trait that makes us good at what we do, but can also be self-defeating because when we spend too much of our time depleting our life force, burnout eventually finds us.

So 2x2 matrix incoming! I think of the way we spend our life force as PMs on two dimensions: the difficulty of the task, and our likelihood of influencing the task’s success.

Some tasks fall in the easy bucket (relatively speaking—don’t @ me!). Think about things like customer interviews, collaborating with designers on a good user experience for a feature, or puttering around in JIRA making comments here and there. But then there are the difficult tasks—solving an organization’s quality problem, fixing development and deployment dependencies, understand team dynamics and creating a safe and open work environment where the whole team feels happy and fulfilled… you get the idea.

We are probably all familiar with that dimension. But the dimension we don’t always take into account is the probability that our work will actually influence the outcome of the task to ensure its success. Maybe the collaboration with the designer has a low probability of success because they report into a different org with different values. Maybe fixing development and deployment dependencies have a high probability of success because you have a really good relationship with engineering leadership and you all are highly motivated to solve the problem.

Which leads me to my main point. It’s in the combination of the ease/effort involved in a task, as well as our known sphere of influence, that we are able to make the best decisions about where to spend our life force. Let’s break out that long-promised matrix now, shall we?

You’ll have to excuse me, I’m not good at naming things. But let’s go through these.

Just don’t

Let’s get this one out of the way first. There are tasks that are easy, that we might be tempted to pick up—especially when we’re already tired and close to burnout—that simply don’t make sense because there really is no winning.

Maybe you are a JIRA wizard, and you think it would be an easy win to redo some of your workflows. But maybe the engineering team has no interest in changing any workflows and they see no benefit in learning a new system. They dig their heals in, and before you know it you’ve spent weeks on an “easy” task that only served to erode trust between you and the engineering team.

Just don’t.

Unnecessary hill-dying

This bucket is really interesting to me because I think a lot of ambitious, smart PMs gravitate towards problems like these. We want to go for the hardest, “wickedest” problems out there, and prove to ourselves and the world that we can solve them. This is such an admirable quality, but not a sustainable way to live your work-life.

Think of our example of solving an organization’s quality problem. This is likely a really hard problem that requires coordination and buy-in across multiple teams, with a lot of resistance and meetings and meetings about meetings and meetings to talk about how bad that one meeting went. With extensive effort and superhuman patience and collaboration skills you might get to a point in 9–12 months where the quality of the organization’s output has seen a marked improvement. At that point it will feel amazing and you’ll be proud—as you should be. But it might also kill your drive, enthusiasm, and ambition and turn you into a relentless cynic.

I think we should all attempt a task like this at least once in our careers. But it is no place to build a home.

Hero makers

Oh, we love these kinds of tasks too, don’t we. Really hard problems with enough social and organizational capital to make a real difference in a reasonable time frame? That’s PM catnip right there! This box is definitely a better use of life force than unnecessary hill-dying, but we have to limit ourselves here too. Because even though the payoff / enjoyment / fulfillment of this work can be huge, so can the cost. This is difficult work that can also become addictive, and if we don’t pace ourselves and limit the number of tasks we take on in this box, burnout will find us here. So choose these carefully, and try to shift more of your life force to…

Huge impact

As we progress in our careers some tasks that used to be difficult become second nature to us. What sometimes happens is that we forget that it wasn’t always easy, so we erroneously start to think that everyone on the team already knows what we know, and we start to undervalue our contributions / knowledge.

Take a moment to think if this is happening to you. Maybe you have gotten really good at JTBD interviews, or facilitating group FigJam sessions, or getting a team to define a customer problem / business outcome effectively, or… What are the things that you can do in your sleep, but only because you’ve spent so much time on those tasks that you have a level of familiarity that others on the team simply don’t have?

Those, my friend, are high impact tasks that take very little energy/life force, and often gives you energy because of how electrifying it can be to be really good at something. You should always be on the lookout for ways to apply those unique skills to problems/opportunities where it can be really impactful. Unfortunately we can’t spend 100% of our time on tasks like these—and frankly, we shouldn’t want that, because then we’ll stop growing. But the number should definitely be more than 0% and probably closer to 20% of our time.


The main point I want to make with this post is that as PMs we generally have a lot of autonomy over how we spend our time, and that can be a blessing and a curse. A blessing because we get to prioritize our impact. A curse because we too often spend our life force on tasks that drain us and lead us towards burnout.

So take a moment to breathe, and think about the amount of time you spend in each of the life force buckets I mentioned here—and where you might need to make changes to avoid the road to exhaustion and burnout. And please, come up with better names for the buckets than I did.

A good definition of “product sense”

I think this is the best definition I’ve seen so far of that elusive term “product sense”:

I define great product sense as the ability to do two things without having extensive data (i.e. without running lengthy research upfront):

  • Generate many solid, highly profitable ideas for ways to make money
  • Intuit whether a product is likely to be successful with a high degree of confidence

The detail of having this sense without extensive data is important. Anyone can get to a great product via guess-and-check. The best product minds reliably take a more direct path.

Meetings are a point of escalation, not the starting point of a conversation

Ben Balter has a solid post on remote and async work, in which he makes the point that meetings are a point of escalation, not the starting point of a conversation:

A few minutes of reading or a few comments on an issue or Google Doc can often replace waiting days for mutual availability and a dedicated 30-minute block of time. In this sense, you can think of meetings as a point of escalation based on complexity, not as the default starting point for a workstream, initiative, or conversation.

Also see his excellent list of benefits of working asynchronously. Also also see Sisi Wei’s excellent guide on asynchronous participation in brainstorming, including this really great idea:

After the meeting, redesign that shared doc to become a worksheet for people participating on their own time. […]

The document should now read like it was designed for asynchronous participation to begin with. Instructions you may have given verbally – even helpful tips you realized and delivered impromptu – should now be captured as written instructions in the document.

Building a music mini-site with data from Last.fm, Discogs, and YouTube

It’s been a little quiet on the blog recently, and the reason for that is either perfectly valid or profoundly unnecessary, depending on your viewpoint. Even I am not entirely sure which one it is.

Over the past couple of weekends (and too many late weeknights) I have used all my spare time to build a mini-site for my obsession with music. It started as a small idea to just show the current track I’m listening to, and a list of recent physical albums I added to my collection. But then it snowballed into something much more. You can view the site at music.elezea.com, or by clicking on the link in the top navigation. If you want to know a bit more about how it works, read on!

It all started when I came across Andy Bell’s mini-site for his music collection. He uses a Notion database and Last.fm to show all the music he has in his collection, and what he’s listening to. Since I also still use Last.fm (yes, it’s still around!), and all my physical music is documented on Discogs, I wanted to build a small site that uses the Last.fm and Discogs APIs to show some of that information.

But once I got started and got stuck into all the information available via those APIs, I just couldn’t stop. I still have so much more I want to do, but I know it’s time to take a break. All in all this has been such a fun and rewarding thing to spend my time on. I know the site has pretty much zero value to the world at large. But I love checking it to get more information about something I’m listening to—and it helped me take quite a few steps forward in my technical skills. So I’m choosing to call it a win.

Below are some notes about what the site does, how it works, and also what the experience was like for me (as a non-developer trying to learn).

Now playing

  • Get the most recently played track from the Last.fm API, and check if the song is currently playing or not.
  • If it’s currently playing, show the current time and a message that what you’re seeing is what I’m listening to in real-time.
  • If it’s not currently playing, mention that and show the time it was played.
  • Pull in the cover art and other data about the song from Last.fm.
  • Do a lookup for the artist and if Last.fm has data about them, show the first two tags (genres), first 3 related artists, and their bio.
  • Do another lookup to a different API endpoint for the artist’s top albums, and display data about their two most popular albums.
  • Use the YouTube API to do a lookup for the song, and embed the most relevant result in the page so that you can listen to it right there.

Top albums and artists

  • Show the top albums I listened to in the last 7 days, including play counts.
  • Show the top artists I listened to in the last 7 days, including play counts.
  • Make a separate API call for each artist to get their genres and similar artists, if that data exists on Last.fm.
  • Make another API call to get each artist’s most popular albums.

Recent purchases

  • Pull the last 6 releases I added to my Discogs collection.
  • Also pull in data about the genre, label, and release date.
  • ⏳ The Discogs API is really great, so I want to add a bunch more stuff here, but that’s also for the mythical v2 of this thing.

Random thoughts, complaints, and what’s next

  • The site is deployed with Netlify via a Github repo, and it just works. Netlify is so great.
  • I don’t care what you “real developers” say, the two biggest problems in programming are environmental variables and formatting dates. I am thankful for ChatGPT for helping me with the date formatting piece, and my colleague and friend Derek for helping to get the environmental variables to work.
  • Last.fm’s API clearly hasn’t been touched in years and the documentation isn’t great, so it’s been a bit of a mission to figure all that out. Postman has been a life-saver here to test the API calls and see what data comes back.
  • YouTube’s API has a limit of 100 search lookups per day, which feels ridiculously low. I hit that within an hour while I was building and testing it. Oops! On the upside: I am now much better at error handling. If the site hits that limit it will now show a message to that effect, and link to a direct search on YouTube for the song.
  • ⏳ I’m using YouTube only because the Spotify API makes it incredibly difficult to get an auth token. Auth tokens expire after 1 hour, and refreshing that token every hour is currently beyond my limited skills. I might come back to this as well because the Spotify API has sooo much interesting data.
  • ⏳ Another huge data source is the MusicBrainz API. I plan to spend some time wading through those docs as well to see what else I could add.
  • If you can think of any other cool things I might want to add to this, please reach out on Mastodon!

4 effective product team structures

Ravi Mehta’s 4 Effective Product Team Structures is a helpful framework for leaders to figure out how to organize product teams:

Because of the nature of product work, there are two vectors that product teams need to be organized around: area of focus and level of accountability.

  1. For area of focus, product teams can align their work with either business outcomes or feature development.
  2. When considering the level of accountability part of the structure, product managers either act as fully responsible owners of the work or as facilitators of the work, where they share metrics responsibilities with cross-functional partners.

In the article he goes through the pros and cons of each of the 4 structures.

Leadership tip: be a thermostat, not a thermometer

In Be a thermostat, not a thermometer Lara Hogan provides a helpful analogy for leaders on what to do when meetings go off the rails…

Once you’re able to start noticing when someone’s amygdala-hijacked, or simply that the vibes are off, you can reframe and use “be the thermostat, not the thermometer” for good. Since humans tend to mirror each other, you can intentionally change the energy in the room, setting the thermostat to a more comfortable temperature.

12 metrics to track for B2B SaaS companies

Elena Verna has a great summary of leading metrics for B2B SaaS companies, including some really useful benchmarks. Also a good reminder that revenue is a lagging metric:

Many leaders obsess over revenue. And rightfully so, because revenue is the outcome of any business. But revenue is a lousy metric to goal the team against because it assesses past performance instead of predicting the future.

If you want to dig a little deeper on the best metrics to choose for SaaS companies, here are a few more resources:

Link roundup for April 2, 2023

No image posts today, but it’s a blockbuster edition of the link roundup this week! I hope you find something interesting in here…

1 → LinkedIn power users are turning to ghostwriters (Vox)

LinkedIn remains a complete mystery to me.

“It’s cliché, but it’s true that people want to work with people, people buy from people, people want to see the human side of who you are before they decide to work with you,” says Tara Horstmeyer, an Atlanta-based ghostwriter who offers packages for 12 LinkedIn posts for anywhere between $2,000 and $3,000.

2 → How the Great Recession paved the way for the influencer industry (Vox)

It’s worth reading this fascinating interview with a curious mind. Especially if you, like me, are “of a certain age” and feel like you just don’t get it…

Influencers are neither ‘a flash in the pan’ nor ‘a bubble about to burst,’ but indicators of a paradigm shift in the way we think about each other and ourselves.

3 → On Place (Alica Kennedy)

This is a lovely, rich essay on the difference between “destination” and “place” when we travel, how digital nomadism displaces locals, the pursuit of a “decent meal” abroad, and more.

Continued economic dependence upon tourism leads inevitably to brain drain, when a labor force no longer wishes to work only service jobs. What does ‘local’ as an experience mean when it’s not in service to those who are literally local?

4 → The Life I Refused to Surrender (The Free Press)

This short essay from Amanda Knox packs a huge punch and really got to me. All we have is now…

No matter how small, cruel, sad, and unfair this life was, it was my life. Mine to make meaning out of, mine to live to the best of my ability. There was no more waiting. There was only now.

5 → The Streaming Market Is Fundamentally Broken. It’s Time To Fix It. (Public Knowledge)

There is just so much wrong with the music streaming industry.

Artists aren’t allowed to see the deals that set their streaming payment rates; indie labels aren’t allowed to see the deals distributors cut with labels on their behalf . And in many cases, artists aren’t even allowed to compare notes and talk about their own contracts.

6 → People Started Buying Crocs During the Pandemic. They Can’t Stop. (NYT Gift Article)

I have no pithy comment for this one.

“I roll into the gym with my Crocs on and everything, and people ask, ‘Aren’t you going to change shoes?’” Mr. Ndugga said. “No, this is how I’m going to live life for now.”

7 → Free Bird (Substack)

A top-to-bottom excellent post about Twitter from Ed Zitron. Read the whole thing!

Twitter can create an incredible sense of both intellectual invincibility and vulnerability that can drive someone quite mad.

8 → The Counterintuitive Thing About Trust That Explains Why So Many Teams Have Issues With It (LinkedIn)

This is an insightful post on the leader qualities that really build trust. In short, it’s about showing that you really, truly care.

Studies indicate that conveying benevolence is much more likely to earn you trust than conveying how competent you are. […] That’s why all things being equal, a person who is charismatic and kind will gain more trust than a person who is seen has having good ability.

9 → The Dangers Of Highly Centralized AI (Medium)

I agree with this take from Clive. It’s like we’ve learned nothing from social media.

The field of large language models is becoming dangerously centralized. A huge amount of power resides in the hands of a tiny number of firms.

This is a wonderful essay about the things that ensure happy and enduring families.

The bottom line: if you want a happier family, create, refine and retell the story of your family’s positive moments and your ability to bounce back from the difficult ones. That act alone may increase the odds that your family will thrive for many generations to come.

There’s more to life than OKRs: using EOS and W Planning for effective goal-setting in empowered teams

At Postmark we’ve long been fans of the “Entrepreneurial Operating System” (EOS) as presented in the book Traction: Get a Grip on Your Business by Gino Wickman. We also love the “W Framework” as outlined in the article The Secret to a Great Planning Process—Lessons from Airbnb and Eventbrite by Lenny Rachitsky and Nels Gilbreth. Both resources are excellent and highly recommended for the thesis and theory behind each of these frameworks.

In this post I’d like to describe how we combined these methods to set goals and run our business and product delivery process. I’ll start with a short summary of each method, and then go into specifics on how we used them together to ensure our teams are aligned on the same goals and have all the context they need to work autonomously on projects.

I promise I’m not here to start an argument about what is the best way to set goals. Instead, I hope this could be useful to folks who have tried a bunch of different frameworks—including OKRs—and found that nothing quite worked for them. Maybe this is a good alternative to try…

Goal-setting using EOS

We tried a several different goal-setting frameworks before landing on the Entrepreneurial Operating System (“EOS” from here on out). There’s no way to cover all it entails here, so please read the book, it’s very good. What I want to focus on specifically here is one of the primary outputs/artifacts of the system. EOS calls it the Vision/Traction Organizer (V/TO), but we adapted it into what we ended up calling the Vision and Focus Plan. This is sort of the equivalent of an OKR document, but we found the additional context extremely useful, especially when we layered W Planning (which I’ll talk about next) on top of it.

In its simplest form the document has two sections, one section for Vision, and one for Focus. The basic structure of the Vision section, using an example from our 2020 planning session for the Wildbit brand as a whole, is as follows:

Every year our leadership team got together for a few days to work on any edits we needed to make to the Vision section. Principles, Values, and Purpose should not change a lot. These are the long-term guiding principles for the company and though they should be revisited at least once a year, frequent changes would indicate that we don’t really know where we want to go with the business, so that should be a red flag.

The 10-year picture is a level down from the purpose—a way to look into the future of what the business would look like in reality if we achieved all our goals. The 3-year picture is way more concrete, and where we spend a good amount of time modeling and debating based on what we know about our business and the industry at large. These are the revenue goals that we want to achieve in the shorter term.

The Focus part of the document changes the most, and this part is the most directly comparable to OKRs. We generally made one of these for each product line (and sometimes even for individual teams). Here’s an abridged example from Postmark that we worked on during 2021 planning:

The sections can be summarized as follows:

  • 1-year plan. Think of this as the “Objectives” in the OKR framework. In tandem with the Vision this is where we want to be at the end of the year from a business perspective.
  • Quarterly plan. Similar to the 1-year plan, but a more immediate timeframe to reflect our planning cadence (this could also be 6 months, 6 weeks, whatever cadence you use for planning).
  • Goals for the Year. This is similar to the “Key Results” part of OKRs. They are measurable metrics and indicators that will tell us whether or not we’re on track to meet our 1-year plan. It helps for this section to cover a longer time horizon so that you can prioritize projects and bets effectively, and avoid sudden changes in priorities (which are really disruptive to teams).
  • Tasks for the Quarter. This is the nitty-gritty prioritization of problems we want to solve in a given planning timeframe to achieve our goals for the year. The visual planning and delivery/execution of these tasks happen in Productboard and JIRA, but this single view keeps us honest about what we’re working on. (See the next section for how we populate this column)
  • Issues List. This is a core component of the EOS system, and is an ongoing list of concerns, things we’re worried about, obstacles or impediments that we have to address, etc.

An essential component of making this approach a success is that we review the Vision & Focus Plan every week in our leadership meetings. We review business metrics, we talk about our progress, where we might be off track, what needs to change, what issues we need to add, how we are doing in addressing the issues, etc. That way we have a weekly check-in where we can adjust our plans and solve problems together1.

One really important part that I skimmed over in this section is describing how things make it onto the “Tasks for the Quarter” list. That’s where W planning comes in…

Planning using the W Framework

As I mentioned earlier, the original article does an excellent job of explaining the W Framework, and it should definitely be on your reading list. But in the interest of time I wanted to provide a short summary of how it works here. The gist is that planning is most effective when it is a collaborative effort between Leadership (senior/executive leaders of a business unit) and Teams (people executing the actual work). This makes it a particularly appropriate framework for empowered and autonomous teams. The framework looks like this:

The four stages are described as follows in the article:

Context: Leadership shares a high-level strategy with Teams.

Plans: Teams respond with proposed plans.

Integration: Leadership integrates into a single plan, and shares with Teams.

Buy-in: Teams make final tweaks, confirm buy-in, and get rolling.

So when we go into our quarterly planning we use our Vision & Focus Plan along with W planning to come up with our tasks for the quarter.

Phase 1: Context

As a leadership team we review our annual and quarterly goals as laid out in the Vision & Focus Plan, and make sure we are still focused on the right things. We ensure that the entire team has the strategic context they need to successfully enter the planning phase.

Phase 2: Plans

Teams take the goals and strategic context, and create project plans as bets on how they would like to achieve those goals. Note that at this point the “Tasks for the Quarter” column in the Focus plan isn’t filled out yet—that comes from the teams based on how they believe we can achieve our stated goals. In the words of Father Cagan:

Instead of being given a roadmap of features, an empowered team is given a problem to solve and they get to figure out the best way to solve that problem.

We use our Project Plan template for this part, which you can see on Github. The plan does not have to have every detail figured out. We view it as “a road sign into the fog.” We make sure the direction and first few steps are known, then add and edit as the fog starts clearing down the road.

We then share the plan with everyone in the DACI section of the plan by posting a link in Basecamp and requesting feedback form the team. We discuss comments asynchronously in Google Docs, or synchronously on a Zoom call if a decision can’t be made quickly in the comments.

Phase 3: Integration

Once the team planning phase is done the leads team gets together again to discuss the plans, how it all fits together, and any trade-offs that need to be made. This is where we fill out the “Task for the Quarter” section and make sure we are not taking on too much work for the quarter.

Phase 4: Buy-in

As a team we then get together to finalize the project plans, discuss any final questions/feedback on our priorities, and move individual tasks to Basecamp/Asana (for non-dev projects) or the appropriate JIRA Epics (for dev projects).

Once we finish this process our teams are ready to execute on their projects with clarity on how each project aims to influence our goals. This includes essential engineering scaling and reliability work—for instance, if our goal is to significantly increase the number of messages sent, we’re going to have to make sure that the platform can scale with that!


So there you have it—a way to combine two different frameworks to create a seamless goal-setting and prioritization process for empowered teams. Admittedly, I left out quite a few details in this post—there are lots more to discuss in this process, such as how we track progress, how we adjust based on new information, how we aim for “healthy pressure” within teams using high-integrity commitments, and so much more. But I am hoping that this brief overview sparks some ideas for teams who might have been struggling to make other frameworks work in the context of their own teams and culture.

Like all things related to software, planning and goal-setting require discovery and experimentation to get right. Even this article should be viewed as a snapshot—capturing a moment in time that describes our planning process. But we are also still constantly evolving the process as we get feedback from our teams and learn what works and what doesn’t. So try this one out, and let me know how it goes if you do!


  1. I plan to write more about the structure of our weekly meetings in a future post.