AI for PMs PM

The model did exactly what it was built to do. The onboarding lied.

AI for PMs AI for PMsAdvanced

The Onboarding Honesty Problem, Setting Expectations for an AI That Will Fail

When onboarding copy says 'AI-powered' without specifics, users fill in the gap with their best-case scenario. This article is about what that gap costs, and how to close it without killing conversion.

When onboarding copy says "AI-powered" without specifics, users fill in the gap with their own best-case scenario. You did not make that promise explicitly. You made it implicitly, and the product will pay for it in churn.

The Setup That Every Team Gets Wrong

A user opens a product with a new AI writing assistant. The onboarding screen says: "Meet your AI, it learns your style and helps you write faster."

The user completes the three-step setup. They open a blank document and type a prompt. The AI returns generic output that sounds nothing like them and ignores the five documents they wrote last month.

The user churns inside sixty days. The team reads the churn survey and sees "AI did not work as expected." The team interprets this as a model quality problem. It is not. It is an onboarding honesty problem.

The model did exactly what it was built to do. The onboarding said it would do something else.


The Trust Calibration Problem

Everyone says they want users to be excited about the AI feature. Most teams write onboarding copy that achieves exactly that, at the cost of every user who actually tries to use it.

There are two onboarding modes for AI features. Neither is theoretical. Both are running in production across products you use today.

Over-Promised Onboarding Calibrated Onboarding
Language pattern "AI that understands your workflow" "AI that suggests next steps based on the current page"
Scope signal None, implies unlimited context Explicit, scopes the capability to a defined surface
Failure mode User expects workspace intelligence; gets single-document suggestions User expects single-document suggestions; gets exactly that
User reaction on failure "This is broken" "I see the limit, let me work around it"
Churn pattern High within 30-60 days of first failure Lower, user attributed the failure correctly
Trust after failure Broken, the product lied Intact, the product was honest
UX pattern it produces Benefit-first copy, no capability boundaries, aspirational language Capability-first copy, explicit scope, honest limitation

The table above is not a moral argument. It is a conversion argument. Calibrated onboarding preserves the product relationship when the AI fails. Over-promised onboarding destroys it.


The Notion AI Case

When Notion AI launched, the onboarding copy described the feature in terms broad enough to invite projection. The language gestured at the AI understanding your work, your notes, your documents, your way of thinking.

Early user reviews on Product Hunt, Reddit, and the App Store showed a consistent pattern: users expected the AI to understand context across their entire workspace. They expected it to know that the project brief in one document was related to the task list in another. At launch, it did not do that. The AI operated within the context of a single block or page.

The gap was not a model capability gap. Notion's engineering team was not hiding a better version. The gap was between what the onboarding implied and what the product actually did on day one.

Users who discovered this limitation through usage, rather than through upfront communication, attributed the failure to the product being deceptive, not to a technical boundary that was disclosed and understood. That attribution matters. A user who says "the AI cannot do that yet" stays. A user who says "the AI lied to me" leaves and writes a review.


The Conflict of Interest Nobody Names

Here is the structural problem that produces bad AI onboarding at almost every company: the team that writes the onboarding copy is the same team that wrote the marketing copy.

Marketing copy is written to generate desire. It lives in a context where the user has not yet committed and needs to be pulled forward. Aspirational language is appropriate there. The user is comparing options, and you need them to feel the possibility.

Onboarding copy is written for a user who has already committed. They are inside the product. They are about to try the feature. What they need now is accuracy, not aspiration. They need to know exactly what the AI will do on the first attempt so that when it succeeds, it exceeds a stated bar, not falls short of an implied one.

When the same writer handles both, the marketing frame leaks into the onboarding. This is not a writing skill problem. It is an incentive problem. The onboarding writer is rewarded for activation metrics, which correlate with excitement, which correlates with aspirational language. Nobody is measuring what happens sixty days later when that excitement collides with reality.

The product manager's job in this moment is to break the incentive alignment. You have to make the case that honest onboarding is a long-term conversion strategy, not a trust exercise. Because the trust argument loses to the activation argument in most sprint reviews.


The Judgment Turn

Here is the uncomfortable position: users who are over-promised on AI capability abandon the product faster than users who are given an accurate picture upfront.

This is not a hypothesis. It is observable in the pattern of AI feature reviews across products that launched with vague onboarding. The negative reviews do not say "this feature failed." They say "this feature failed to do what it said it would do." That is a different complaint. It contains a reference to a promise.

The short-term conversion gain from optimistic framing is real. If you change your onboarding from "AI that transforms your writing" to "AI that suggests one alternative sentence at a time," your activation rate will drop. You should accept that drop. The alternative is that you activate more users, deliver a worse experience relative to their expectations, and churn them at a higher rate, with worse reviews on the way out.

The teams that resist this logic are usually looking at activation metrics without looking at sixty-day retention by onboarding cohort. If you have not cut that data, cut it before your next AI onboarding review. The number will clarify the argument in a way this article cannot.


Language Patterns That Work

The goal is not to make the AI sound weak. The goal is to make the AI sound specific. Specific is not weak, specific is trustworthy.

These are the patterns that produce calibrated onboarding without reducing the user's willingness to try:

Scope the surface, not the ambition. Instead of "AI that understands your project," write "AI that reads the current document and suggests a next action." You have not diminished the feature. You have told the user exactly where to look for value.

Name the failure mode in the first session. During the first AI interaction, surface a brief disclosure: "This works best when your document has at least two paragraphs, shorter inputs produce generic suggestions." You are not apologizing. You are giving the user a success condition.

Replace benefit claims with behavior descriptions. "Saves you hours" is a benefit claim that varies by user. "Rewrites a paragraph in three seconds" is a behavior description that is true for every user. Behavior descriptions set expectations that the product can meet.

Let the first interaction be a safe failure. Design the first AI interaction in onboarding to be one where the user can see a limitation without consequence. If the AI summarizes a document and the summary is imperfect, the user learns the tool's ceiling in a low-stakes moment. They recalibrate. They stay.


What This Costs You

Calibrated onboarding requires you to hold a position that your marketing team will push back on. It requires you to ship onboarding copy that is less exciting than the landing page. It requires you to surface limitations during activation, which every growth instinct says to avoid.

The cost of not doing it is a cohort of users who tried the AI feature, felt misled, and churned. Those users write reviews. Those reviews shape the next cohort's expectations. The cycle compounds.

You are not managing a single user's experience. You are managing the expectation field that every future user arrives with. What you put in onboarding either narrows that field to something the product can satisfy, or widens it to something the product will inevitably disappoint.


Key Takeaways

  1. "AI-powered" in onboarding is a projection surface, users fill it with their best-case scenario, and the product pays for that gap in churn.
  2. Calibrated onboarding preserves the trust relationship when the AI fails; over-promised onboarding destroys it.
  3. The conflict of interest is structural, onboarding is written by the same team rewarded for activation, not sixty-day retention.
  4. Specific language is not weak language, scoping the AI's surface area makes the capability trustworthy, not smaller.
  5. The uncomfortable tradeoff is real: calibrated onboarding may reduce activation and will reduce churn. Cut the sixty-day retention data by onboarding cohort before accepting the argument that optimistic framing is worth it.

Related Articles


Warm-up Reps

Did it land?

0 / 1 CORRECT
Three quick checks on the ideas above. Pick an answer and you will see why it is right or wrong. Consider it the warm-up before the real gym.
Q1
What was the specific onboarding gap in Notion AI's initial launch?
The gap was in onboarding specificity, not model capability. Users expected workspace-wide context awareness because nothing in the onboarding said otherwise.
AW

Anmoll Wadhwa

Senior PM · writing The PM Code

Field notes on product judgment: essays, teardowns, and reps for PMs who would rather think than template. A sharper take most days on LinkedIn.

More like this. Once a week.

Tactical essays on the calls that actually matter. In your inbox before they are on the feed.

LEARN·BUILD·COLLABORATE