Skip to content
beewhile

Example survey

AI coding assistants: the wait

See how this survey was built

Demo data: ~120 synthetic responses, nothing saved. How we protect respondents

These responses are generated in your browser from a fixed seed. No real people answered, and nothing here is saved. It’s the same dashboard buyers get, with the same rules: groups under 5 are hidden, and the CSV has pseudonymous ids only.

Demo data120 of 150 completesSynthetic responses, generated in your browser. Nothing here is real.

Who answered

Completed
120
In the results below
Screened out
19
Didn’t qualify; not in results
Still answering
4
Started, not finished yet
Left out for quality
3
Failed a quality check; replaced at no charge

Filter by audience

Showing all 120 responses

Filters need 10+ matching responses and counts are rounded to 5. How we protect respondents

Filters use audience fields only and run on our server: a filter has to match at least 10 responses, and one that leaves out fewer than 5 people is hidden too (comparing it with all results would show what they said). Counts are rounded to the nearest 5. Responses arrive in groups of 5 so no one can be singled out, with no completion times or per-answer timings. The CSV has every released response with a random id, the day its group arrived, no profile data, and written answers with contact details removed. Answers flagged as too fast are left out of filtered results on our server. Two filters whose responses differ by fewer than 5 people can’t both be shown.

Insights

AI summary

Key findings with numbers, themes with real quotes, and what to be careful about. It only reads totals, breakdowns with at least 5 people per cell, and answers with names removed.

Q1Single choiceScreener

Do you use an AI coding assistant at least once a week?

120 answered

Only people who qualified finish the survey, so everyone counted here passed this screener. 19 people screened out and aren’t included.

  • Yes100% · 120
  • No0% · 0

Q2Single choice

Which one do you use most?

120 answered

  • Cursor35% · 42
  • Claude Code23% · 28
  • GitHub Copilot23% · 27
  • Codex7% · 8
  • Windsurf11% · 13
  • Other2% · 2

Q3Multiple choice

What do you usually do while it works?

120 answered · people could pick more than one, so shares add up to more than 100%

  • Watch it28% · 34
  • Review earlier output36% · 43
  • Switch to other work47% · 56
  • Check my phone43% · 51
  • Something else12% · 14

Q4Scale

How happy are you with how fast it is?

120 answered

Mean 3.5Median 3on a 1–5 scale
  1. 1 (Very unhappy): 5 (4%)
  2. 2: 10 (8%)
  3. 3: 46 (38%)
  4. 4: 35 (29%)
  5. 5 (Very happy): 24 (20%)

Q5Single choice

Who pays for it?

120 answered

  • My employer44% · 53
  • I do32% · 38
  • Free tier10% · 12
  • Mix14% · 17

Q6Open text

What one change would make waiting on it less painful?

113 answered

Themes

Group these 113 answers into a few themes with example quotes.

113 answers · tick great answers to tip them (100% goes to the respondent)

  • Faster responses, honestly. Most waits are 20-40 seconds.

    89731bb4

  • Cut the wait in half and I would be happy

    63264cc2

  • Some progress indicator beyond a spinner

    9991efdc

  • Show progress while it thinks, which file it is reading

    e0ffb3db

  • Just make it faster

    3049f0f6

  • Ping me with a notification when it finishes

    c7dd57ae

  • Faster responses on big refactors

    fa39f6cb

  • Cheaper plans for students

    5cc1565f

  • Better accuracy on large codebases

    b08c7778

  • Faster responses, honestly. Most waits are 20-40 seconds.

    2fc1d3bc

  • Show progress while it thinks, which file it is reading

    56bb1b4b

  • Lower price for priority speed

    435c0f91

  • Run two tasks in parallel

    df7e45c4

  • Lower price for priority speed

    42141106

  • Speed. Faster responses beat everything else.

    5bbb522b

  • Let me queue the next task while it runs

    c4bd06e5

  • Cheaper plans for the fast model

    6cf4e714

  • Show progress so I know it is not stuck

    b45eb507

  • Show progress so I know it is not stuck

    61c21b0b

  • A notification when the answer is ready so I can switch tabs

    640f476a

Before you see written answers, we remove emails, phone numbers, links and handles, and names that follow a title. Other details can slip through: please don’t try to identify anyone.

Q7Number

About how many minutes a day do you wait on it?

120 answered

Average
19.3 minutes
Median
20 minutes
Lowest
5 minutes
Highest
39 minutes

Q8Grid

How does it do on each of these?

120 answered

Speed · 120 answered

  • Poor10% · 12
  • OK31% · 37
  • Good36% · 43
  • Great23% · 28

Accuracy · 120 answered

  • Poor11% · 13
  • OK27% · 32
  • Good43% · 52
  • Great19% · 23

Code quality · 120 answered

  • Poor14% · 17
  • OK33% · 39
  • Good38% · 46
  • Great15% · 18

Q9Ranking

Rank what matters most

120 answered

  1. 1. Speedaverage rank 1.3 · 82% first
  2. 2. Accuracyaverage rank 2.0 · 14% first
  3. 3. Priceaverage rank 3.0 · 3% first
  4. 4. Privacyaverage rank 3.8 · 1% first

Q10Constant sum

Split 100 points across what you want improved

120 answered

  • Speed50.2 of 100 · 50%
  • Price25.3 of 100 · 25%
  • Accuracy24.5 of 100 · 25%

Q11MaxDiff

Which feature matters most, and which least?

120 answered

  1. 1. Long contextscore +0.89 · 192 best · 0 worst · shown 216
  2. 2. Code reviewscore +0.34 · 77 best · 3 worst · shown 216
  3. 3. Team sharingscore +0.13 · 70 best · 41 worst · shown 216
  4. 4. Offline modescore -0.47 · 18 best · 120 worst · shown 216
  5. 5. Voice inputscore -0.89 · 3 best · 196 worst · shown 216

Score = (times picked best − times picked worst) ÷ times shown, from −1 to +1.

Q12Concept test

How appealing is this plan?

120 answered

  • Pro monthlymean 3.3 of 5 · 43% rate it 4–5 · n 60
  • Pay as you gomean 4.0 of 5 · 67% rate it 4–5 · n 60

Q13Price sensitivity

Think about a faster “priority” plan for your assistant.

120 answered

Optimal price
USD 17.50
Indifference price
USD 20.43
Acceptable from
USD 13.13
Acceptable up to
USD 29.46
  • Too cheap
  • Bargain
  • Expensive
  • Too expensive
0%25%50%75%100%Optimal USD 17.50USD 3USD 47
Table view
PriceToo cheapBargainExpensiveToo expensive
USD 3100%100%0%0%
USD 498%100%0%0%
USD 592%100%0%0%
USD 683%100%0%0%
USD 776%100%0%0%
USD 867%100%0%0%
USD 957%99%0%0%
USD 1047%98%0%0%
USD 1138%92%0%0%
USD 1232%88%0%0%
USD 1327%76%0%0%
USD 1417%66%1%0%
USD 153%57%1%0%
USD 160%53%1%0%
USD 170%45%2%0%
USD 180%34%5%0%
USD 190%28%11%0%
USD 200%22%17%1%
USD 210%18%24%2%
USD 220%13%28%3%
USD 230%10%34%4%
USD 240%3%39%6%
USD 250%0%46%8%
USD 260%0%57%11%
USD 270%0%68%14%
USD 280%0%75%18%
USD 290%0%77%18%
USD 300%0%82%24%
USD 310%0%89%29%
USD 320%0%91%35%
USD 330%0%92%40%
USD 340%0%95%52%
USD 350%0%95%59%
USD 360%0%97%66%
USD 370%0%100%71%
USD 380%0%100%75%
USD 390%0%100%78%
USD 400%0%100%79%
USD 410%0%100%82%
USD 420%0%100%88%
USD 430%0%100%92%
USD 440%0%100%94%
USD 450%0%100%98%
USD 470%0%100%100%
Shaded: the range of acceptable prices (where “too cheap” meets “not a bargain”, to where “too expensive” meets “not expensive”). The optimal price is where “too cheap” and “too expensive” cross.

Q14Slider

How much faster would it need to be to switch?

120 answered

Average
39.5 %
Median
39 %
Lowest
10 %
Highest
70 %

Q15Date

When did you last change assistants?

120 answered

Earliest
2026-01-02
Median
2026-04-25
Latest
2026-09-27
  • 2026-019% · 11
  • 2026-0214% · 17
  • 2026-0318% · 22
  • 2026-048% · 10
  • 2026-0511% · 13
  • 2026-0612% · 14
  • 2026-078% · 9
  • 2026-089% · 11
  • 2026-0911% · 13

Want results like this for your question?

Describe your goal and get a drafted survey, a price and a reach estimate. Free to draft. You pay when you submit; we review within one working day and it goes live on approval. Not approved, not charged.