Beta Program Incentives

I’ve been part of the beta program for over a decade.  Many cycles I bemoan the fact that I’ve found very little time to real testing before its released.  That’s bad and I suspect many of my fellow members of the beta program feel much the same way.

The incentive to be in the beta program is simple.  See the new features first and help find bugs and along the and way offer some advice and guidance on how new features work.  And in general, make the product better.  That is an incentive and it’s a laudable one but many cycles that’s not enough.  Perhaps there’s a way to give us more incentives.

I fight with finding time to beta test.  I’m often working under deadlines with real projects that I can’t afford to release a version with the beta.  There’s no way around that.  Perhaps there is something that Xojo can do to make it worth my while to do more testing.

What if Xojo gave a percentage off, say 5%, off a license purchase (either new or upgrade) if I hit some threshold of credible bug reporting?  I spend a lot of money on licenses so that might be a good incentive for me (or at least one of my developers) to work with the beta on a regular basis.

Obviously there would need to be ground rules to prevent abuse.  Bug reports must be well defined with demonstrable repeatability, example project, video, etc. to make sure there’s not a flood of crap.  After it’s reviewed by a Xojo engineer that bug report gets applied to our account.  Then when it comes time for renewal we can apply the discount we’ve earned.  Perhaps that means a percentage point for every five credible bug reports (not feature requests) during a release cycle with a maximum percentage.

Make a game of it.  Reward outstanding bug reporters with recognition.  Make the participant list public so everyone is aware that so-and-so is participating and finding a lot of bugs.  Maybe reward the yearly ‘winner’ with free or discounted admission to XDC.  As a person always on the lookout for new Xojo talent this might be a good way find someone as well as having a little fun with it.

I see this as a way to get new users involved.  For me a license is no big deal but for some it’s huge and if that user has extra time (or at least more than me) that will give them extra incentive to submit bug reports.

I get it it.  The beta program should be a win-win for Xojo and us users.  The reality is that I feel like we’re free labor to a certain extent.  I don’t feel much love from Xojo even though I *know* they do appreciate whatever beta testing we do.  Offer some discounts, make it a game.  Do something to entice us!

What are your thoughts?

3 thoughts on “Beta Program Incentives

  1. Great idea. When a feedback case is finished, an engineer could set a checkmark for whether it’s rewarded and once a year on XDC Geoff could say thank you to the top three bug reporter and maybe give some coupon or award.

    PS: I regularly work here with the latest beta for my own projects and examples. Just for building a solution for clients I often go back to older releases for compatibility to older systems.

  2. Anything would be better than nothing. Xojo wants us to test everything. I only test if I there is some new feature or a bad bug is fixed.

  3. Your proposals are solid, but I think there is a general problem with Xojo’s marketing policy. E.g. I often had time to test and I also reported many bugs. Some day I was excluded from the beta forum without any notice, because I didn’t had the Pro licence, only the Desktop and the Command Line licence at this time. So what Xojo does, is cutting down the amount of possible beta testers to those with the most less time … however, aren’t we all beta testers for years ? 🙂

Comments are closed.