Tag Archives: Issues

How Do You Best Test a New App Online? Five Perspectives

Situation: A CEO has a new app that her company wants to test online. The principal challenge is avoiding a “catastrophic success” – success that ramps so quickly that the company is unable to deliver the quality or responsiveness expected by users. How do you best test a new app online?

Advice from the CEOs:

  • The challenge is similar to that faced in the massively multiplayer game space.
    • Creators target a small number of known enthusiasts (sneezers) with the message that they are special. The creators ask them to preview a new game and provide feedback that will help the creators produce the best game possible.
    • Never apologize for an Alpha or Beta test. Let enthusiasts know that they are getting the first peek at what will be the greatest thing since sliced bread. Enthusiasts will tolerate Alpha conditions – as long as the company responds quickly to their suggestions for service or performance improvement.
  • For initial live tests hype the coolness and uniqueness of early availability and adoption.
    • Don’t lower expectations – manage them by responding very rapidly and fixing any glitches. This is why Web companies are 24-hour, eat and sleep in the office affairs during launch and for as long post-launch as needed to assure success.
    • Continually hype the coolness of being involved early.
    • Use the current version as the early test. When the company is ready to spread beyond the very first users, reward them for sneezing the app to other users.
      • For example, as a Beta Testers, users get 10 free 1-year plug-ins to give to their friends. For each additional user that they bring on-board, they get an additional 10 free 1-year plug-ins.
      • This technique supports the coolness of having been a Test participant because it makes the participants cooler with their close circle of contacts. The really smart ones will give free plug-ins to other sneezers and influencers. Reward this latter group for bringing on additional users.
  • Using lessons from the gaming market:
    • Shake out all issues pre-Alpha Test.
    • Conduct automated testing of the software via server farms that are set up for this.
    • Be prepared for upgrades – both in the software and in the server farms. Typically upgrades are conducted while the software and systems are live.
    • Create test localities to pre-test any upgrades to assess the impact on performance and service prior to deployment. This minimizes disruption to the broader audience.
    • Recruit, alert, and reward those who assist with these tests.
  • It is possible to conduct an unsophisticated Alpha Test, but this can’t be risked in Beta Tests.
    • Alpha testing is usually conducted as an internal exercise and lasts until all of the bugs have been identified and worked out.
    • The Beta test is then planned, with a known number of sites or users.
  • Concerning IP Protection:
    • Threats will come from two sources:
      • The iTunes types who may perceive the new offering as a threat to their markets – ones with deep pockets to keep the company busy defending its legal position.
      • International teams who rapidly clone any new technology that they find for a variety of motives. These groups tend to work from locales where IP protection is difficult to impossible.
    • IP is not secure until tested in courts. Often this involves the most innocuous aspects of the IP or software offering. In addition, big players may seek injunctions to halt service until courts resolve claimed IP conflicts.

[like]

Do You Have Control of the Numbers? Four Points

Situation: A company has a good accounting system, but the CEO is concerned that they are not making the best use of metrics to drive the business. He senses a lack of shared understanding of key metrics and goals. He senses the appearance of financial disarray, despite his clear grasp of the business. Do you have control of the numbers?

Advice from the CEOs:

  • A good accounting system may be in place, but if it is not being used to drive the business and monitor the achievement of milestones then the company is not gaining the best advantage from it.
  • If there is a sense of financial disarray, this suggests that the company lacks financial metrics. Employees and managers may be doing their jobs, but without financial metrics it is difficult to tell how well they are doing their jobs.
  • Start with basic metrics:
    • Where are sales coming from?
    • What is the profitability of sales by customer segment and product line?
    • What is the company’s profitability?
    • What are the profitability trends of the company and key segments of the business?
  • Once a company is tracking these metrics, it is easier to focus managers and employees on products, product development, operations, sales and marketing issues that are most essential to the company’s success.
  • The company needs the equivalent of a CFO. This means a financial person, not an accountant. An individual who knows how to look at the numbers. A CFO will help the company to
    • See the strategic trends in the business,
    • Uncover the best opportunities for growth, and
    • Understand the greatest potential threats to growth of the business.

[like]

How Do You Address a Customer-Supplier End Run? Three Ideas

Situation: A company’s top customer has approached one of the company’s suppliers with a request that the supplier sell directly to them rather than through the company. The supplier normally does not sell directly to OEMs, and has neither the sales force nor the customer service capacity to work with these companies. Nevertheless, following the customer’s request, the supplier has asked the company’s CEO for a meeting. How should the CEO plan for this meeting? How do you address a customer-supplier end run?

Advice from the CEOs:

  • You need well-placed advocates both within the customer company and your supplier company. These advocates can help you to better understand what is behind the customers approach to your supplier, and what the true issues are. You will also better understand how the supplier is reacting to this request.
  • Talk to the boss of the purchasing manager who initiated this and let him know how this will impact your ability to supply other critical parts for their operation.
    • Ask for fast track approval as a preferred supplier.
    • Try to cut this off before the supplier representative arrives for your meeting.
  • You know from your history with this customer that you have had to make frequent delivery adjustments to meet their needs. Further, as a value add you make modifications to the parts supplied to meet the customer’s engineering specs. This level of flexibility is not part of your supplier’s business model. When you meet with the supplier, paint a picture of the downside of working directly with this customer to convince them that they don’t want to take this business direct.

[like]