Archives For testing

Apple's developer portal

Apple’s developer portal

When you as a iOS developer want to send out beta versions to testers, you need to create a build of your app with an ad hoc profile that contains the UDID’s from all the devices of your testers. Not only is that a painful process, you are also limited to 100 devices. That is, a 100 devices per developer license per year. When the iPhone 3 was released that was OK, but now it is becoming a major hurdle to do testing. It is time for Apple to change this policy. Here’s why:

  1. fragmentation – now you have the iPhone 4, 4S and 5 as well as the iPad 2, 3, 4 and iPad Mini. Don’t forget iPod Touch 4 and 5. Also iOS 5 is still around (not for iPhone 5, iPad 4, iPad Mini or iPod Touch 5), so times 2 major iOS versions = 14 different devices.
  2. developers create more apps per year – imagine a company that publishes 10 apps per year, for 10 different demographics. That 100 device limitation is for that one publisher, meaning you can have max 10 testers per demographic.
  3. quality standards have gone up – There are 700,000 iOS apps out there. Only the best that get in a top 25 make money. High quality is required, so developers have to test thoroughly.

What could Apple do? Continue Reading…

Burstly just announced that they have acquired TestFlight. Congrats on both, it shows how mature the mobile market is becoming. Besides the acquisition they also announced TestFlight Live, a product to see how your app is performing once it has been published.

I think this is a step away of what they have been doing until now, which was all focused on the phase before launching. Also it is a crowded space: there are already mobile analytics companies like Flurry and app download companies like Distimo and Mobapp.

Meanwhile, we at Mobtest.com keep on focusing on our mission: to build a great marketplace where mobile developers can find testers. Developers need feedback on their apps before they push them out in the app stores. They need to get high ratings to do their marketing in the app stores and get interested users to actually download their app.

We are looking for beta testers of our own service, so sign up at mobtest.com to get an invite. First batch is 50 testers, so sign up quickly!

OK, your iPhone app is about to be released. You and your teammates think the app is perfect. You just want to ask a couple of friends to test the app. Should you?

Yes you should let others test.

Continue Reading…

Mobile development is not easy. A lot of platforms that change a lot, many different programming languages and tools. And of course a slew of new devices each year, in particular on the Android platform.

Testing is even harder, arguably also more important. Native apps crash completely on an error, not just one page. You have less screen real estate. Users have less time to use your app. And there are so many tools to choose from. So let me ask a few questions: what to test? And when are tools appropriate, and when do you need users?

Continue Reading…