|
|
Testing in an SOA Environment Testing Web applications built with service-oriented architecture (SOA) is not the same as testing any other GUI-based application. Testing teams encounter major challenges including errors due to unexpected changes in internal and external services, compliance verification requirements, industry-specific standards, security issues, and more. To address these challenges, teams must adopt new testing methodologies that focus on ensuring the quality of services (QoS) deployed under the SOA development framework. Join Sanjeev Padasalgi as he explains how to plan and deploy a complementary SOA testing framework that addresses compliance, governance, and overall QoS issues. Supporting functional, security, performance, and regression testing, this SOA testing framework addresses Web services testing throughout the development and delivery lifecycle.
|
Sanjeev Padasalgi, Sonata Software Ltd.
|
|
|
Testing and Quality Beyond the Requirements and Code Many organizations institute testing and quality improvement initiatives focused on testers, developers, and software managers. One stakeholder often ignored in these efforts is the user-your customer. To dramatically improve overall product quality, you must purposefully include the user in your testing efforts. Lanette Creamer illustrates this anecdotally with some important bugs missed, which would not be found even with 100% test and code coverage. Find new ways to collaborate with users and learn how to adopt a customer-based focus on integration and functionality. Explore ideas that will help you consciously “zoom out” to see important gaps in your test coverage. Learn specific techniques to help you and your team find bugs that lurk outside the requirements and beneath the code.
|
Lanette Creamer, Adobe Systems
|
|
|
A Death Knell for Traditional Test Labs In this jab at the traditional test lab approach to testing software and Web services, Ken Johnston explains the what, why, and how of the practices and processes for testing in production (TiP). He describes how cloud computing is changing the cost model of developing Web services and testing them efficiently. Learn about the role of system deployment as an enabler of dynamic, timely testing and how to get immediate feedback from some of the best testers anywhere-customers and users. Find out about the coming intersection of pre-deployment test automation and production monitoring as you discover the immense value of emulation tools. See how test hooks in production systems enable testers to “see” inside a system while it’s live.
|
Ken Johnston, Microsoft
|
|
|
Testing with Real Users--User Interaction and Beyond Evidence shows than more than half of the ideas that we think will improve the user experience actually fail to do so-and some actually make it worse. Instead of guessing, why not measure what your real users like and don't like? Controlled, online experiments (A/B tests being the simplest version) are a proven way to make data-driven decisions about what works and what doesn't. Seth Eliot shares numerous examples of online experimentation within Microsoft to test new user interfaces with their customers. Seth shows how special frameworks, such as Microsoft's ExP (Experimentation Platform), can also move testing into the high-value realm of testing-in-production. In addition to new features and designs, Microsoft tests the impact of new code in production. By employing online experimentation, you can control how and when new, potentially dangerous code is exposed to users.
|
Seth Eliot, Microsoft
|
|
|
Crowdsourced Testing of Mobile Applications With new mobile applications for Blackberry, iPhone, and Android battling for media attention and consumer dollars, the pressure to get applications built, tested, and launched has never been greater. Getting high-quality apps to market quickly can make or break a product or company. However, the testing methods that work for Web and desktop apps (e.g., in-house QA, outsourcing, emulators/simulators, and beta testers) do not meet the extreme testing needs of mobile apps. Companies must test across many handset makers and models, wireless carriers, operating systems, browsers, and locations. This calls for a new approach-crowdsourcing. Doron Reuveni provides insight into the growing trend of crowdsourced testing for mobile applications and addresses both the benefits and challenges of this new testing model.
|
Doron Reuveni, uTest
|
|
|
Taming Bug Reports and Defects: The Agile Way Software defects bug everyone. If your organization is like most and you have a large queue of defects waiting to be fixed, this session is for you. It's probably not realistic to think we'll get around to fixing all of these bugs; so, we need to consider another approach. Lisa Crispin explains how agile teams address defects and how you can apply an agile approach to defects whether or not your development approach is "agile." Explore with Lisa ways to deal with a giant pile-or database-of old bug reports and which of the many, available defect tracking systems to consider-if you need one at all. See examples of alternatives to traditional bug reporting and how to shift your team's mindset toward preventing bugs in the first place. Get new ideas for taming your backlog of defects and discover ways your team can work together to minimize or eliminate bug reports all together.
|
Lisa Crispin, ePlan Services, Inc.
|
|
|
Keys to a Successful Beta Testing Program Your company is ready to launch its new product. How will it perform under real-world conditions? Will it meet the needs and expectations of the users? Will it operate on all the platforms and configurations for which it was designed? With the future of the product, your company, and perhaps your job depending on the answers, beta testing is a great way to maximize your chances of success. Beta testing provides empirical metrics that prove or disprove that your product will meet clients’ expectations, providing you with input for necessary course corrections in the product. Rob Swoboda explains the process of beta testing as well as the key concepts needed to plan, execute, and evaluate a successful beta testing effort. Rob shares his insights into the practices he employs to design and manage high-priority beta test efforts and offers you the keys to succeed in your own beta test program.
|
Rob Swoboda, HomeShore Solutions
|
|
|
The Power of Risk Erik Boelen starts his risk-based testing where most others stop. Too often, risk-based test strategies are defined in the initial test plan and are never looked at or used again. Erik explores how a dynamic, living risk-based testing strategy gives testers a vital tool to manage and control testing activities and identify the infrastructure they need to perform these activities. Find out how to use your risk-based testing strategy as a tool for negotiations among the different stakeholders. Take on the important role of risk mediator for all of the parties in the project. The risk-based test strategy is a tool you can use to defend testing’s need for time and resources, especially when late delivery is possible. Use your risk-based strategy to drive and manage exploratory testing sessions.
|
Erik Boelen, QA Consult Services
|
|
|
Creating the Right Environment for Mobile Applications Testing Is your organization releasing applications that target multiple mobile devices, platforms, or browsers? If so, you have faced-or soon will face-the challenge of choosing and setting up a test environment for these devices and platforms. Nat Couture shows how to develop a cost-effective application test environment to mitigate the risks associated with deploying mobile applications. He shares his latest research on mobile devices, mobile platforms, and mobile browser usage, and explains in detail what you need to consider when choosing a test environment. Learn how to select a winning combination of device-specific simulation, platform-specific simulation, and browser-specific simulation-coupled with tests on the actual devices. Build a mobile device testing program that reduces cost, increases coverage, and helps achieve the level of confidence you need to release mobile applications into production.
|
Nat Couture, Professional Quality Assurance Ltd.
|
|
|
Enabling Agile Testing through Continuous Integration Continuous integration is one of the key processes that support an agile software development and testing environment. Sean Stolberg describes how a traditional software tester-transitioning to an agile development environment-put a continuous integration infrastructure in place. In doing so, he helped improve development practices and made possible his team’s transition to agile testing. Sean discusses his team’s initial motivations for adopting agile development practices and dives into the nuts-and-bolts implementation details. He shares their post-assessment of the implementation using Martin Fowler's “Practices of Continuous Integration” and concludes with a retrospective on implementing and promoting continuous integration within the context of agile testing. Find out how continuous integration can help improve your testing results and the quality of the software your team delivers.
|
Sean Stolberg, Pacific Northwest National Laboratory
|
