Conference Presentations

Agile Testing: Facing the Challenges Beyond the Easy Contexts

Don't let anyone tell you otherwise-doing testing well on agile teams is hard work! First, you have to get management over the misconception that you don't need specialist testers within agile teams. Next, you have to integrate testers with the developers and provide holistic, high quality results. Those are just the easy challenges you face. Then, comes the hard part! Bob Galen explores more difficult agile testing contexts-how to attack a total lack of test automation, how to remain agile in highly regulated environments, how to serve your PMO or Testing COE while remaining agile, how to organize testing when your agile team is globally dispersed, how to blend traditional testing processes with their agile counterparts, and more. If you're in a difficult testing context within an agile development environment, come and join the conversation. You'll find examples and options, but no silver bullets. Remember-it's HARD!

Bob Galen, iContact
Testing Dialogues: Automation Issues

What problems are you facing in test automation right now? Just getting started? Trying to choose the right tool set? Working to convince executive managers of the value of automation? Dealing with excessive maintenance of scripts? Worrying about usability and security testing? Something else? Based on the problems and topics you and fellow automators bring to this session, Dorothy Graham and Mieke Gevers, both experienced test automation experts, will explore many of the most vexing test automation issues facing testers today. Join with other participants in small groups to discuss your situation, share your experiences, learn from your peers, and get the experts’ views from Dorothy and Mieke. As you learn and share, each group will create a brief presentation to give at the conclusion of the session.

Dorothy Graham, Consultant
Go Sleuthing with the Right Test Technique

Although much information is available on test design techniques, very little is written on how to select which techniques to use for the job at hand. Derk-Jan de Grood believes that many testers find it difficult to select the right techniques and very often use a technique simply because they know it. Instead, the best reason is that the technique is likely to discover the most important errors quickly. Derk-Jan shares his insights on test technique selection and poses three questions you should ask yourself when selecting a technique: What types of errors do I want to find? What impact do these errors have in production? Is the needed information to perform these tests available? He then lays out a list of common test techniques and discusses which error types they are most likely to discover. Take back a new understanding of test technique choice and selection to become a better software defect sleuth.

Derk-Jan de Grood, Valori
Taking Your Testing Team Global

With pressure to downsize local teams in favor of offshore or outsourced testing, you may be faced with taking your team global. Jane Fraser discusses the good, the bad, and the ugly of having to outsource or offshore testing. She talks about the pitfalls of hiring across cultures, such as when “Yes” means “We don't understand, but we'll try.” Jane shares ways to maintain your team processes and standards with a distributed team. She examines the issues and benefits of insourcing and outsourcing-and the difference between the two. Using her experience setting up insourced offices in China and India, and outsourced offices in Argentina, Vietnam, India, and China, Jane shares her transition plan to move 70% of her main development studio to five countries around the world. Whether you decide to offshore testing or it's decided for you, join Jane to discover how to successfully transfer some or all of your testing to a remote team.

Jane Fraser, Electronic Arts
Stick a Fork in It: Defining Done

It seems that developers have as many definitions of “done” as Eskimos have words for “snow.” But without a clear definition of done, it is difficult to gauge progress on a project. Menlo Innovations has a simple solution. Instead of declaring a story card or feature done on its own, developers collaborate with the business analyst and testing teammates to determine when the application meets their requirements. Tracy Beeson highlights the power of asking one deceptively simple question that has multiple, complex answers that can, if not implemented with care, upset the status quo and lead to new problems. Using loosely orchestrated role playing, you'll practice this approach for discovering when done is really done.

Tracy Beeson, Menlo Innovations
Test as a Service: A New Architecture for Embedded Systems

The classic models adopted in test automation today-guaranteeing ease of test implementation rather than extendibility of the test architecture-are inadequate for the unprecedented complexity of today’s embedded software market. Because many embedded software solutions must be designed and developed for multiple deployments on different and rapidly changing hardware platforms, testers need something new. Raniero Virgilio describes a novel approach he calls Test as a Service (TaaS), in which test logic is implemented in self-consistent components on a shared test automation infrastructure. These test components are deployed at runtime to make the test process completely dynamic. The TaaS architecture provides specific high-level test services to testers as they need them.

Raniero Virgilio, Intel
Testing with Virtual Machines: Past, Present, and Future

In the past several years, virtualization has dramatically improved tester productivity. A virtual machine is a useful abstraction for encapsulating the entire software stack. Roussi Roussev presents proven techniques that no modern test environment is complete without. Running multiple virtual machines on a single host maximizes hardware resource utilization and reduces operating costs. Strong isolation facilitates building security testing and multi-tenant environments. With the help of snapshots, virtual machines can quickly travel in time and space. Virtual hardware makes simulating machine, cluster or entire datacenter failure scenarios a whole lot easier. Deterministic record/replay helps track hard to reproduce bugs, comparing outputs allows for measuring the impact of small configuration and binary changes.

Roussi Roussev, VMware
State-driven Testing: An Innovation in UI Test Automation

Keyword-driven testing is an accepted UI test automation technique used by mature organizations to overcome the disadvantages of record/playback test automation. Unfortunately, keyword-driven testing has drawbacks in terms of maintenance and complexity because applications easily can require thousands of automation keywords. To navigate and construct test cases based on so many keywords is extremely cumbersome and can be impractical. Join Dietmar Strasser to learn how state-driven testing employs an application state-transition model as its basis for UI testing to address the disadvantages of keyword-driven testing. By defining the states and transitions of UI objects in a model, you can minimize the set of allowed UI actions at a specific point in a test script, requiring fewer keywords.

Dietmar Strasser, Borland (a Micro Focus company)
Streamlining the Developer-Tester Workflow

The islands that many development and test teams live on seem far apart at times. Developers become frustrated by defect reports with insufficient data to reproduce a problem; testers are constantly retesting the same application and having to reopen "fixed" defects. Chris Menegay focuses on two areas for improvement that will help both teams: a better build process to deliver a more testable application to the test team and a defect reporting process that delivers better defect data back to the developers. From the build perspective, he explores ways for the development team to identify which requirements are completed, which defects were fixed, and how to guide testers on which test cases to execute. Chris details the components of a good defect report, illustrating ways for testers to provide accurate reproduction steps, demonstrating video capture tools, examining valuable log files, and discussing test environment issues.

Chris Menegay, Notion Solutions, Inc.
STARWEST 2010: Quality Metrics for Testers: Evaluating Our Products, Evaluating Ourselves

Finally, most businesses realize that a final system testing "phase" in the project cannot be used as the catch-all for software quality problems. Many organizations are changing development methodologies or creating organization-wide initiatives that drive quality techniques into all aspects of development. So, how do you know that a quality initiative is working or where the most improvement effort is needed? Adrian O’Leary shares examples of quality improvement programs he has observed and illustrates how they are using defect data from various test phases to guide their efforts. See how measurements of defect leakage help these organizations gauge the efficiency and effectiveness of all development activities. Adrian identifies key "quick hit" recommendations for defect containment, including the use of static testing, traceability, and more.

Lee Copeland, Software Quality Engineering

Pages

CMCrossroads is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.