Conference Presentations

Testing Web Services: A Dose of Reality

Web services truly have the potential to change the world! Along with the magic of Web services comes a dose of reality. For Web services to truly be a panacea to the masses, quality is imperative. The old guard of "not enough" resources or processes must be challenged. The testing of Web services is one aspect of ensuring quality, but is it prudent to automate the testing of Web services? In this presentation, Theresa Lanowitz explores answers to these important questions:

  • How are Web services tested today? What is real in 2003? Are we ready for test automation or should we conduct manual testing?
  • What is the future direction of testing Web services? What is the outlook for 2005 and beyond?
  • Who are the vendors making in-roads today? Who is laying the groundwork for the future?
Theresa Lanowitz, Gartner Inc
Adventures in Test Automation of Embedded Systems

Has your organization ever wondered about the various types, levels, and approaches to automation in testing embedded software-systems, and how you "stack up" in using them? Examine both the common test automation practices and unique particular problems by acquiring reference pints to compare against. Receive both introduction material and pointers in areas such as levels of tests (unit, integration, software, and system), techniques for generating inputs and outputs, types of testing (structural, functional, and behavioral), and active research. Focus will be on techniques, tools and approaches that have been successful in a variety of real world industrial settings. A decision flow graph will be included as a road map/checklist that you can take home to guide your organization's quests for excellence.

  • Road map for assessing and improving embedded test automations
Jon Hagar, Jon Hagar Educational Services
Differential Testing: A Cost-Effective Automated Approach for Large, Complex Systems

Differential testing is an automated method you can use in testing large, complex systems. It's especially useful in situations where part or all of an existing production system is being upgraded, and the end-to-end functionality of the new system is expected to be the same as the old one. Rick Hower uses two case studies to provide descriptive examples of this novel and surprisingly effective approach. One case involves the rewrite of a complex business rule processing system for a large financial institution; the second involves the replacement of a critical sub-system in a telecom billing process.

  • Learn how to determine if differential testing will be useful for a project
  • Obtain some useful methods for selecting appropriate automated test data
  • Discover critical factors in the success of differential testing
Rick Hower, Digital Media Group, Inc.
The Journey to Test Automation Maturity

There's a pattern to the way test automation typically emerges within an organization. Since you want your automation projects to excel, considering the possibilities of what could happen based on those patterns can help you successfully prepare yourself and your team for anything. By doing this you'll avoid pitfalls, counteract resistance to automation, and set realistic expectations for what automation can do. From other people's common experiences, you can extract information that will help you at all stages of automation maturity.

  • Explore the patterns from pre-launch to advanced levels of test automation maturity
  • Learn traps to avoid and tips for success
  • Discover ways to sustain the benefits of automation even after the first flush of enthusiasm has passed
Dorothy Graham, Grove Consultants
Implementing an Enterprise Monitoring Solution: Testing and Operations Deliver Together

Achieving high levels of availability and scalability for large server environments is a challenge that impacts all aspects of application design, development, testing, deployment, and operations. In this presentation, Nancy Landau provides a real-world case study of a successful implementation of a multi-layered enterprise system that supports 600-plus servers in multiple sites. You'll see how a wide assortment of monitoring tools were integrated together to assess the health of server farms, the individual components within the environments, and the applications themselves. Learn how test engineers and operations staff work together to improve performance and reliability.

  • Discover how the team overcame process and tool challenges
  • Dissect the case study to determine what led to the project's success
Nancy Landau, Fidelity Information Services
Home-Brewed Test Automatioin: Approaches from Extreme Programming Projects

Projects that use eXtreme programming (XP) often do not use commercial GUI test tools, finding it more useful to build their own support for test automation. This session explains the strategies they've used, which can actually cross over to any project where developers take responsibility for building support for automated testing. The XP community has already made an impact on the tools and practices for unit testing in the wider development community. The instructor reviews the potential impact on customer-perspective testing.

  • Share experiences in building in-house GUI test tools
  • How and when to build and use test APIs
  • Open-source tools to support these approaches
Bret Pettichord, Pettichord Consulting
Smaller-Scale Web Sites Need Performance Testing Too!

Even a smaller-scale Web site requires careful planning and execution of performance tests. Making the critical decisions in a timely manner and identifying the performance goals are still prerequisites to a successful test. However, smaller sites don't necessarily have the resources required to do large-scale testing, so compromises have to be made. This requires good test planning. The instructor explains the testing of a small site looking to grow, as well as the successes and pitfalls of achieving reasonable goals.

  • Define the test objectives; what's reasonable?
  • Plan the test then utilize tools, choices, and tradeoffs effectively
  • Apply and understand the results
Dale Perry, Software Quality Engineering
Web Application Performance Testing with the Open Source Hyades Project

What if you could build and run multi-user performance tests with a free, open source tool? Then, this coming Monday, you could validate multi-user application performance before deploying your application to your users, automate performance tests without spending money, and add additional features and capabilities to the
performance test tool as desired. Join Jeff Robbins to learn about two open source tools, Eclipse and Hyades.

Jeff Robbins, IBM Rational Software Group
Why Software Quality Assurance Practices Become Evil!

Are your organization's software quality assurance practices (SQA) working well? Would some developers even say they cause discomfort or are destructive? If so, maybe you are focusing too much on the processes and not enough on the underlying principles. Based on his 35 years of being involved in almost every aspect of the software development business from programmer to CEO, Greg Pope shares his eight principles for good software. You'll learn about a quantitative, risk-based approach to tailor these principles into appropriate practices. By employing a context-driven approach to select the right practices for each application and project, you'll go along way toward making customers and developers appreciate the value and benefits of SQA principles and practices.

  • Symptoms of "evil" SQA practices
  • Eight principles for good software development
Gregory Pope, Univ. of California / Lawrence Livermore National Laboritory
Fault Injection to Stress Test Windows Applications

Testing an application's robustness and tolerance for failures in its natural environment can be difficult or impossible. Developers and testers buy tool suites to simulate load, write programs that fill memory, and create large files on disk, all to determine the behavior of their application under test in a hostile and unpredictable environment. Herbert Thompson describes and demonstrates new, cutting edge methods for simulating stress that are more efficient and reliable than current industry practices. Using Windows Media Player and Winamp as examples, he demonstrates how new methods of fault injection can be used to simulate stress on Windows applications.

  • Runtime fault injection as a testing and assessment tool
  • Cutting edge stress-testing techniques
  • An in-depth case study on runtime fault injection
Herbert Thompson, Security Innovation

Pages

CMCrossroads is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.