06 June 2010

Comparing AutomatedQA Test Complete and HP Quick Test Professional


Having tried AutomatedQA's Test Complete for a while, I am just trying to put down my views on it when you compare it with HP Quick Test Professional. Both of these tools are excellent for regression testing with automation. However, there is a huge cost difference between the two. You can only buy 1 QTP license for the cost of six Test Complete License.

Missing Features in Test Complete

  • There is no Object Repository concept in Test Complete instead it supports something called as Name Mapping which you will find a bit disorganized when you compare it with QTP.
  • Regular Expressions are missing which is a huge huge miss and a big disadvantage. Regular expressions have a big role in automation testing of complex dynamic applications and AutomatedQA needs to understand this soon.
  • Descriptive Programming is not available which again is a big ingredient of any test automation.
Test Complete's Advantage over HP Quick Test Pro

  • It seems faster than QTP but then again it is because of lesser features and the right time to evaluate this will be when you get all the QTP features in Test Complete. There is lesser CPU usage and higher stability. If you are testing a simple plain application, Test Complete is your candidate.
  • Object Identification can be done at different levels like, Document Object Model (DOM), Tree, Tag and Hybrid. The Hybrid option of object identification gives you a faster identification at runtime which is way too fast than QTP.
  • Load Testing feature comes in the same license.
Test Complete's Disadvantage over HP QTP

  • The major drawbacks are in the form of missing features like regular expressions and descriptive programming.
  • You do not have a proper sync function like the Browser.Sync in QTP. An inbuilt sync function plays a major role in Web Testing. Although, there are a few inbuilt sync functions in Test Complete but they are not as efficient as that of QTP.
  • Using the Document Object Model (DOM) method of object identification, object identification gets way too slow compared to QTP when you try to find child objects. QTP uses DOM for object identification in maximum cases when you find child objects.
  • No accompanied product support for Business Process Testing as in the case of QTP. QTP has Quality Center BPT as the Keyword Driven Framework. However, there are 3rd Party KDF engines available in the market for working with Test Complete. Something very similar to Quality Center.
In the end, my conclusion is that it largely depends upon your budget and requirement. If your test automation requirements are getting fulfilled with Test Complete, there is no need to go for QTP at a higher cost. Both these tools solve the same purpose, it is just that QTP is a versatile tool for a critical and more risky Application Under Test (AUT).

Business Process Testing Suite for Test Complete is provided by STAR (Software Test Automation Resource) which works the same way as the Quality Center Business Process Testing works. It is just that it costs way too less that Hewlett Packards's QC.

9 comments:

  1. This comment has been removed by the author.

    ReplyDelete
  2. You write: "However, there is a huge cost difference between the two. You can buy 6 QTP licenses for the cost of one Test Complete License."

    This is actually closer to the opposite. TestComplete is less expensive than QTP.

    ReplyDelete
  3. TestComplete supports regular expressions, RTFM

    ReplyDelete
  4. @RTFM TestComplete did not support regular expressions when i wrote this article and the support for regular expressions will only be available with version 8.5 which is yet not available.

    ReplyDelete
  5. Been using regular expressions in TC for years, both the integrated TC feature as well as the scripting language support (at least in JScript). Not sure what you mean that it will not be there until 8.5?

    ReplyDelete
  6. I meant regular expressions in test object properties like the way QTP supports. I am not talking about parsing strings using regex.

    ReplyDelete
  7. For modern application (Using .net frameworks), i recommended Test complete.

    ReplyDelete
  8. I would also recommend testcomplete, after using both tools for a very long period of time.

    QTP is very clunky and I honestly have no idea how they can justify that price point. No company that I know will pay out almost 10k a license for an automated software tool, when they can get a standard node-locked license at testcomplete for 1/10th that cost.

    While there's definitely things done better in QTP, it's few and far between in my opinion. TestComplete's namemapping feature is rubbish, but I wasn't all that fond of QTPs object repository either... I find working directly with the objects is the best way to go though I admit, its definitely personal preference.

    Overall though - good comparison - I expected this to be bias towards QTP when I clicked the link but it was mostly objective which I can definitely appreciate.

    Cheers,

    ReplyDelete
  9. You need to modify this post, I have worked extensively with both the tool...
    Test complete does has lot of feature then the QTP.
    Below are some of the strong features of the Test complete over QTP.
    1. Multiple object recognition techniques.
    2. Better reporting then QTP.
    3. Supports 5 different scripting language (only difference is Syntax)
    4. IDE is similar to Visual studio, way better then QTP IDE.
    5. Very Strong in Descriptive programming.
    6. Event handler, which is similar to recovery scenario (Test complete has specific event handlers then QTP)
    7. Object Browser, which we don’t have it in QTP.
    8. Distributed testing using Test execute, which is not there in QTP,
    One test execute license comes for free with the test complete,
    cost of the additional test execute is less than 400$.

    Many more...

    ReplyDelete