Graphical TestNG Reporting

Hi There,

Automation without a proper reporting ?

We have developed an Open Source Reporting utility (ATU Reporter) for Selenium. This will be a TestNG listener for generating customized graphical reports. Following reports can be generated by this listener.

  • Line Charts
  • Bar Charts
  • Pie Charts 

ATU Reporter for Selenium TestNG:


The Project is a TestNG Listener which can be used along with Selenium WebDriver for a more detailed Graphical reports.

This Post is organized into following parts:

Go To: ATU Reporter Part 1  - Contains Details regarding The ATU Reporter
Go To: ATU Reporter Part 2  - Contains Details regarding The usage along with Examples
Go To: ATU Reporter Part 3  - Contains Details regarding Upcoming Releases and Features
Go To: ATU Reporter Part 4  - Contains Details regarding Customizing the Reports
Go To: ATU Reporter Part 5  - Contains Details regarding Excel Reports Dependencies



Download Links: Current Version 5.5 BETA

For list of Bug fixes/Features, visit ATU Reporter Part 3

Download: ATUReporter for Selenium TestNG

The above zip file contains  ATU Reporter, ATU Test Recorder, Java-doc, Properties file and a Sample Project.

ATU Reporter for TestNG - Stable Version 2.1:

This project is purely for TestNG. This does not Depend on Selenium.
Use this if you wish to work with TestNG tests which are not browser based such as API Testing, Unit Testing etc.

Refer to the link for Detailed Description : ATUReporter for TestNG

LinkedIn Group:

you can join our LinkedIn group here for more collaborative discussions: ATU LinkedIn Group

Give our tools a Feedback - Request New Features:

 We are constantly working on several projects, we would like to have a feedback on all the tools so that we can prioritize, introduce new features, enhancing them etc. This will also help us in understanding the usage of these tools and lift us to develop further more utilities.

Feedback page : ATU Utilities User Feedback

Features request page: ATU Reporter New Features Request Page


Hope Reporting will be interesting for you :) .. Let us know any bugs if you encounter. :)

 We love Automation; we love to keep its utilities Open Source. 
                                                                                                – Automation Testing Utilities

379 comments:

  1. ASJ2 December 2013 at 07:32

    Hi Sir,

    Pls provide customization so I can rename Header title of reports as currently it is ATU.
    Thanks
    Aman ur Automaion frnd.

    ReplyDelete
    Replies
    1. Automation Tester3 December 2013 at 00:24

      Hi Aman,

      User customization is something that we have planned out in the next release of ATU Reporting.

      Regards
      AT

      Delete
    2. ASJ5 December 2013 at 08:53

      Thanks Sir Waiting for next release pls let me wenever it will go live :)

      Delete
    3. Automation Tester5 December 2013 at 09:07

      Aman,

      The next release features the Customization part :) stay updated , you would definitely have it in your pot :)

      Regards
      AT

      Delete
  2. Automation Tester4 December 2013 at 21:46

    Minor modifications made in the new version 2.1 . This should fix the issues :)

    Regards
    AT

    ReplyDelete
  3. Anonymous5 December 2013 at 07:06

    Hi,
    Is there a way to change output folder?

    ReplyDelete
    Replies
    1. Automation Tester5 December 2013 at 09:01

      Hi,

      As of now , the generated reports directory is standard, you cannot change the output folder. I would want to know why would you do this ?

      Delete
    2. Anonymous5 December 2013 at 23:42

      I like very much your reports and I want to use them.

      1. I have many types of tests (eg. smoke, regression). For each type of test I need a different results folder.

      2. Also I think it'll be useful to have a description for each run (left table: index, run 1 (description 1), run 2 (description 2)....)

      3. Custom summary for each run (eg. build number). Possibility to add information in that table.

      4. Can you publish the source code?

      Delete
    3. Automation Tester5 December 2013 at 23:55

      Hi All,

      We have received several requests related to customization part for reporting. We are happy to inform that the work is already in progress and it will be available soon.

      Regards
      AT

      Delete
  4. Anonymous26 December 2013 at 21:05

    Hi Automation Tester,

    I really like you rreporting format would love to use them .
    Please if possible release customized version as with current version its difficult to use it on real project base as i am facing a lot of issues . Please allow to customize as many feature as possible like allow to extend array size so that for large project we can also use it.
    Apart from that there are different variables which probably would be different as per individual needs .
    Its really great work but if we can customize and use it on real project then that would be really great.

    ReplyDelete
    Replies
    1. Automation Tester26 December 2013 at 23:54

      Dear Anonymous,

      The ATU Reports is widely being used in real time projects as it turns out to be the only reporting available for Selenium TestNG with very detailed test execution summary reports, However, we are adding many features and I would like to let you know that the new version of the ATU Reports will be released soon with Customization and few other features :)

      Regards
      AT

      Delete
  5. Anonymous29 December 2013 at 21:58

    Hi Automation Tester,

    Reports fails to take screenshot and test details on retrying test more than one time only first time it works.

    ReplyDelete
    Replies
    1. Automation Tester30 December 2013 at 00:15

      Hi ,

      For taking screenshots, after instantiating webdriver object, you need to set the webdriver object in configuration annotations like before class or before suite, in the script.

      Can you tell me in which method have you set the webdriver obj ?

      Delete
    2. Abhishek30 December 2013 at 01:01

      Well i am using screenshot as listener but my problem is not screenshot as its taking screenshot but i am also using retry listener to run test again in case of fail test but in that case no test case detail page is appearing its showing "File not found" on clicking on fail test case for first its working fine and after retrying any fail test case none of the test case even fail or pass no detail page appearing i.e. no screenshot no test detail my screenshot function is working fine.
      I am also facing anther problem i am using more than one reporting format and using second listener which is reportng but reportng listener is not firing if i am using your report format any suggestion or solution ??

      Delete
    3. Abhishek30 December 2013 at 01:16

      well hi thats me above with some problem with my account and as a result you can see that name helena .
      I tried to decompile your jar file and able to customize and meet the requirement i have but the only problem i faced is the one i mentioned above as i guess your onFinish method is only for single run while on retrying again test its should call onfinish() from start but its throwing java.lang.IllegalStateException: java.lang.ArrayIndexOutOfBoundsException exception if you can test your jar for this scenario or may be provide some suggestion so that i can work on it .
      thanks

      Delete
    4. Automation Tester30 December 2013 at 01:33

      Hi,

      Possibly we might have not tested the listener against executing the failed tests xml. We appreciate the inputs provided. We will amend the necessary changes in the new version :)

      Regards
      AT

      Delete
    5. Automation Tester30 December 2013 at 05:17

      Hi,

      we have fixed the issue in version 2.2. you can download it from the provided link. let us know if you encounter any more issues :)

      Regards
      AT

      Delete
  6. Abhishek30 December 2013 at 21:44

    This comment has been removed by the author.

    ReplyDelete
    Replies
    1. Abhishek30 December 2013 at 21:50

      Hi AT
      Still i am getting test details only for first run on retrying test second and third time no details. For second run onward test case html page is not getting generated while screenshots are there.
      Any way i really appreciate for replying so fast if possible test by running failed test xml 2 or 3 times

      Delete
    2. Automation Tester30 December 2013 at 22:33

      Could you mail us the xml files? It will help us in debugging.

      Delete
  7. Abhishek30 December 2013 at 23:03

    can't send you xml file but can tell the scenario .
    take any test and retest fail test case using IRetryAnalyzer as on the output section you will see for first case report is present but for second attempt no test case html page is created only on the current run report results are there but on clicking on second attempt no page present.

    ReplyDelete
  8. Anonymous6 January 2014 at 02:53

    Hi AT,
    Your reporting is really good and working fine. Will this report work fine for grid execution too?

    ReplyDelete
    Replies
    1. Automation Tester6 January 2014 at 07:14

      Hi,

      ATU Reporter is a TestNg listener, as long as you use TestNg in grid setup, it should work fine.

      Regards
      AT

      Delete
  9. Anonymous8 January 2014 at 06:45

    Hi Automation Tester,

    I'm not getting response on ur given "Download Links: Stable Version 2.2" here.
    Please, provide me a proper link to download 'ATU Reporter project'
    my Email_ID are: "kumar.kd20@gmail.com" OR "kumar@abksoftware.in"

    Regards
    Kumar Dharmanand

    ReplyDelete
    Replies
    1. Automation Tester8 January 2014 at 07:13

      Kumar,

      The links are working fine, If you click on the provided link, you will be redirected to google drive, click on version 2.2 folder. From there you can download it.

      if you are downloading from a corporate network, It might be blocked due to internal security. However, I will be mailing you the ATU Reporter 2.2 Zip file.

      Regards
      AT

      Delete
    2. Anonymous8 January 2014 at 07:34

      Hi Automation Tester,

      Thanks for ur reply.

      I got ATU Reporter 2.2 Zip attachment.
      You are right, It was blocked due to internal security.
      I will send my test feedback as soon as possible.

      Thank You again.
      KD

      Delete
    3. Automation Tester8 January 2014 at 08:08

      Welcome Kumar :)

      Regards
      AT

      Delete
  10. Anonymous9 January 2014 at 08:47

    Hi Automation Tester,

    I integrated ATU jar in a maven projects, & I got all screens as u shared.
    Report is Excellent.

    But, here some of limitation with reporting.

    1. No filtering for passed, failed and skipped tcs.
    2. Line Chart is showing all runs(more than 10).
    3. No pagination for Pie Chart's table, showing all results in current page.
    4. Screen shots are not working.

    If u have any suggestion for these mention limitation, plg, give me description.

    My test is going on, I will provide more feedback.

    Regards.
    Kumar Dharmanand

    ReplyDelete
  11. Automation Tester9 January 2014 at 10:14

    Hi Kumar,

    For the list you have mentioned,

    1. Filtering is not possible at this point, instead you can see all the Test Cases in a single summary. (This is a good suggestion, we would like to incorporate it in the newer version)

    2. We have intentionally kept the line chart data to show all the execution history.
    3. Pagination is something again related to the first point.
    4. Screenshots should work fine. can you tell me what issue are you facing ?

    From your comments, "Filtering Test Cases". This is a good input provided, we would add this feature :). Thanks Kumar, we would like to hear more from you :)

    Regards
    AT

    ReplyDelete
  12. Anonymous10 January 2014 at 06:13

    Hi Automation Tester,

    Thanks for quick reply.

    About the screen shots, I had checked my scripts then finally,
    It is working for both passed and failed tcs.

    When I'm using only with testNG,
    I can set screen shots as our passed OR failed tcs with help of 'ITestResult' interface.

    But with 'ATUReports' how to control it? or Any other way ?

    Regards.
    Kumar Dharmanand

    ReplyDelete
    Replies
    1. Automation Tester10 January 2014 at 07:00

      Hi Kumar,

      The ATU Reporter can take screenshots and place them in the reports. can you brief on ''how to control it'', ?

      Delete
    2. Anonymous10 January 2014 at 07:35

      Hi Automation Tester,

      I want take Screenshots only for failed tests.

      I have taken these lines of code in a test method:

      1. ATUReports.add("Log In", "kd", "kd1", "kd", true);
      2. ATUReports.add("Log In", "kd", "kd", "kd", true);

      Here, my test has passed (on same Expected Value and Actual Value),
      But screen shots are coming for both line.
      How to set it for failed test only ?

      Regards
      KD

      Delete
    3. Automation Tester10 January 2014 at 08:45

      That is not possible. You can only set the boolean value.

      Regards
      AT

      Delete
  13. Automation Tester14 January 2014 at 05:29

    Hi,

    Could you provide details on when are you facing this issue? What kind of configuration is it?

    ReplyDelete
  14. Unknown14 January 2014 at 11:52

    Its a simple testng configuration. Like, I setup in the testNG to run all methods in a class and also in another run, I run all classes in a package. This happens even for 1 thread or 5 threads. Please let me know what other details you want.

    ReplyDelete
  15. Unknown14 January 2014 at 12:04

    One clue is, I am logging some content and HTML link to appear in the final report.

    ReplyDelete
  16. Unknown14 January 2014 at 12:12

    If i have the code, I could have taken a look, but I have no idea why it is happening. Any help is greatly appreciated. I already have another listener to generate a custom report. Since this is failing, the run fails abruptly and my other report is also not getting generated.

    ReplyDelete
  17. Automation Tester14 January 2014 at 19:49

    What content are you adding to the final report? additional html link? Describe a little more on this, also if you run without this html link, do you face this error?

    Regards
    AT

    ReplyDelete
  18. Unknown14 January 2014 at 21:01

    Thanks, AT ! Its amazing to see your responses.

    I guess I narrowed down what the issue is:

    Success Scenario: NO HTML Content logged
    ----------------------------------------

    I ran a test which doesn't do any HTML content reporting(I mean the Reporter.log() method in TestNG).

    The Report generation was successful with NO exception.

    Failure Scenario: HTML Content logged using Reporter.log()
    ----------------------------------------------------------

    I ran a test which logs HTML content using Reporter.log() and its gives me the above exception and aborts.

    Since the blog is not allowing me to post HTML contents, I have sent the details to automationtestingutilities@gmail.com.

    Please take a look and let me know if you need more information.

    Thanks !

    ReplyDelete
    Replies
    1. Automation Tester14 January 2014 at 21:24

      Hi,

      I have checked your mail, this part is related to customization. All the features realted to customization will be available in the next version.

      We are working actively on many other projects simultaneously, we would realease the next version very soon. I appreciate for the inputs you shared.

      Regards
      AT

      Delete
    2. Unknown14 January 2014 at 21:27

      Thanks, AT. You guys are amazing !!

      Delete
  19. Unknown16 January 2014 at 22:57

    hi AT,

    When i am using these line...
    ATUReports.add("Step Desc", "inputValue", "expectedValue","actualValue", false);

    I don't get report with filled 'inputvalue" value , it shows empty..

    Can you please verify these line & check the report at your end..

    Regards
    Sujan

    ReplyDelete
    Replies
    1. Automation Tester17 January 2014 at 00:12

      Hi Sujan,

      Let me ckeck it.

      Delete
    2. Automation Tester17 January 2014 at 01:23

      Hi,

      It's working fine with the above specified parameters, all the reports are being shown. Can you re check it.

      Regards
      AT

      Delete
  20. Posiblemente posible17 January 2014 at 08:02

    Hi, Im using Mac, and I think you have a problem with path resolution as Its looking for this js file in an incorrect path. Can you review it?

    java.io.FileNotFoundException: /Users/jconsol/Documents/workspace/IOS-ClubeOfertas-Regression/Custom Reports/Results/Run_10/pieChart.js (No such file or directory)

    run_10 has not been created insted it creates run_910

    ReplyDelete
    Replies
    1. Automation Tester17 January 2014 at 08:24

      Hi,

      This issue arises when you have listeners declared in both script and testng.xml. Make sure that the listener's are declared only once.

      Regards
      AT

      Delete
  21. Unknown17 January 2014 at 11:22

    Can I use the listener with any TestNG project (I do not use selenium, my test framework go through REST, and it is a maven project)? If so, how would I go about using it it with Maven?

    ReplyDelete
    Replies
    1. Automation Tester18 January 2014 at 08:56

      You can use the listener with any project that uses TestNG framework. Since you are not using selenium, you cannot see the screenshot in the test execution report. There is no specific configuration that you have to do while you are working with maven, you just have to add the report content with the availabile methods.

      Regards
      AT

      Delete
  22. Ravi Nelluri6 February 2014 at 05:31

    Hi AT,

    1) Is there any way to mentioned the result folder path .. presently "Custom Reports" folder is creating in project folder. Can I mentioned any other specific path to store the results .
    2) is any way to change the title "ATU Graphical Reports for Selenium - TestNG" name section when opened index.html file

    ReplyDelete
    Replies
    1. Automation Tester6 February 2014 at 06:24

      Hi Ravi,

      From version 3 of ATUReporter it will be possible for you to change the directory of the reports and edit the header content.

      The expected release date for v3 is feb 10 or the earliest.

      Regards
      AT

      Delete
    2. Ravi Nelluri7 February 2014 at 02:21

      Thanks AT :) .

      Delete
  23. Gustavo6 February 2014 at 11:53

    Hi! This utility is great! Thank you!
    Is there any chance you can put the proyect in a Maven repository so I can use it with Maven??

    Regards
    Gustavo

    ReplyDelete
    Replies
    1. Automation Tester7 February 2014 at 01:22

      Hi Gustavo,

      Currently we do not maintain in Maven Repository. As of now, please add it to your build path.

      Regards
      AT

      Delete
  24. Unknown10 February 2014 at 01:25

    HI Automation,

    I observed some Issue related to Screen Shot option in ATU.

    I have a line of code...
    ATUReports.add("Step Desc", "expectedValue", "actualValue", True);

    When i Run these line of code in Firefox i get proper Screenshot of screen.
    but if I run these line of code in IE i don't get any screenshot .

    Can you verify at your end also..

    Thanks & Regards
    Sujan

    ReplyDelete
    Replies
    1. Automation Tester10 February 2014 at 07:58

      Are you encountering any exception Sujan ? Can you let me know which version of IE it is ?

      Regards
      AT

      Delete
    2. Unknown13 February 2014 at 08:29

      NO exception during Run.
      I am using IE8 version...No error no exception....

      Delete
    3. Automation Tester13 February 2014 at 20:13

      Hi Sujan,

      We had a workaround solution for this in v3.5. This should be the issue in Internet Explorer. Please refer to ATU Reporter Part 3 page where you can find fixes/features/enhancements in new versions.

      Regards
      AT

      Delete
    4. Anonymous21 March 2014 at 00:33

      I have used the v3.5 and v4.0 but still screen shots are not showing in reports.Can you kindly provide me the settings in IE,so that i can get the screen shots in Reports.

      Delete
    5. Automation Tester21 March 2014 at 02:21

      Hi,

      ATU Reporter v3.5+ Screenshots should work fine with IE. Can you mail us the reports to debug ?

      Delete
  25. Boopathi13 February 2014 at 04:51

    Hi Automation Tester,

    The reports are awesome !!!!

    Is there a way to exclude Configuration Methods (Like Before and After Class) from Reports. (I agree there is a separate filter option available)

    In my script, Before and After classes will be used for all test cases. So All Methods having a considerable number of methods which all are configuration methods.

    It would be so nice, if there is an option in properties file.

    ReplyDelete
    Replies
    1. Automation Tester13 February 2014 at 05:20

      Hi Boopati,

      That is a valid suggestion. As requested, this option for configuration reports will be pulled from properties file. :) this will be one of the new features in the next release.

      Regards
      AT

      Delete
  26. Unknown19 February 2014 at 08:06

    hey great reporting utils,,, all ready intergrated to my framework …. can u please show me how can i add , my company logo to this report.

    ReplyDelete
    Replies
    1. Ravi Nelluri20 February 2014 at 01:14

      Rakesh-

      it's so simple ... in the property file it's already mentioned path for the the logo ... keep your logo as per the property file path and ran the script

      Delete
    2. Unknown20 February 2014 at 01:58

      HI Ravi

      Thanks for your reply.... still cannot import my logo into reports. All i did was i copied atu.properties into project and changed this parameter some thing like this "atu.proj.header.logo=/Users/rakesh/desktop/MyLogo.jpg" then excuted my scripts.

      is their any explicit configuration other than this

      Delete
  27. Ravi Nelluri20 February 2014 at 02:55

    Rakesh-



    atu.reports.dir=E:/ATU Reporter
    atu.proj.header.text=MY COMPANY
    atu.proj.header.logo=D:/MYCOMPNAYLOGO.jpg
    atu.proj.description=MyProject Testing Reports
    atu.reports.excel=false
    atu.reports.pdf=false


    This is the sample property file and if you observe 3rd step directing to the physical location of the company logo. place your company logo at (d:\){you can mentioned different one or you can create one folder in the project and you can call that one also) and run the script .. it will pull the logo from your physical location .

    ReplyDelete
  28. Unknown20 February 2014 at 03:05

    Thanks Ravi ,,, I got it now. One quick question, is their possibility to remove ATU logo which is on left side of the reports and also text under it "Reflections of Visionary Minds".

    Is this possible ????

    ReplyDelete
    Replies
    1. Ravi Nelluri20 February 2014 at 03:10

      I don't think so .. it can not be possible to remove the logo and under text and at bottom "ATU Reporter Version: v3.0 Reports by: Automation Testing Utilities" . As it's a author signature so we can't delete it.

      @Automation Tester

      can you comment on this one

      Thanks
      RN

      Delete
    2. Unknown20 February 2014 at 03:18

      ok, Thanks for your answer. My team said that it would be nice to remove if possible(not mandatory),,,, but any way this is the best reporting tool till now i used...

      Delete
    3. Unknown20 February 2014 at 03:32

      This comment has been removed by the author.

      Delete
    4. Automation Tester22 February 2014 at 23:40

      Guys ... :)

      Some parts of the reports such as logo and the description cannot be modified as it reflects the work what we do :) our team puts so many efforts to publish these content, such things gives us immense confidence and happiness to contribute and work, this is like an hobby for us. I hope you can make it out :)

      Regards
      AT

      Delete
  29. Unknown20 February 2014 at 06:37

    Hi

    It would be really nice if this can achieve by JUnit as well. The problem with the TestNG is that it cannot support to designed CUCUMBER framework.

    Regards
    RK

    ReplyDelete
    Replies
    1. Automation Tester22 February 2014 at 23:44

      Rakesh,

      Well, I could say yes for what you have asked, but there are certain things which JUnit does not offer as TestNG. However, we can work on JUnit reports which will have similar structure. We will have to check the feasibility and come out with a solution. This is definitely possible, but it would take consider amount of time to release the first version :)

      Regards
      AT

      Delete
  30. Anonymous23 February 2014 at 03:43

    Hi AT,

    I tried to incorporate graphical reporting, but one of the listeners (ConfigurationListener) doesn't get recognized when I add it in the TestNG configuration, nor when I add it as a Listener class for the class I have my tests in.

    The compiler says I'm using incompatible types. Found java.lang.Class, but java.lang.Class is required.

    I'm using Intellij 13, and adding the jar to the project as a library - I tried adding versions 3 and 3.5 (separately), but got the same error.

    Any tips on what could have went wrong?

    Thanks,
    Levi

    ReplyDelete
    Replies
    1. Automation Tester23 February 2014 at 04:05

      Hi Levi,

      you need to use the three listeners as follows - annotate your class:

      @Listeners({ ATUReportsListener.class, ConfigurationListener.class,
      MethodListener.class })
      public class TestNGScript { ...

      Now, if you have faced the issue after the above has been done, can you paste the exception stacktrace here?

      Regards
      AT

      Delete
  31. Anonymous25 February 2014 at 07:03

    hi ,
    This utility is great! Thank you!
    can any one help me where i can send the step status [ fail, pass, skip] , the reporter always passed in all TC's

    ReplyDelete
    Replies
    1. Automation Tester26 February 2014 at 00:46

      Any tc if failed, the reporter provides failure description where you have full stack trace along with a short failure message.

      Delete
  32. Anonymous26 February 2014 at 02:15

    Thanks for your response :)

    am using testing with selenium so if i use isElementPresent the ATU report will stop but also the test will stop running

    if (selenium.isElementPresent("id=login_module_txtlogin")!= false) {
    selenium.type("id=login_module_txtlogin",Name );
    ATUReports.add("User name text box under login page is exist with this user name : " + Name + " " , false );

    } else {
    ATUReports.add("User name text box under login page not exist" , false);

    }
    i want in this line to failed the step so the whole TC flipped to failed .
    ATUReports.add("User name text box under login page not exist" , false);

    Thanks in advance ;
    Abualzait

    ReplyDelete
    Replies
    1. Automation Tester26 February 2014 at 03:03

      Abualzait,

      setting a step status is not supported. instead you can modify the else block as

      else {
      throw new IllegalStateException("User name text box under login page not exist");
      }

      or

      else {
      Assert.fail("User name text box under login page not exist");
      }

      This exception is captured in the Reports, this indicates a failed tc :)


      Regards
      AT

      Delete
    2. Anonymous26 February 2014 at 04:19

      Thank you very much that is really helpful :) and i hope you add the step status in the next releases .
      Best regards ;
      Abualzait,

      Delete
  33. Unknown4 March 2014 at 01:36

    Hi Automation Tester,

    I have been following your blog for quiet a long time and use the techniques in my projects. I had recently tested our reporting with multiple TestNG Tests in a single suite of testng.xml, even-though I had not found any error but I did not find the proper reports as well.

    It had created 2 runs, while doing so and results were displayed for only one run the other run did not create any results

    Please let me know is there any configuration changes required for maintaining multiple tests in one testng.xml

    ReplyDelete
    Replies
    1. Automation Tester4 March 2014 at 02:25

      When the listener is used in both class and testng.xml, then the events are listened twice due to which it creates two runs. Make sure that the listener is called either from xml or class file but not from both.

      Regards
      AT

      Delete
    2. Unknown4 March 2014 at 23:11

      This comment has been removed by the author.

      Delete
    3. Unknown4 March 2014 at 23:17

      Hi I had ensured that ATU listeners are called only in classes, i just have listeners for reportNG

      this is my mock testng.xml
      suite
      test name="Test1"
      classes
      class name="com.tests.package1.XYZ"
      classes
      test

      test name="Test2"
      classes
      class name="com.unit.package.ATU"
      classes
      test


      IN XYZ Class
      I use
      @Listeners({ ATUReportsListener.class, ConfigurationListener.class,
      MethodListener.class })

      Please correct me if anything is not right

      Delete
    4. Automation Tester5 March 2014 at 00:06

      When yu have more than one class, instead of declaring listeners in each class, declare once in the testng.xml and remove listeners from all the classes.

      Also check it without using reportNg.

      Regards
      AT

      Delete
  34. Bilal19 March 2014 at 14:39

    Awesome!

    This is just a suggestion to add away to the filter drop-down list in the HTML report to filter for Test methods only (i.e. exclude configuration methods). This way, only actual test methods will be shown on the page

    ReplyDelete
  35. Bilal20 March 2014 at 11:36

    Issue: when set atu.reports.dir within the atu.properties file to use point to a network shared location, all graphics don’t show in the report.

    It will be great if this will support creating reports on a network location instead of the local drive

    ReplyDelete
    Replies
    1. Automation Tester21 March 2014 at 02:14

      Hi,

      I would not say this is as an issue, rather I could say that this feature is not supported. generating reports on a remote machine is not supported. If this is a feature that you would like to have, we can check the feasibility.


      -- #AT

      Delete
    2. Bilal24 March 2014 at 16:28

      Agree, my apology, I didn't mean to report this as an issue. Anyways, in my case it seemed that some JS files didn't get generated on the remote machine, copying the files manually to the result folder on the remote machine fixed it.

      Delete
    3. Automation Tester24 March 2014 at 19:22

      Great :)

      Delete
  36. Boopathi28 March 2014 at 04:29

    Hi Automation Tester,

    I am using ATU reports for my selenium projects and it's awesome.

    Now i am trying to use same report for my API test automation as well as both are running through TestNG.

    But Here i am not able to get "Reporter.log" in report unless i add selenium artifact in my maven repository, Even though i am not using selenium here.

    Is there a way to overcome that? or incase if i add, Selenium info is getting reflected under Platform Execution details, Is there a way to hide selenium info from my report?

    ReplyDelete
    Replies
    1. Automation Tester28 March 2014 at 22:12

      Hi Boopathi,

      Some parts of the ATU Reporter API uses Selenium classes due to which you have to add the Selenium jar file in the build path. As of now, this has to be done.

      very soon the ATU community will release another project which is a clone project of ATU Reporter, this will have complete functionality except that it will no more depend on Selenium.

      #AT

      Delete
    2. Automation Tester13 April 2014 at 07:26

      Boopathi,

      A clone project of ATU Reporter is released which is purely for TestNG that does not depend on Selenium. Hope you can find it useful :)

      #AT

      Delete
  37. Unknown8 April 2014 at 03:41

    Hi ATU ,
    I wanted to take Screenshot of Screen when Any javascript popup , download file popup appears in screen (These pop up generally contains some text with Ok & Cancel button).
    when we call ATUReports.add("Step Desc", "inputValue", "expectedValue","actualValue", true);
    At the point of popup , these method does not take screen shot of screen & some time it takes the screen shot of web driver instance screen not popup which appears on screen.
    Tried with different combination to call these method...but didnt work

    Can you help to check from your end also

    Regards
    Sujan

    ReplyDelete
    Replies
    1. Automation Tester8 April 2014 at 04:04

      Hi Sujan,

      The webdriver screenshot API deals only with browser page screens. The screenshot of native dialogs such as download or other popups cannot be captured using webdriver API.

      Instead the desktop screenshot can be captured using java. This again puts you into a new challenge as explained below.

      When a dialog say download dialog appears, the webdriver does not proceed to next step unless the dialog is closed, which means the next step for taking screenshot doesnot execute.

      However you can still overcome this challenge by implementing threads.

      This is an interesting scenario you have put forth. I will add this feature in ATU Reporter. This is an excellent idea.

      Thank you.
      #AT

      Delete
  38. naresh9 April 2014 at 14:10

    Hi Guy's,
    Is these reports will run on Jenkins server?
    Thanks in advance.

    ReplyDelete
    Replies
    1. Automation Tester9 April 2014 at 19:54

      Works fine.. :)

      #AT

      Delete
    2. naresh15 April 2014 at 03:01

      Thank you. May I know the steps. please

      Delete
    3. Automation Tester15 April 2014 at 06:13

      Hi Naresh,

      you might have configured your Jenkins to call the tests via (ANT/ CMD Line/ Maven/ Java), Any of this call will invoke TestNG tests which will generate reports.

      #AT

      Delete
  39. Unknown9 April 2014 at 21:02

    HI Automation Tester

    Just want to ask if there is way in ATU Report that i want to log it as FAILED in the report then it will continue the other test cases.

    ReplyDelete
    Replies
    1. Automation Tester9 April 2014 at 21:56

      Hi Hector,

      This is not yet supported, You can expect this feature(Logging Levels) in next releases.

      #AT

      Delete
    2. Unknown9 April 2014 at 22:15

      THANKS, i will just wait for the next release.

      Delete
    3. Unknown9 April 2014 at 23:12

      Hi,

      Can i ask when will be the next release?

      THANKS

      Delete
    4. Automation Tester10 April 2014 at 00:16

      Hector,

      I have launched a recent version of reporter yesterday. since we are allocated with many other tasks, the release date cannot be stated.

      I can assure you that the releases are frequent and actively developed. Please follow the part 3 post for upcoming releases and features.

      #AT

      Delete
    5. Unknown10 April 2014 at 00:58

      Thanks AT, So excited to have that functionality..

      Delete
  40. Vishnu Agrawal11 April 2014 at 07:12

    I am trying to run multi browser testing. Problem is that in the generated reports, browser name is being displayed same for all tests (the last one). Can you suggest solution for this.

    package com.appsnack.billboard.tests;

    import org.openqa.selenium.By;
    import org.openqa.selenium.WebDriver;
    import org.openqa.selenium.chrome.ChromeDriver;
    import org.openqa.selenium.firefox.FirefoxDriver;
    import org.openqa.selenium.safari.SafariDriver;
    import org.testng.annotations.AfterClass;
    import org.testng.annotations.BeforeClass;
    import org.testng.annotations.Parameters;
    import org.testng.annotations.Test;

    import atu.testng.reports.ATUReports;
    import atu.testng.reports.utils.Utils;

    public class MultiBrowserTest {

    private WebDriver driver;

    // Configure for multi browser drivers
    @Parameters("browser")
    @BeforeClass
    public void beforeTest(String browser) {
    if (browser.equalsIgnoreCase("firefox")) {
    driver = new FirefoxDriver();
    } else if (browser.equalsIgnoreCase("chrome")) {
    // Set Path for the executable file
    System.setProperty("webdriver.chrome.driver", "/Users/vishnuagrawal/data/setups/chromedriver");
    driver = new ChromeDriver();
    } else if (browser.equalsIgnoreCase("safari")) {
    // Set Path for the executable file
    driver = new SafariDriver();
    } else {
    throw new IllegalArgumentException("The Browser Type is Undefined");
    }
    ATUReports.setWebDriver(driver);
    setIndexPageDescription();
    }

    @Test
    public void login() throws InterruptedException {
    // Open App
    driver.get("http://www.google.com");
    setAuthorInfoForReports();
    }

    @AfterClass
    public void afterTest() {
    try {
    driver.quit();
    } catch (Exception e) {
    driver = null;
    }
    }

    private void setIndexPageDescription() {
    ATUReports.indexPageDescription = "My Project Description
    Can include Full set of HTML Tags";
    }

    private void setAuthorInfoForReports() {
    ATUReports.setAuthorInfo("Automation Tester", Utils.getCurrentTime(), "1.0");
    }
    }






























    Browser name is safari in every test method while test was run on chrome, firefox and safari

    ReplyDelete
  41. Vishnu Agrawal11 April 2014 at 07:18

    somehow testng.xml is not being diaplyed here but it is same as mentioned in your link - multi browser testing (with one minor change, I've used safari instead of ie)

    ReplyDelete
    Replies
    1. Automation Tester11 April 2014 at 10:09

      Hi,
      I have mailed you on the same. I will update accordingly.

      #AT

      Delete
    2. Automation Tester13 April 2014 at 23:47

      Fixed the bug :)

      Thank you for your feedback :)

      #AT

      Delete
  42. Unknown21 April 2014 at 08:00

    AT

    Just a quick question how to remove this best view in different browser name ???

    ReplyDelete
  43. Unknown21 April 2014 at 08:48

    java.lang.NoClassDefFoundError: org/jfree/data/general/PieDataset
    at atu.testng.reports.excel.ExcelReports$ExcelChart.writeChartToExcel(Unknown Source)

    ReplyDelete
    Replies
    1. Automation Tester21 April 2014 at 08:57

      Hi,

      "NoClassDefFoundError": This occurs when you miss a jar file in your build path.

      Please add all the necessary jar files required for generating excel reports. The list of required jar files are described in ATU Reporter Part 5.

      #AT

      Delete
    2. Unknown21 April 2014 at 10:09

      I Have all of this jar files , Tell me which one iam missing(its all added into my buildpath)

      poi-3.10-FINAL-20140208.jar
      poi-ooxml-3.10-FINAL-20140208.jar
      poi-ooxml-schemas-3.10-FINAL-20140208.jar

      xmlbeans-2.3.0.jar
      dom4j-1.6.1.jar

      jcommon-1.0.22.jar
      jfreechart-1.0.17-demo.jar

      Delete
    3. Unknown21 April 2014 at 10:27

      AT,

      Found it problem with the jar download , replaced with all new . working

      Delete
    4. Automation Tester21 April 2014 at 20:25

      Great!!

      #AT

      Delete
  44. Anonymous21 April 2014 at 13:21

    Hi AT,
    I am able to create reports successfully but I am having problem with taking screenshots. Report not capturing the screen shot of the new window opened by WebDriver. It is only taking the screenshot of the inistial window opened.
    Am I missing any settings?

    Could you please help on this

    ReplyDelete
    Replies
    1. Automation Tester21 April 2014 at 20:24

      What kind of window are you referring to?

      #AT

      Delete
    2. Anonymous24 April 2014 at 07:33

      Actually I did not switch to new window and taking screenshot thats why it is taking the initial window screenshot. Is there any way we can take a screenshot dektop as a whole. Even If I did not switch to new window and my control is in parent window, I want take a screenshot of a desktop as a whole (not only the IE).

      Delete
    3. Automation Tester24 April 2014 at 20:41

      Hi,

      Desktop screenshot is not yet supported but we can consider this as a pull request to implement in next versions.

      #AT

      Delete
  45. Aditya Sekhar21 April 2014 at 20:39

    Hi ,
    A small doubt . does Selenium Testng report work if the Webdriver is an event firing driver. ? . As getting browser detail is little difficult with event firing webdriver

    ReplyDelete
    Replies
    1. Automation Tester21 April 2014 at 22:15

      Aditya,

      Browser details are captured by executing JavaScript and not by identifying the type of instance of the driver, so it should work with EventFiringWebdriver too. If you face any issues let us know.

      #AT

      Delete
    2. Aditya Sekhar23 April 2014 at 03:01

      Hi ,
      I tried it out . However i am facing some issues .
      1. Loading the properties .
      I would like the atu.properties inside my maven scr/test/resources folder . So getting path is again complicated
      Cant you load it like log4j does ?
      2. Capture screen shot is working only in 3.0 version for me . I am not sure getting . java.lang.NullPointerException
      at atu.testng.reports.ATUReports.takeScreenShot(Unknown Source) .

      3. Is there a way to change the column names inside the Test case steps page . I would like to add steps of all web events . so Expected , Acutal column names does not make sense .

      Delete
    3. Automation Tester23 April 2014 at 23:18

      Hi,

      1) you can place the properties file in any directory(including the scr/test/resources folder) provided you have to set the System property for this path.

      2) In which version are you facing "NullPointerException" ? have you tried with the current version 4.6 ?

      3) NO - you cannot change the column names.
      you can write your web events in the Step description , Expected and Actual columns helps when dealing with verification - unless you don't use them. The reports are designed in a more generic way which suits everyone needs.

      #AT

      Delete
    4. Aditya Sekhar24 April 2014 at 01:31

      Hi ,
      Thanks For the detailed report .
      I tried out 4.6 everything is working fine . I figured out when the Null pointer exception is happening . When ever we try to Capture Screen Shot in Before and After Methods .

      ******************************
      package tests;

      import org.openqa.selenium.By;
      import org.openqa.selenium.WebDriver;
      import org.openqa.selenium.firefox.FirefoxDriver;
      import org.testng.annotations.AfterMethod;
      import org.testng.annotations.BeforeMethod;
      import org.testng.annotations.Test;

      import atu.testng.reports.ATUReports;


      public class TestReport {
      private WebDriver driver;
      static{
      System.setProperty("atu.reporter.config", "E://atu.properties");
      }
      @Test
      public void f() {
      driver.findElement(By.name("q")).sendKeys("Cheese");
      driver.findElement(By.name("btnG")).click();
      ATUReports.add("HI", "Test","Is",true);
      }
      @BeforeMethod
      public void beforeMethod() {
      driver = new FirefoxDriver();
      driver.get("http://www.google.co.in");
      ATUReports.setWebDriver(driver);
      ATUReports.add("HI", "Before","Is",true);//Null Pointer Exception
      }

      @AfterMethod
      public void afterMethod() {
      ATUReports.add("HI", "After","Is",true);

      driver.quit();
      }

      }

      Delete
    5. Automation Tester24 April 2014 at 06:22

      Hi,

      Thank you for the feedback :)

      #AT

      Delete
    6. Aditya Sekhar29 April 2014 at 03:58

      Hi ,
      I have one more issue . All the Skip reason i am providing in script using
      throw new Skip Exception is not showing in report . Could you please try to add it in the report .
      http://testng.org/javadoc/org/testng/SkipException.html

      Delete
  46. Anonymous24 April 2014 at 07:40

    Hi AT,

    I want to send this execution report to in email after the execution is in zip format. I found the code to send the email. But It always sends the email of the zip folder which has till previous run (not including the current run). And I found the reason the report is getting generated once all the testng @Test function is over but I am trying to send the result as part of execution.
    My question is, Is there a way to send the report currently generated ATU reports once my test script is over.

    ReplyDelete
    Replies
    1. Automation Tester24 April 2014 at 20:37

      Consider Apache ANT. This would help you.

      I would like to mention that email feature will be supported in next versions of ATU Reporter.

      #AT

      Delete
  47. Unknown29 April 2014 at 02:14

    Hello Automation Tester,

    Thanks for your efforts,the reports work pretty nice

    Is there any maven dependency for this project ?

    Regards

    ReplyDelete
  48. Unknown29 April 2014 at 03:01

    Also i have a question about the number of runs ? it is limited by a specific number ? for example i need to do one run for week ? is the solution will support my runs for 6 mounths ? !!

    ReplyDelete
    Replies
    1. Automation Tester29 April 2014 at 07:50

      Hi,

      There is no maven dependency.

      Till version 4.6, The reports can be generated for unlimited number of runs.

      #AT

      Delete
  49. Kiran K29 April 2014 at 20:14

    Hello Automation Tester,

    Thanks for your efforts,the reports work pretty nice, But i want implement this in Selenium Rc, Can you let me know is it possible?
    if yes, please let me know the steps.

    Thanks
    Kiran

    ReplyDelete
    Replies
    1. Automation Tester30 April 2014 at 18:53

      Hi,

      It is definitely possible with Rc as well.

      From a Selenium rc instance, get the driver object and set it. It will work pretty fine.

      This is how you can get it,

      WebDriver driver = ((WebDriverBackedSelenium) selenium).getWrappedDriver();

      #AT

      Delete
  50. Anonymous29 April 2014 at 20:15

    Hi AT,
    I want to execute 5 test cases at a time and all the results should be in one single report. I am wondering how to use ATU reporter for this. For a single test case run I am able to create report perfectly. Can you help me how can I execute more than 1 test cases at a time?

    ReplyDelete
    Replies
    1. Automation Tester30 April 2014 at 18:46

      Please refer to parallel execution feature of TestNG.

      This link is should help you get started
      http://automationtestingutilities.blogspot.in/2013/11/multi-browser-testing-using-selenium.html

      #AT

      Delete
  51. Automation Tester2 May 2014 at 20:10

    Hi,

    We will check it and let you know accordingly :)

    #AT

    ReplyDelete
  52. dadams.chi12 May 2014 at 07:14

    Is the source published anywhere?

    ReplyDelete
    Replies
    1. Automation Tester13 May 2014 at 21:15

      No. However, We will be moving all our projects to GitHub.

      #AT

      Delete
    2. Henry David Adams15 May 2014 at 05:59

      Do you know when that is happening? We are looking forward to contributing with a MySQL backend and a smaller composite view.

      Thanks.

      Delete
    3. Automation Tester18 May 2014 at 22:31

      It is going to take certain time. The time period is lengthy.

      #AT

      Delete
    4. dadams.chi7 July 2014 at 08:27

      Any update on this?

      Delete
  53. naresh13 May 2014 at 09:13

    Hi Automation Tester,
    I am facing below issue when i try to run using Remote Web Driver on Sauce Labs.
    It works fine with FireFox Driver but fails with remote one :
    driver = new RemoteWebDriver(new URL(fromConfig(WebDriverHelper.PK_SAUCE_LABS_URL)), capabilities);

    EXCEPTION
    Running TestSuite

    Results :

    Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 10:23.800s
    [INFO] Finished at: Tue May 13 16:24:43 BST 2014
    [INFO] Final Memory: 10M/218M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project frog-autotests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test failed: There was an error in the forked process
    [ERROR] java.lang.IllegalStateException: java.lang.NullPointerException
    [ERROR] at atu.testng.reports.listeners.ATUReportsListener.onFinish(Unknown Source)
    [ERROR] at org.testng.SuiteRunner.invokeListeners(SuiteRunner.java:202)
    [ERROR] at org.testng.SuiteRunner.run(SuiteRunner.java:257)
    [ERROR] at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    [ERROR] at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
    [ERROR] at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
    [ERROR] at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
    [ERROR] at org.testng.TestNG.run(TestNG.java:1057)
    [ERROR] at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:293)
    [ERROR] at org.apache.maven.surefire.testng.TestNGXmlTestSuite.execute(TestNGXmlTestSuite.java:84)
    [ERROR] at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:91)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
    [ERROR] Caused by: java.lang.NullPointerException
    [ERROR] at atu.testng.reports.writers.CurrentRunPageWriter.getTestCaseHTMLPath(Unknown Source)
    [ERROR] at atu.testng.reports.writers.CurrentRunPageWriter.writeFailedData(Unknown Source)
    [ERROR] at atu.testng.reports.writers.CurrentRunPageWriter.content(Unknown Source)
    [ERROR] at atu.testng.reports.listeners.ATUReportsListener.generateCurrentRunPage(Unknown Source)
    [ERROR] ... 14 more
    [ERROR] -> [Help 1]
    [ERROR]
    [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR]
    [ERROR] For more information about the errors and possible solutions, please read the following articles:
    [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException

    ReplyDelete
    Replies
    1. Automation Tester13 May 2014 at 21:32

      Hi,

      Can you send the reports folder - ping us @ our mail?

      #AT

      Delete
    2. Anonymous10 June 2014 at 21:25

      HI,
      I am also facing similar issue with RemoteWebDriver or AppiumDriver.
      Any solution for this would be greatly useful as we are dealing with mobile app automation using Appium which is an extension to webDriver.

      thanks.

      Delete
    3. Automation Tester11 June 2014 at 01:50

      If you could mail us the Exception stack with reports we would look into it.

      #AT

      Delete
    4. Automation Tester12 June 2014 at 21:44

      The issue is fixed in version 5.1.

      #AT

      Delete
  54. Karuna16 May 2014 at 04:36

    can you please send the details that how can i integreate this tool into my maven project, is there any doc ?

    ReplyDelete
    Replies
    1. Automation Tester18 May 2014 at 22:46

      Karuna,

      As of now, there are no maven dependencies for ATU Reporter. Please add the jar file in your build path.

      #AT

      Delete
    2. Karuna20 May 2014 at 06:32

      Thanks for your reply.

      In the current report, if the test case is failed, the status is showing in cross symbol, To know the failure reason/exception, we need to drill down on test case name.

      It good to show the Failure reason/exception in another column beside the status if the test case Failed.

      If we have 100 test cases, among them 50 are failed, to analyze the results or to know the Failure reason/exception we need to drill down on each test case name.

      Delete
    3. Automation Tester21 May 2014 at 11:59

      Your feedback will be taken into consideration. However this feature will be available from 5.x version onwards. Thank you.

      #AT

      Delete
  55. Unknown25 May 2014 at 05:07

    Hi,

    I downloaded the latest version 4.6 and used the properties file available in the zip. But when I try to run it getting below error

    ...
    ... TestNG 6.8.6 by Cédric Beust (cedric@beust.com)
    ...

    [TestNG] Running:
    D:\Selenium\TestNGPractise\TestNG.xml

    java.lang.IllegalStateException: java.lang.NullPointerException
    at atu.testng.reports.listeners.ATUReportsListener.onStart(Unknown Source)
    at org.testng.SuiteRunner.invokeListeners(SuiteRunner.java:197)
    at org.testng.SuiteRunner.run(SuiteRunner.java:238)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
    at org.testng.TestNG.run(TestNG.java:1057)
    at org.testng.remote.RemoteTestNG.run(RemoteTestNG.java:111)
    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:204)
    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:175)
    Caused by: java.lang.NullPointerException
    at atu.testng.reports.utils.Directory.init(Unknown Source)
    at atu.testng.reports.utils.Directory.verifyRequiredFiles(Unknown Source)
    ... 11 more

    ReplyDelete
    Replies
    1. Automation Tester26 May 2014 at 00:25

      please check the values that you are defining in the properties file !!

      #AT

      Delete
    2. Unknown27 May 2014 at 09:20

      I tried with the default ones. Not sure what I am missing

      atu.reports.dir=D:/ATU Reporter
      atu.proj.header.text=My Proj Reports
      atu.proj.description=MyProject Testing Reports
      atu.reports.takescreenshot=false
      atu.reports.configurationreports=false
      atu.reports.excel=false
      atu.reports.pdf=false

      Delete
    3. Unknown27 May 2014 at 09:37

      Hi,

      Today I tried with the version 5 and its working fine. Awesome work :-)

      Delete
    4. Automation Tester27 May 2014 at 21:19

      Fantastic!!

      #AT

      Delete
  56. Vishnu Agrawal27 May 2014 at 00:51

    Is there any property by Which I could rename Run1, Run2 to something more descriptive name ?

    ReplyDelete
    Replies
    1. Automation Tester27 May 2014 at 08:59

      You cannot change the run name. If there was an option available, then you need to give a different folder name each time before you run a test - which is a overhead.

      #AT

      Delete
    2. Unknown27 May 2014 at 09:17

      This comment has been removed by the author.

      Delete
  57. Unknown27 May 2014 at 09:45

    Hi,

    I am using latest version 5 and I am getting below error :

    Cannot find class in classpath: com.ATUReporterSampleTests
    at org.testng.xml.XmlClass.loadClass(XmlClass.java:81)
    at org.testng.xml.XmlClass.init(XmlClass.java:73)
    at org.testng.xml.XmlClass.(XmlClass.java:59)
    at org.testng.xml.TestNGContentHandler.startElement(TestNGContentHandler.java:543)
    at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:501)
    at com.sun.org.apache.xerces.internal.parsers.AbstractXMLDocumentParser.emptyElement(AbstractXMLDocumentParser.java:179)
    at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.emptyElement(XMLDTDValidator.java:788)
    at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanStartElement(XMLDocumentFragmentScannerImpl.java:1343)
    at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2756)
    at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:647)
    at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:511)
    at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:808)
    at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
    at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:119)
    at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
    at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)

    Thanks,
    Ritesh Chouhan

    ReplyDelete
  58. Unknown27 May 2014 at 22:06

    Thanks for the reply. I fixed the problem.

    Thanks,
    Ritesh

    ReplyDelete
  59. Unknown2 June 2014 at 06:13

    How to generate my Testcase number in report?

    We have 320 testcase run.Out of which we have 120 random testcase fail.
    Now I run only 120 failed testcase, how do I update my testcase using report whether its pass or fail?

    ReplyDelete
    Replies
    1. Automation Tester3 June 2014 at 09:24

      when you re-run these failed test cases, a new Run is created which contains detailed reports of the current set of testcases. Can you elaborate the purpose of test case number ?

      #AT

      Delete
  60. Unknown2 June 2014 at 23:46

    can you explain me How to configure the ATU version.5 in eclipse.
    am adding the jar file but i am not getting report.

    Thanks in advance.

    ReplyDelete
    Replies
    1. Automation Tester3 June 2014 at 09:17

      Hi,

      Please go through the posts - everything is described. you can also find a sample project in the download zip file, that should help you in getting started !!

      #AT

      Delete
  61. Aditya Sekhar9 June 2014 at 02:10

    Tried out version 5.0 . However the overloaded add method is not part of the jar .
    Please do check if its missing . I tried twice .

    ATUReports.add("INfo Step", LogAs.INFO, new CaptureScreen(ScreenshotOf.BROWSER_PAGE));

    ReplyDelete
    Replies
    1. Automation Tester9 June 2014 at 04:34

      Please check the javadocs.

      static void add(java.lang.String stepDescription, LogAs logAs, CaptureScreen captureScreenshot)

      #AT

      Delete
    2. Aditya Sekhar9 June 2014 at 05:15

      Hi ,
      Ya i saw that . However what i am saying is in the ATUReporter_Selenium_testNG_5.0.jar . this method is not included . I am getting error in Eclipse . All other properties are there but the method is not added . Please check you ATUReports.class methods once again

      Delete
    3. Aditya Sekhar9 June 2014 at 05:41

      Sorry my mistake . My Local maven repository was taking old atu version . :-)

      Delete
  62. Unknown10 June 2014 at 09:18

    Hi,

    I tried with multiple tags in my TestNG.xml then reporting is not as expected. Is there any support for it? On giving n number of it creates n number of runs.

    ReplyDelete
    Replies
    1. Automation Tester11 June 2014 at 01:33

      Can you elaborate on "multiple tags" and "On giving n number of it creates n number of runs" ?

      #AT

      Delete
    2. Unknown13 June 2014 at 04:06

      I used the below xml













      And reporting engine created Run_1 and Run_2 folders under Results. Run_1 folder was empty when we reached "Test1" folder. Also in the consolidated report when we click on Run_1 it takes to the error page

      Delete
    3. Automation Tester13 June 2014 at 04:18

      Please make sure that you have declared the listeners only once - either in testng.xml or java file but not both. If it is declared in multiple java files, you run into this issues.

      #AT

      Delete
    4. Unknown13 June 2014 at 12:54

      I declared it only in Java file. Does this utility also support parallel execution. If I run testng xml files parallel, will it create suite level reporting?

      Delete
    5. Automation Tester13 June 2014 at 22:08

      Hello Shobhit,

      Parallel execution is supported - The issue is seen when you try to run multiple suite files.

      Log the issue in the below page.

      https://docs.google.com/spreadsheet/ccc?key=0ArrZvkq9tkwPdEpfa0tFN0RIQ0ZyXy1mSGZPdzl4MVE&usp=drive_web#gid=2

      #AT

      Delete
    6. Unknown13 June 2014 at 23:24

      Even with the serial execution I am getting this issue. The testNG.xml file had two "TEST" tags. Can you try simply running a single test suite having multiple tags. I will furnish the details in issue logger.

      Delete
    7. Automation Tester14 June 2014 at 00:42

      Hello Shobhit,

      Could you mail the xml file along with the reports?

      #AT

      Delete
    8. Unknown14 June 2014 at 11:48

      Sure I will do it.
      Your quick replies are highly appreciated :-)

      Delete
  63. Anonymous10 June 2014 at 16:17

    Hi ATU,

    when I try to write a custom message with the following command on the latest version

    ATUReports.add("failed step message", LogAs.FAILED, null);

    I am getting the error. Here is the stack trace.
    [ATU Custom Reporter Step Failed Exception]
    at atu.testng.reports.ATUReports.stepFailureHandler(Unknown Source)
    at atu.testng.reports.ATUReports.add(Unknown Source)
    at AppName_Test.AppName_Story_Test.firstTest(AppName_Story_Test.java:21)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
    at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
    at org.testng.TestRunner.privateRun(TestRunner.java:767)
    at org.testng.TestRunner.run(TestRunner.java:617)
    at org.testng.SuiteRunner.runTest(SuiteRunner.java:334)
    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:329)
    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:291)
    at org.testng.SuiteRunner.run(SuiteRunner.java:240)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
    at org.testng.TestNG.run(TestNG.java:1057)
    at org.testng.remote.RemoteTestNG.run(RemoteTestNG.java:111)
    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:204)
    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:175)

    ReplyDelete
    Replies
    1. Anonymous10 June 2014 at 21:09

      Hi ATU,

      Actually the error for me is that, my program is not reading settings from atu.properties file. hence the
      atu.reports.continueExecutionAfterStepFailed = true
      does not take effect and test case failed.

      I am using Mac and dont know if the
      System.setProperty("atu.reporter.config",
      "/Users/abc/Workspace/src/properties/atu.properties");
      is being executed correctly. The program does not throw any error.

      Appreciate your reply.

      thanks

      Delete
    2. Automation Tester11 June 2014 at 01:54

      if you are not sure with the path, then you could try with System.getproperty("user.dir") , this will return you current working directory. Do not place the properties file under src folder , its not advisable.


      modify your code to ..

      System.setProperty("atu.reporter.config",
      System.getproperty("user.dir")+"/src/properties/atu.properties");

      #AT

      Delete
    3. Anonymous11 June 2014 at 17:17

      HI ATU,
      Thanks for the reply.

      The error at my side was that, I had the System.setProperty command in my base class and was thinking that it is at suite level.

      Once I moved the code into test class then its working.

      How do we set the atu properties at global suite level?

      thanks,

      Delete
    4. Automation Tester12 June 2014 at 04:40

      Set the property in a static block. That will be sufficient.

      #AT

      Delete
  64. Aditya Sekhar24 June 2014 at 07:35

    Hi ,
    Any update regarding showing steps for skipped tests too. So that its easier to debug. Right now its not showing any message

    ReplyDelete
  65. Automation Tester24 June 2014 at 22:14

    Hello Aditya,

    what is the purpose behind throwing a SkipException in your testcase ? I suppose you also want to have steps to be shown in the report - why do you want to have this ?

    #AT

    ReplyDelete
  66. Anonymous2 July 2014 at 23:20

    java.io.FileNotFoundException: D:\ATU Reports\Results\Run_8\Test\com\Demo_Iteration1\Demo.html (The system cannot find the path specified)
    at java.io.FileOutputStream.open(Native Method)
    at java.io.FileOutputStream.(FileOutputStream.java:194)
    at java.io.FileOutputStream.(FileOutputStream.java:84)
    at java.io.PrintWriter.(PrintWriter.java:146)
    at atu.testng.reports.listeners.ATUReportsListener.startReportingForPassed(Unknown Source)
    at atu.testng.reports.listeners.ATUReportsListener.onFinish(Unknown Source)
    at org.testng.SuiteRunner.invokeListeners(SuiteRunner.java:200)
    at org.testng.SuiteRunner.run(SuiteRunner.java:243)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
    at org.testng.TestNG.run(TestNG.java:1057)
    at org.testng.remote.RemoteTestNG.run(RemoteTestNG.java:111)
    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:204)
    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:175)

    ReplyDelete
  67. Andrei11 July 2014 at 08:57

    Hello,

    I use TestNG as a framework.
    I want to take screenshots when a test case fails. Is it possible in ATUReports?

    Thank you

    ReplyDelete
    Replies
    1. Automation Tester13 July 2014 at 21:39

      Yes It is definitely possible Andrei.

      #AT

      Delete
    2. Andrei14 July 2014 at 01:16

      How can i activate this feature?
      Default there is shown only the error message, stack trace... but no picture.

      Delete
    3. Automation Tester30 July 2014 at 10:40

      ATUReports.add("INfo Step", LogAs.INFO, new CaptureScreen(
      ScreenshotOf.BROWSER_PAGE));

      This will capture the browser page screenshot, also make sure that the property takescreenshot is set to true in properties file.

      #AT

      Delete
  68. Unknown16 July 2014 at 20:34

    Hi,

    I met below issue when running testng suite on a mac, could you help me with that? thanks.

    java.lang.IllegalStateException: [ATU Custom Reporter Exception] Settings File Not Available
    at atu.testng.reports.listeners.ATUReportsListener.onStart(Unknown Source)
    at org.testng.SuiteRunner.invokeListeners(SuiteRunner.java:197)
    at org.testng.SuiteRunner.run(SuiteRunner.java:238)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
    at org.testng.TestNG.run(TestNG.java:1057)
    at org.testng.remote.RemoteTestNG.run(RemoteTestNG.java:111)
    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:204)
    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:175)
    at org.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:125)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
    Caused by: [ATU Custom Reporter Exception] Settings File Not Available
    at atu.testng.reports.utils.SettingsFile.open(Unknown Source)
    at atu.testng.reports.utils.SettingsFile.get(Unknown Source)
    at atu.testng.reports.utils.SettingsFile.correctErrors(Unknown Source)
    ... 17 more

    ReplyDelete
    Replies
    1. Unknown17 July 2014 at 18:33

      actually I know why the issue happens, one properties file under folder result got deleted.
      thanks anyway

      Delete
  69. Unknown16 July 2014 at 22:28

    Hi
    Is this open source? where can i get source code? I met some issue i want to see source code if it's possible. thanks

    ReplyDelete
  70. Unknown25 July 2014 at 07:59

    Hi i have added the ATU jars (configure build path->Add jars) but when i try to run the maven install command , facing errors due to ATU listeners.
    whether i am missing out something
    screen shot:
    http://tinypic.com/r/dyn3a0/8

    ReplyDelete
    Replies
    1. Automation Tester30 July 2014 at 10:14

      ATU Reporter does not have a Maven based library hence please install the library manually into your local repository using "mvn istall" command.

      #AT

      Delete
    2. Unknown1 August 2014 at 07:31

      Thanks for the reply.. i am new to Maven.. could you pls give the steps for installing Atu library or any link where i can refer it to..

      Delete
    3. Unknown1 August 2014 at 07:55

      http://maven.apache.org/guides/mini/guide-3rd-party-jars-local.html i got this link and command "mvn install:install-file -Dfile=" how to use this ..

      Delete
    4. Automation Tester6 August 2014 at 23:46

      Please go through the Maven documentation to explore more about the commands.

      #AT

      Delete
  71. ASJ9 August 2014 at 04:17

    Hi AT

    Above report generation is awsome could it be possible to take screenshot only in case of TC failing ?

    Aman

    ReplyDelete

Subscribe to: Posts (Atom)