Friday 27 December 2013

ATU Reporter Part 1

what details can we get from this Reports ?


For each execution of a TestNG script the following things are generated in the form of HTML pages

* An Index page -  A Start Page, you can set any Description in this page

A Consolidated Report Page - Displays all the Runs in the form of Line and Bar Charts

A Current Run Report Page - For each run, The Current Run page shows the number of Test cases executed in a tabular format along with the Iteration details, a Summary section and a Pie Chart

A Test Case Report Page - This Page gives the information about a Test Case with detailed steps in a tabular format along with the screenshot, a Summary section, Execution Platform details, Author Details and provides information about Failure / Skipped / Parameters

For generating this Graphs we have used JQuery, CSS, HTML and jqPlot charting library.


* An Index page




A Consolidated Report Page



A Current Run Report Page


A Test Case Report Page



Go To: ATU Reporter Part 2  - Contains Details regarding The usage along with Examples

39 comments:

  1. How to show verification values on the scripts like expected and actual if fails??

    ReplyDelete
  2. In the Consolidated Report Page, the line report and bar reports are messed up with testcases which are in y-axis , if we have more than 30 test cases executed in single run.

    ReplyDelete
  3. no option to mark a particular step pass/fail

    ReplyDelete
    Replies
    1. As mentioned in the ATU Reporter Part 3 post. This feature will be supported from version 5.x onwards.

      #AT

      Delete
  4. for 1 set of data, 5 Run links getting displayed in the left menu. upon clicking on links 1-4 getting page not found error message .. only one link Run5 opens up run details

    ReplyDelete
    Replies
    1. As described in the blog - declare the listeners only once.

      Perhaps you might want to check your script to see if the listeners are annotated in more than one class.

      #AT

      Delete
  5. Try to put java file in the package otherwise it will not create "Test Case Report Page"

    ReplyDelete
    Replies
    1. Srikanth,

      your finding is valid !!

      please log it in the below page.

      https://docs.google.com/spreadsheet/ccc?key=0ArrZvkq9tkwPdEpfa0tFN0RIQ0ZyXy1mSGZPdzl4MVE&usp=drive_web#gid=2

      #AT

      Delete
  6. i have used this reporting which are running perfectly,, problem is that am running 150+ test cases,, the section of line chart and bar chart will not show graph properly

    ReplyDelete
    Replies
    1. i mean y-axis,, all the test case number from 1-150 will be overlapped

      Delete
    2. Hi Rakesh,

      Thank you for the feedback. Log the issue in the below page so that we can keep track of open issues.

      https://docs.google.com/spreadsheet/ccc?key=0ArrZvkq9tkwPdEpfa0tFN0RIQ0ZyXy1mSGZPdzl4MVE&usp=drive_web#gid=2

      #AT

      Delete
    3. i am facing the same problem

      Delete
    4. This issue is fixed in 5.5 version. We will upload the latest version once the development work is done.

      #AT

      Delete
  7. Hi ATU,

    I am using 5.1.1 version of ATU reporter, for me screenshot is not working in this condition ATUReports.add("Fail step", LogAs.FAILED, new CaptureScreen(
    CaptureScreen.ScreenshotOf.BROWSER_PAGE));
    but working fine for this step
    ATUReports.add("Fail step", LogAs.FAILED, new CaptureScreen(
    CaptureScreen.ScreenshotOf.DESKTOP));

    problem is BROWSER_PAGE is not working to take screenshot

    ReplyDelete
    Replies
    1. Hi ATU,

      Any updates on this.

      Delete
    2. It is working fine after proper configuration.

      Delete
  8. Sorry, it is working after proper configuration setup.

    ReplyDelete
    Replies
    1. What kind of configuration changes you made to fix this? Please help on it.

      Delete
  9. Hi,
    I am running my test from jenkins through Sauce labs in remote machine. ATU reports are getting generated properly.
    But Test case report page displays Execution platform details as the details of Jenkins server, Not actual sauce remote machine details.
    Is there any configuration i need to do?

    ReplyDelete
  10. Hi,

    How to configure these reports in my project , can you please help me on this.
    I need to get these reports in my project so i have added the jar files in my class path.
    ATUReporter_Selenium_testNG_5.5_BETA and ATUTestRecorder_2.1 2 jars i have added.there one property file i have not added were to add that property file.
    can you please help me on this.

    ReplyDelete
  11. This comment has been removed by the author.

    ReplyDelete
  12. I need only one RUN in report for one execution. no need of displaying previous runs in the report. what I need to do? single run is enough for me.what to do?

    ReplyDelete
  13. But not showing the total test cases in the current Run and if all test cases are passed still showing 0tc(For Failed) and 0tc(For Skipped),which is making confusing the clients/management (who see this report for the first time.)

    Really we dont require previous reports.So, Please make the Current Run Very Much Informative like how many cases executed in the current run.

    This ATU Reports,In which the bar graph showing for the Test Present and Past 10 Runs Reports....it is awesome. Please fix this soon and the Consolidated Reports text overlapping in the Eclipse Browser...

    ReplyDelete
    Replies
    1. Please provide some sample code to generate the reports, and also for excel generate reports, how mention the code to keep true.

      Please really it is very confusing so put sample code for the declaration of Project Description and Project Logo...... tried as mentioned in one of the ATU article but throwing errors.

      #change results directory
      atu.reports.dir=D:/ATU Reporter

      #change header text
      atu.proj.header.text=My Proj Reports

      #add project/client logo, the image is copied to "HTML_Design_Files/IMG" directory
      atu.proj.header.logo=D:/google.png


      #specify your project description
      atu.proj.description=MyProject Testing Reports

      Delete
  14. Hi There,
    I need the report to be shown for each test case like screenshot 5.How could i do that? and these days i am not getting the screenshots for failed testcases..


    Please help me ...

    ReplyDelete
  15. Hi, can you please add your jar files to a central maven repo and provide the dependency script in this page? This will be really useful.

    ReplyDelete
  16. Will it support for JUnit based framework???

    ReplyDelete
  17. report folder is not created in specified path. how to check that

    ReplyDelete
  18. report folder is not created in specified path. how to check that

    ReplyDelete
  19. Hi, I need a sample steps, How to use this reports in your Testcase

    ReplyDelete
  20. How to set the report directory dynamically. I want to save the report in the project folder

    ReplyDelete
  21. I could not capture screen in ATU reporter

    ATUReports.add("Step 1","Nothing", "Before test run", "Before test have to be run",LogAs.FAILED, new CaptureScreen(ScreenshotOf.DESKTOP));
    ATUReports.setAuthorInfo("Sourabh Chakroborty", new SimpleDateFormat("MM_dd_y_hhmmssa").format(new Date()), "1.0");

    ReplyDelete
  22. i am getting NULL pointer exception on below line:
    System.setProperty("atu.reporter.config", System.getProperty("user.dir")+"\\src\\atureporter.properties");

    ReplyDelete
  23. Please let me know whether we can configure ATU UI Reporting tool in Mac; because when I tried to execute the code in Mac, I could see below error message:

    [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test) on project Framework: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test failed: There was an error in the forked process
    [ERROR] java.lang.IllegalStateException: [ATU Custom Reporter Exception] The Path for the Custom Properties file could not be found
    [ERROR] at atu.testng.reports.listeners.ATUReportsListener.onStart(Unknown Source)
    [ERROR] at org.testng.SuiteRunner.invokeListeners(SuiteRunner.java:199)
    [ERROR] at org.testng.SuiteRunner.run(SuiteRunner.java:252)
    [ERROR] at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    [ERROR] at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
    [ERROR] at org.testng.TestNG.runSuitesSequentially(TestNG.java:1224)
    [ERROR] at org.testng.TestNG.runSuitesLocally(TestNG.java:1149)
    [ERROR] at org.testng.TestNG.run(TestNG.java:1057)
    [ERROR] at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:295)
    [ERROR] at org.apache.maven.surefire.testng.TestNGXmlTestSuite.execute(TestNGXmlTestSuite.java:84)
    [ERROR] at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:90)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
    [ERROR] Caused by: [ATU Custom Reporter Exception] The Path for the Custom Properties file could not be found
    [ERROR] at atu.testng.reports.utils.Directory.init(Unknown Source)
    [ERROR] at atu.testng.reports.utils.Directory.verifyRequiredFiles(Unknown Source)
    [ERROR] ... 14 more
    [ERROR]
    [ERROR] -> [Help 1]
    [ERROR]
    [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR]
    [ERROR] For more information about the errors and possible solutions, please read the following articles:

    ReplyDelete
  24. I appreciate your efforts because it conveys the message of what you are trying to say. It's a great skill to make even the person who doesn't know about the subject could able to understand the subject . Your blogs are understandable and also elaborately described. I hope to read more and more interesting articles from your blog. All the best.
    microsoft azure training in bangalore
    rpa training in bangalore
    rpa training in pune
    best rpa training in bangalore

    ReplyDelete
  25. Hi, Great.. Tutorial is just awesome..It is really helpful for a newbie like me.. I am a regular follower of your blog. Really very informative post you shared here. Kindly keep blogging.
    Best Devops Training in pune
    Devops Training in Bangalore
    Power bi training in Chennai

    ReplyDelete
  26. Looking for JOB in core industry? We're offering additional discount on early enrollment on full module Automation Training. Certificate will be given to those who completed their training and also get 100% Job assistance(Life Time).Call 9953489987, 9711287737.

    ReplyDelete