Jan 2013 Features in QAMonitor

Year 2013 is remarkable for QAMonitor as we now have a very good set of happy customers. Some of the features that are available in our latest cloud/enterprise versions are given below.

- In Setting, Baseline / Current Draft version in Requirement & TestCase modules.

> A version can be marked as Current Draft version. Later it can be marked as Base-lined version.

> While editing requirement/testcase, Update the version to current Draft.

- In Requirement, order/Move the Requirement and Folder. This will help to arrange the same in the way you want

- In TestPlan, TestCase Copy-Paste into other module/scenario with-in project.

 

- In TestPlan, order/Move the TestCase & Scenario. This will help to arrange the same in the way you want

 

- In TestPlan, "Root" was added in Scenario tree. This avoids confusion on ambiguous parents.

- In TestPlan, copy Requirement Folder structure to TestPlan Scenario. When a parent folder is selected, the entire sub-tree will be copied as such into Scenario.

 

- In TestRun, Copy TestCase from one Round To another. This saves time for test leads

- In TestRun, Attachment option is included for each step, while logging Manual Execution, in Test Run. And shown in History & LastRun windows.

 

- In TestRun, Manual TestRun step's status, actual result and attachments are saved as draft, for respective logged-in user. At a later time you can come and save the results and finish the run.

- In Issues, UDF (User Defined Fields) columns are editable in Issues Quick add/edit.

 

- In Issues, Copy/Paste in defects added UDF also.

 

- In Issues, Mutli-Select combo added in Issues inline add/edit.

 

- In Issues, Mandatory columns checked in Inline add/edit.

 

- In Issues, Copy/paste a single Issue in same project.

 

- In Reports, you can Send Reports as mail to selected users.

 

- In Charts, send Standard Charts & Custom Charts as mail to selected users.

 

- In Settings, Project deactivation. Projects will not be listed in any combo-boxes.

 

- In Settings, Page titles taken from SDF page. Select "Configuration" in group's dropdown to change page title.

 

- In Settings, Multi-selection combobox option added in UDF.

 

- In Settings, added the UDF fields in the Test case grid

 

- In Settings, IssueCycle's cycle-start & cycle-end status are changed to update-able.

 

- In Settings, Copy UDFs to another project feature is added..

 

- Kanban cards module introduced in QAMonitor. This is excellent way to track simple tasks

- All pages, Word wrap for all the grid cells. This provide better readability for long texts

- All pages, Quick search on Id, Name or Description in Tasks, Issues, Requirements and Test Plan.

 

- Dynamic reports are added. You can make your own reports based on SQL queries.

 

- Project admin can now modify all project settings. This eases out the load on eadmin.

 

For more details, please visit www.qamonitor.net.

The inseparable Excel from any bug tracking tool

I had seen many tools and met many test managers and leads; whenever they want to present some report to their management, they need Excel sheets. Tools provide many charts and reports, but end of day, they have specific format for their needs.

The easy way to help them is to provide an export option from tools to Excel.Simple clicks, and test manager can get the relevant data and do whatever he/she wants. Look at this sample from QAMonitor tool.

Usually there will be grids to show the defect details; from there,the manager or lead can do filtering and then export. This is one of their top most requirements.

Also, many test leads and managers are not happy with open source tools. They want to move out to a better test management system. But how to move the data from the existing ones to the new system? QAMonitor provides a simple solution.

Import from an excel sheet. Before doing this, export the data to csv files, either from the tool or from the database the older tool uses. Once this is done, you are just minutes away from using QAMonitor.



Do an import. Import engine will ask you to point the file and it will take you thru steps to map the columns in your excel file to the fields that QAMonitor needs for bug tracking. Very simple with virtually no learning curve required, you can import the defect details and get started in minutes.





This way, QAMonitor helps any test manager or lead to get started in minutes, whether you start new or migrate from another tool. QAMonitor helps you to feel comfortable in presenting the results, the way you want.

What you get and not get in open source tools - Top 5 items

Open source movement is amazing. Linux, FireFox, MySQL, Open Office etc etc. They had really changed the way people started looking at software. They save around $5-8bn every year for customers, cumulatively. There are always doubts and anti-campaign on open source software. Here we try to give the top 5 items that you do get and that you do not get in open source. Take it or drop it.

You get this. 1. Many to most of open source software are free. Open source need not always be free, beware. So you do not have to worry about licensing, budgeting etc. You get it fee, the biggest saving!

You do not get this. 1. Usually the upgrades are not that quick. Except products like FireFox or OpenOffice, you do get stable releases very late. Their nightly builds need not be stable. So you may start feeling "Will I get this feature or not?".

You get this. 2. A community support. You can see content to help in blogs, forums. A mindset of not being alone.

You do not get this. 2. 90-95% of open source products do not have phone or live support. You need to be prepared to wait, before you get a solution, if you face problems.

You get this. 3. You get source code. How it is built - you can see it inside out.

You do not get this. 3. You do not get the supporting specs, design documents, test cases for that in most of the cases. What can you and I do with the source code Linux or MySQL? At least I do not even need the source code; I do not know about you.

You get this. 4. You may get many islands of tools. For anything, you get a tool. For bug tracking - you get one tool, for task tracking you get one tool. You name it, you get it.

You do not get this 4. You will not get integrated ones. They come with some catch. If you want an integrated task, test and bug tracking system, like QAMonitor, you may not get it.

You get this. 5. A complete stack to build an end to end application. A UI platform, an operating system, a backend programming language, a web server, a database, a report engine, and IDE etc. But each one may be provided by different communities.

You do not get this 5. Time tested products. There are products that you can name like FireFox, Linux etc. At the same time, many open source products are dead within a decade; those development communities vanished. End of the day, everyone wants to make money. If an open source product does not make money, it is going to be obsolete. They must either get donations or they must come up with paid support or premium versions etc. to make money. It is not a charity.

Before you evaluate a test management tool, please read this.

Testing requires a lot of coordination between business analysts team, development team and the testing team. When the product is live, testing team needs to coordinate with implementation and support team as well. Teams with size more than 5 members, cannot be so easily managed with spreadsheets and emails alone. There needs to be a centralized system that can control various activities in testing and fixing. There are many test management tools in the market. This section will touch the important features that one must look for, in a test management tool.

Manage Requirements

Testing, in short, is to ensure whether the product does what the customer wants. The starting point is what the customer wants and this is nothing but the set of requirements given by the customer. The first feature of every test management tool is to manage requirements as well. Without managing requirements, we cannot ensure what the customer wants and what we deliver. The tool must provide features to enter requirements, its short description and long description, type of requirements such as functional, performance, UI, legal etc. The tool must ensure that the proper version details of the requirements are maintained. The user must be in a position to attach any documents with a requirements. More importantly the requirements have to be managed in a hierarchical fashion - i.e. the parent requirement child requirement relationship must be maintained. It will be great if the tool provides some sort of tracking mechanism whether the requirement is reviewed or not. Also, if there are multiple products among which the requirements are shared, we must be in a position to tie requriements to one or more products.

Requirements and their variations may change from release to release. Hence the tool needs to provide a way to map a release with one or more requirements. Whenever a requirement is modified, there must be a history of what got changed and who modified at what time. This is essential from the compliance point of view. Many tools provide a mechanism to associate a priority with requirement for satisfying the same in subsequent releases.

Since many companies are already used to maintaining the requirements in documents and spreadsheets, it will be of great use, if the tool provides an import feature to directly import the requirements from a document or spreadsheet to the tool's repositiory. People feel comfortable in free hand typing rather than data entry in an application. This can greatly help users to accumulate past requirements in the projects. One requirement may be dependent on another requirement or a set of requirements. Some tools provide a mapping of dependencies between requirements.

Manage Test Scenarios and Cases

For every requirement, we may arrive at one or more test cases and scenarios. Using the tool, the testers will start documenting what to be tested and how to test the same. So the test case description, pre conditions, test steps, expected results, any data attachments to the test case, test case type such as smoke test, performance test, install test etc. are to be stroed in the tool. Here again, an import facility from a spreadsheet or document to the tool is greatly desired. This can minimize a whole lot of data entry time.

The test cases must also be managed hierarchically. The history of any modifications done to the test cases and scenarios must be stored automatically. The very important feature is to tie the requirements to the associated test cases. This is required to ensure traceability. This in turn ensures the functional coverage of the product. This also helps in doing an impact analysis in case of a change in requirements.

Manage Test Executions

The test execution happens in terms of test rounds. Some companies call this as test iteration or test cycle or test set. By principle, every roud must execute all available test cases. But practically, based on the changes made in the product, a specific set of test cases are planned and executed for any given test round. The tool must provide a feature to define a test round with its effective start and end dates and a facility to map what test cases will be part of that round. Also for tracking purpose, for each test case we must assocaite a tester who is supposed to execute the same.

Once the test cases are allocated to testers, the testers must execute the same and provide the status in the tool. When the test was started, when it ended, the status of pass or fail for each test step must be provided in the tool. This will clearly show the work in progress and the test manager will come to know where the project stands in testing. If a tester executes the same test multiple times, the status of each run must be stored as history.

Defect Tracking

The resultant effect of testing is the list of defects found on the product. We have already seen elaborately on problem reporting and tracking. The use of the tool should make bug tracking simple, easy and efficient. The system must provide data entry screen for bugs and its associated attachments such as screenshots. The tester must be able to do search of bugs to see if it has been already duplicated. The bug cycle across various status codes must be a configurable one. The bug tracking system must trigger automatic notifications between testing team and development team to ensure that the people are aware of the status of every single bug. Also the bugs must be mapped to test cases and test rounds so that we can do further analysis.

Data Analytics

The test management tool's efficiency comes out in its reporting and charting features. The stakeholders in the project require various reports from the system. It may be a document like vertical report or a spreadsheet like tabular report. The reporting engine of the tool must provide a variety of read-made reports and configurable reprots. For every report, the user must be able to use filters and sorting order. Also, the user must be in a position to choose a field to be or not to be displayed in report. This kind of a reporting feature is an essential one for any enterprise wide application.

Examples:

• List of bugs reported today
• Summary of bugs based on status
• List of tests executed in this week with status
• List of requirements not mapped to test cases

Also, in reports, we require simple reports that are a list of data presented to the user. Also we require trend reports. Trend reports provide a clue on how things changed over a period of time. For example, how many tests executed day-wise in the last 5 weeks or how many bugs were kept open in the last 10 days. Any report that provides data for a time period to show progress, is a good piece of information for the management.

More than the textual reports, the tool must provide a pictorial view of the data. These are charts. The tool must provide at least bar charts and pie charts with possibly 2D and 3D modes. These will be based on the data fed to the system by various users. If we plot all defects based on status, we can see a set of bars and we can easily find which bar is tall and take corrective actions. A graph hits the eyes better than text. A set of charts grouped together is called a dashboard. If the user can see a variety of graphs on a single panel, then it can help the user to quickly compare and contrast each parameter. This kind of analytics help management to take actions based on the statistics.

Also the tool must provide a feature to plot one parameter over another parameter. For example, we must be able to generate a graph that groups items based on defect severity; within each group we want further grouping based on status of the bugs.

Administration Features

Since the test management tool is usually an enterprise wide application, there must be clear boundaries within the tool to create various projects and group projects under various business units. For each project we must allocate users. These users must be further associated with their roles such as developer, tester, manager, business analyst etc. The purpose of any enterprise wide application is to bring consistency in usage, control in usage, visibility of information and to facilitate data analysis. Since the templates in the tool is used by all users, the consistency is established. The tool is used by all users in the organization that provides visibility to the management on what happens at this moment, within a few clicks.

The tool must provide access rights to various forms and fields to various user roles. This way, we can set that these users can enter the form, these users can modify this field, these users cannot see this form etc. This ensures that the users cannot misuse the tool and the built-in security of the tool must take care of this control mechanism.

Also, in many projects we may require additional data to be captured that are not provided by the tool in its templates. We must be able to add new fields on the fly to desired projects in desired screens only. This will make the tool more configurable and adaptable to any client and any project.

The tool must have provisions to send automatic email notifications upon certain fixed events and configurable events. For example, we must have a feature to automatically send email if a show stopper bug is raised. This will reduce the time latency in project coordination.

If you need a tool, that solves the above items, try QAMonitor.

Visit http://www.freeqamonitor.com.

A Test Manager's Wish List - Top 5 Items

When we talk to a test manager, first he/she complains; after some point, their wish list starts coming out. The test manager wants something that is not there now, but can be implemented across teams; yet the test manager feels that it may not happen in near future. Looks like never-ending chase!

1. One single system for all my test assets. But branded tools are costly; my management rules those out when I give a quote. They do not understand my problem of dealing with so many spreadsheets and emails!

What is the real problem here? It takes time to get even the simplest metrics. Also it always gives doubt whether the data in the spreadsheets are 100% correct or not. The recurring pain of manually reviewing the same and making charts out of it, drains my energy at EOD; oh,,I have a con-call tonight to attend and present these metrics once again!

2. Status of test execution and bug fixes must be fully visible to all. Every day I need to collate all status reports, (btw, I have become a super user of copy-paste technique!). So many status mails and sugar-coated wordings by my test leads to protect their team members, sluggish fix updates by developers...I feel I do not have full control on the testing status. If I have a system that tells me, what tests are executed till the last minute, I will be the happiest person in this world.

3. Ready charts and reports with just 1 click. I know my boss appreciates one specific report and chart; if that reaches his/her inbox every night, I am assured of a great appraisal. The test management system that I have does not have that report; hence I export data, massage it and make the report and chart. I am good type-setter as well.

4. Automatic Alerts when something goes very bad. I do too many things. I cannot keep track of everything. But my blackberry or mobile alerts me when a new alert email comes. If build is not deployed or a show stopper happens or 2 testers do not update execution status for last 2 hours, I must be notified. Can someone do that for me?

5. Traceability of tests and requirements. Holy grail of testing. I must know coverage at any given point of time. People write 1000 test cases, but my business team says the test coverage is poor. Again I need some magic medicine.

There is a clear solution for this. Softsmith heard these lines so often from so many people and developed QAMonitor. This tool is aimed at satisfying these top 5 wish list items for FREE to micro organizations with less than 25 employees and at a throw away price to small and medium enterprises.

Please visit http://www.freeqamonitor.com.

Simple steps to improve testing process

Every time, we meet customers, we do hear that every stakeholder in the project conveys the message "there are gaps in our process", "we do not follow processes seriously", etc. etc. What surprises me is that, their senior management listens to that with a smile! If there is a process problem in crediting their salary, will they tell the same reason?

Here are some simple steps to improve testing process, if you feel that you are not happy with your current process.

1. Foremost complaint is "We do not get proper requirements specs from any teams!". In this case, let the testers go one extra mile. Someone has to bell the cat. Let the testing team simply write use cases or features list after dev team gives demo or build; let the testing team ask for green signal on the piece of specs that they wrote. Put the blame on the business analyst and project manager. Someone will review and get back to you. Take it from me. If you do this a few times, you can see a positive attitude change in your dev team. As a good side effect, a few of your testers can easily grow as business analyst.

2. If your testing team members do assume a lot on specs and write bad tests or write unwanted tests, do this. For every change request or build release instructions, ask every tester to come up with just 1 clarification needed. Reward a good one. This will motivate the team. If testers stop asking clarifications, there is something wrong, for sure. Give a target, every requirement or CR must have at least 1 clarification needed.

3. Testers do not write test cases. They try only adhoc tests. If this is your problem, try this medicine. Ask every tester to first write "what to test" - kind of test conditions or test scenarios. For 1 week or 2 weeks, do not ask them to write test cases. Make them to write only test conditions. This must not take much time. You review the same and point out where they make mistakes. This will give a jump start for testers who do not write test documentation. Once they get to the normalcy of writing test conditions, load them with test cases as well.

4. Bug reports do not have proper information. If this is the problem, here is a simple solution. Ask every tester to talk about the bugs they found, the next day and not on the same day. They might have forgotten many details about the bug; then you ask logical questions and make them understand what they miss in bug reports. They will realize and change.

5. Because of so many problems, test leads do not present proper status. In this case, spreadsheets and emails will not solve the problem. Use a test management tool. Some of the tools are HP's Quality Center, Rational IBM Test Manager or Softsmith's QAMonitor.

Imagine, you send good status to your management with charts like this?

For more information on this tool, QAMonitor, please visit www.freeqamonitor.com.

QAMonitor - Oct 2011 Upgraded Features

We are happy to communicate that QAMonitor has now more features. All these features are requested by various users from various companies. Thanks to all of them who provide value adding feedback to us.

1. Issues can now be saved as draft. Later, a senior member may review the defect and approve. Till then it is not counted as part of regular defects for the dev team.
2. You can choose to generate requirement id by yourself in manual entry mode or you can set that to auto-generate id mode.
3. You can choose to generate test case id by yourself in manual entry mode or you can set that to auto-generate id mode.
4. All new icons in many pages. These enhance the look and feel of the product.
5. Mail settings has now 2 options. You can use your company's SMTP server or Amazon AWS SES mail settings.
6. Login panel will appear if session times out
7. Forgot password screen will have captcha feature enabled.
8. Users can be removed from project if the user has not done any transactions in the project and nothing is assigned to the user
9. Groups can be removed from project if the group has no users assigned to it
10. About 20 bug fixes to enhance usability