Ben Weese

5 QA Gifs

When you get a new build filled with bugs

When you get to test a new feature

The bug we both live for and yet never want to see

When unable to reproduce a crash so you try everything

Finally are able to reproduce a bug you have been working on for a while

What is DevOps?

DevOps is a software development method that emphasizes communication, collaboration (information sharing and web service usage), integration, automation, and measurement of cooperation between software developers and other IT professionals. The method acknowledges the interdependence of software development, quality assurance, and IT operations, and aims to help an organization rapidly produce software products and services and to improve operations performance.

DevOps Visual Model – While development methodologies, such as agile software development, encourage cross-functional collaboration between the analysis, design, development, and QA functions, in traditional, functionally separated organizations there is rarely cross-departmental integration of these functions with IT operations. As illustrated in this visual model, DevOps promotes a set of processes and methods for thinking about communication and collaboration between development, QA, and IT operations

http://theagileadmin.com/what-is-devops/



Analytics

So what are Analytics and how can they help you QA. Well Analytics are “information resulting from the systematic analysis of data or statistics.” according to Google. I use analytics when I am performance testing. At first I use to use a stop watch and would have to record the data on the slowness and record what my network link conditioner was set to test how slow and fast something should act. We then added anayltics and now all I do is load and save and the times are recorded by the software saving me days of work.

You can use anayltics for all kinds of things. You can record times like i did in order to see the performance of your software. then in slow parts you can run a time profiler if you are using xcode. What a time profiler does is it will tell you all the calls that were made and how long each one took so the developer can pinpoint the slowness. For websites you can use it to see how often was your site down, how many people are visiting, where are they from, how long were they on the site, what OS were they using. There is so many applications for analytics.

So besides performance what other things can QA learn. Well you can learn what OS and browser they were using so you know what to test more then another scenario. You can learn what is happening in the field rather then a controlled environment and you can try to recreate it with all the given information. This can help you get ahead of the game.

Here is a QA Gif for you:


When you have figured out a complicated bug.

Reign Design

We’re pleased to announce that ReignDesign is this weeks sponsor. ReignDesign is a mobile app development studio with offices in Shanghai, Barcelona and Santiago, Chile. They work with brands like Porsche, WeightWatchers and Nike to create amazing mobile apps. But more importantly, they’re trying to make a great place for developers and designers to work.

They’re currently looking to hire a QA Engineer in their new Barcelona office. If you’re interested, or have any friends who might be interested in relocating to Barcelona, you can visit their website jobs page.

For more information on Reign Design check out their website or listen to Wednesday’s podcast of Test Reactor.

Documenting Bugs

Picture

When documenting a bug there are some things you will need:

Bug name/short description – You will want to state the basics of the bug some thing simple but descries the whole bug. Like “Crashes when in 2 windows and deleting an object from window 2” Now that does not describe the whole thing but it gives you a basic idea. This is more so you can easily find this bug later.

Found in version – What version did you find it in. This allows the developer to go back to that version and see what happened and if it is in a newer version.

Type of bug – Is it a crash, is it data loss, is it a spelling error, or is it a consistency bug. What type is it?

Severity – How bad is this bug? If it is a spelling error that depends if the client sees it a lot then big if they rarely see it minor. Crashes are big and so is data loss. you have to judge this so they know which bug to fix first.

Reproducible – Is it reproducible or did it just happen this one time. the more reproducible the easier it will be to track down and the bigger and issue it is. If it is complicated then maybe not hit so often so lower. And if it was a on hit wonder then it may never be fixed until you find a way to hit it consistently.

Hardware setup – What is your hardware setup? there might have been something in your setup that is different then what they test and this will show us the key. If you are on a mac instead of windows, safari instead of chrome… that is important knowledge to figuring out what went wrong.

Screen shots and videos – These are life savers always, always have these. When you type out a bug and can’t explain it the screen shots can speak that 1000 words. and videos can show someone just how to reproduce.

Other attachments such as spin dumps, crash reports, and error logs – These are all very important in trouble shooting slowness and crashes and what might have went wrong the programers have these spit out things for a reason. you should learn to read these and I will go over this in the future.

Long Description –  This is your brass tax, your meat, this is where you will put everything you can into this ticket so they can figure it out. But remember the Dev might like a lot of info but they don’t want a novel. So be to the point and make sure you are documenting 1 bug and not 3. They may read the first paragraph and find a bug in that one and then fix only that when your ticket was a 3 parter. Then make 3 tickets and not just one to rule them all.

Steps to reproduce – What were the steps the reproduce your bug? This is critical in figuring out what went wrong. Even putting this in a one hit crash is good and ending with can’t reproduce a second time. Any info can help.

Expected results
– What were you expecting to happen can help the engineer figure out where it went wrong so always add that if you can.

Also this week on Test Reactor I go over this same thing. So when Wednesday rolls around feel free to check it out at www.testreactor.com

5 QA GIFs

When asked if a buggy build is ready for release

When a developer fixes one bug only to create several more

When explaining to others what your day was like

When you get a new build and are ready to test

When testing a text box or text field

How to think like  tester

A tester is the kind of person who loves puzzle games and trouble shooting tough issues. I use to play a lot of rpg puzzle games always liking to figure out how to get to the next level. When i use to learn to program i liked fixing more then making and i liked the complexity of some programs. As a tester you want to be able to figure why something works the way it does and know how it should. Not everyone can handle being a tester as it takes a lot of patience hunting down bugs. Running similar test every day. But for those who can handle it love it.
Found from BugHuntress

Here are several puzzles, disguised as interview questions aimed to trigger logic, creativeness, rational thinking, etc. what to give them a shot?

  • Let’s start things easy: how many ping-pong balls are required to fully stuff a school bus?
  • One more seemingly tricky question: how much do you wish to charge for washing every single window in NYC?
  • Here’s a brain-cracker: why do they make round manhole covers?
  • Try to design a decent evacuation plan for LA!

Now, that the “easy” part is over, let’s get to some really hardcore questions:

  • Here is a fun one: Imagine you have been shrined in size to a nickel, when your mass was reduced proportionally, thus your original density remains the same and, wait for it, you have been placed inside an empty blender. Blades will begin spinning in a minute. What would your actions be?
  • How would you explain a database to a ten-year-old with 3 simple sentences?
  • You must pass a note to Bob through Ginny. The note contains your actual phone number, yet Ginny cannot be trusted, hence the message has to be encrypted. And you have to gain a positive response from Bob, clearing the fact your number was delivered properly. How will you pull this one off?
  • How come “dead beef” is significant?
  • There was once a man who has pushed his own car straight to a hotel. That man lost his fortune. What happened?
  • You have 2 eggs and a 100-story building. These eggs are exactly the same and if you toss them out the window there are equal odds that they will either break or survive the fall despite the heights, You may toss them from the first floor or the hundreds floor, no matter. Chances remain the same. They will either break or they won’t. What is the highest floor you can throw them from without breaking? And how many drops will you have to make to find out?

When to write a Test Plan

When I started in QA all the test plans were written out for all the aspects of the software. They were written by design and up-kept by QA. The test plans became out of date as the software grew. It still has some valued test but they needed updated. Over time it got more and more out dated. When we moved to agile we started having QA write test plans but this was based on an already completed product. So what is wrong with this way of writing test plans?

When constantly updating test they get complex and convoluted testing things that may no longer need testing. When writing a test plan based on an already completed product it could not match the design and that could be the bugs. So we have now started to write a test plan based on the design. Everyone is brought in to ok the design and the test plan. So after the QA person writes the test plan based off the design that they and their squad already signed off on. Once the test plan is done the squad then goes over it so the developer and the designer can make sure it matches their idea of what the product will be then it stays updated as it goes through the development process. This makes sure that what comes out is what was designed.

Also Check out this weeks episode of Test Reactor at www.testreactor.com

We’re pleased to announce that ReignDesign is this weeks sponsor. ReignDesign is a mobile app development studio with offices in Shanghai, Barcelona and Santiago, Chile. They work with brands like Porsche, WeightWatchers and Nike to create amazing mobile apps. But more importantly, they’re trying to make a great place for developers and designers to work.

They’re currently looking to hire a QA Engineer in their new Barcelona office. If you’re interested, or have any friends who might be interested in relocating to Barcelona, you can visit their website jobs page.

How to unit test? part 2 of 2