So this blogpost is in response to the weekly Specflow blog posts and challenges that have been written by Gojko Adzic.
This weeks challenge was how would you rewrite or rephrase the below scenario:
Given a user registers successfully When the account page reloads And the user waits 2 seconds Then the account page displays "Account approved"
My initial though was something like this:
Given a user registers successfully
When the account page reloads
Then the account page is displayed within a satisfactory time period
And the account page displays "Account Approved"
Now the problem with this scenario is what defines a satisfactory time? You could add it as a comment or in a scenario outline but over time the time a user waits could change and if this is updated in the code behind but the scenario outline or comments are not, then what the test does and what is described do not match - this would potentially cause issues in the future.
My next idea was to write it using examples:
Given a user registers successfully
When the account page reloads
Then the account page is displayed within <time> minutes
And the account page displays <Account approval message>
Examples:
| time | Account approval message |
| 1 | Account Approved |
| 2 | Account Approved |
| 3 | Account Not Approved - system took to long to respond |
| 4 | Account Not Approved - system took to long to respond |
Now this scenario although more detailed, suffers from the same problem as the original scenario i.e. The timing can be affected by things like CPU usage and network traffic and you may get inconsistent test results. It does however, give the user different examples of what constitutes a pass or failure.
My final idea was this:
Given a user registers successfully
And the account page reloads
When the account page loading progress bar is at 100%
Then the account page displays "Account Approved"
Now this scenario (although not perfect) takes the timing element out and the reader of this takes away that the account page will display "Account Approved" once the progress bar is at 100% . It removes the actual time a user should be waiting so it means that the code behind doesn't need to contain specific details about the time needed to wait just that once the progress bar is at 100% that the account page should display "Account Approved". This means that whatever the state of the CPU or network traffic the test will pass whether the progress bar takes 10 mins or 10 seconds to get to 100%.
I cant put my finger on why I still don't like my last scenario but I struggle with how you can successfully include waits and pauses in Specflow but I'm sure Gojko will put me out of my misery ๐
This weeks challenge was how would you rewrite or rephrase the below scenario:
Given a user registers successfully When the account page reloads And the user waits 2 seconds Then the account page displays "Account approved"
My initial though was something like this:
Given a user registers successfully
When the account page reloads
Then the account page is displayed within a satisfactory time period
And the account page displays "Account Approved"
Now the problem with this scenario is what defines a satisfactory time? You could add it as a comment or in a scenario outline but over time the time a user waits could change and if this is updated in the code behind but the scenario outline or comments are not, then what the test does and what is described do not match - this would potentially cause issues in the future.
My next idea was to write it using examples:
Given a user registers successfully
When the account page reloads
Then the account page is displayed within <time> minutes
And the account page displays <Account approval message>
Examples:
| time | Account approval message |
| 1 | Account Approved |
| 2 | Account Approved |
| 3 | Account Not Approved - system took to long to respond |
| 4 | Account Not Approved - system took to long to respond |
Now this scenario although more detailed, suffers from the same problem as the original scenario i.e. The timing can be affected by things like CPU usage and network traffic and you may get inconsistent test results. It does however, give the user different examples of what constitutes a pass or failure.
My final idea was this:
Given a user registers successfully
And the account page reloads
When the account page loading progress bar is at 100%
Then the account page displays "Account Approved"
Now this scenario (although not perfect) takes the timing element out and the reader of this takes away that the account page will display "Account Approved" once the progress bar is at 100% . It removes the actual time a user should be waiting so it means that the code behind doesn't need to contain specific details about the time needed to wait just that once the progress bar is at 100% that the account page should display "Account Approved". This means that whatever the state of the CPU or network traffic the test will pass whether the progress bar takes 10 mins or 10 seconds to get to 100%.
I cant put my finger on why I still don't like my last scenario but I struggle with how you can successfully include waits and pauses in Specflow but I'm sure Gojko will put me out of my misery ๐
Comments
Post a Comment