PowerShell7/test/powershell
Andrew Schwartzmeyer 1b3bd12230 Don't load Netwonsoft.Json from path
It's already loaded.
2016-04-01 22:35:00 -07:00
..
assets New pester test for Import-LocalizedData 2016-02-11 10:13:56 -08:00
Add-Member.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Add-Type.Tests.ps1 Skip Add-Type.Tests.ps1 2016-04-01 22:35:00 -07:00
Clear-Variable.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Compare-Object.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
ComparisonOperator.Tests.ps1 Add comparison operator tests for #219 2016-03-22 01:17:22 -07:00
ConvertFrom-Csv.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
ConvertFrom-StringData.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
ConvertTo-Csv.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
ConvertTo-SecureString.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
DotNetAPI.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
DotNetInterop.Tests.ps1 Add regression test .NET class interop 2016-03-22 21:41:46 -07:00
Environment-Variables.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
ExecutionPolicy.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Export-Alias.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Export-Csv.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Export-FormatData.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Format-Custom.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Format-List.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Format-Table.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Format-Wide.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Alias.Tests.ps1 Update Pester Unit test for Get-Alias 2016-03-31 20:03:07 -07:00
Get-ChildItem.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Content.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Culture.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Date.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Event.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-EventSubscriber.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-FileHash.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-FormatData.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Host.Tests.ps1 Reorganize tests 2016-01-14 17:00:06 -08:00
Get-Item.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-ItemProperty.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Location.Tests.ps1 Fixed Pester Get-Location test 2016-03-08 14:55:30 +08:00
Get-Member.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Process.Tests.ps1 Add Get-Process Pester test for issue 147 2016-03-17 23:49:09 -07:00
Get-PSBreakpoint.Tests.ps1 Modify Pester Test for Get-PSBreakpoint 2016-03-20 22:04:08 -07:00
Get-PSDrive.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-PSProvider.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Random.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-RunspaceDebug.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-UICulture.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Unique.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Get-Variable.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Group-Object.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Import-Alias.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Import-Csv.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Import-LocalizedData.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Import-Module.Tests.ps1 Add Pester Test for Get-PSBreakpoint, Import-Module, Sort-Object 2016-03-18 02:30:26 -07:00
Invoke-Expression.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Json.Tests.ps1 Don't load Netwonsoft.Json from path 2016-04-01 22:35:00 -07:00
Measure-Command.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Measure-Object.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
NativeLinuxCommands.Tests.ps1 Update Pester test for calling native Linux commands for isssue 138 2016-03-18 00:23:57 -07:00
New-Alias.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
New-Event.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
New-Item.Tests.ps1 Modify tests to display link type and link target 2016-03-28 14:35:34 -07:00
New-Object.Tests.ps1 Modify Pester test for New-Object 2016-03-24 20:20:06 -07:00
New-TimeSpan.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
New-Variable.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Out-File.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Out-String.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Pop-Location.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
PSVersionTable.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Push-Location.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
README.md Fix up Pester test documentation 2016-03-30 23:30:25 -07:00
Register-EngineEvent.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Register-ObjectEvent.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Remove-Event.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Remove-Item.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Remove-Module.Tests.ps1 Add Pester test for Remove-Module 2016-03-17 23:50:23 -07:00
Remove-PSBreakpoint.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Remove-Variable.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Select-Object.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Select-String.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Set-Alias.Tests.ps1 Add Pester Unit test for Set-Alias 2016-04-01 00:50:10 -07:00
Set-Location.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Set-PSBreakpoint.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Set-PSDebug.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Set-Variable.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Sort-Object.Tests.ps1 Add Pester Test for Get-PSBreakpoint, Import-Module, Sort-Object 2016-03-18 02:30:26 -07:00
Split-Path.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Start-Process.Tests.ps1 Fix Start-Process tests 2016-03-04 17:35:13 -08:00
Start-Sleep.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Tee-Object.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Test-Mocks.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Test-Path.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Update-FormatData.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Update-TypeData.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Wait-Event.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Write-Error.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Write-Output.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Write-Stream.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00
Write-Verbose.Tests.ps1 Programmatic indentation and whitespace-cleanup of tests 2016-03-04 14:52:27 -08:00

Pester Testing Test Guide

Who this is for

Cmdlet behavior is validated using the Pester testing framework. The purpose of this document is to create a single standard to maximize unit test coverage while minimizing confusion on expectations. What follows is a working document intended to guide those writing Pester unit tests for PowerShell.

Unit testing is done not only to validate that the block of code works as expected, but also to assist the developer to know precisely where in the code to look; in some cases, seeing the source code may inspire better unit tests. In many cases, a unit test is the only documented specification. Fortunately, the MSDN is a great source of information about Cmdlets.

Test suites need to be created and many cmdlets added and unit-tested. The following list is to be used to guide the thought process of the developer in writing a suite in minimal time, while enhancing quality.

Test suites should proceed as functional and system tests of the cmdlets, and the code treated as a black box for the purpose of test suite design.

Portability

Some tests simply must be tied to certain platforms. Use Pester's -Skip directive on an It statement to do this. For instance to run the test only on Windows:

It "Should do something on Windows" -Skip:($IsLinux -Or $IsOSX) { ... }

Or only on Linux and OS X:

It "Should do something on Linux" -Skip:$IsWindows { ... }

Use of Mocks

It is often necessary for the code to interact with the system or other components. When possible, use Mock objects to facilitate this in order to minimize external dependencies. Note: creating a Mock in Powershell on Linux causes PowerShell to look at the Mock, never actually hitting any C# code. Cmdlets cannot be tested using Mocks.

Aliases

Each cmdlet with an alias must be tested with all of its aliases at least once to verify the code path calls the original function.

Testing Standards

Readability

Every effort should be made to maximize readability of code. Code is written for the developer in the future to debug- not for the developer writing the code.

  1. When assertions are on consecutive lines, the pipes should line up:
MyFirstCondition | Should Be 0
MySecondCondition | Should Be 1

This is less readable than:

MyFirstCondition  | Should Be 0
MySecondCondition | Should Be 1

So the second section of code should instead be used. The same style should be followed for assignments of variables on consecutive lines:

$var1 = <expression 1>
$variable2 = <expression 2>
$var3 = <expression 3>
$typeCollection1 = <expression 4>
$object1 = <expression>
... etc

is much less readable than

$var1            = <expression 1>
$variable2       = <expression 2>
$var3            = <expression 3>
$typeCollection1 = <expression 4>
$object1         = <expression 5>
... etc

So all assignment statements must be aligned.

Other style standards are no less important to readability of the code:

  • Use readable and meaningful variable name when assigning variables.

  • Do not make large functions. Tests should be simple: define -> manipulate -> assert

  • Do not use tabs. Tabs are rendered differently depending upon the machine. This greatly affects readability.

  • Remove the first 3 auto-generated lines of each .Tests.ps1 file. This is created automatically by Pester and is unnecessary. Each .Test.ps1 file should begin with a Describe block.

  • Discard the auto-generated function file that is generated in tandem with the .Tests.ps1 file

  • Name the test file "Test- when you create a new test fixture.

  • Each test describes a behavior- use the word "Should" at the beginning of each test description- so it reads "It 'Should..."

Basic Unit Tests

The following table should suffice to inspire in the developer sufficient content to create a suite of tests.

test # test name entry criteria/setup exit criteria/assertion
01 Should be able to be called without params (if applicable) no throw
02 Should be able to be called minimal required params no throw, expected output
03 Should be able to use the X alias minimal required params no throw, expected output
04 Should return the proper data type required params no throw, proper data type
05 Should be able to accept piped input piped input expected output
06 Should be able to call using the X parameter use X parameter no throw, expected output
07 Should be able to call using the Y parameter use Y parameter no throw, expected output
08 Should be able to call using the Z parameter use Z parameter no throw, expected output
09 Should throw under condition X create condition X Throw error x
10 Should throw under condition Y create condition Y Throw error y
11 Should throw under condition Z create condition Z Throw error z

These are the basic unit tests required to verify the functionality of any Cmdlet. If the above questions cannot be answered for each Cmdlet, then they cannot be verified to work.

Look at the existing suites of pester tests located within this directory and use that as inspiration.

Running Pester Tests

Go to the top level of the PowerShell repository and run: ./bin/powershell -c "Invoke-Pester test/powershell"