TUnit.Playwright v0.57.65 — nugetz
thomhurst/ TUnit.Playwright v0.57.65 ✓ Verified .NET 8.0 .NET 9.0 .NET 10.0 .NET Std2.0
A .NET Testing Framework
Get Started dotnet CLI PackageReference Package Manager
$ dotnet add package TUnit.PlaywrightReadme
🚀 The Modern Testing Framework for .NET
TUnit is a next-generation testing framework for C# that outpaces traditional frameworks with source-generated tests , parallel execution by default , and Native AOT support . Built on the modern Microsoft.Testing.Platform, TUnit delivers faster test runs, better developer experience, and unmatched flexibility.
⚡ Why Choose TUnit? Feature Traditional Frameworks TUnit Test Discovery ❌ Runtime reflection ✅ Compile-time generation Execution Speed ❌ Sequential by default ✅ Parallel by default Modern .NET ⚠️ Limited AOT support ✅ Full Native AOT & trimming Test Dependencies ❌ Not supported ✅ [DependsOn] chains Resource Management ❌ Manual lifecycle ✅ Intelligent cleanup
⚡ Parallel by Default - Tests run concurrently with intelligent dependency management
🎯 Compile-Time Discovery - Know your test structure before runtime
🔧 Modern .NET Ready - Native AOT, trimming, and latest .NET features
🎭 Extensible - Customize data sources, attributes, and test behavior
🏁 Quick Start
Using the Project Template (Recommended) dotnet new install TUnit.Templates
dotnet new TUnit -n "MyTestProject"
Manual Installation dotnet add package TUnit --prerelease
✨ Key Features
🚀 Performance & Modern Platform
🔥 Source-generated tests (no reflection)
⚡ Parallel execution by default
🚀 Native AOT & trimming support
📈 Optimized for performance
🎯 Advanced Test Control
🔗 Test dependencies with [DependsOn]
🎛️ Parallel limits & custom scheduling
🛡️ Built-in analyzers & compile-time checks
🎭 Custom attributes & extensible conditions
📊 Rich Data & Assertions
📋 Multiple data sources ([Arguments], [Matrix], [ClassData])
✅ Fluent async assertions
🔄 Smart retry logic & conditional execution
📝 Rich test metadata & context
🔧 Developer Experience
💉 Full dependency injection support
🪝 Comprehensive lifecycle hooks
🎯 IDE integration (VS, Rider, VS Code)
📚 Extensive documentation & examples
📝 Simple Test Example [Test]
public async Task User_Creation_Should_Set_Timestamp()
{
// Arrange
var userService = new UserService();
// Act
var user = await userService.CreateUserAsync("john.doe@example.com");
// Assert - TUnit's fluent assertions
await Assert.That(user.CreatedAt)
.IsEqualTo(DateTime.Now)
.Within(TimeSpan.FromMinutes(1));
await Assert.That(user.Email)
.IsEqualTo("john.doe@example.com");
}
🎯 Data-Driven Testing [Test]
[Arguments("user1@test.com", "ValidPassword123")]
[Arguments("user2@test.com", "AnotherPassword456")]
[Arguments("admin@test.com", "AdminPass789")]
public async Task User_Login_Should_Succeed(string email, string password)
{
var result = await authService.LoginAsync(email, password);
await Assert.That(result.IsSuccess).IsTrue();
}
// Matrix testing - tests all combinations
[Test]
[MatrixDataSource]
public async Task Database_Operations_Work(
[Matrix("Create", "Update", "Delete")] string operation,
[Matrix("User", "Product", "Order")] string entity)
{
await Assert.That(await ExecuteOperation(operation, entity))
.IsTrue();
}
🔗 Advanced Test Orchestration [Before(Class)]
public static async Task SetupDatabase(ClassHookContext context)
{
await DatabaseHelper.InitializeAsync();
}
[Test, DisplayName("Register a new account")]
[MethodDataSource(nameof(GetTestUsers))]
public async Task Register_User(string username, string password)
{
// Test implementation
}
[Test, DependsOn(nameof(Register_User))]
[Retry(3)] // Retry on failure
public async Task Login_With_Registered_User(string username, string password)
{
// This test runs after Register_User completes
}
[Test]
[ParallelLimit<LoadTestParallelLimit>] // Custom parallel control
[Repeat(100)] // Run 100 times
public async Task Load_Test_Homepage()
{
// Performance testing
}
// Custom attributes
[Test, WindowsOnly, RetryOnHttpError(5)]
public async Task Windows_Specific_Feature()
{
// Platform-specific test with custom retry logic
}
public class LoadTestParallelLimit : IParallelLimit
{
public int Limit => 10; // Limit to 10 concurrent executions
}
🔧 Smart Test Control // Custom conditional execution
public class WindowsOnlyAttribute : SkipAttribute
{
public WindowsOnlyAttribute() : base("Windows only test") { }
public override Task<bool> ShouldSkip(TestContext testContext)
=> Task.FromResult(!OperatingSystem.IsWindows());
}
// Custom retry logic
public class RetryOnHttpErrorAttribute : RetryAttribute
{
public RetryOnHttpErrorAttribute(int times) : base(times) { }
public override Task<bool> ShouldRetry(TestInformation testInformation,
Exception exception, int currentRetryCount)
=> Task.FromResult(exception is HttpRequestException { StatusCode: HttpStatusCode.ServiceUnavailable });
}
🎯 Perfect For Every Testing Scenario
🧪 Unit Testing
[Test]
[Arguments(1, 2, 3)]
[Arguments(5, 10, 15)]
public async Task Calculate_Sum(int a, int b, int expected)
{
await Assert.That(Calculator.Add(a, b))
.IsEqualTo(expected);
}
Fast, isolated, and reliable
🔗 Integration Testing
[Test, DependsOn(nameof(CreateUser))]
public async Task Login_After_Registration()
{
// Runs after CreateUser completes
var result = await authService.Login(user);
await Assert.That(result.IsSuccess).IsTrue();
}
Stateful workflows made simple
⚡ Load Testing
[Test]
[ParallelLimit<LoadTestLimit>]
[Repeat(1000)]
public async Task API_Handles_Concurrent_Requests()
{
await Assert.That(await httpClient.GetAsync("/api/health"))
.HasStatusCode(HttpStatusCode.OK);
}
Built-in performance testing
🚀 What Makes TUnit Different?
Compile-Time Intelligence Tests are discovered at build time, not runtime - enabling faster discovery, better IDE integration, and precise resource lifecycle management.
Parallel-First Architecture Built for concurrency from day one with [DependsOn] for test chains, [ParallelLimit] for resource control, and intelligent scheduling.
Extensible by Design The DataSourceGenerator<T> pattern and custom attribute system let you extend TUnit's capabilities without modifying core framework code.
🏆 Community & Ecosystem
🌟 Join thousands of developers modernizing their testing
🤝 Active Community
🛠️ IDE Support TUnit works seamlessly across all major .NET development environments:
Visual Studio (2022 17.13+) ✅ Fully supported - No additional configuration needed for latest versions
⚙️ Earlier versions : Enable "Use testing platform server mode" in Tools > Manage Preview Features
JetBrains Rider ⚙️ Setup : Enable "Testing Platform support" in Settings > Build, Execution, Deployment > Unit Testing > VSTest
Visual Studio Code ⚙️ Setup : Install C# Dev Kit and enable "Use Testing Platform Protocol"
Command Line ✅ Full CLI support - Works with dotnet test, dotnet run, and direct executable execution
📦 Package Options Package Use Case TUnit⭐ Start here - Complete testing framework (includes Core + Engine + Assertions) TUnit.Core📚 Test libraries and shared components (no execution engine) TUnit.Engine🚀 Test execution engine and adapter (for test projects) TUnit.Assertions✅ Standalone assertions (works with any test framework) TUnit.Playwright🎭 Playwright integration with automatic lifecycle management
🎯 Migration from Other Frameworks Coming from NUnit or xUnit? TUnit maintains familiar syntax while adding modern capabilities:
// Enhanced with TUnit's advanced features
[Test]
[Arguments("value1")]
[Arguments("value2")]
[Retry(3)]
[ParallelLimit<CustomLimit>]
public async Task Modern_TUnit_Test(string value) { }
📖 Need help migrating? Check our detailed Migration Guides
💡 Current Status The API is mostly stable, but may have some changes based on feedback or issues before v1.0 release.
🚀 Ready to Experience the Future of .NET Testing?
⚡ Start in 30 Seconds
# Create a new test project with examples
dotnet new install TUnit.Templates && dotnet new TUnit -n "MyAwesomeTests"
# Or add to existing project
dotnet add package TUnit --prerelease
🎯 Why Wait? Join the Movement
📈 Performance
Optimized execution
Parallel by default
Zero reflection overhead
🔮 Future-Ready
Native AOT support
Latest .NET features
Source generation
🛠️ Developer Experience
Compile-time checks
Rich IDE integration
Intelligent debugging
🎭 Flexibility
Test dependencies
Custom attributes
Extensible architecture
📖 Learn More : tunit.dev | 💬 Get Help : GitHub Discussions | ⭐ Show Support : Star on GitHub
TUnit is actively developed and production-ready. Join our growing community of developers who've made the switch!
Performance Benchmark
Scenario: Building the test project
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median Build_TUnit 0.57.24 2.065 s 0.1725 s 0.4976 s 1.982 s Build_NUnit 4.4.0 1.828 s 0.1465 s 0.4226 s 1.827 s Build_xUnit 2.9.3 1.522 s 0.0958 s 0.2793 s 1.490 s Build_MSTest 3.10.4 1.445 s 0.0720 s 0.2112 s 1.374 s
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median Build_TUnit 0.57.24 1.869 s 0.0368 s 0.0626 s 1.854 s Build_NUnit 4.4.0 1.535 s 0.0128 s 0.0113 s 1.531 s Build_xUnit 2.9.3 1.542 s 0.0179 s 0.0149 s 1.541 s Build_MSTest 3.10.4 1.512 s 0.0169 s 0.0141 s 1.509 s
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median Build_TUnit 0.57.24 1.895 s 0.0374 s 0.0665 s 1.881 s Build_NUnit 4.4.0 1.606 s 0.0298 s 0.0264 s 1.607 s Build_xUnit 2.9.3 1.596 s 0.0160 s 0.0150 s 1.599 s Build_MSTest 3.10.4 1.608 s 0.0167 s 0.0157 s 1.603 s
Scenario: Tests focused on assertion performance and validation
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests running asynchronous operations and async/await patterns
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 215.6 ms 14.87 ms 43.15 ms 213.9 ms TUnit 0.57.24 789.9 ms 59.44 ms 171.50 ms 744.7 ms NUnit 4.4.0 1,567.0 ms 151.39 ms 444.00 ms 1,423.6 ms xUnit 2.9.3 1,274.8 ms 79.27 ms 231.22 ms 1,219.6 ms MSTest 3.10.4 1,272.5 ms 123.48 ms 354.29 ms 1,227.9 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 29.02 ms 0.409 ms 0.383 ms 28.93 ms TUnit 0.57.24 976.24 ms 19.365 ms 18.114 ms 978.34 ms NUnit 4.4.0 1,368.18 ms 14.624 ms 13.680 ms 1,368.58 ms xUnit 2.9.3 1,471.50 ms 16.876 ms 15.786 ms 1,466.35 ms MSTest 3.10.4 1,339.35 ms 18.397 ms 17.209 ms 1,338.87 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 65.19 ms 1.265 ms 1.893 ms 64.95 ms TUnit 0.57.24 1,031.11 ms 19.896 ms 22.912 ms 1,024.97 ms NUnit 4.4.0 1,448.81 ms 14.974 ms 14.007 ms 1,450.70 ms xUnit 2.9.3 1,546.58 ms 11.472 ms 10.731 ms 1,546.14 ms MSTest 3.10.4 1,369.38 ms 10.885 ms 9.090 ms 1,372.15 ms
Scenario: Simple tests with basic operations and assertions
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 205.5 ms 17.73 ms 52.00 ms 195.8 ms TUnit 0.57.24 988.7 ms 103.38 ms 303.19 ms 918.7 ms NUnit 4.4.0 1,287.6 ms 140.36 ms 404.96 ms 1,171.8 ms xUnit 2.9.3 1,081.4 ms 54.54 ms 157.35 ms 1,034.3 ms MSTest 3.10.4 1,112.1 ms 75.59 ms 219.30 ms 1,106.3 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 27.28 ms 0.496 ms 0.464 ms 27.08 ms TUnit 0.57.24 968.46 ms 18.823 ms 17.607 ms 966.27 ms NUnit 4.4.0 1,344.21 ms 8.838 ms 8.267 ms 1,344.79 ms xUnit 2.9.3 1,421.52 ms 11.041 ms 10.328 ms 1,423.52 ms MSTest 3.10.4 1,287.97 ms 11.257 ms 9.979 ms 1,287.26 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 61.14 ms 1.197 ms 1.899 ms 62.27 ms TUnit 0.57.24 1,029.01 ms 19.699 ms 24.912 ms 1,020.23 ms NUnit 4.4.0 1,389.48 ms 19.476 ms 18.218 ms 1,390.31 ms xUnit 2.9.3 1,467.00 ms 14.576 ms 13.634 ms 1,469.37 ms MSTest 3.10.4 1,350.82 ms 12.123 ms 11.340 ms 1,348.95 ms
Scenario: Parameterized tests with multiple test cases using data attributes
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 890.9 ms 47.84 ms 140.3 ms 849.9 ms xUnit 2.9.3 882.3 ms 36.86 ms 108.1 ms 849.1 ms MSTest 3.10.4 968.4 ms 63.73 ms 185.9 ms 916.2 ms
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 1.308 s 0.0135 s 0.0126 s 1.302 s xUnit 2.9.3 1.379 s 0.0138 s 0.0129 s 1.375 s MSTest 3.10.4 1.254 s 0.0115 s 0.0108 s 1.254 s
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 1.333 s 0.0131 s 0.0122 s 1.331 s xUnit 2.9.3 1.388 s 0.0139 s 0.0116 s 1.391 s MSTest 3.10.4 1.314 s 0.0260 s 0.0449 s 1.296 s
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests utilizing class fixtures and shared test context
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 102.9 ms 1.84 ms 2.70 ms 101.6 ms TUnit 0.57.24 542.3 ms 7.76 ms 6.48 ms 542.9 ms NUnit 4.4.0 728.1 ms 7.08 ms 6.27 ms 728.0 ms xUnit 2.9.3 752.8 ms 11.80 ms 10.46 ms 753.8 ms MSTest 3.10.4 687.2 ms 10.94 ms 10.23 ms 685.3 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 27.07 ms 0.485 ms 0.539 ms 27.05 ms TUnit 0.57.24 939.73 ms 18.717 ms 23.671 ms 933.43 ms NUnit 4.4.0 1,304.30 ms 13.060 ms 12.216 ms 1,300.81 ms xUnit 2.9.3 1,366.76 ms 7.899 ms 7.389 ms 1,367.51 ms MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 61.69 ms 1.172 ms 1.350 ms 62.36 ms TUnit 0.57.24 1,084.28 ms 21.435 ms 29.340 ms 1,085.06 ms NUnit 4.4.0 1,461.71 ms 26.486 ms 36.254 ms 1,449.49 ms xUnit 2.9.3 1,529.14 ms 20.700 ms 19.362 ms 1,524.25 ms MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests executing in parallel to test framework parallelization
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 126.6 ms 5.18 ms 14.61 ms 126.7 ms TUnit 0.57.24 546.6 ms 9.43 ms 8.82 ms 547.1 ms NUnit 4.4.0 871.7 ms 52.50 ms 153.97 ms 810.4 ms xUnit 2.9.3 911.9 ms 26.82 ms 79.07 ms 909.9 ms MSTest 3.10.4 750.7 ms 14.96 ms 33.15 ms 746.1 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 25.75 ms 0.321 ms 0.284 ms 25.72 ms TUnit 0.57.24 948.67 ms 18.705 ms 22.267 ms 951.05 ms NUnit 4.4.0 1,328.79 ms 15.702 ms 14.688 ms 1,326.58 ms xUnit 2.9.3 1,406.24 ms 7.430 ms 6.204 ms 1,407.50 ms MSTest 3.10.4 1,271.67 ms 10.432 ms 9.758 ms 1,268.96 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 58.43 ms 1.165 ms 2.880 ms 57.46 ms TUnit 0.57.24 1,020.35 ms 20.368 ms 22.639 ms 1,012.48 ms NUnit 4.4.0 1,379.94 ms 18.763 ms 17.550 ms 1,378.05 ms xUnit 2.9.3 1,469.48 ms 27.796 ms 27.299 ms 1,460.47 ms MSTest 3.10.4 1,405.20 ms 17.441 ms 15.461 ms 1,410.30 ms
Scenario: A test that takes 50ms to execute, repeated 100 times
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 NA NA NA NA TUnit 0.57.24 NA NA NA NA NUnit 4.4.0 NA NA NA NA xUnit 2.9.3 NA NA NA NA MSTest 3.10.4 NA NA NA NA
Benchmarks with issues:
RuntimeBenchmarks.TUnit_AOT: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.TUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.NUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.xUnit: Job-YNJDZW(Runtime=.NET 9.0)
RuntimeBenchmarks.MSTest: Job-YNJDZW(Runtime=.NET 9.0)
Scenario: Tests with setup and teardown lifecycle methods
macos-latest
BenchmarkDotNet v0.15.2, macOS Sequoia 15.5 (24F74) [Darwin 24.5.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), Arm64 RyuJIT AdvSIMD
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 166.8 ms 19.39 ms 57.18 ms 143.2 ms TUnit 0.57.24 1,040.1 ms 98.72 ms 284.83 ms 1,014.4 ms NUnit 4.4.0 1,163.5 ms 76.14 ms 214.75 ms 1,111.1 ms xUnit 2.9.3 1,152.3 ms 45.92 ms 131.01 ms 1,138.9 ms MSTest 3.10.4 1,074.1 ms 65.22 ms 190.24 ms 1,042.7 ms
ubuntu-latest
BenchmarkDotNet v0.15.2, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 27.22 ms 0.535 ms 0.833 ms 27.27 ms TUnit 0.57.24 960.21 ms 17.493 ms 16.363 ms 963.80 ms NUnit 4.4.0 1,334.68 ms 9.249 ms 8.652 ms 1,332.05 ms xUnit 2.9.3 1,391.21 ms 13.163 ms 12.313 ms 1,388.89 ms MSTest 3.10.4 1,272.16 ms 13.746 ms 12.858 ms 1,271.26 ms
windows-latest
BenchmarkDotNet v0.15.2, Windows 10 (10.0.20348.4052) (Hyper-V)
AMD EPYC 7763 2.44GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.304
[Host] : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Job-YNJDZW : .NET 9.0.8 (9.0.825.36511), X64 RyuJIT AVX2
Runtime=.NET 9.0
Method Version Mean Error StdDev Median TUnit_AOT 0.57.24 52.80 ms 1.042 ms 0.975 ms 52.98 ms TUnit 0.57.24 1,014.34 ms 20.095 ms 26.129 ms 1,007.50 ms NUnit 4.4.0 1,348.52 ms 6.670 ms 6.239 ms 1,351.84 ms xUnit 2.9.3 1,411.12 ms 11.775 ms 11.014 ms 1,409.01 ms MSTest 3.10.4 1,309.57 ms 14.812 ms 13.855 ms 1,314.12 ms
Compatibility .NET 8.0
.NET 9.0
.NET 10.0
.NET Std2.0
