C
C#•3w ago
WolfDK

Issues running BenchmarkDotNet fron NUnit test

I am trying to have BenchmarkDotNet run a Benchmark when running (NUnit) tests for one of my services. However the Benchmark fails with 'Build Error'. My whole project has no trouble building and running, so i don't understand what its issue is... I have included the testlog, for anybody who wish to look through that... My test that runs the Benchmark is the following. 
c#
[Test]
public void BenchmarkPerformance()
{
    ManualConfig config = ManualConfig.Create(DefaultConfig.Instance)
        .WithOptions(ConfigOptions.DisableOptimizationsValidator).AddLogger(ConsoleLogger.Default)
        .AddExporter(MarkdownExporter.GitHub).AddExporter(HtmlExporter.Default).AddExporter(JsonExporter.Default)
        .AddValidator(JitOptimizationsValidator.DontFailOnError).AddFilter(new ExcludeAssembliesFilter("Uno"));

    Summary? summary = BenchmarkRunner.Run<AppliedKeywordServiceBenchmarks>(config);
}

private class ExcludeAssembliesFilter : IFilter
{
    private readonly string[] _excludedAssemblies;

    public ExcludeAssembliesFilter(params string[] excludedAssemblies)
    {
        _excludedAssemblies = excludedAssemblies;
    }

    public bool Predicate(BenchmarkCase benchmarkCase)
    {
        foreach (string assembly in _excludedAssemblies)
        {
            if (benchmarkCase.Descriptor.Type.Assembly.FullName.Contains(assembly))
            {
                return false;
            }
        }

        return true;
    }
}
c#
[Test]
public void BenchmarkPerformance()
{
    ManualConfig config = ManualConfig.Create(DefaultConfig.Instance)
        .WithOptions(ConfigOptions.DisableOptimizationsValidator).AddLogger(ConsoleLogger.Default)
        .AddExporter(MarkdownExporter.GitHub).AddExporter(HtmlExporter.Default).AddExporter(JsonExporter.Default)
        .AddValidator(JitOptimizationsValidator.DontFailOnError).AddFilter(new ExcludeAssembliesFilter("Uno"));

    Summary? summary = BenchmarkRunner.Run<AppliedKeywordServiceBenchmarks>(config);
}

private class ExcludeAssembliesFilter : IFilter
{
    private readonly string[] _excludedAssemblies;

    public ExcludeAssembliesFilter(params string[] excludedAssemblies)
    {
        _excludedAssemblies = excludedAssemblies;
    }

    public bool Predicate(BenchmarkCase benchmarkCase)
    {
        foreach (string assembly in _excludedAssemblies)
        {
            if (benchmarkCase.Descriptor.Type.Assembly.FullName.Contains(assembly))
            {
                return false;
            }
        }

        return true;
    }
}

BenchmarkPerformance...

2 Replies
WolfDK
WolfDKOP•3w ago
From the testlog, it does not appear that my ´ExcludeAssembliesFilter ´ does the expected action of excluding my Uno Platform project from the code generated by BenchmarkDotNet. I highly suspect it is the inclusion of Uno Platform in the code generated by BenchmarkDotNet that is messing it up... As i have no previous experience using BenchmarkDotNet, i have used Copilot to generate most of the code for this benchmarking, so it might also have some faults because of that... The AppliedKeywordServiceBenchmarks class can be view in full here: https://github.com/NoergaardMikkelsen/gaio/blob/benchmark/Statistics.Tests/Services/Benchmark/AppliedKeywordServiceBenchmarks.cs
GitHub
gaio/Statistics.Tests/Services/Benchmark/AppliedKeywordServiceBench...
Program to register questions to be asked to AI's and responses logged - NoergaardMikkelsen/gaio
WolfDK
WolfDKOP•3w ago
... Fixed... One of my test was targeting a class in my Uno Platform project. Now that i have removed that test, and the project reference the benchmark works.

Did you find this page helpful?