Welcome to Software Development on Codidact!
Will you help us build our independent community of developers helping developers? We're small and trying to grow. We welcome questions about all aspects of software development, from design to code to QA and more. Got questions? Got answers? Got code you'd like someone to review? Please join us.
Preloading some data at application startup as fast as possible
I am caching some very static information (changes once per day) in my ASP.NET Core application. This is normally done when needed ("lazy").
One such cache item is a 50K list of items that are taking less than 500ms when the application is deployed and about one second in the development environment.
However, one colleague has a slower Internet connection and this takes several seconds to complete.
One solution to keep the caching and make things faster for my colleague is to start the fetch ("eager load") in parallel with the API startup.
How can I do this in ASP.NET Core?
1 answer
One way to do this is to launch a Task at application startup as soon as possible (the DI is configured). The only hard part is to make DI available in the prewarm functionality.
The following implementation is based on this article.
/// <summary>
/// Credit: https://anduin.aiursoft.com/post/2020/10/14/fire-and-forget-in-aspnet-core-with-dependency-alive
/// </summary>
public class FireAndForgetService
{
private readonly ILogger<FireAndForgetService> _logger;
private readonly IServiceScopeFactory _scopeFactory;
public FireAndForgetService(
ILogger<FireAndForgetService> logger,
IServiceScopeFactory scopeFactory)
{
_logger = logger;
_scopeFactory = scopeFactory;
}
public void Fire<T>(Action<T> bullet, Action<Exception> handler = null)
{
_logger.LogInformation("Fired a new action.");
Task.Run(() =>
{
using var scope = _scopeFactory.CreateScope();
var dependency = scope.ServiceProvider.GetRequiredService<T>();
try
{
bullet(dependency);
}
catch (Exception e)
{
_logger.LogError(e, "Fire and forget crashed!");
handler?.Invoke(e);
}
finally
{
dependency = default;
}
});
}
public void FireAsync<T>(Func<T, Task> bullet, Action<Exception> handler = null)
{
_logger.LogInformation("Fired a new async action.");
Task.Run(async () =>
{
using var scope = _scopeFactory.CreateScope();
var dependency = scope.ServiceProvider.GetRequiredService<T>();
try
{
await bullet(dependency);
}
catch (Exception e)
{
_logger.LogError(e, "Cannon crashed!");
handler?.Invoke(e);
}
finally
{
dependency = default;
}
});
}
}
// this goes in Startup.ConfigureServices
services.AddSingleton<FireAndForgetService>();
// this goes in Program.cs
private static void PreWarmCache(IServiceProvider services, NLog.Logger _logger)
{
try
{
var cannon = services.GetRequiredService<FireAndForgetService>();
cannon.FireAsync<IListOfValuesProviderService>(async (lovProvider) =>
{
_ = await lovProvider.GetAll<Employee>(default);
});
}
catch (Exception exc)
{
// log error
}
}
public async static Task Main(string[] args)
{
try
{
var host = CreateHostBuilder(args).Build();
using (var scope = host.Services.CreateScope())
{
await host.MigrateDatabaseAsync<ApplicationDbContext>();
var services = scope.ServiceProvider;
PreWarmCache(services, _logger);
}
await host.RunAsync();
}
catch (Exception ex)
{
// log error
throw;
}
}
Note that cannon.FireAsync
is not awaited and it does not block the application startup.
0 comment threads