Войти
  • 19208Просмотров
  • 11 месяцев назадОпубликованоComputerix

Building a Scalable Queue System with NestJS & BullMQ & Redis

In this video, we tackle the challenge of handling heavy tasks in real-world applications by introducing BullMQ for background job processing in a NestJS application. 🚀 What you'll learn: - The problem with heavy tasks and how queues solve them. - How to set up BullMQ in a NestJS project. - Creating and processing jobs with workers. - Leveraging progress tracking, retries, delays, and concurrency. - Scaling your application with dedicated worker services. BullMQ docs: Buy me a coffee : Github Repo: Timestamps: --------------------- 0:00 - Introduction: Explaining the problem 00:55 - Solution: BullMQ and Redis Queues 4:40 - Setting up BullMQ and Redis in NestJs 7:57 - Creating and sending Jobs to our Queue 15:04 - Creating our Worker and Processing Jobs 19:05 - Handling Concurrency 20:51 - Worker Event Listeners 22:40 - Handling failure with retries 26:00 - Rate Limiting, Job Progress, etc.. 30:35 - Queue Event Listeners (Global Listeners) 33:20 - Handling Multiple Job Names 36:10 - Scaling : Using separate dedicated worker services