I spent years managing my own Puppeteer (and before that, PhantomJS😱) render system for internal use doing the exact thing this product does, but Remotion has taken it to a whole other level.
Remotion is a whole ecosystem for programmatically building and rendering videos with HTML/CSS/javascript. From multi-platform renderers.. including AWS Lambda... to a player-based web preview... to the eslint rules to help with the tricky parts of distributed video rendering, everything is covered.
I'm a delighted paid customer.