Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Related Rants
So I am running Spark on Docker. I have hardcoded the docker-compose file to 1 master and 3 workers which works fine. What would be a good way to dynamically scale the number of workers up and down through the command line ? I guess we have to use --scale or replica, but how ?
rant
spark
docker-compose
docker