Production planning and control has a great influence on the economic efficiency and logistical performance of a company. In this context, this article gives an insight into the use of simulation as a virtual model of a filling machine in the process industry. Furthermore, it shows the possibilities of a reinforcement learning (RL) approach for dynamic lot sizing. The contribution indicates a possible implementation in an ERP system and shows how a decision support tool can support the planner to save up to 5% of costs compared to a human planner and a heuristic approach proposed by Groff.