Dynamically changing sequencing rules with reinforcement learning in a job shop system with stochastic influences

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Sequencing operations can be difficult, especially under uncertain conditions. Applying decentral sequencing rules has been a viable option; however, no rule exists that can outperform all other rules under varying system performance. For this reason, reinforcement learning (RL) is used as a hyper heuristic to select a sequencing rule based on the system status. Based on multiple training scenarios considering stochastic influences, such as varying inter arrival time or customers changing the product mix, the advantages of RL are presented. For evaluation, the trained agents are exploited in a generic manufacturing system. The best agent trained is able to dynamically adjust sequencing rules based on system performance, thereby matching and outperforming the presumed best static sequencing rules by ~ 3%. Using the trained policy in an unknown scenario, the RL heuristic is still able to change the sequencing rule according to the system status, thereby providing a robust performance.
Translated title of the contributionDynamische Auswahl von Reihenfolgeregeln mit bestärkendem Lernen in einer Werkstattfertigung mit stochastischen Einflüssen
Original languageEnglish
Title of host publicationProceedings of the 2020 Winter Simulation Conference, WSC 2020
EditorsK.-H. Bae, B. Feng, S. Kim, S. Lazarova-Molnar, Z. Zheng, T. Roeder, R. Thiesing
Number of pages11
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Publication date14.12.2020
Pages1608 - 1618
Article number9383903
ISBN (electronic)978-1-7281-9499-8
DOIs
Publication statusPublished - 14.12.2020
EventWinter Simulation Conference - WSC 2020: Simulation Drives Innovation - Orlando, United States
Duration: 14.12.202018.12.2020
http://meetings2.informs.org/wordpress/wsc2020/

Recently viewed

Publications

  1. Binary Random Nets I
  2. Simple saturated relay non-linear PD control for uncertain motion systems with friction and actuator constraint
  3. Data-driven and physics-based modelling of process behaviour and deposit geometry for friction surfacing
  4. Q-Adaptive Control of the nonlinear dynamics of the cantilever-sample system of an Atomic Force Microscope
  5. Model-based logistic controlling of converging material flows
  6. From Open Access to Open Science
  7. Detection time analysis of propulsion system fault effects in a hexacopter
  8. Nonlinear PD fault-tolerant control for dynamic positioning of ships with actuator constraints
  9. Passive Rotation Compensation in Parallel Kinematics Using Quaternions
  10. Erroneous examples as desirable difficulty
  11. Optimal scheduling of AGVs in a reentrant blocking job-shop
  12. You cannot not transact - Big Data und Transaktionalität
  13. Wavelet functions for rejecting spurious values
  14. Frame-based Data Factorizations
  15. Developing a Complex Portrait of Content Teaching for Multilingual Learners via Nonlinear Theoretical Understandings
  16. Developing a Process for the Analysis of User Journeys and the Prediction of Dropout in Digital Health Interventions:
  17. Using measures of reading time regularity (RTR) to quantify eye movement dynamics, and how they are shaped by linguistic information
  18. Early Edema Detection Based on the Examination of Multidimensional Ultra-Wide band Data
  19. Effectiveness of the world network of biosphere reserves in maintaining forest ecosystem functions
  20. Sliding Mode Control of an Inductive Power Transmission System with Maximum Efficiency
  21. Cascade PID Controllers Applied on Level and Flow Systems in a SMAR Didactic Plant
  22. Audio-Hacks
  23. A Two-Stage Sliding-Mode High-Gain Observer to Reduce Uncertainties and Disturbances Effects for Sensorless Control in Automotive Applications
  24. What motivates people to use energy feedback systems? A multiple goal approach to predict long-term usage behaviour in daily life
  25. An Outcome-Oriented, Social-Ecological Framework for Assessing Protected Area Effectiveness
  26. Dealing with inclusion–teachers’ assessment of internal and external resources
  27. A utilitarian notion of responsibility for sustainability
  28. Emancipative Values and Non-violent Protest
  29. Pushing the Envelope: Creating Public Value in the Labor Market
  30. A generalized α-level decomposition concept for numerical fuzzy calculus
  31. Disentangling who is who during rhizosphere acidification in root interactions: combining fluorescence with optode techniques