Paraphrasing Method for Controlling a Robotic Arm Using a Large Language Model

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Standard

Paraphrasing Method for Controlling a Robotic Arm Using a Large Language Model. / Yasuda, Shohei; Komori, Yuka; Nakajima, Kosuke et al.
GCCE 2024 - 2024 IEEE 13th Global Conference on Consumer Electronics. Institute of Electrical and Electronics Engineers Inc., 2024. p. 943-945 (GCCE - IEEE Global Conference on Consumer Electronics).

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Harvard

Yasuda, S, Komori, Y, Nakajima, K, Tanabe, R, Uemura, W & Walter, N 2024, Paraphrasing Method for Controlling a Robotic Arm Using a Large Language Model. in GCCE 2024 - 2024 IEEE 13th Global Conference on Consumer Electronics. GCCE - IEEE Global Conference on Consumer Electronics, Institute of Electrical and Electronics Engineers Inc., pp. 943-945, 13th IEEE Global Conference on Consumer Electronic - GCCE 2024, Kitakyushu, Japan, 29.10.24. https://doi.org/10.1109/GCCE62371.2024.10760305

APA

Yasuda, S., Komori, Y., Nakajima, K., Tanabe, R., Uemura, W., & Walter, N. (2024). Paraphrasing Method for Controlling a Robotic Arm Using a Large Language Model. In GCCE 2024 - 2024 IEEE 13th Global Conference on Consumer Electronics (pp. 943-945). (GCCE - IEEE Global Conference on Consumer Electronics). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/GCCE62371.2024.10760305

Vancouver

Yasuda S, Komori Y, Nakajima K, Tanabe R, Uemura W, Walter N. Paraphrasing Method for Controlling a Robotic Arm Using a Large Language Model. In GCCE 2024 - 2024 IEEE 13th Global Conference on Consumer Electronics. Institute of Electrical and Electronics Engineers Inc. 2024. p. 943-945. (GCCE - IEEE Global Conference on Consumer Electronics). doi: 10.1109/GCCE62371.2024.10760305

Bibtex

@inbook{54ebc76f82ea4e8ab0f181aa62e19415,
title = "Paraphrasing Method for Controlling a Robotic Arm Using a Large Language Model",
abstract = "In recent years, factory production systems have shifted from low-mix high-volume production to high-mix low-volume production and the robots such as arm typed robots and mobile robots are installed in a factory. Integrating robots, sensors and the other devices into a system is costly. To solve the problems in regard to the costs, a method to automatically generate control code for a robot using a large language model (LLM) is considered. Controlling a robot using an LLM makes it possible for non experts in on-site adjustment of robots to adjust motion of a robot installed in factory by giving text-base instructions. In case to use an LLM, we must devise how to write instructions to obtain desired motion of the robot. In this paper, we address pick and place task using a robotic arm and propose a method to learn how to paraphrase instructions to high quality ones for desired controlling a robotic arm using an LLM in reinforcement learning.",
keywords = "large language model, paraphrase, reinforcement learning, robotic arm, Engineering",
author = "Shohei Yasuda and Yuka Komori and Kosuke Nakajima and Ryota Tanabe and Wataru Uemura and Niclas Walter",
note = "Publisher Copyright: {\textcopyright} 2024 IEEE.; 13th IEEE Global Conference on Consumer Electronic - GCCE 2024, GCCE 2024 ; Conference date: 29-10-2024 Through 01-11-2024",
year = "2024",
month = nov,
doi = "10.1109/GCCE62371.2024.10760305",
language = "English",
isbn = "979-8-3503-5508-6",
series = "GCCE - IEEE Global Conference on Consumer Electronics",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "943--945",
booktitle = "GCCE 2024 - 2024 IEEE 13th Global Conference on Consumer Electronics",
address = "United States",
url = "http://ieee-gcce.org/",

}

RIS

TY - CHAP

T1 - Paraphrasing Method for Controlling a Robotic Arm Using a Large Language Model

AU - Yasuda, Shohei

AU - Komori, Yuka

AU - Nakajima, Kosuke

AU - Tanabe, Ryota

AU - Uemura, Wataru

AU - Walter, Niclas

N1 - Conference code: 13

PY - 2024/11

Y1 - 2024/11

N2 - In recent years, factory production systems have shifted from low-mix high-volume production to high-mix low-volume production and the robots such as arm typed robots and mobile robots are installed in a factory. Integrating robots, sensors and the other devices into a system is costly. To solve the problems in regard to the costs, a method to automatically generate control code for a robot using a large language model (LLM) is considered. Controlling a robot using an LLM makes it possible for non experts in on-site adjustment of robots to adjust motion of a robot installed in factory by giving text-base instructions. In case to use an LLM, we must devise how to write instructions to obtain desired motion of the robot. In this paper, we address pick and place task using a robotic arm and propose a method to learn how to paraphrase instructions to high quality ones for desired controlling a robotic arm using an LLM in reinforcement learning.

AB - In recent years, factory production systems have shifted from low-mix high-volume production to high-mix low-volume production and the robots such as arm typed robots and mobile robots are installed in a factory. Integrating robots, sensors and the other devices into a system is costly. To solve the problems in regard to the costs, a method to automatically generate control code for a robot using a large language model (LLM) is considered. Controlling a robot using an LLM makes it possible for non experts in on-site adjustment of robots to adjust motion of a robot installed in factory by giving text-base instructions. In case to use an LLM, we must devise how to write instructions to obtain desired motion of the robot. In this paper, we address pick and place task using a robotic arm and propose a method to learn how to paraphrase instructions to high quality ones for desired controlling a robotic arm using an LLM in reinforcement learning.

KW - large language model

KW - paraphrase

KW - reinforcement learning

KW - robotic arm

KW - Engineering

UR - http://www.scopus.com/inward/record.url?scp=85213354505&partnerID=8YFLogxK

U2 - 10.1109/GCCE62371.2024.10760305

DO - 10.1109/GCCE62371.2024.10760305

M3 - Article in conference proceedings

AN - SCOPUS:85213354505

SN - 979-8-3503-5508-6

T3 - GCCE - IEEE Global Conference on Consumer Electronics

SP - 943

EP - 945

BT - GCCE 2024 - 2024 IEEE 13th Global Conference on Consumer Electronics

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 13th IEEE Global Conference on Consumer Electronic - GCCE 2024

Y2 - 29 October 2024 through 1 November 2024

ER -

Recently viewed

Activities

  1. Transdisciplinary Evaluation of Alternative Adaptation Strategies Value-Tree Method as a Tool to Integrate Multiple Values of Science, Practice and the General Public into Decision-Making
  2. “Through the Threshold: responsive, performative, self-referential”
  3. Trajectory-based computational study of coherent behavior in flows
  4. Collaborative modeling in climatic change adaptation and energy transformation.
  5. Closing Session: Summary Notes
  6. archiDART: an R package for the automated 2D computation of root architectural traits
  7. Concurrent Adaptive Tests for Formative Assessments in School Classes
  8. The semantics of transformation: conceptual work based on Freirean methodology.
  9. "Curious and Concerned" – A mixed-methods study of teacher educators’ AI literacy, usage experience, and perceptions
  10. Exploring Affective Human-Robot Interaction with Movie Scenes
  11. Lagrangian aspects of turbulent superstructures: numerical analysis of long-term dynamics and transport properties
  12. Towards a fully-automated adaptive e-learning environment: A predictive model for difficulty generating factors in gap-filling activities that target English tense-aspect-mood
  13. International Conference of Computational Methods in Engineering Science - Chair of Session III
  14. Context-based discrimination in school
  15. DigiSchreib - A tool to support teachers in the selection and use of digital writing tools
  16. Understanding Learning Processes For Developing Key Competencies In Sustainability Implication For Higher Education

Publications

  1. Appendix A: Design, implementation, and analysis of the iGOES project
  2. Analyzing User Journey Data In Digital Health: Predicting Dropout From A Digital CBT-I Intervention
  3. Changes in the Complexity of Limb Movements during the First Year of Life across Different Tasks
  4. Structure and dynamics laboratory testing of an indirectly controlled full variable valve train for camless engines
  5. The Use of Factorization and Multimode Parametric Spectra in Estimating Frequency and Spectral Parameters of Signal
  6. Guest Editorial Special Issue on Sensors in Machine Vision of Automated Systems
  7. Exploiting linear partial information for optimal use of forecasts. With an application to U.S. economic policy
  8. Agency and structure in a sociotechnical transition
  9. Control of an Electromagnetic Linear Actuator Using Flatness Property and Systems Inversion
  10. A PHENOMENOGRAPHICAL STUDY OF CHILDRENS’ SPATIAL THOUGHT WHILE USING MAPS IN REAL SPACES
  11. A Lean Convolutional Neural Network for Vehicle Classification
  12. Robust Flatness Based Control of an Electromagnetic Linear Actuator Using Adaptive PID Controller
  13. An extended analytical approach to evaluating monotonic functions of fuzzy numbers
  14. Understanding the properties of isospectral points and pairs in graphs
  15. Considerations on efficient touch interfaces - How display size influences the performance in an applied pointing task
  16. Performance analysis for loss systems with many subscribers and concurrent services
  17. Analysis of long-term statistical data of cobalt flows in the EU
  18. TRY plant trait database – enhanced coverage and open access
  19. Metaphors and Paradigms of the Language Animal—or—The Advantage of seeing “Time Is a Resource” as a Paradigm
  20. Knowledge-Enhanced Language Models Are Not Bias-Proof
  21. Mechanism of dynamic recrystallization and evolution of texture in the hot working domains of the processing map for Mg-4Al-2Ba-2Ca Alloy
  22. Species constancy depends on plot size - A problem for vegetation classification and how it can be solved
  23. Effectiveness of a Web-Based Cognitive Behavioural Intervention for Subthreshold Depression
  24. Using heuristic worked examples to promote solving of reality‑based tasks in mathematics in lower secondary school
  25. Mechanical performance prediction for friction riveting joints of dissimilar materials via machine learning
  26. The Replication Database: Documenting the Replicability of Psychological Science
  27. Learning and Re-learning from net- based cooperative learning discourses