Autors: Ivanova, M. S., Bogdanova G., Kertesz C.Z.
Title: Large and Small Language Models in Manufacturing and Electronics
Keywords: artificial intelligence, electronics, large language models, manufacturing, small language models

Abstract: Contemporary manufacturing, including electronics, is characterized by automation of a large part of manufacturing activities, and automation is also associated with the application of artificial intelligence (AI) techniques. In recent years, there has been a discussion about how useful large and small language models are for supporting and improving manufacturing activities by creating systems for questioning/answering, for extracting and summarizing knowledge from documents, for analyzing different types of content. This paper explores the applicability of large and small language models in manufacturing practice and how they influence the manufacturing process and final production in the field of electronics. Then, a conceptual model that summarizes the obtained findings is created and discussed.

References

  1. A. Manta-Costa, S. O. Araújo, R. S. Peres, and J. Barata, "Machine Learning Applications in Manufacturing-Challenges, Trends, and Future Directions," IEEE Open Journal of the Industrial Electronics Society, vol. 5, 1085-1103, 2024, DOI: 10.1109/OJIES.2024.3431240.
  2. K. S. S. Liyakat and K. K. S. Liyakat, "ML in the Electronics Manufacturing Industry," Journal of Switching Hub, 8(3), 2023, https://api.semanticscholar.org/CorpusID:266142926.
  3. W. L. Ng, G. L. Goh, G. D. Goh, J. S. J. Ten, and W. Y. Yeong, "Progress and Opportunities for Machine Learning in Materials and Processes of Additive Manufacturing," Advanced Materials, 2024, https://doi.org/10.1002/adma.202310006.
  4. R. Malhan and S. K. Gupta, "The Role of Deep Learning in Manufacturing Applications: Challenges and Opportunities," Journal of Computing and Information Science in Engineering, vol. 23, 2023, https://api.semanticscholar.org/CorpusID:259864135.
  5. H. Naveed et al., "A Comprehensive Overview of Large Language Models," 2024, https://doi.org/10.48550/arXiv.2307.06435.
  6. M. U. Hadi, Q. A. Tashi, R. Qureshi, et al., "Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects," TechRxiv, 2025, DOI: 10.36227/techrxiv.23589741.v8.
  7. X. Wang, N. Anwer, Y. Dai, and A. Liu, "ChatGPT for design, manufacturing, and education," Procedia CIRP 119, 7-14, 2023, https://doi.org/10.1016/j.procir.2023.04.001.
  8. M. Javaida, A. Haleema, R. Pratap Singh, "A study on ChatGPT for Industry 4.0: Background, potentials, challenges, and eventualities," Journal of Economy and Technology, 1, 127-143, 2023.https://doi.org/10.1016/j.ject.2023.08.00.
  9. V. Chamola, S. Sai, R. Sai, A. Hussain and B. Sikdar, "Generative AI for Consumer Electronics: Enhancing User Experience With Cognitive and Semantic Computing," in IEEE Consumer Electronics Magazine, 14(2), 10-19, 2025, doi: 10.1109/MCE.2024.3387049.
  10. F. Wang et al., "A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness," https://arxiv.org/pdf/2411.03350.
  11. C. V. Nguyen et al., "A Survey of Small Language Models," 2024, https://doi.org/10.48550/arXiv.2410.20011.
  12. R. O. Popov, N. V. Karpenko and V. V. Gerasimov, "Overview of small language models in practice," CS&SE@SW 2024: 7th Workshop for Young Scientists in Computer Science & Software Engineering, Kryvyi, Rih, Ukraine, 164-182, 2024.
  13. M. Aria and C. Cuccurullo, "bibliometrix: An R-tool for comprehensive science mapping analysis," Journal of Informetrics, 11(4), 959-975, 2016.
  14. S. Kernan Freire, C. Wang, M. Foosherian, S. Wellsandt, S. Ruiz- Arenas, and E. Niforatos, "Knowledge sharing in manufacturing using LLM-powered tools: user study and model benchmarking," Frontiers in Artificial Intelligence 7:1293084, 2024, doi: 10.3389/frai.2024.1293084.
  15. A. Chandrasekhar, J. Chan, F. Ogoke, O. Ajenifujah, and A. Barati Farimani, "AMGPT: A large language model for contextual querying in additive manufacturing," Additive Manufacturing Letters, vol. 11, 100232, 2024, ISSN 2772-3690, https://doi.org/10.1016/j.addlet.2024.100232.
  16. S. Badini, S. Regondi, E. Frontoni, and R. Pugliese, "Assessing the capabilities of ChatGPT to improve additive manufacturing troubleshooting," Advanced Industrial and Engineering Polymer Research, 6(3), 278-287, 2023, ISSN: 2542-5048, https://doi.org/10.1016/j.aiepr.20233.003.
  17. J. Lim, B. Vogel-Heuser, and I. Kovalenko, "Large Language Model- Enabled Multi-Agent Manufacturing Systems," 2024, https://doi.org/10.48550/arXiv.2406.01893.
  18. L. Makatura et al., "How Can Large Language Models Help Humans in Design And Manufacturing?," 2023, https://arxiv.org/pdf/2307.14377.
  19. Y. Li et al., "Large Language Models for Manufacturing," 2024, https://doi.org/10.48550/arXiv.2410.21418.
  20. Yuan, Zhe, Shi, Jianqi, Huang, Yanhong, "OpenECAD: An efficient visual language model for editable 3D-CAD design," Computers and Graphics (Pergamon), vol. 124, 2024, ISSN: 00978493, DOI: 10.1016/j.cag.2024.104048.

Issue

2025 10th International Conference on Smart and Sustainable Technologies, SpliTech 2025, pp. 1-4, 2025, Croatia, https://doi.org/10.23919/SpliTech65624.2025.11091684

Copyright IEEE

Вид: публикация в международен форум, публикация в реферирано издание, индексирана в Scopus