Troubleshooting Chatbots Applied to ATM Technical Maintenance Support: Comparison
Please note this is a comparison between Version 2 by Camila Xu and Version 1 by Nádila Silva Azevedo.

The banking industry has been employing artificial intelligence (AI) technologies to enhance the quality of its services. More recently, AI algorithms, such as natural language understanding (NLU), have been integrated into chatbots to improve banking applications. 

  • chatbot
  • automated teller machine
  • natural language processing
  • human computer interaction
  • dialogflow cx
  • retrieval based chatbot

1. Introduction

Financial institutions play a pivotal role in the economy by offering specialized services that diminish the cost of discovering savings and borrowing opportunities [1][2][3]. Moreover, these institutions accept deposits from savers and lend to borrowers, thereby promoting liquidity in the economy and facilitating financial activity. Furthermore, financial institutions function as a marketplace for money and assets, allowing capital to be efficiently allocated where it is most needed [1].
Banks represent the predominant type of financial institution, delivering essential services to society. They are integral to the perpetuation of commerce, offering financial support, facilitating payment transactions, and granting personal credit, thus catalyzing the expansion of both national and international trade [3].
The most recent Brazilian Federation of Banks (Febraban) statistics suggest that 76% of bank drafts occur through automated teller machines (ATMs) in Brazil [4]. An ATM is a device that facilitates financial transactions without the need for direct intervention by a bank agent. It encompasses numerous peripheral devices, including a monitor, keypad, card reader, bill dispenser, printers, and more complex modules. These may include devices employing special colored ink on banknotes in response to ATM attacks [5].
Bank branches may encounter challenges in providing satisfactory service when these machines malfunction, attributable to the time needed to engage a technician and rectify the issue. Therefore, maintaining ATM availability in bank branches presents a significant challenge in the banking industry, as they play a vital role in providing round-the-clock service to clients. Thus, ensuring that ATMs are consistently in optimal operating conditions to meet customers’ needs is of paramount importance [4].
The process of ATM maintenance for banks comprises two distinct levels of support: self-service and assisted service maintenance [6]. Bank agents are typically responsible for “self-service maintenance”, the primary level of maintenance, which involves performing fundamental maintenance tasks to ensure the ATM’s proper functioning. These tasks include replenishing the cash supply, rebooting the ATM to address minor technical issues, troubleshooting straightforward error messages, and replacing receipt paper. The primary maintenance level aims to tackle routine problems swiftly and efficiently, minimizing downtime and ensuring that the ATM remains operational for customers.
Implementing self-service maintenance can prove arduous for a bank agent. Optimally, the bank operator should endeavor to resolve the issue using fundamental knowledge before escalating the issue to more costly technical support. Regrettably, many bank agents lack the expertise to rectify basic ATM problems, resulting in bank branches struggling to maintain satisfactory ATM availability. Should the bank operator fail to rectify an ATM issue, technical support typically becomes necessary [6].
The second level, known as “assisted service maintenance”, is a technical level responsible for resolving more complex problems, such as hardware replacement. Technical support staff are highly trained and experienced, with the expertise to diagnose and repair any ATM issue [6].
This two-tiered approach to maintenance ensures that customers receive prompt and effective support, regardless of the nature of their problem. It minimizes downtime and enhances overall ATM performance, ensuring customers can access their banking services. However, with the advancement of the technologies embedded in ATMs, the complexity of installing internal equipment such as recycling modules and smart check deposits has increased. The maintenance of these devices has become more complex and operators often fail at self-service maintenance. This necessitates opening a service request for assisted service maintenance to resolve the ATM issue. In many cases, the call is unnecessary, and there is no real need to send a technician to maintain the equipment. Such erroneous calls generate unnecessary delays and cause equipment unavailability for customers [6].
These problems related to the two-tiered approach underscore the need for a more advanced solution to assist bank agents in resolving ATM-related issues. For the first level of assistance, it is crucial to acknowledge all the information needed to address the problem. Data structuring is fundamental to ensuring the bank agent executes the maintenance routine properly. Indeed, Cárcel-Carrasco and Cárcel-Carrasco [7] investigated the impact of organizing and making these records available to all collaborators through qualitative research. The results showed that knowledge management can optimize time and reduce maintenance costs and operating times. Based on these considerations, a pivotal aspect of the study revolves around the meticulous utilization of a meticulously curated dataset. This dataset has been constructed from a comprehensive knowledge database that is commonly utilized in the maintenance process. The dataset reflects the practical challenges and complexities users may encounter by encompassing real-world technical maintenance scenarios. This realism enhances the chatbot’s ability to effectively comprehend user queries and provide contextually accurate responses, thereby enhancing the user experience. Furthermore, the dataset plays a crucial role in training the intent recognition and entity recognition models, enhancing their performance. Finally, the dataset ensures greater accuracy and reliability in understanding and interpreting user requests by exposing the models to various technical maintenance-related intents, entities, and associations.
The bank agent is often unaware of the precise issues the ATM could encounter. However, it is possible to describe the abnormalities which shape the conversation’s context. Given these circumstances, determining an approach to address this barrier is necessary.
Artificial intelligence (AI) solutions can be employed to improve the efficiency and effectiveness of ATM maintenance processes at the first level, which is handled by nontechnical operators [8]. In modern banking, many new digital technologies have been driven by AI at their core. This has led to innovative disruptions of banking channels, such as automated teller machines, online banking, and mobile banking. It has also transformed services such as check imaging, voice recognition, chatbots, and solutions such as AI investment advisors and AI credit selectors [9].
Chatbots’ application in this sector is an emerging trend. According to Febraban, chatbots, and virtual assistants have become increasingly popular in the banking sector [4]. AI-based chatbot technology is a noteworthy and popular development in the financial industry. Numerous approaches exist to create these systems, one of which is through closed platforms. These platforms offer the advantage of utilizing state-of-the-art technologies, reducing development time and offering the flexibility to build complex conversations [10][11]. Moreover, these platforms have allowed the construction of information retrieval chatbots, which do not generate answers at run time but retrieve predefined textual data [12].
Named entity recognition (NER) and intent recognition (IR) are essential components of natural language understanding (NLU) in chatbots [13][14]. Identifying specific entities and user intent enables chatbots to deliver personalized and relevant responses, leading to a better user experience. NER and IR are typically achieved through machine learning algorithms. These algorithms can analyze patterns in language and map them to predefined categories, allowing chatbots to interpret user inputs quickly and accurately.
The Google Dialogflow CX (Customer Experience) framework, a platform utilized for the development of AI-powered chatbots, plays a pivotal role in the research [15]. This framework was deliberately chosen for its robust AI capabilities, notably its incorporation of bidirectional encoder representation from transformers (BERT) for the training of information retrieval (IR) and named entity recognition (NER) models [16]. The purpose of employing this framework lies in its ability to facilitate the modeling and maintenance of virtual agents across various tasks. This includes but is not limited to, healthcare management and appointment scheduling, thereby enhancing the scope and efficiency of the study [15].

2. BackgTrounbleshooting Chatbots Applied to ATM Technical Maintenance Support

2.1. Natural Language Understanding

Natural language understanding (NLU) is a subfield of artificial intelligence (AI) that aims to enable machines to comprehend and analyze natural language based on concepts, entities, sentiments, and keywords [17] using machine learning and natural language processing (NLP) techniques. At the core of most chatbot applications lies NLU [18]. Chatbots need to allow the extraction of structured information from natural language inputs with unstructured semantic inputs, such as natural language inputs [19]. Nevertheless, developing an entire NLU system is challenging and expensive; therefore, the standard market practice consists of employing NLU solutions to create chatbots [20][21]. In the context of chatbots, NLU is utilized to analyze the question asked by the user and complete their requests [11]. To achieve this, NLU extracts domain-specific entities and intents from a text. Intents are the intentions or purposes with which the user asks a question. Intent recognition (IR) is a crucial component of NLU that involves identifying the intent behind a user’s query [22]. Named entity recognition (NER) is another subtask of NLU that includes identifying and categorizing named entities in text or speech. Named entities are objects, people, locations, organizations, and other entity names in natural language [23][24]. To illustrate this with an example, consider the ATM maintenance process. In this context, the words “on” and “off” are classified as entities representing the status of a red LED on the receipt printer. These entities might carry different implications in different scenarios, highlighting the importance of context in NLU. Now, when a user inputs “The LED is on”, the NLU system springs into action. The intent recognition (IR) component identifies the intent of the user’s message—in this case, to report the status of the LED. Concurrently, the named entity Recognition (NER) component pinpoints the word “on” as an entity specifying the LED’s current status. By utilizing these entities and intents, an NLU engine can generate a targeted response that can efficiently assist users with their queries [25]. Thus, IR and NER—intent and entity recognition—form the twin pillars of NLU. Their applications are extensive, ranging from information extraction and text understanding to the creation of knowledge bases [24].

2.2. Virtual Assistant Types

When developing chatbots, it is crucial to consider the criteria for classification. The classification standards include the objectives, development techniques, communication style, and knowledge domain [26]. Additionally, some authors Adamopoulou and Moussiades [10] define criteria based on the platforms utilized to build a chatbot. They can be either from closed or open platforms. One of the most popular frameworks from a closed platform for developing conversational agents is Google Dialogflow CX, which offers a range of features for designing, building, and deploying conversational experiences. Regarding the development method, the authors divide the types of chatbots between rule-based, also known as template-based [27], and AI-based [12][28]. Furthermore, AI-based chatbots can be further categorized into retrieval-based and general-based chatbots [10][12]. Rule-based chatbots, also known as pattern-matching chatbots, are a type of chatbot architecture that utilizes a set of predefined rules and patterns to generate responses to user input [29]. They are simple and easy to design and implement and perform effectively for structured tasks with a limited range of possible inputs [12], providing prompt and precise responses to user queries and requests; moreover, they do not require abundant training data availability or machine learning algorithms. The predefined rules and patterns that generate responses are typically created by experts and cover a range of possible user inputs and scenarios. When a user enters a query or request, the chatbot matches the input against the predefined rules and patterns to determine the appropriate response. Therefore, this model is not robust against spelling or grammatical errors from the user [10], and it may struggle with more complex tasks that require understanding context, nuances, and natural language, as they are unable to learn from new inputs or adapt to new situations. Rule-based chatbots are best suited for specific and repetitive tasks, such as customer service inquiries or FAQ support, that employ a question-answering chatbot [13]. Singh et al. [30] and Vishwakarma [31] present examples of these types of chatbots. Considering AI-based chatbots, virtual assistants are categorized based on their information processing and response generation techniques. This section discusses two types of chatbots: (i) retrieval-based and (ii) generative models. This information is relevant for selecting the appropriate virtual assistant architecture for a specific task, thus enhancing performance. Retrieval and generative models are the two main categories into which AI can be further classified. AI models are based on machine learning algorithms, allowing them to learn from an existing database of human conversations [12]. Retrieval-based chatbots are the first type of AI-based chatbots, with an architecture that uses a predefined set of responses to generate a response to user input. They typically employ keyword matching and similarity measures to select the best answer from a predefined set. As a result, they only need a small amount of training data or limited use of complicated machine learning algorithms, and they can handle a wide range of user inputs. However, retrieval-based chatbots may need help with more complex tasks that require context, nuance, and natural language understanding. For example, suppose they are still looking for a suitable answer in their predefined set. In that case, they may respond with generic or unhelpful responses. Retrieval-based chatbots are primarily designed to handle operational problems, particularly those related to troubleshooting, by efficiently retrieving and providing relevant information for customer support and other service-oriented tasks that require a prompt and accurate response [10][28][32][33]. The second type of AI-based chatbot, generative chatbot, utilizes natural language generation (NLG) techniques to generate responses to user inputs. In contrast to rule-based and retrieval-based chatbots, generative chatbots do not rely on predefined responses or rules. Instead, they produce responses based on their understanding of the input and the context. They use machine learning algorithms, such as deep learning, to analyze large amounts of data and learn how to generate human-like responses. They can understand and create natural language queries and handle a variety of inputs, including ambiguous or incomplete entries. Generative chatbots often tackle more complex tasks, such as providing recommendations or advice, engaging in conversation, and entertainment. In Kapočiūtė-Dzikienė [34], the applications of these chatbots are illustrated.

2.3. Dialogflow

Currently, Google provides two closed platforms for chatbot development: Dialogflow ES and Dialogflow CX. “CX” stands for Customer Experience, while “ES” stands for Essentials. Although both versions provide tools to design VA, Dialogflow CX has functionalities to construct more complex conversational systems. Google Dialogflow CX allows the creation, management, and development of conversational applications, such as chatbots and virtual assistants. It is easy to use and enables the construction of complex interactions with the user. Dialogflow CX presents an innovative approach to agent creation using state machine-based design. The tool gives precise and defined control over the conversation, improving the end user experience and simplifying the development process [15]. The following topics describe the components of Dialogflow CX [15]:
  • Agents: These are responsible for processing the simultaneous conversations with the end user. An agent performs the natural language processing and understanding of the varieties of human language. It is based on a state machine architecture, which allows developers to explicitly and thoroughly control the conversation to create personalized and enhanced conversation experiences for their users. In addition, the agent allows adding context to the conversation, which can help improve the accuracy of the agent’s responses.
  • Flows: These define conversation topics and the associated conversation paths. Each agent has an initial default flow. A dialog flow represents a sequence of interactions between the user and the virtual assistant. These flows allow you to define a series of questions and answers to guide the conversation with the user and conditions to direct the conversation to different paths according to the user’s responses.
  • Pages: These group intentions into a more organized and manageable structure. They act as a container for related intents, allowing them to manage and edit intents more efficiently. Pages are beneficial in more complex conversations with many interconnected intentions and dialog flows. They help keep them organized and easy to manage, making it easier to edit and manage the conversation model. Pages also allow for the sharing of intentions and dialog flows between multiple virtual assistants or applications, which is especially useful when consistency across numerous user communication channels is desired.
  • Event-Handler: In Dialogflow, event-handlers are actions triggered by the user’s entry or for an event in the application's backend. It uses an event-handler to give a user response every time a piece of information is not matched. This could be an intent or entity.
  • Intents: These represent the user’s intent in a conversation. They are defined based on sample input sentences that the user may submit and help Dialogflow understand what the user is trying to achieve or ask. Each intent represents a specific action the user wants to perform, such as making a reservation at a restaurant, getting weather information, or asking for help with a task. Dialogflow uses these intentions to steer the conversation with the user toward the correct answer. In addition, intents can also include variables, known as parameters, that help capture specific information from the user, such as the date or location of a reservation. These variables allow Dialogflow to personalize its response to the user, making the conversation more effective and relevant. Finally, intentions in Dialogflow enable the model to understand what the user is trying to achieve or ask and steer the conversation to the correct response based on the customization of variables.
  • Entities: These represent specific and relevant information for the conversation, such as names of people, places, dates, and times. They extract relevant information from the user’s input sentences and store them as variables, which helps customize the virtual assistant’s responses. There are many types of predefined entities in Dialogflow, such as date, time, number, address, and custom entities; they represent specific information for an application. Additionally, entities can also be utilized to define patterns of phrases and expected behaviors for different types of information, such as names of people or addresses. This helps Dialogflow understand user input sentences more accurately and efficiently.
  • Contexts: These help to maintain the conversation context between the user and the chatbot. They are utilized to remember relevant information and make it available throughout the conversation. For example, if the user is having issues with an ATM, the conversation context can include information about the type of transaction they are trying to perform and the date and time of the issue. This information can be employed to provide a more precise and relevant solution to the user. Contexts are also fundamental for controlling the flow of the conversation and preventing the virtual assistant from getting stuck on a specific task or question. For instance, if the user changes the subject, the context can be altered to reflect the new topic of the conversation.

2.4. Evaluation of Chatbots

There is no established standard evaluation protocol for chatbots. A brief investigation was conducted to define the evaluation strategies. There are several strategies to measure the performance of chatbots. They can be one of two categories: human evaluation, which involves analyzing user feedback, and automated evaluation, which uses metrics such as precision, recall, and F1-score to evaluate the chatbot’s classification abilities. Even though human evaluation is valuable, it can be expensive and time-consuming [12]. Another metric is the exact match accuracy, which evaluates the IR and NER together [35]. This metric refers to the number of times a chatbot correctly identifies the user’s intent and any relevant entities mentioned in their input as compared to the total count of inputs. The chatbot background is the IR and NER algorithms that can be evaluated as any other machine learning classifier. The metrics for automated evaluation utilize the frequency of true positives (𝑇𝑃𝑠), true negatives (𝑇𝑁𝑠), false positives 𝐹𝑃𝑠, and false negatives (𝐹𝑁𝑠), which are terms used to describe the occurrence of correct (𝑇𝑃) and incorrect (𝐹𝑃) predictions for a given class.

3.1. General Chatbot Applications

One of the most significant contributions to the development of chatbots with NLP features was the Eliza program, created by Weizenbaum in 1966 [36]. The operation of this chatbot involves analyzing keywords within the user’s input and matching them against predefined rules. While this approach made a notable contribution for its time, it had limitations in understanding contextual information. Other programs that became part of the first generation of chatbots include Parry [37] and A.L.I.C.E [38]. In Singh and Thakur [29], yeung Shum et al. [39], the authors demonstrate the increasing popularity of this technology that has been seen in multiple applications created since then. The rising generation of digital assistants has been applied in distinct scenarios, such as e-commerce, e-learning, healthcare, and the industrial sector, to improve efficiency and enhance user experience. In the e-commerce industry, brands are adopting chatbots to increase and engage customers, as evidenced in [40][41]. In the research conducted by Khan [42], an e-commerce sales chatbot platform is proposed to provide customer support. The project comprises five distinct modules, each playing a pivotal role in the overall system. Notably, the NLU engine assumes a particularly critical position within this framework. While this work provides a comprehensive overview of the system architecture, it, unfortunately, lacks detailed information regarding the performance evaluation of the NLU engine utilized in the chatbot. A comprehensive evaluation encompassing the entire system would be highly valuable in order to gain deeper insights into its overall effectiveness and capabilities. By reducing the need for human presence in situations involving the COVID-19 pandemic, as shown by Amiri and Karahanna [43], the assistance capacity of this tool is expressed in various use cases ranging from scheduling vaccines to disseminating information about the coronavirus. E-learning [44] is a promising area where a chatbot can be applied. Huang et al. [45] extensively reviewed the impact and relevance of integrating chatbots in education, highlighting the technological affordances that make them an attractive tool for the field. Instances of this application can be seen in the industrial sector, where chatbots have been acting as instructors for workers. Casillo et al. [46] propose an approach regarding the training of new workers carried out by a virtual assistant prototype and reports results demonstrating that this system’s advantage is the reduction of the learning process. In this aspect, Colabianchi et al. [47] also present a point of view related to the role of chatbots as mentors with Popeye, a chatbot that trains new employees in container inspection.

3.2. Troubleshooting Chatbots

The domain of maintenance represents a field where chatbots have been employed. Troubleshooting chatbots are designed to identify and solve technical issues. They aim to provide efficient and effective technical support by identifying and addressing common problems. Chatbots as technical assistants is a topic explored by Alhassan et al. [48], in which the authors proposed a methodology for an IT chatbot framework to assist common IT problems. Despite the demonstrated merits of incorporating chatbots in the troubleshooting domain, this study lacks empirical data pertaining to the chatbot’s efficacy in effectively discerning and comprehending user descriptions to receive the appropriate procedure. Another application of chatbots regarding the maintenance process can be seen in [49] where the chatbot, Telmi, is responsible for providing customer support for troubleshooting tasks. This work shows the number of issues resolved by the chatbot and the characteristics of the problems that were not. One of the traits that characterized the issues that the chatbot could not address was the difficulty in identifying the intent resulting in a higher level of FN. This result highlights the importance of creating a well-constructed training dataset to maximize evaluation metrics effectively. Previous works only presented the accomplished results without explaining the methodology of transforming the knowledge database into a chatbot with artificial intelligence [42][46][47][48][49]. Additionally, the works are poor in evaluation metrics. Finally, prior research does not cover the experimental protocol to assess chatbots [23][50]. To the best of researchers' understanding of the methodologies for developing chatbots, transmuting an automated teller machine (ATM) maintenance knowledge base into a chatbot remains largely uncharted territory [12][51][52]. This presents numerous opportunities for further exploration and innovation in this sphere [46]. Moreover, existing methodologies have been predominantly tailored for different application contexts [47], resulting in a noticeable scarcity of direct comparisons in the context of ATM maintenance [48][49]. Consequently, it is imperative to conduct a thorough examination of the available methodologies [46][47] and to evaluate the ramifications of adapting these methodologies within the specific milieu of ATM maintenance [42][50]. The research work of [53] focuses on meticulously modeling a specific process within a business process model and notation (BPMN) framework and subsequently transforming it comprehensively into a functional chatbot. The primary transformation pipeline encompasses several key components. Initially, a graph normalization block is employed to load the BPMN diagram and ensure the structural integrity of the graph. Subsequently, a label processing block gathers the linguistic information inherent to the model. Furthermore, a dialog graph construction block generates finite state automata (FSA) based on the BPMN model governing conversational transitions. A natural language generator (NLG) produces chatbot responses by generating text based on each node of the BPMN model. Finally, the encoded FSA is integrated into an AIML engine for subsequent processing. While the methodology for chatbot development is commendable, its application to an ATM maintenance knowledge base reveals significant drawbacks. The current structure of a bank agency knowledge base, primarily comprising text-based procedures and specific information, necessitates better alignment with the node-based representation of the BPMN model. This misalignment poses challenges in accurately mapping content, resulting in incomplete or oversimplified representations within the chatbot. Additionally, the BPMN model’s lack of granularity limits its ability to capture intricate troubleshooting steps, diminishing the effectiveness of the generated chatbot. Another noteworthy drawback to consider is the inherent limitation in capturing and preserving critical information from the conversation efficiently. Such content registration holds utmost significance, as it plays a pivotal role in the maintenance process, precisely determining the appropriate execution of procedures based on the key elements discussed within the conversation. Although the application does not primarily focus on the educational field, it is pertinent to acknowledge that existing methodologies employed in developing educational chatbots incorporate the concept of a virtual assistant. A notable example can be found in the work of [54], where a methodology for constructing a conversational chatbot tutor is proposed. This approach leverages the application of first-order logic, which serves as a formal language specialized in inference and symbolic representation of knowledge, to delineate the chatbot’s knowledge base. Nonetheless, the utilization of this methodology for implementing and troubleshooting chatbots within the specific context would present inherent challenges. The inadequacy of first-order logic in comprehensively capturing the intricacies and complexities inherent in natural language poses a significant hurdle. Given that the maintenance process necessitates interactions with users who may articulate their issues or queries differently, first-order logic, although proficient in representing rudimentary relationships and logical operations, may encounter difficulties when faced with more intricate or ambiguous scenarios. Consequently, this limitation could impede the chatbot’s ability to handle diverse user queries and effectively provide appropriate responses. The third analyzed methodology was the work of [55], which demonstrates the integration of an ontology and a knowledge base to develop an efficacious programming assistant chatbot. First, the authors introduce the Rela-Model, an ontology that organizes the knowledge base, precisely delineating the interrelations between programming concepts and the pre-established rules governing inferential processes. Then, to support its functionality, this model is amalgamated with a meticulously structured repertoire of scripts, encompassing five key components: script nomenclature, related content, an array of interrogatives and corresponding responses, and a set of rules meticulously employed for question selection within the script for the chatbot. This systematic procedure forms the bedrock of knowledge base construction for a question-and-answer-oriented chatbot. Furthermore, it is pertinent to note that chatbots reliant upon ontology-based systems often require users to articulate queries utilizing terminology or expressions that align with the ontology’s lexical framework.

3.3. Banking Assistants

Virtual assistants are increasingly being utilized to provide customers with prompt and personalized responses to their queries, enhancing the overall customer experience [56]. Therefore, recent research has focused on developing and improving virtual banking assistants to serve customers better. Several scholars have proposed and evaluated dialogue systems in the banking industry to improve customer service and satisfaction. Rustamov et al. [57] developed and evaluated several dialog management pipelines to verify the most suitable one for application in a banking context. The primary objective of this research was to investigate the dialogue manager and NLU components. A comprehensive experiment was conducted involving the utilization of fastText, an open-source library widely employed for text classification, and custom machine learning models trained on a specialized banking dataset. The experimental findings clearly indicated that the custom machine learning models outperformed fastText in terms of accuracy. Another field of research concerns investigating the impact of virtual banking assistants on customer engagement and satisfaction to comprehend the significant role that chatbots play in the banking industry, as evidenced in [58]. Furthermore, customer acceptance is a crucial factor to consider when implementing chatbots in the banking industry. Alt et al. [59] have identified several key factors that can increase chatbots’ appeal to customers and enhance their usage. While their work effectively highlights the substantial presence of virtual banking assistants catering to customer needs, it regrettably overlooks the mention of any applications specifically pertaining to troubleshooting chatbots for agent banks. This conspicuous absence suggests that the domain of this category of chatbots remains largely unexplored, presenting an as-yet uncharted domain, which holds promise for future research and development endeavors. The applications mentioned above demonstrate the indispensability of chatbots in the banking industry. With their ability to provide personalized and efficient customer service, chatbots are valuable assets in improving customer satisfaction and loyalty.

3.4. Virtual Assistants Using Dialogflow

Dialogflow has been widely applied in various scenarios due to its diverse range of tools that enable developers to construct complex conversational agents. Dhavan [21] developed a chatbot system with Dialogflow ES to detect possible heart attack symptoms through the user-provided description, which was collected using entity parameters. The user provides inputs regarding factors such as the severity of chest pain or breathing difficulties, among other pertinent details. After the patient submits the descriptions of their symptoms, the chatbot prompts the user to complete a questionnaire. Subsequently, these data are forwarded to a support vector machine model, which carries out the prediction. The evaluation metrics employed were accuracy (0.824), precision (0.843), and recall (0.843). Although the results appear promising, it is imperative to emphasize the criticality of ensuring precise responses for a medical tool to provide accurate responses. Therefore, the metrics results should exceed a threshold of 0.9. Furthermore, the intents and entities utilized to retain the conversation context could also have been evaluated, as the chatbot’s ability to deliver appropriate responses to the user is contingent upon the effective performance of these evaluative measures. Muhammad et al. [63] demonstrate a conversational tool that facilitates English language learning for students, utilizing Dialogflow ES and incorporating an English conversation book as its knowledge base. Additionally, entity extraction techniques were utilized to retain essential information from user responses. Dall’Acqua and Tamburini [60] employed the latest Dialogflow (Dialogflow CX) to develop a conversational agent capable of delivering standard customer services such as subscription, instruction for download, and discounts after receiving a user query. To recognize user input, this author used intent recognition and NER to collect relevant information and define the conversational context.

References

  1. Korkmaz, S. Impact of bank credits on economic growth and inflation. J. Appl. Financ. Bank. 2015, 5, 51–69.
  2. Petkovski, M.; Kjosevski, J. Does banking sector development promote economic growth? An empirical analysis for selected countries in Central and South Eastern Europe. Econ. Res.-Ekon. Istraž. 2014, 27, 55–66.
  3. Nguyen, P.T. The Impact of Banking Sector Development on Economic Growth: The Case of Vietnam’s Transitional Economy. J. Risk Financ. Manag. 2022, 15, 358.
  4. Deloitte; Federação Brasileira de Bancos (FEBRABAN). Pesquisa FEBRABAN de Tecnologia Bancária 2022—Volume 3 Transações Bancárias. 2022. Available online: https://cmsarquivos.febraban.org.br/Arquivos/documentos/PDF/pesquisa-febraban-2022-vol-3.pdf (accessed on 26 February 2023).
  5. Wang, Y.; Zhang, Y.; Sheu, P.C.; Li, X.; Guo, H. The Formal Design Model of an Automatic Teller Machine (ATM). Int. J. Softw. Sci. Comput. Intell. 2010, 2, 102–131.
  6. Diebold Nixdorf. Self-Service Reloaded: How Industry Leaders Maximize Customer Engagement and Strategic ROI; Diebold Nixdorf: Green, OH, USA, 2019; Volume 1, pp. 1–42.
  7. Cárcel-Carrasco, J.; Cárcel-Carrasco, J.A. Analysis for the knowledge management application in maintenance engineering: Perception from maintenance technicians. Appl. Sci. 2021, 11, 703.
  8. Tripathi, S.; Garg, R.; Varshini, K. Role of Artificial Intelligence in the Banking Sector. Int. J. Res. Publ. Rev. J. 2022, 3, 433–442.
  9. Dobrescu, E.M.; Dobrescu, E.M. Artificial intelligence (AI)-the technology that shapes the world. Glob. Econ. Obs. 2018, 6, 71–81.
  10. Adamopoulou, E.; Moussiades, L. Chatbots: History, technology, and applications. Mach. Learn. Appl. 2020, 2, 100006.
  11. Borah, B.; Pathak, D.; Sarmah, P.; Som, B.; Nandi, S. Survey of textbased chatbot in perspective of recent technologies. In Computational Intelligence, Communications, and Business Analytics, Proceedings of the Second International Conference, CICBA 2018, Kalyani, India, 27–28 July 2018; Revised Selected Papers, Part II 2; Springer: Singapore, 2019; pp. 84–96.
  12. Caldarini, G.; Jaf, S.; McGarry, K. A literature survey of recent advances in chatbots. Information 2022, 13, 41.
  13. Ramesh, K.; Ravishankaran, S.; Joshi, A.; Chandrasekaran, K. A survey of design techniques for conversational agents. In Information, Communication and Computing Technology, Proceedings of the Second International Conference, ICICCT 2017, New Delhi, India, 13 May 2017; Revised Selected Papers; Springer: Singapore, 2017; pp. 336–350.
  14. Nadeau, D.; Sekine, S. A survey of named entity recognition and classification. Lingvisticae Investig. 2007, 30, 3–26.
  15. Google LLC. Dialogflow CX Documentation. 2021. Available online: https://cloud.google.com/dialogflow/cx/docs (accessed on 26 February 2023).
  16. Devlin, J.; Chang, M.; Lee, K.; Toutanova, K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv 2018, arXiv:1810.04805.
  17. Khurana, D.; Koli, A.; Khatter, K.; Singh, S. Natural language processing: State of the art, current trends and challenges. Multimed. Tools Appl. 2023, 82, 3713–3744.
  18. Abdellatif, A.; Badran, K.; Costa, D.E.; Shihab, E. A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineering. IEEE Trans. Softw. Eng. 2022, 48, 3087–3102.
  19. Braun, D.; Mendez, A.H.; Matthes, F.; Langen, M. Evaluating natural language understanding services for conversational question answering systems. In Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, Saarbrücken, Germany, 15–17 August 2017; pp. 174–185.
  20. Godse, N.A.; Deodhar, S.; Raut, S.; Jagdale, P. Implementation of chatbot for ITSM application Using IBM watson. In Proceedings of the 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA), Pune, India, 16–18 August 2018; pp. 1–5.
  21. Dhavan, S. Smart Medicare Chatbot Using Dialogflow and Support Vector Machine Algorithm. Int. J. Res. Appl. Sci. Eng. Technol. 2021, 9, 1848–1860.
  22. Suhaili, S.M.; Salim, N.; Jambli, M.N. Service chatbots: A systematic review. Expert Syst. Appl. 2021, 184, 115461.
  23. Mohit, B. Named entity recognition. In Natural Language Processing of Semitic Languages; Springer: Berlin/Heidelberg, Germany, 2014; pp. 221–245.
  24. Li, J.; Sun, A.; Han, J.; Li, C. A Survey on Deep Learning for Named Entity Recognition. IEEE Trans. Knowl. Data Eng. 2022, 34, 50–70.
  25. Zubani, M.; Sigalini, L.; Serina, I.; Putelli, L.; Gerevini, A.E.; Chiari, M. A performance comparison of different cloud-based natural language understanding services for an Italian e-learning platform. Future Internet 2022, 14, 62.
  26. Hussain, S.; Ameri Sianaki, O.; Ababneh, N. A survey on conversational agents/chatbots classification and design techniques. In Web, Artificial Intelligence and Network Applications, Proceedings of the Workshops of the 33rd International Conference on Advanced Information Networking and Applications (WAINA-2019), Matsue, Japan, 29 March 2019; Springer: Cham, Switzerland, 2019; pp. 946–956.
  27. Luo, B.; Lau, R.Y.; Li, C.; Si, Y.W. A critical review of state-of-the-art chatbot designs and applications. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 2022, 12, e1434.
  28. Thorat, S.A.; Jadhav, V. A Review on Implementation Issues of Rule-based Chatbot Systems. SSRN Electron. J. 2020.
  29. Singh, S.; Thakur, H.K. Survey of various AI chatbots based on technology used. In Proceedings of the 2020 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Noida, India, 4–5 June 2020; pp. 1074–1079.
  30. Singh, J.; Joesph, M.H.; Jabbar, K.B.A. Rule-based chabot for student enquiries. J. Phys. Conf. Ser. 2019, 1228, 012060.
  31. Vishwakarma, A. A Review & Comparative Analysis on Various Chatbots Design. Int. J. Comput. Sci. Mob. Comput. 2021, 10, 72–78.
  32. Hien, H.T.; Cuong, P.N.; Nam, L.N.H.; Nhung, H.L.T.K.; Thang, L.D. Intelligent assistants in higher-education environments: The FIT-EBot, a chatbot for administrative and learning support. In Proceedings of the 9th International Symposium on Information and Communication Technology, Danang City, Vietnam, 6–7 December 2018; pp. 69–76.
  33. Suta, P.; Lan, X.; Wu, B.; Mongkolnam, P.; Chan, J.H. An overview of machine learning in chatbots. Int. J. Mech. Eng. Robot. Res. 2020, 9, 502–510.
  34. Kapočiūtė-Dzikienė, J. A Domain-Specific Generative Chatbot Trained from Little Data. Appl. Sci. 2020, 10, 2221.
  35. Larson, S.; Leach, K. A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialog. arXiv 2022, arXiv:2207.13211.
  36. Weizenbaum, J. ELIZA—A computer program for the study of natural language communication between man and machine. Commun. ACM 1966, 9, 36–45.
  37. Huesmann, L.R.; Schank, R.C.; Colby, K.M. Computer Models of Thought and Language. Am. J. Psychol. 1974, 87, 751–754.
  38. Wallace, R.S. The Anatomy of A.L.I.C.E.; Springer: Dordrecht, The Netherlands, 2009; pp. 181–210.
  39. yeung Shum, H.; dong He, X.; Li, D. From Eliza to XiaoIce: Challenges and opportunities with social chatbots. Front. Inf. Technol. Electron. Eng. 2018, 19, 10–26.
  40. Chung, M.; Ko, E.; Joung, H.; Kim, S.J. Chatbot e-service and customer satisfaction regarding luxury brands. J. Bus. Res. 2020, 117, 587–595.
  41. Landim, A.R.D.B.; Pereira, A.M.; Vieira, T.; de B. Costa, E.; Moura, J.A.B.; Wanick, V.; Bazaki, E. Chatbot design approaches for fashion E-commerce: An interdisciplinary review. Int. J. Fash. Des. Technol. Educ. 2022, 15, 200–210.
  42. Khan, M.M. Development of an e-commerce sales Chatbot. In Proceedings of the 2020 IEEE 17th International Conference on Smart Communities: Improving Quality of Life Using ICT, IoT and AI (HONET), Charlotte, NC, USA, 14–16 December 2020; pp. 173–176.
  43. Amiri, P.; Karahanna, E. Chatbot use cases in the Covid-19 public health response. J. Am. Med. Inform. Assoc. 2022, 29, 1000–1010.
  44. Sangrà, A.; Vlachopoulos, D.; Cabrera, N. Building an inclusive definition of e-learning: An approach to the conceptual framework. Int. Rev. Res. Open Distrib. Learn. 2012, 13, 145–159.
  45. Huang, W.; Hew, K.F.; Fryer, L.K. Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. J. Comput. Assist. Learn. 2022, 38, 237–257.
  46. Casillo, M.; Colace, F.; Fabbri, L.; Lombardi, M.; Romano, A.; Santaniello, D. Chatbot in industry 4.0: An approach for training new employees. In Proceedings of the 2020 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), Takamatsu, Japan, 8–11 December 2020; pp. 371–376.
  47. Colabianchi, S.; Bernabei, M.; Costantino, F. Chatbot for training and assisting operators in inspecting containers in seaports. Transp. Res. Procedia 2022, 64, 6–13.
  48. Alhassan, N.A.; Albarrak, A.S.; Bhatia, S.; Agarwal, P. A Novel Framework for Arabic Dialect Chatbot Using Machine Learning. Comput. Intell. Neurosci. 2022, 2022, 1844051.
  49. Følstad, A.; Taylor, C. Conversational repair in chatbots for customer service: The effect of expressing uncertainty and suggesting alternatives. In Chatbot Research and Design, Proceedings of the Third International Workshop, CONVERSATIONS 2019, Amsterdam, The Netherlands, 19–20 November 2019; Revised Selected Papers 3; Springer: Cham, Switzerland, 2020; pp. 201–214.
  50. Mleczko, K. Chatbot as a Tool for Knowledge Sharing in the Maintenance and Repair Processes. Multidiscip. Asp. Prod. Eng. 2021, 4, 499–508.
  51. Lin, C.C.; Huang, A.Y.; Yang, S.J. A review of ai-driven conversational chatbots implementation methodologies and challenges (1999–2022). Sustainability 2023, 15, 4012.
  52. Trivedi, A.; Gor, V.; Thakkar, Z. Chatbot generation and integration: A review. Int. J. Adv. Res. Ideas Innov. Technol. 2019, 5, 1308–1311.
  53. López, A.; Sànchez-Ferreres, J.; Carmona, J.; Padró, L. From process models to chatbots. In Advanced Information Systems Engineering, Proceedings of the 31st International Conference, CAiSE 2019, Rome, Italy, 3–7 June 2019; Proceedings 31; Springer: Cham, Switzerland, 2019; pp. 383–398.
  54. Sánchez-Díaz, X.; Ayala-Bastidas, G.; Fonseca-Ortiz, P.; Garrido, L. A knowledge-based methodology for building a conversational chatbot as an intelligent tutor. In Advances in Computational Intelligence, Proceedings of the 17th Mexican International Conference on Artificial Intelligence, MICAI 2018, Guadalajara, Mexico, 22–27 October 2018; Proceedings, Part II 17; Springer: Cham, Switzerland, 2018; pp. 165–175.
  55. Nguyen, H.; Tran, T.V.; Pham, X.T.; Huynh, A.T.; Do, N. Ontology-based integration of knowledge base for building an intelligent searching chatbot. Sens. Mater. 2021, 33, 3101–3123.
  56. Sarbabidya, S.; Saha, T. Role of chatbot in customer service: A study from the perspectives of the banking industry of Bangladesh. Int. Rev. Bus. Res. Pap. 2020, 16, 231–248.
  57. Rustamov, S.; Bayramova, A.; Alasgarov, E. Development of dialogue management system for banking services. Appl. Sci. 2021, 11, 995.
  58. Fares, O.H.; Butt, I.; Lee, S.H.M. Utilization of artificial intelligence in the banking sector: A systematic literature review. J. Financ. Serv. Mark. 2022.
  59. Alt, M.A.; Vizeli, I.; Săplăcan, Z. Banking with a Chatbot – A Study on Technology Acceptance. Stud. Univ. Babes-Bolyai Oecon. 2021, 66, 13–35.
  60. Dall’Acqua, A.; Tamburini, F. Implementing a Pragmatically Adequate Chatbot in DialogFlow CX. In Proceedings of the CLiC-it, Milan, Italy, 26–28 January 2021.
More
Video Production Service