key: cord-0705393-28ubdsha authors: Wassan, Sobia; Shen, Tian; Xi, Chen; Gulati, Kamal; Vasan, Danish; Suhail, Beenish title: Customer Experience towards the Product during a Coronavirus Outbreak date: 2022-02-02 journal: Behav Neurol DOI: 10.1155/2022/4279346 sha: a881ca24c22915e2f817d38d51732819c4d2bb1b doc_id: 705393 cord_uid: 28ubdsha Nowadays, sentimental analysis of consumers' review is becoming much crucial in the marketing world. It is not just giving ideas to the firms that how consumers like their product or service, but it would also help them make their service better. In this article, the statistical method identifies the relationship of many factors in consumer feedback. It introduces a deep-based learning method called DSC (deep sentiment classifier) to determine whether or not to recommend the reviewed product thoroughly. Our suggested method also investigates the effect sizes of the feedback, such as positives, negatives, and neutrals. We used the women's clothing review dataset containing 22,642 records after preprocessing of the results. Experimental studies show that the recommendations are an excellent positive sentiment indicator. In comparison, ratings become fuzzy performance metrics in product reviews. The 10-fold cross-validation analysis shows that the recommended form has the top F1 score (93.56%) in the sentimental classification on average and the recommended classification (88.32%) on average. A comparative description of other classifiers focused on machine learning, for example, KNN, random forest, logistic regression, decision tree, support vector machine multilayer perceptron, and naïve Bayes, also demonstrates that DSC gives the best possible result. We have tested DSC on the dataset IMDB (Internet Video Database), which includes the sentiment of the 50,000 movie reviews (25000 for training and 25000 for testing). In comparison to other baseline methods, DSC obtained an excellent classification score for this experiment. The study of emotions is a tactic of understanding the ideas, feelings, and expectations expressed in the text feature or the level of a sentence in a given text [1] . Today, enterprises use sites such as Twitter, forums, and blogs as reliable platforms to understand their consumers' expectations and improve their services. Sentiment analysis has become an attractive research field for collecting and assessing thoughts, feelings, and behaviours from sources of language, expression, and datasets that tally to how people respond to a given problem or event [2, 3] . Understanding consumer preferences based on the results of sentiment analysis will boost the industry world [4] . Nowadays, text mining is one of the most considered problems in the area defined above, a technique used to manually or automatically classify text. To address this gap, many studies have been investigated using sentiment analysis to interpret the comments found in chat forums, social media, and review pages [5] [6] [7] . Companies have frequently used the task described above to understand investors through their social media customer service teams. In particular in e-commerce review analyses, there are three crucial approaches for assessing sentimental analysis: Lexical analysis: this method of categorizing the words of the response stream in their sections of expression and their reciprocal tagging, well known as POS tagging, is lexical analysis. It is a pretrained lexicon that is prepared for the method [8, 9] . Machine learning-based analysis: artificial intelligence is a subset of machine learning [10, 11] that is used for intelligent algorithms to train a correct classifier model. The research comprises preprocessing data, feature extraction, feature selection, testing, and labelling of the test dataset [12] [13] [14] . Deep learning methods are classified into three main classes: unsupervised learning, supervised learning, and semisupervised learning [1, 15, 16] . Hybrid analysis: hybrid methodology is a grouping of classification and regression problems. This methodology is more rapid and more precise than the other methods stated above. In this article, on this dataset, we established a DSC for sentimental analysis and concentrated on the relationship of different factors in consumer reviews using statistical analysis, which included multivariate distributions, univariate distributions, multivariate analysis, and descriptive statistics [17] . During the first phase, we scrutinized the not-text feedback features (e.g., clothing, department name, ages, classes, and names) and the consumer references present in this dataset to analyze their relationship. We used a deep learning technique [18] to identify customer reviews' feelings about the products and assess whenever a positive review has been done for the purchased items. Generally, the main contributions of the present research work are as follows: (i) Have a critical overview of similar studies on the study of sentimental analysis of consumer product review (ii) The way to examine the correlation between the different variables in the consumer product review depends on the four statistical research methods, containing multivariate distribution, univariate distribution, multivariate statistical analysis, and descriptive analysis (iii) Create a new deep learning algorithm called a deep sentiment classifier that accepts binary forms of text mining problems, such as a recommendation classification and a sentimental analysis on consumer review of purchased products (iv) Our method can automate the mining and selection of features. This methodology differentiates our contribution from that of [19] [20] [21] utilizing handcrafted features (v) Doing a comprehensive survey by performing several machine learning and conventional natural language and deep learning methods on these complex data to provide businesses with an understanding of how consumers like their goods and amenities This paper is structured into sections: Section 2 presents the related work, Section 3 provides a list of the dataset used in this research, Section 4 set out realistic scientific work, Section 5 presents the conclusions as well as the discussions, and Section 6 concludes with several recommendations for future research. Sentimental analysis is a type of data mining. We relied on predictive analysis and machine learning customer reviews of women's apparel e-commerce datasets. Some traditional methods focus on complex feature models or hand-crafted dictionary-based approaches for predictive analysis and sentiment analysis. In this article, we discussed the previous work on sentiment analysis. Authors [22] performed a hypothetical level of sentimental analysis. The researchers' focus is on three different lexicon techniques, supervised learning and unsupervised learning. At this time, we implemented supervised learning since we had access to supervised machine learning approaches and supervised data. That performed better than the unsupervised ones. Authors [23] addressed the tree-CRF approach to support binary and sparse function presentations. This methodology was a comprehensive and dynamic model of information. In other words, [24] recommended a stacked denoising autoencoder technique that used a distributed feature to use such distributed word representations. That methodology outperformed tree-CRF as it could not provide a dynamic future structure and can be applied to many other domains. Tang et al.'s [25, 26] sentiment classification was implemented on microblog. Previously, authors used distributed word presentation as polarization, and scholars including [27] applied deep learning approaches. Their implementation was built using a single-layer CNN, while our method includes RNN and addresses two kinds of textual classification problems. In some researchers [28, 29] , a recursive autoencoder approach has been used to embed lexical information into deep learning. [8] proposed a Japanese emotion classification method that used a bidirectional long-term memory (LSTM) RNN network. After, it would be seen that integrating POS tag, word embedding, and Japanese polarization dictionary features strongly affected classification accuracy. Authors [30] used the long-term memory system (LSTM) bidirectional recurrent neural network (RNN) to suggest and identify sentiments on datasets of e-commerce review. The results have shown that the recommendation is now a high positive sentiment metric. The bidirectional LSTM model mentioned above obtained an F1 score of 89% for the recommendation classified and 94% for the sen-timental analysis. At the same time, our proposed model gained an F1 score of 89.32% for classifying recommendations and of 94.52% for classifying emotions. Much like our proposed methods, Mousa and Schuller and Song et al. [31, 32] have built approaches using a bidirectional LSTM model to produce high-level information through expression and Asian consumer review datasets. In our study, we found actual consumer reviews on women's apparel for dataset analysis and used a deep learning method for sentimental analysis. This research applies natural language and machine learning methods to define large patterns in customer behaviour in text. In the data collection, the total number of unique words is 9811. Our crucial objective existed to find out what consumers like and do not like about their purchasing. To accomplish this goal, we have performed observational analyses on this massive dataset. Firstly, we used to have to identify the features of the selected attributes and accelerate the difficulty of the analysis until a proper objective had been envisaged. And after that, through our research, we have shown that our statistical experiments are conducted using natural language methods. The results of sentiment analysis provided by state-of-the-art deep learning techniques have been considerable and helpful to e-commerce. (iv) The sentiment of the women's clothe e-commerce product review dataset [17] is made by actual customers and is thus anonymized; i.e., brand names are replaced by suppliers and customer names are exempted. The data consisted of 22,641 user reviews with 9 supporting attributes, such as age, department, class name, and positive feedback count. Table 1 describes the additional features with the titles, and Table 2 describes the frequency Behavioural Neurology distribution and labelling of the features present in the dataset, such as age and recommendation ID An analysis of IMDB's (50,000) movie reviews was performed using two positive features, text analysis, and sentiment analysis [5] . Compared to the previous benchmark functions, this framework gives considerably more information about quantitative emotion classification. The dataset includes a collection of 25,000 vastly polarized film reviews for preparation and 25,000 for analysis. The computational method is distributed about three portions to evaluate the classification of sentiments: statistical analysis, deep learning, and machine learning analysis. The statistical analysis describes the computational relationship among variables using equations or models [33] . In this part, the dataset was analyzed using four statistical analysis methods, such as univariate Class name distribution: as we can see in Figure 4 , in the frequency of distributions, the top 3 clothing types (skirts, knits, and blouses) have been the most reported. distributions, multivariate analysis, multivariate distributions, and descriptive analysis. Drawing the plot was done using the author's text in [34] . Table 3 describes the statistical detailed info of the datasets. 4.1.1. Analysis Univariate Distribution. Age and positive feedback count distribution: Figure 1 shows that most consumers aged 36-45 years had the most positive review of the products purchased. We also noticed two points from this analysis: (i) at the time of the analysis, e-commerce should include an emphasis on managing this section for the aged listed above, which remains with the utmost positive reviews, and (ii) electronic commerce will see that most of an age group remains quite pleased compared to more pleased age group of 36-45 years. Division name and department distribution: Figure 2 indicates the frequency distributions of consumer ratings by division and department names. Distributions of division name: the distribution of division names has three categories of standard, limited, and personal. This provided some perception into the size of the consumers' clothing sendoff comments. Behavioural Neurology Distribution of department name: this is important to remember that skirts and tops seem to be the most highly rated product. It will be fascinating to explore the motivation for leaving the analysis in the first place. Clothing ID distribution: Figure 3 displays the top 60 IDs for clothes to identify the product's interest. Three dress IDs from 1079, 862, and 1095 have obtained considerably more ratings than others. As shown in Table 4 , these products expected an average rating of 4/2 and an overall recommendation ratio of around 82%. They also observed that these products mainly were regular. (1) Distributions of Rating, Recommendation, and Label. Rating distribution: the increasing number of ratings, with a score of five out of five, has been very positive. This proved that the department store was doing pretty well. Recommended IND distribution: this factor represented the positivity of the rating distribution; however, as previously discussed, we assume that it produced the difference in positive thinking that had been societal rather than private. Label distribution: we are surprised to find that the items were rated as three or better and recommended by the consumer. We predicted the relationship between rating and recommendation to be multivariate. To figure out how customers express their hatred, we found these three variables especially promising. We based on the correlations between these variables in the multivariate section. The distribution of scores, recommendations, and labels is seen in Figure 5 . Length of word: Figure 6 indicates that the analysis's character and word counts are strongly correlated. They were equal in length, as seen in Table 5 . The term and character count correlation coefficient are 0.99. Figure 7 indicates that the general-sized top was the most dominant commodity. The dominance of general size within the department name was consistent across multiple categories, as seen in Figure 8 . There had been a significant overall difference in the name of the general petite and the department. Name of class by department name: Figure 9 provides a better look into the classification of multiple clothing types. As seen in Figure 10 , the superiority of dress popularity was visible till now. Behavioural Neurology Figure 11 indicates that the most reviewed clothing styles were general-sized blouses, skirts, and knits, and Figure 12 indicates that most reviews have stayed popular for dresses with general petite sizes. Age as per positive feedback count: Figure 13 indicates that age was marginally correlated with positive feedback counts. Focusing on the textual anatomy of incredibly positive reviews will be fascinating. Department and division naming recommendation: the same observations are shown in Figure 14 as those found in Figure 7 . Division and department rating names: Figure 15 indicates that the division and department are compatible with the overall rating distribution. The positive response count is under 40 through recommended IND and rating. This plot offers still more nuance only as a follow-up to a previous review of the dominant strongly positive reviews recommended by consumers. The first was a bump to the lower left: cutoff = true and recommended IND = 0:0. This strategy interacted unexpectedly with criticism of individual items; that is why the second bump (rate = 1) of the lighter blue dominated the positive feedback range of~110. In the bottom-right plot, later performance was identified, while standard ratings were recommended. The vast range of yellow distributions with a ranking of 3 was interesting to see. Positive reviews of constructive criticism were the most highly rated. Also, see Figure 16 for more visualization. Rate by recommendation: Figure 17 shows that five-star ratings are not preferred, but some cases recommend lowquality items. The recommended portion of the feedback for the more real instance of recommended and nonrecommended items with three scores is interesting to listen to, which could shed light on the utmost essential constraints on the store manager and the consumer's apparel behaviour. Statistics. Classification average by recommendation: Figure 18 evaluates the rating recommendations. When recommended or reduced by the reviewer, the rating was below the maximum, so experimentation is not recommended. This process in the department and division has been persistent. Average ranking and recommended IND correlated by clothing ID: Figure 19 shows the correlation between ratings and the dress ID recommended by IND. This heat map correlation indicates no relation between counts and average score, suggesting that the item's reputation did not contribute to special consideration once it came to average ratings. The age variables demonstrated similar behaviour. However, there has been a high positive correlation of 80% between the recommended IND average and rating. A more quantitative view of the interest rate relationship is given in Figure 20 and focuses on the p value. The dots on the bottom left are the items that, in the expectation of maintaining the brand's reputation, definitely require attention from marketers. Class name average rating and recommended IND correlation: in several class groups, Figure 21 shows significant relationships between average age and likelihood of recommendation. We use state-of-the-art machine learning classifiers for the role of emotion classification in this section, like naïve Bayes [35] , KNN [12] , Behavioural Neurology support vector machine [36] , random forest [37] , logistic regression [38] , decision tree [39] , and multilayer perception [40] . We also considered both of these to be similar to the current DSC algorithm as simple classification methods. The women's apparel dataset, which contains more than 23,000 user ratings with 9 attributes after preprocessing, was discussed during our first experiment (see Section 3). We reached an accuracy of 77.45% for KNN, 78.34% for RF, show that the strongest classifiers for LR, naïve Baseline, and MLP remain with an accuracy of more than 80% across all these machine learning baseline classifiers. Table 6 summarizes the complete results. Our next experiment discussed the IMDB dataset, containing 50,000 sentiments for movie reviews (see Section 3). For this study, DSC remains outstanding with an F1 score of 88.64% among the simple classification methods, including linear regression, random forest, decision trees, naive Bayes, multilayer perceptron, SVM classifiers, and KNN (see Table 7 ). 4.3.1. Preprocessing. Embedding and tokenizer: for the analysis of documents, a fully convolutional neural network cannot be used directly; therefore, we must translate it somehow. There were two stages in the integration process. The first move was called a "tokenizer," which translated text analysis from word to integer and was performed on the datasets before a neural network input [41] . The 2 nd phase had been an integral component of a neural network itself, called the "embedding" layer [42] . Dropout layers offer an optimal process to prevent overfitting, which can be accomplished by arbitrary dropout to ignore these neurons in the training point [43] . Because this helps to minimize codependent neuronal learning, we boost DSC dropouts with linear and exponential growth. We introduced a deep sentiment classifier to extract a review text from the input series at numerous time phases. The recommended solution (DSC) is seen in Figure 22 . The system was initially developed of the recurrent unit (RU) which has been internally set to 1 by TensorFlow each time a new series has begun. During the first phase, the word "this" is inserted into the RU that was used for its embedding layer (coded to zero) and also its gate to estimate a novel state. RU used another gate to measure the performance, but that was skipped since it simply included a description at the end of the series. In the 2 nd phase, the expression "is" was introduced into the RU that used the embedding layer that had been shifted by seeing all previous words "this." There is no meaning in the term "this is" because by seeing these words, the RU probably did not save anything significant from its internal state. Nevertheless, whenever the third word "not" was detected, RU discovered that the overall sentiment of input text could be valuable to calculate and therefore need to be recorded in the memory state of RU that can be used later once RU had seen the phrase "good" in step 6. Thirdly, RU To obtain a goal node between 0.0 and 1.0, which has been understood either negatively (values near to 0.0) or positively, we have used a fully associated layer with activation of a sigmoid (values relative to 1.0). Two types of text classification problems were applied to the recommended classification model. Sentiment classification: sentiment on consumer ratings of the product purchased is classified. In this dataset, the product analysis has negative, positive, and neutral feeling states. As a multinomial classification problem, we considered this type of problem. Classification by recommendation: this identifies whether the product reviewed is recommended by the customers' reviews. Here, the product evaluation in the datasets contains two recommended and not recommended approval states. We found these types of issues to be binary classification problems. To evaluate our model in python3, we used TensorFlow [44] , scikit-learn [45] , and Keras [46] . Intel Core i5 2.67 GHz and 8 GB RAM are the computer systems used for this work. With the first learning rate of 0.0001, we used the Adam Optimizer. Table 8 shows the setup of the parameter method proposed. During the training and testing of the proposed deep sentiment classification model, 10 k cross-validations were applied. For both recommendation and sentiment classifications, the average preparation, consistency testing, and loss by the deep sentiment classifier are discussed in Table 7 . We use the usual metrics to measure the efficiency of the classifiers [12, [47] [48] [49] : true negative (TN) is the correct negative review analysis, true positive (TP) is the correct analysis of a positive review, and fake positive (FP) means the positive test's false positive interpretation. The accuracy, precision, recall, and F measurement are determined using the gauges set out directly above. Accuracy is calculated as the proportion of all forecasts to Correlation coefficient for mean and count for rating, recommended likelihood, and age grouped by class name Figure 21 : Good correlations between both the average age and the probability of recommendation in different class groups. (1)). Precision indicates whether the model's positive predictions are accurate and are computed by dividing all positive predictions by the total number of true positives (shown in equation (2)). The recall is the positive described by the all feasible positive models and is accomplished by dividing the true positive by the actual positive total (shown in equation (3)). Its weighted average of recall and accuracy was F1measurement. The controlled F score or F measure is now the precision and recall confusion matrix, as defined in equation (4) . We compared the performance of our proposed method to many current methods of computational intelligence based on problems of sentiment classification (see Table 9 ). Our proposed DSC method obtained an average accuracy of 93.55% for sentiment classification tasks under the experiment described above. Table 10 shows the performance metrics of a new DSC methodology and other unique classifications based on the women's clothing databases for emotion detection tasks. It has been demonstrated that in terms of accuracy, precision, recall, and F1measure, the method produced outperformed all other simple classifiers. In our DSC process, the F1 score is 25.53% more reliable than the KNN and RF baseline classifiers, 22.53% higher than the DTC baseline classifier, 14.53% higher than the LR baseline classifier, 13.53% higher than the Naïve Bayes baseline method, and 28.53 and 14.53% points higher than the SVM and MLP baseline classifiers, respectively. With the other baseline IMDB dataset classifiers, Table 10 presents the experimental effects of the proposed DSC process. The experimental results show that DSC remained highly high among all baseline classification methods, with an F1 score of 88.01%. Based on the sentiment classification analysis, Table 11 assesses the recommended method for existing techniques. It clearly shows that the approach proposed has remained extremely high compared to other approaches discussed. It should, however, be stated that there was a variance in the distribution of frequencies between recommendation and sentiment groups. For example, more recommended reviews were done in the women's clothing database because there were more positive attitudes than potential and neutral ones. It can be a challenge for the model because it boosts the bias against a class of high-frequency propagation. Statistical analysis for the classification of recommendations is provided in Table 12 . As shown in the table, comparatively, the deprecated class of the recommended classification problem gave worse predictions. In addition, on the IMDB dataset, we tested DSC, which has a balanced sentiment for film reviews (25,000 for positive and 25,000 for negative). For the role of sentiment classification, which gained an average F1 score of 88.01% (see Table 13 ), our outcomes found that the deep sentimental classifier model was implemented well under the assumption that samples were spaced randomly and unevenly in the datasets. Table 14 describes our proposed DSC success metrics and reflects our observations on the stigma against the imbalanced community (the class with the maximum frequency distribution). The predictive utility of the proposed technique was moderately low for neutral and negative emotions, as stated in the tables. Despite imbalances in the dataset, our empirical analysis provided the facts with relatively high predictive performance to support the recommendation and sentiment classifications. Our findings showed that the bidirectional gated recurrent unit (GRU) was acceptable and highly predictive for analyzing customer reviews. We also advocate employing the unidirectional RNN-LSTM and CNN for a fair comparison in the future work on the same classification problem to further validate this conclusion. Online reviews are becoming a forum for trust buildingconsumer buying trends and affecting them. There is a need to manage such a massive number of comments with such dependency and provide reliable reviews before the user. This article analyzed two different types of datasets to classify sentiments: "women clothing review" datasets, consisting of 22641 records and IMDB sample size, containing 50,000 sentiments from the movie reviews. Our study is aimed at exploring the correlation between the different variables in the statistical analysis datasets of the review and at constructing a deep learning algorithm for DSC (deep sentiment classifier). Our proposed method addresses two types of text classification problems: (ii) classification of sentiments by recommendation, which investigates whether customer ratings recommend the product reviewed, and (ii) classification of sentiment by calculating consumer reviews' sentiment values toward the purchased product. In our proposed model, there is no feature selection technique used. DSC, however, performed well in the emotional classification, with an F1 score of 93.52% in the recommended classification of the women's clothing dataset. In addition, on the IMDB datasets, we tested DSC, which has a balanced sentiment for film reviews (25,000 for positive and 25,000 for negative), which obtained an average F1 score of 88.01% for the task of data mining (see Table 12 ). Our results demonstrated which the model DSC worked well under the situation that samples in the dataset were spread uniformly and unevenly. Furthermore, our analyses have shown that the recommendation is a reliable indicator for studying positive sentiment. Based on statistically analyses and state-of-the-art classifiers, our extensively investigated findings of this study will provide businesses with ideas on how to develop their services and satisfy consumer demands accordingly. On this model, many possible studies can still be performed. The tuning of hyperparameters for further development may be used in future works. The hyperparameters of the recommended method were restricted to one randomly selected parameter because of the computational cost limit. The datasets we used in this study are publicly available at the following links: (1) https://www.kaggle.com/nicapotato/ womens-ecommerce-clothing-reviews and (2) https://www .kaggle.com/lakshmi25npathi/imdb-dataset-of-50k-moviereviews. The authors declare that they have no conflicts of interest. Sentiment analysis in Twitter using machine learning techniques Opinion Mining and Sentiment Analysis Sentiment analysis: a perspective on its past, present and future Knowledge-based approaches to concept-level sentiment analysis Learning word vectors for sentiment analysis New features for sentiment analysis: do sentences matter? Sentiment analysis using extreme learning machine with linear kernel Japanese sentiment classification using bidirectional long short-term memory recurrent neural network Serendio: simple and practical lexicon-based approach to sentiment analysis Machine learning: An artificial intelligence approach Machine learning: a review of classification and combining techniques IMCFN: image-based malware classification using fine-tuned convolutional neural network architecture Image-based malware classification using ensemble of CNN architectures (IMCEC) Malware detection in industrial Internet of things based on hybrid image visualization and deep learning model Twitter sentiment classification using machine learning techniques for stock markets Deep reinforcement learning-based image captioning with embedding reward No title An empirical exploration of recurrent network architectures Review-level aspect-based sentiment analysis using an ontology Comparative study of sentiment analysis with product reviews using machine learning and lexicon-based approaches Sentiment analysis and extractive summarization based recommendation system Survey on aspect-level sentiment analysis Dependency treebased sentiment classification using CRFs with hidden variables Japanese sentiment classification with stacked denoising auto-encoder using distributed word representation Learning sentiment-specific word embedding for Twitter sentiment Classification Twitter sentiment analysis using deep convolutional neural network Convolutional neural networks for sentence classification Semi-supervised recursive autoencoders for predicting sentiment distributions Personality, gender, and age in the language of social media: the openvocabulary approach Statistical analysis on E-commerce reviews, with sentiment classification using bidirectional recurrent neural network (RNN) Contextual bidirectional long short-term memory recurrent neural network language models Text sentiment analysis based on convolutional neural network and bidirectional LSTM model Nag ranks and scores (G01Dhc) 1 No title Sentiment analysis of Twitter data: a survey of techniques Baselines and bigrams: simple, good sentiment and topic classification Classification of amazon book reviews based on sentiment analysis A multiobjective weighted voting ensemble classifier based on differential evolution algorithm for text sentiment classification The random subspace method for constructing decision forests Sentiment analysis for movies reviews dataset using deep learning models Deep learning using tensor flow and NLTK-analyzing corpus's sentiments part 1 Deep sentence embedding using long short-term memory networks: analysis and application to information retrieval Dropout: a simple way to prevent neural networks from overfitting Tensor flow-Google's latest machine learning system, open sourced for everyone Scikit-learn: Machine learning without learning the machinery Keras: deep learning library for Theano and Ten-sorFlow MTHAEL: cross-architecture IoT malware detection based on Neural Network Advanced Ensemble Learning Sentiment analysis of customer reviews using robust hierarchical bidirectional recurrent neural network Sentiment mining of product opinion data The work was supported in part by the National Social Science