МАТНЛИ МАЪЛУМОТЛАРНИ ТАСНИФЛАШДА БЕЛГИЛАРНИ ШАКИЛЛАНТИРИШ УСУЛ ВА АЛГОРИТМЛАРИ
Keywords:
Матнли маълумотларни таснифлаш, белгиларни шакллантириш, Bag of Words, TF-IDF, One-hot encoding, табиий тилни қайта ишлаш, матнларни анализ қилиш, векторли модель.Abstract
The article examines the methods and algorithms for character formation used
in text data classification. In particular, the Bag of Words (BoW) model, TF-IDF indicator, and
One-hot encoding methods are analyzed. The theoretical foundations and practical importance of
representing texts in digital form are covered. Information about the main researchers in this field
and their scientific contributions is also provided.
References
Salton G., McGill M.J. Introduction to Modern Information Retrieval. – McGraw-Hill, 1983.
Spärck Jones K. A statistical interpretation of term specificity and its application in retrieval // Journal of Documentation. – 1972. – Vol. 28, No. 1. – P. 11–21. – DOI: 10.1108/eb026526.
Stevens S.S. On the theory of scales of measurement // Science. – 1946. – Vol. 103, No. 2684. – P. 677–680. – DOI: 10.1126/science.103.2684.677.
Bishop C.M. Pattern Recognition and Machine Learning. – Springer, 2006.
Goodfellow I., Bengio Y., Courville A. Deep Learning. – MIT Press, 2016.