A Three Layer Stacked Auto Encoders for Semantic Hashing
DOI:
https://doi.org/10.46243/jstj.2017.v2.i4.213Keywords:
semantic enrichment, semantic hashing, deep neural networkAbstract
Suggesting an original method for sympathetic short texts is to present a device to augment short texts with thoughts and co-occurring terms that are mined from a probabilistic semantic network. To bunch short texts by their senses, we suggest to add more semantic signals to short texts. Precisely, for each term in a short text, we get its concepts and co-occurring terms from a probabilistic information base to augment the short text. Also, we present a basic bottomless learning network entailing of a 3-layer stacked auto-encoders for semantic hashing.
References
M. Sahami and T. D. Heilman, ―A web-based kernel function for measuring the similarity of short text snippets,‖ in Proc. 15th Int. Conf. World Wide Web, 2006, pp. 377–386
W. tau Yih and C. Meek, ―Improving similarity measures for short segments of text,‖ in Proc. 22nd Nat. Conf. Artif. Intell., 2007, pp. 1489–1494
D. Shen, R. Pan, J.-T. Sun, J. J. Pan, K. Wu, J. Yin, and Q. Yang, ―Query enrichment for web-query classification,‖ ACM Trans. Inf. Syst., vol. 24, no. 3, pp. 320–352, 2006
C. Fellbaum, WordNet: An Electronic Lexical Database. Cambridge, MA, USA: MIT Press, 1998
X. Hu, N. Sun, C. Zhang, and T.-S. Chua, ―Exploiting internal and external semantics for the clustering of short texts using world knowledge,‖ in Proc. 18th ACM Conf. Inf. Knowl. Manage., 2009, pp. 919–928
S. Banerjee, K. Ramanathan, and A. Gupta, ―Clustering short texts using wikipedia,‖ in Proc. 30th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2007, pp. 787–788
E. Gabrilovich and S. Markovitch, ―Computing semantic relatedness using Wikipedia-based explicit semantic analysis,‖ in Proc. 20th Int. Joint Conf. Artif. Intell., 2007, pp. 1606–1611
E. Gabrilovich and S. Markovitch, ―Feature generation for text categorization using world knowledge,‖ in Proc. 19th Int. Joint Conf. Artif. Intell., 2005, pp. 1048–1053
W. Wu, H. Li, H. Wang, and K. Q. Zhu, ―Probase: A probabilistic taxonomy for text understanding,‖ in Proc. Int. Conf. Manage. Data, 2012, pp. 481–492
Y. Song, H. Wang, Z. Wang, H. Li, and W. Chen, ―Short text conceptualization using a probabilistic knowledge base,‖ in Proc. 22nd Int. Joint Conf. Artif. Intell., 2011, pp. 2330–2336
D. Kim, H. Wang, and A. H. Oh, ―Context-dependent conceptualization,‖ in Proc. 23rd Int. Joint Conf. Artif. Intell., 2013, pp. 2654–2661
B. Stein, ―Principles of hash-based text retrieval,‖ in Proc. ACM 30th Annu. Int. Conf. Res. Develop. Inf. Retrieval, 2007, pp. 527–534
R. Salakhutdinov and G. E. Hinton, ―Semantic hashing,‖ Int. J. Approx. Reasoning, vol. 50, no. 7, pp. 969–978, 2009
G. E. Hinton, ―Training products of experts by minimizing contrastive divergence,‖ Neural Comput., vol. 14, no. 8, pp. 1771–1800, 2002
S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman, ―Indexing by latent semantic analysis,‖ J. Amer. Soc. Inf. Sci., vol. 41, no. 6, pp. 391–407, 1990. Journal of Science and Technology (ISSN: 2456-5660), Volume 2, Special Issue 1, July 2017 51
