Emerging Databases for Next Generation Big Data Applications
DOI:
https://doi.org/10.46243/jst.2022.v7.i01.pp111-120Keywords:
.Abstract
The rising quality of large-scale period analytics applications (real-time inventory/pricing, mobile apps that offer you suggestions, fraud detection, risk analysis, etc.) emphases the requirement for distributed knowledge management systems which will handle quick transactions and analytics simultaneously. Efficient process of transactional and analytical requests, however, need completely different optimizations and branch of knowledge selections in a system. This paper presents the wildfire system that targets Hybrid Transactional and Analytical process (HTAP). wildfire leverages the Spark system to modify large-scale processing with differing types of complicated analytical requests, and columnar processing to modify quick transactions and analytics simultaneously.
References
Aerospike. http://www.aerospike.com/
Alluxio. http://www.alluxio.org/
Amazon S3. https://aws.amazon.com/s3/
Apache Cassandra. http://cassandra.apache.org
Apache Hadoop. http://hadoop.apache.org/
Apache Hadoop HDFS. http://hortonworks.com/apache/hdfs/
Apache HBase. https://hbase.apache.org/
Apache Kudu. https://kudu.apache.org/
Apache Parquet. https://parquet.apache.org/
Apache Phoenix. http://phoenix.apache.org/
Apache Spark. http://spark.apache.org/
DataStax Spark Cassandra Connector. https:
//github.com/datastax/spark-cassandra-connector
Hive Transactions. https://cwiki.apache.org/ confluence/display/Hive/Hive+Transactions. MemSQL. http://www.memsql.com/
MyRocks. https://code.facebook.com/posts/190251048047090/myrocks-a-space-and-write-optimized-mysql-database/
OpenStack Swift. https://www.swiftstack.com/product/openstack-swift
Splice Machine. http://www.splicemachine.com/
D. Abadi, S. Babu, F. O¨ zcan, and I. Pandis. Tutorial: SQL-on-Hadoop Systems. PVLDB, 8:2050–2051, 2015
M. Armbrust, R. S. Xin, C. Lian, Y. Huai, D. Liu, J. K. Bradley, X. Meng, T. Kaftan, M. J. Franklin, A. Ghodsi, and M. Zaharia. Spark SQL: Relational
Data Processing in Spark. In SIGMOD, pages 1383–1394, 2015
J. Baker, C. Bond, J. C. Corbett, J. Furman, A. Khorlin, J. Larson, J.-M. Leon, Y. Li, A. Lloyd, and V. Yushprakh. Megastore: Providing Scalable, Highly
Available Storage for Interactive Services. In CIDR, 2011
R. Barber, M. Huras, G. M. Lohman, C. Mohan, R. Mueller, F. O¨ zcan, H. Pirahesh, V. Raman, R. Sidle, O. Sidorkin, A. Storm, Y. Tian, and P. To¨zu¨n
Wildfire: Concurrent Blazing Data Ingest and Analytics. In SIGMOD, pages 2077–2080, 2016
Published by: Longman Publishers www.jst.org.in
P. Boncz, M. Zukowski, and N. Nes. MonetDB/X100: Hyper-Pipelining Query Execution. In CIDR, 2005
E. A. Brewer. Towards Robust Distributed Systems. In PODC, pages 7–, 2000
F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A Distributed Storage
System for Structured Data. In OSDI, pages 205–218, 2006
L. Chang, Z. Wang, T. Ma, L. Jian, L. Ma, A. Goldshuv, L. Lonergan, J. Cohen, C. Welton, Sherry, and M. Bhandarkar. HAWQ: A Massively Parallel
Processing SQL Engine in Hadoop. In SIGMOD, pages 1223–1234, 2014
F. F a¨rber, N. May, W. Lehner, P. Große, I. Mu¨ller, Rauhe, and J. Dees. The SAP HANA Database – An Architecture Overview. IEEE DEBull
S. Gray, F. O¨ zcan, H. Pereyra, B. van der Linden, and A. Zubiri. IBM Big SQL 3.0: SQL-on-Hadoop without compromise
https://public.dhe.ibm.com/common/ssi/ecm/sw/en/ sww14019usen/SWW14019USEN.PDF, 2015
A. Kemper and T. Neumann. HyPer – A Hybrid OLTP&OLAP Main Memory Database System Based on Virtual Memory Snapshots. In ICDE, pages
M. Kornacker, A. Behm, V. Bittorf, T. Bobrovytsky, C. Ching, A. Choi, J. Erickson, M. Grund, D. Hecht, Jacobs, I. Joshi, L. Kuff, D. Kumar, A. Leblang
Li, I. Pandis, H. Robinson, D. Rorke, S. Rus, J. Russell, D. Tsirogiannis, S. Wanderman-Milne, and M. Yoder. Impala: A Modern, Open-Source SQL Engine
for Hadoop. In CIDR, 2015
A. Lamb, M. Fuller, R. Varadarajan, N. Tran, B. Vandiver, L. Doshi, and C. Bear. The Vertica Analytic Database: C-store 7 Years Later. PVLDB
N. Mukherjee, S. Chavan, M. Colgan, D. Das, M. Gleeson, S. Hase, A. Holloway, H. Jin, J. Kamp, K. Kulkarni, T. Lahiri, J. Loaiza, N. Macnaughton, V
Marwah, A. Mullick, A. Witkowski, J. Yan, and M. Zait. Distributed Architecture of Oracle Database In-memory. PVLDB, 8(12):1630–1641, 2015
P. O’Neil, E. Cheng, D. Gawlick, and E. O’Neil. The Log-structured Merge-tree (LSM-tree). Acta Inf., 33(4):351–385, 1996
V. Raman, G. Attaluri, R. Barber, N. Chainani, D. Kalmuk, V. KulandaiSamy, J. Leenstra, S. Lightstone, S. Liu, G. M. Lohman, T. Malkemus, R
Mueller, I. Pandis, B. Schiefer, D. Sharpe, R. Sidle, A. Storm, and L. Zhang. DB2 with BLU Acceleration: So Much More than Just a Column Store. PVLDB
A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, N. Zhang, S. Anthony, H. Liu, and R. Murthy. Hive - A Petabyte Scale Data Warehouse Using
Hadoop. In ICDE, pages 996–1005, 2010
Z. Zhang. Spark-on-HBase: Dataframe Based HBase Connector. http://hortonworks.com/blog/ spark-hbase-dataframe-based-hbase-connector. (Basic
Book/Monograph Online Sources) J. K. Author. (year, month, day). Title (edition) [Type of medium]. Volume(issue). Available: http://www.(URL)
J. Jones. (1991, May 10). Networks (2nd ed.) [Online]. Available: http://www.atm.com
(Journal Online Sources style) K. Author. (year, month). Title. Journal [Type of medium]. Volume(issue), paging if given. Available:
