Survey BigData Analyzer

Survey BigData Analyzer covers the entire process of gathering, modeling, and interpreting survey information.

OVERVIEW

Survey BigData Analyzer consists of a suite of applications covering the entire process of gathering, modeling, and interpreting survey information for the purpose of discovering new market trends, customer preferences, and hidden patterns.

KEY FEATURES

Here are the main features of the web application:

  • Discover market trends and customer preferences to evaluate supply and demand by using data gathered from customer surveys
  • The suite allows users to create surveys and distribute them across email, social networks or via QR codes
  • All the data resulted from completed surveys is stored inside Cassandra database clusters
  • The data is gathered from the databases by a custom analysis service component, then it is modeled and analyzed in the Apache Spark framework
  • The data processed by the custom analysis service is displayed via the Data Reporting Dashboard

The suite comes packed with multiple applications, as follows:

  1. Survey Creator
  2. Survey Distribution System
  3. Survey Data Storage
  4. Survey Analysis Service
  5. Data Reporting Dashboard

Survey Creator

The Survey Creator application allows content managers to create surveys for various areas of activity (retail industry, research activities etc.). All surveys are mobile-friendly and can be created using default templates or can be personalized with the help of custom templates.

Survey Distribution System

The Survey Distribution System is a component which allows users to automatically distribute the created surveys.

The surveys can be shared on various channels, by email, social networking services (such as Facebook, Twitter, and LinkedIn), or by using QR codes, which is a good approach for mobile devices.

Survey Data Storage

The data gathered from completed surveys is stored inside Apache Cassandra clusters, which are located in different areas for a better geographical span, as well as to improve server availability and failover. All the data collected from surveys is stored as structured data in Cassandra, thanks to this management system’s capability to handle very large amounts of data.

Survey Analysis Service

The Survey Analysis Service is able to perform real-time data analysis on the data stored in Apache Cassandra databases. Using the Apache Spark framework, the service is able to extract and prepare the data for visualization and predictive analytics.

The Data Access Layer is implemented via Spark Cassandra connectors. The service comes with Cassandra Storage Cluster support, allowing jobs to be distributed across multiple nodes. Additionally, the data integration engine is capable of running multiple processes in parallel by using a multi-threaded architecture, which results in low execution times.

Data Reporting Dashboard

The Data Reporting Dashboard shows the resulting information and statistics from the Survey Analysis Service. Based on the data processed by this service, the user can visualize and analyze data in order to create reports. Data analysts can then review the detailed information as a means for discovering patterns and trends.

SCREENS

The following diagram presents the entire flow of the Survey BigData Analyzer:

The following diagram details how the Survey Analysis Service works:

The following diagram presents the data-collection flow, from completed surveys all the way to data interpretation:

PLATFORM DETAILS

Survey Creator

  • Ruby on Rails 4.2
  • Bootstrap 3.3.2

Survey Distribution System

  • Ruby 2.2

Survey Data Storage

  • Apache Cassandra 2.2

Survey Analysis Service

  • Python 3.4.2
  • Apache Spark 1.2.2

Data Reporting Dashboard

  • Ruby on Rails 4.2
  • Bootstrap 3.3.2



Recent posts on our blog
Hadoop: the future is now - and it's all about Big Data
Jun 05, 2017, by Dragos
Apache Hadoop is an open-source software written in Java, a framework that allows for the distributed processing of very large data sets across clusters of computers.... read more
Linux goes down in history: a mature operating system
Mar 14, 2017, by AdrianC
As we’ve seen in the second part of this series, the number of Linux distros has increased rapidly, as the Open Source community responded in a positive manner to the flexibility of the Linux kernel.... read more
Linux goes down in history: the early life
Dec 08, 2016, by AdrianC
The first mention about Linux was made by Linus Torvalds in 1991. The Finnish software engineer confirmed his interest in the standard POSIX definition, without revealing the name of his MINIX project.... read more


Products  |  Press  |  Site Map  |  Technologies  |  Terms of Use  |  Privacy Policy
© 2017 SBP Romania. All rights reserved.