Data Analytics Interview QA Preparation

 



1. What is Spark SQL ?

Ans: Spark SQL is a component of the Spark ecosystem and is used to access structured and semi-structured information.

  • It is used for relational big data processing in integration with Scala, Python, Java, etc.

  • It also provides the SQL query execution support to Spark. The process of querying data can be done on data stored in internal Spark RDDs and other external data sources.

2. What are the two types of data in Big Data ?

Ans: Data in Big Data can be classified as: Structured, Semi-structured and Unstructured data. 


3. What is RDD ?

Ans: RDD is Resilient Distributed Datasets. It is an immutable, cacheable, distributed set of data. It is the primary distributed Dataset abstraction in Spark.


4. What is Spark SQL ?

Ans: Spark SQL is the solution for data analysis from the Spark family of tool sets. It runs SQL on top of Spark.

  • Spark SQL can deal with data from a wide variety of data sources such as:

    • Structured data files

    • Tables in Hive

    • External Databases

    • Existing RDD

  • Spark SQL uses easy-to-use and straightforward Domain Specific Language (DSL) for selecting, filtering, and aggregating data.

5. What are the goals of Spark SQL ?
Ans:
Goals of Spark SQL

  • Relational processing can be done on both native RDDs and external sources.

  • DBMS techniques ensure high performance processing.

  • Easy to process new data sources (both semi-structured data and external sources).

  • Supports advanced analytics algorithms such as machine learning and graph processing.


Note: Important URL for Data Analytics Interview Preparation

Url: https://www.amazon.com/dp/B07YKQK4M9

Url : https://www.amazon.com/dp/B07QBGVF5L

Url: https://www.amazon.com/dp/B07LFDY87F

Comments

Post a Comment

Popular posts from this blog

Python & Shell Scripting Real Time Course Book & Videos

Image
In this e-book we explained every thing with a example so that it will be easy for user to understand. we will also share the  Basic and advanced shell Scripting videos. Below are the topics Basic Shell Scripting: Content 1. Introduction 2. Variables 3. Echo 4. Shell Arithmetic 5. Quotes 6. Exit status 7. Read Statement 8. Wildcards 9. Semicolon 10. Command line argument 11. Redirector Symbol 12. Sort 13. Tr 14. Pipes 15. Filter 16. Process 17. Bc 18. if condition 19. Test command 20. if-else 21. Multilevel if then else 22. Loops 23. for loop 24. While loop 25. Case statement 26. Debug Advanced Shell Scripting  Content 1. /dev/null 2. Local variable 3. Global variable 4. Conditional Execution 5. File Descriptor 6. Functions 7. Dialog utility 8. Trap Command 9. Shift Command 10. Getopts 11. Cut Utility 12. Paste Utility 13. Join Utility 14. Awk Utility 15. Sed Utility 16. Uniq Utility 17. Grep Utility 18. Ex Utility 19. Doing arithmetic with awk 20. Predefined variable of awk 2...
Read more

Top Five Devops Technical Interview QA Books

Image
1. Devops:Git,Jenkins,Chef,Perl & SVN URL:  https://payhip.com/b/Mt9p 2. Devops:AWK,AWS,Docker,Kubernetes & Puppet URL: https://payhip.com/b/Mt9p 3. Devops: Jira,Gradle,Consul & Fortify URL:  https://payhip.com/b/Mt9p 4. Devops: RHEL8 , Docker & Puppet URL:  https://payhip.com/b/Mt9p 5. Devops: Data Science URL:  https://payhip.com/b/VXDRJ
Read more

Linux-Command Hands-On (DF)

Image
  OBJECTIVE: Aim of this practical is to show you all the possible cases of df command in a real time situation.This kind of practical make you expertise in solving big IT problem in minimum effort. 1. Suppose you have list of multiple servers where you have want to check all the local filesystem.How will you overcome with this problem ? Solution: #!/bin/bash for i in $(cat hostname.txt) do ssh $i df -a done For more problems Please click on below link  https://payhip.com/b/247HD
Read more