Target group
SAS programmers that need to access data in Hadoop from within SAS
Course structure
Introduction
- What is Hadoop?
- How SAS interfaces with Hadoop.
Accessing HDFS and Invoking Hadoop Applications from SAS
- Overview of methods available in Base SAS for interacting with Hadoop.
- Reading and writing Hadoop files using Base SAS.
- Methods.
- Executing MapReduce code.
- Executing Pig code using PROC HADOOP.
Using the SQL Pass-Through Facility
- Understand the SQL procedure pass-through facility.
- Connecting to a Hadoop Hive database.
- Learning methods to query Hive tables.
- Investigating Hadoop Hive metadata.
- Creating SQL procedure pass-through queries.
- Creating and loading Hive tables with SQL pass-through EXECUTE statements.
- Handling Hive STRING data types.
Using the SAS/ACCESS LIBNAME Engine
- Using the LIBNAME statement for Hadoop.
- Using data set options.
- Creating views.
- Combining tables.
- Benefits of the LIBNAME method.
- Using the HDMD procedure to access delimited data, XML data, and other non-Hive formats.
- Performance considerations for the SAS/ACCESS LIBNAME statement.
- Copying data from a SAS library to a Hive library.
Partitioning and Clustering Hive Tables
- Identifying partitioning, clustering, and indexing methods in Hive.
- Understanding how partitioning and clustering can increase query performance.
- Creating and loading partitioned and clustered Hive tables.
SAS Viya and Hadoop and SAS Code Accelerator for Hadoop
- Loading and saving CAS tables to HDFS.
- Executing DS2 threads in Hadoop to summarize data.
- Using the HDMD procedure to access HDFS files.
