• What is analytics & Data Science?
• Common Terms in Analytics
• Analytics vs. Data warehousing, OLAP, MIS Reporting
• Relevance in industry and need of the hour
• Types of problems and business objectives in various industries
• How leading companies are harnessing the power of analytics?
• Critical success drivers
• Overview of analytics tools & their popularity
• Analytics Methodology & problem solving framework
• List of steps in Analytics projects
• Identify the most appropriate solution design for the given problem statement
• Project plan for Analytics project & key milestones based on effort estimates
• Build Resource plan for analytics project

• Why Python for data science?
• Overview of Python- Starting with Python
• Introduction to installation of Python
• Introduction to Python Editors & IDE’s(Canopy, pycharm, Jupyter, Rodeo, Ipython etc…)
• Understand Jupyter notebook & Customize Settings
• Concept of Packages/Libraries – Important packages(NumPy, SciPy, scikit-learn, Pandas, Matplotlib, etc)
• Installing & loading Packages & Name Spaces
• Data Types & Data objects/structures (strings, Tuples, Lists, Dictionaries)
• List and Dictionary Comprehensions
• Variable & Value Labels –  Date & Time Values
• Basic Operations – Mathematical – string – date
• Reading and writing data
• Simple plotting
• Control flow & conditional statements
• Debugging & Code profiling
• How to create class and modules and how to call them?

• Importing Data from various sources (Csv, txt, excel, access etc)
• Database Input (Connecting to database)
• Viewing Data objects – subsetting Data, methods
• Exporting Data to various formats
• Important python modules: Pandas, beautiful soup

• Cleansing Data with Python
• Data Manipulation steps(Sorting, filtering, duplicates, merging, appending, subsetting, derived variables, sampling, Data type conversions, renaming, formatting etc)
• Data manipulation tools(Operators, Functions, Packages, control structures, Loops, arrays etc)
• Python Built-in Functions (Text, numeric, date, utility functions)
• Python User Defined Functions
• Stripping out extraneous information
• Normalizing data
• Formatting data
• Important Python modules for data manipulation (Pandas, Numpy, re, math, string, datetime etc)

• Introduction exploratory data analysis
• Descriptive statistics, Frequency Tables and summarization
• Univariate Analysis (Distribution of data & Graphical Analysis)
• Bivariate Analysis(Cross Tabs, Distributions & Relationships, Graphical Analysis)
• Creating Graphs- Bar/pie/line chart/histogram/ boxplot/ scatter/ density etc)
• Important Packages for Exploratory Analysis(NumPy Arrays, Matplotlib, seaborn, Pandas and SciPy. Stats etc)

• Basic Statistics – Measures of Central Tendencies and Variance
• Building blocks – Probability Distributions – Normal distribution – Central Limit Theorem
• Inferential Statistics -Sampling – Concept of Hypothesis Testing Statistical Methods – Z/t-tests( One sample, independent, paired), Analysis of variance, Correlations and Chi-square
• Important modules for statistical methods: NumPy, SciPy, Pandas

• Concept of model in analytics and how it is used?
• Common terminology used in analytics & Modelling process
• Popular modelling algorithms
• Types of Business problems – Mapping of Techniques
• Different Phases of Predictive Modelling

• Need for structured exploratory data
• EDA framework for exploring the data and identifying any problems with the data (Data Audit Report)
• Identify missing data
• Identify outliers data
• Visualize the data trends and patterns

• Need of Data preparation
• Consolidation/Aggregation – Outlier treatment – Flat Liners – Missing values- Dummy creation – Variable Reduction
• Variable Reduction Techniques – Factor & PCA Analysis

• Introduction to Segmentation
• Types of Segmentation (Subjective Vs Objective, Heuristic Vs. Statistical)
• Heuristic Segmentation Techniques (Value Based, RFM Segmentation and Life Stage Segmentation)
• Behavioural Segmentation Techniques (K-Means Cluster Analysis)
• Cluster evaluation and profiling – Identify cluster characteristics
• Interpretation of results – Implementation on new data

• Introduction – Applications
• Assumptions of Linear Regression
• Building Linear Regression Model
• Understanding standard metrics (Variable significance, R-square/Adjusted R-square, Global hypothesis ,etc)
• Assess the overall effectiveness of the model
• Validation of Models (Re running Vs. Scoring)
• Standard Business Outputs (Decile Analysis, Error distribution (histogram), Model equation, drivers etc.)
• Interpretation of Results – Business Validation – Implementation on new data

• Introduction – Applications
• Linear Regression Vs. Logistic Regression Vs. Generalized Linear Models
• Building Logistic Regression Model (Binary Logistic Model)
• Understanding standard model metrics (Concordance, Variable significance, Hosmer Lemeshov Test, Gini, KS, Misclassification, ROC Curve etc)
• Validation of Logistic Regression Models (Re running Vs. Scoring)
• Standard Business Outputs (Decile Analysis, ROC Curve, Probability Cut-offs, Lift charts, Model equation, Drivers or variable importance, etc)
• Interpretation of Results – Business Validation – Implementation on new data

• Introduction – Applications
• Time Series Components( Trend, Seasonality, Cyclicity and Level) and Decomposition
• Classification of Techniques(Pattern-based – Patternless)
• Basic Techniques – Averages, Smoothening, etc
• Advanced Techniques – AR Models, ARIMA, etc
• Understanding Forecasting Accuracy – MAPE, MAD, MSE, etc

• Introduction to Machine Learning & Predictive Modelling
• Types of Business problems – Mapping of Techniques – Regression vs. classification vs. segmentation vs. Forecasting
• Major Classes of Learning Algorithms -Supervised vs Unsupervised Learning
• Different Phases of Predictive Modelling (Data Pre-processing, Sampling, Model Building, Validation)
• Overfitting (Bias-Variance Trade off) & Performance Metrics
• Feature engineering & dimension reduction
• Concept of optimization & cost function
• Overview of gradient descent algorithm
• Overview of Cross validation(Bootstrapping, K-Fold validation etc)
• Model performance metrics (R-square, Adjusted R-square, RMSE, MAPE, AUC, ROC curve, recall, precision, sensitivity, specificity, confusion metrics )

• What is segmentation & Role of ML in Segmentation?
• Concept of Distance and related math background
• K-Means Clustering
• Expectation Maximization
• Hierarchical Clustering
• Spectral Clustering (DBSCAN)
• Principle component Analysis (PCA)

• Decision Trees – Introduction – Applications
• Types of Decision Tree Algorithms
• Construction of Decision Trees through Simplified Examples; Choosing the “Best” attribute at each Non-Leaf node; Entropy; Information Gain, Gini Index, Chi Square, Regression Trees
• Generalizing Decision Trees; Information Content and Gain Ratio; Dealing with Numerical Variables; other Measures of Randomness
• Pruning a Decision Tree; Cost as a consideration; Unwrapping Trees as Rules
• Decision Trees – Validation
• Overfitting – Best Practices to avoid

• Concept of Ensembling
• Manual Ensembling Vs. Automated Ensembling
• Methods of Ensembling (Stacking, Mixture of Experts)
• Bagging (Logic, Practical Applications)
• Random forest (Logic, Practical Applications)
• Boosting (Logic, Practical Applications)
• Ada Boost
• Gradient Boosting Machines (GBM)
• XGBoost

• Motivation for Neural Networks and Its Applications
• Perceptron and Single Layer Neural Network, and Hand Calculations
• Learning In a Multi Layered Neural Net: Back Propagation and Conjugant Gradient Techniques
• Neural Networks for Regression
• Neural Networks for Classification
• Interpretation of Outputs and Fine tune the models with hyper parameters
• Validating ANN models

• Motivation for Support Vector Machine & Applications
• Support Vector Regression
• Support vector classifier (Linear & Non-Linear)
• Mathematical Intuition (Kernel Methods Revisited, Quadratic Optimization and Soft Constraints)
• Interpretation of Outputs and Fine tune the models with hyper parameters
• Validating SVM models

• What is KNN & Applications?
• KNN for missing treatment
• KNN For solving regression problems
• KNN for solving classification problems
• Validating KNN model
• Model fine tuning with hyper parameters

• Concept of Conditional Probability
• Bayes Theorem and Its Applications
• Naïve Bayes for classification
• Applications of Naïve Bayes in Classifications

• Taming big text, Unstructured vs. Semi-structured Data; Fundamentals of information retrieval, Properties of words; Creating Term-Document (TxD);Matrices; Similarity measures, Low-level processes (Sentence Splitting; Tokenization; Part-of-Speech Tagging; Stemming; Chunking)
• Finding patterns in text: text mining, text as a graph
• Natural Language processing (NLP)
• Text Analytics – Sentiment Analysis using Python
• Text Analytics – Word cloud analysis using Python
• Text Analytics – Segmentation using K-Means/Hierarchical Clustering
• Text Analytics – Classification (Spam/Not spam)
• Applications of Social Media Analytics
• Metrics(Measures Actions) in social media analytics
• Examples & Actionable Insights using Social Media Analytics
• Important python modules for Machine Learning (SciKit Learn, stats models, scipy, nltk etc)
• Fine tuning the models using Hyper parameters, grid search, piping etc.

• What is analytics & Data Science?
• Common Terms in Analytics
• Analytics vs. Data warehousing, OLAP, MIS Reporting
• Relevance in industry and need of the hour
• Types of problems and business objectives in various industries
• How leading companies are harnessing the power of analytics?
• Critical success drivers
• Overview of analytics tools & their popularity
• Analytics Methodology & problem solving framework
• List of steps in Analytics projects
• Identify the most appropriate solution design for the given problem statement
• Project plan for Analytics project & key milestones based on effort estimates
• Build Resource plan for analytics project
• Why R for data science?

• Introduction R/R-Studio – GUI
• Concept of Packages – Useful Packages (Base & Other packages)
• Data Structure & Data Types (Vectors, Matrices, factors, Data frames,  and Lists)
• Importing Data from various sources (txt, dlm, excel, sas7bdata, db, etc.)
• Database Input (Connecting to database)
• Exporting Data to various formats)
• Viewing Data (Viewing partial data and full data)
• Variable & Value Labels –  Date Values

• Data Manipulation steps
• Creating New Variables (calculations & Binning)
• Dummy variable creation
• Applying transformations
• Handling duplicates
• Handling missings
• Sorting and Filtering
• Subsetting (Rows/Columns)
• Appending (Row appending/column appending)
• Merging/Joining (Left, right, inner, full, outer etc)
• Data type conversions
• Renaming
• Formatting
• Reshaping data
• Sampling
• Data manipulation tools
• Operators
• Functions
• Packages
• Control Structures (if, if else)
• Loops (Conditional, iterative loops, apply functions)
• Arrays
• R Built-in Functions (Text, Numeric, Date, utility)
• Numerical Functions
• Text Functions
• Date Functions
• Utilities Functions
• R User Defined Functions
• R Packages for data manipulation (base, dplyr, plyr, data.table, reshape, car, sqldf, etc)

• introduction exploratory data analysis
• Descriptive statistics, Frequency Tables and summarization
• Univariate Analysis (Distribution of data & Graphical Analysis)
• Bivariate Analysis(Cross Tabs, Distributions & Relationships, Graphical Analysis)
• Creating Graphs- Bar/pie/line chart/histogram/boxplot/scatter/density etc)
• R Packages for Exploratory Data Analysis(dplyr, plyr, gmodes, car, vcd, Hmisc, psych, doby etc)
• R Packages for Graphical Analysis (base, ggplot, lattice,etc)

• Basic Statistics – Measures of Central Tendencies and Variance
• Building blocks – Probability Distributions – Normal distribution – Central Limit Theorem
• Inferential Statistics -Sampling – Concept of Hypothesis Testing
• Statistical Methods – Z/t-tests( One sample, independent, paired), Anova, Correlations and Chi-square

• Concept of model in analytics and how it is used?
• Common terminology used in analytics & modelling process
• Popular modelling algorithms
• Types of Business problems – Mapping of Techniques
• Different Phases of Predictive Modelling

•  Need for Data preparation
• Consolidation/Aggregation – Outlier treatment – Flat Liners – Missing values- Dummy creation – Variable Reduction
• Variable Reduction Techniques – Factor & PCA Analysis

• Introduction to Segmentation
• Types of Segmentation (Subjective Vs Objective, Heuristic Vs. Statistical)
• Heuristic Segmentation Techniques (Value Based, RFM Segmentation and Life Stage Segmentation)
• Behavioral Segmentation Techniques (K-Means Cluster Analysis)
• Cluster evaluation and profiling – Identify cluster characteristics
• Interpretation of results – Implementation of new data

• Introduction – Applications
• Assumptions of Linear Regression
• Building Linear Regression Model
• Understanding standard metrics (Variable significance, R-square/Adjusted R-square, Global hypothesis ,etc)
• Assess the overall effectiveness of the model
• Validation of Models (Re running Vs. Scoring)
• Standard Business Outputs (Decile Analysis, Error distribution (histogram), Model equation, drivers, etc.)
• Interpretation of Results – Business Validation – Implementation of new data

• Introduction – Applications
• Linear Regression Vs. Logistic Regression Vs. Generalized Linear Models
• Building Logistic Regression Model (Binary Logistic Model)
• Understanding standard model metrics (Concordance, Variable significance, Hosmer Lemeshov Test, Gini, KS, Misclassification, ROC Curve etc)
• Validation of Logistic Regression Models (Re running Vs. Scoring)
• Standard Business Outputs (Decile Analysis, ROC Curve, Probability Cut-offs, Lift charts, Model equation, Drivers or variable importance, etc)
• Interpretation of Results – Business Validation – Implementation of new data

• Introduction – Applications
• Time Series Components( Trend, Seasonality, Cyclicity and Level) and Decomposition
• Classification of Techniques(Pattern based – Patternless)
• Basic Techniques – Averages, Smoothening, etc
• Advanced Techniques – AR Models, ARIMA, etc
• Understanding Forecasting Accuracy – MAPE, MAD, MSE, etc

• Introduction to Machine Learning & Predictive Modeling
• Types of Business problems – Mapping of Techniques – Regression vs. classification vs. segmentation vs. Forecasting
• Major Classes of Learning Algorithms -Supervised vs Unsupervised Learning
• Different Phases of Predictive Modeling (Data Pre-processing, Sampling, Model Building, Validation)
• Overfitting (Bias-Variance Trade off) & Performance Metrics
• Feature engineering & dimension reduction
• Concept of optimization & cost function
• Overview of gradient descent algorithm
• Overview of Cross-validation(Bootstrapping, K-Fold validation, etc)
• Model performance metrics (R-square, Adjusted R-square, RMSE, MAPE, AUC, ROC curve, recall, precision, sensitivity, specificity, confusion metrics )

• What is segmentation & Role of ML in Segmentation?
• Concept of Distance and related math background
• K-Means Clustering
• Expectation Maximization
• Hierarchical Clustering
• Spectral Clustering (DBSCAN)
• Principle component Analysis (PCA)

• Decision Trees – Introduction – Applications
• Types of Decision Tree Algorithms
• Construction of Decision Trees through Simplified Examples; Choosing the “Best” attribute at each Non-Leaf node; Entropy; Information Gain, Gini Index, Chi Square, Regression Trees
• Generalizing Decision Trees; Information Content and Gain Ratio; Dealing with Numerical Variables; other Measures of Randomness
• Pruning a Decision Tree; Cost as a consideration; Unwrapping Trees as Rules
• Decision Trees – Validation
• Overfitting – Best Practices to avoid

• Concept of Ensembling
• Manual Ensembling Vs. Automated Ensembling
• Methods of Ensembling (Stacking, Mixture of Experts)
• Bagging (Logic, Practical Applications)
• Random forest (Logic, Practical Applications)
• Boosting (Logic, Practical Applications)
• Ada Boost
• Gradient Boosting Machines (GBM)
• XGBoost

• Motivation for Neural Networks and Its Applications
• Perceptron and Single Layer Neural Network, and Hand Calculations
• Learning In a Multi Layered Neural Net: Back Propagation and Conjugant Gradient Techniques
• Neural Networks for Regression
• Neural Networks for Classification
• Interpretation of Outputs and Fine-tune the models with hyperparameters
• Validating ANN models

• Motivation for Support Vector Machine & Applications
• Support Vector Regression
• Support vector classifier (Linear & Non-Linear)
• Mathematical Intuition (Kernel Methods Revisited, Quadratic Optimization, and Soft Constraints)
• Interpretation of Outputs and Fine-tune the models with hyperparameters
• Validating SVM models

• What are KNN & Applications?
• KNN for missing treatment
• KNN For solving regression problems
• KNN for solving classification problems
• Validating KNN model
• Model fine-tuning with hyperparameters

• Concept of Conditional Probability
• Bayes Theorem and Its Applications
• Naïve Bayes for classification
• Applications of Naïve Bayes in Classifications

• Taming big text, Unstructured vs. Semi-structured Data; Fundamentals of information retrieval, Properties of words; Creating Term-Document (TxD);Matrices; Similarity measures, Low-level processes (Sentence Splitting; Tokenization; Part-of-Speech Tagging; Stemming; Chunking)
• Finding patterns in text: text mining, text as a graph
• Natural Language processing (NLP)
• Text Analytics – Sentiment Analysis using R
• Text Analytics – Word cloud analysis using R
• Text Analytics – Segmentation using K-Means/Hierarchical Clustering
• Text Analytics – Classification (Spam/Not spam)
• Applications of Social Media Analytics
• Metrics(Measures Actions) in social media analytics
• Examples & Actionable Insights using Social Media Analytics
• Important R packages for Machine Learning (caret, H2O, Randomforest, nnet, tm etc)
• Fine-tuning the models using Hyperparameters, grid search, piping etc.

• Analytics World
  • Introduction to Analytics
  • Concept of ETL
  • S-A-S in advanced analytics
• Global Certification: Induction and walkthrough
  • Getting Started
  • Software installation
  • Introduction to GUI
  • Different components of the language
  • All programming windows
  • Concept of Libraries and Creating Libraries
  • Variable Attributes – (Name, Type, Length, Format, In format, Label)
  • Importing Data and Entering data manually
• Understanding Datasets
  • Descriptor Portion of a Dataset (Proc Contents)
  • Data Portion of a Dataset
  • Variable Names and Values
  • Data Libraries

• Understanding Data Step Processing
  • Data Step and Proc Step
  • Data step execution
  • Compilation and execution phase
  • Input buffer and concept of PDV
• Importing Raw Data Files
  • Column Input and List Input and Formatted methods
  • Delimiters, Reading missing and non standard values
  • Reading one to many and many to one records
  • Reading Hierarchical files
  • Creating raw data files and put statement
  • Formats / Informat
• Importing and Exporting Data (Fixed Format / Delimited)
• Proc Import / Delimited text files
• Proc Export / Exporting Data
• Datalines / Cards;
• Atypical importing cases (mixing different style of inputs)
  • Reading Multiple Records per Observation
  • Reading “Mixed Record Types”
  • Sub-setting from a Raw Data File
  • Multiple Observations per Record
  • Reading Hierarchical Files
  •  
• Concept of SAS library and SAS Catalog
• Variable Types in SAS
• Reading Data stored external to SAS
• Importing Data by using Proc Import
• Data Step SAS statements
• SAS Functions
• Appending and Merging using SAS
• SAS Procedures like proc means, proc Univariate, proc append, proc freq and proc export.
• SAS SQL
• SAS Macros

• One Sample t-test of comparing means
• Two Sample t-test of comparing means
• One Way ANOVA
• Assumptions of ANOVA Modeling
• n-way ANOVA
• ANOVA Post Hoc Studies

• Apply the principles of honest assessment to model performance measurement
• Assess classifier performance using the confusion matrix
• Model selection and validation using training and validation data
• Create and interpret graphs (ROC, lift, and gains charts) for model comparison and selection
• Establish effective decision cut-off values for scoring

• Understanding and Exploration Data
  • Introduction to basic Procedures – Proc Contents, Proc Print
• Understanding and Exploration Data
  • Operators and Operands
  • Conditional Statements (Where, If, If then Else, If then Do and select when)
  • Difference between WHERE and IF statements and limitation of WHERE statements
  • Labels, Commenting
  • System Options (OBS, FSTOBS, NOOBS, etc…)
• Data Manipulation
  • Proc Sort – with options / De-Duping
  • Accumulator variable and By-Group processing
  • Explicit Output Statements
  • Nesting Do loops
  • Do While and Do Until Statement
  • Array elements and Range
• Combining Datasets (Appending and Merging)
  • Concatenation
  • Interleaving
  • Proc Append
  • One To One Merging
  • Match Merging
  • IN = Controlling merge and Indicator

• Introduction to Databases
• Introduction to Proc SQL
• Basics of General SQL language
• Creating a table and Inserting Values
• Retrieve & Summarize data
• Group, Sort & Filter
• Using Joins (Full, Inner, Left, Right, and Outer)
• Reporting and summary analysis
• Concept of Indexes and creating Indexes (simple and composite)
• Connecting S-A-S to external Databases
• Implicit and Explicit pass-through methods

• Macro Parameters and Variables
• Different types of Macro Creation
• Defining and calling a macro
• Using call Symput and Symget
• Macros options (mprint symbolgen mlogic merror serror)

• Basic Statistics – Measures of Central Tendencies and Variance
• Building blocks – Probability Distributions – Normal distribution – Central Limit Theorem
• Inferential Statistics -Sampling – Concept of Hypothesis Testing
• Statistical Methods – Z/t-tests( One sample, independent, paired), Anova, Correlations, and Chi-square    
• Levels of Measurement and Variable types
• Descriptive Statistics and Picturing Distributions
• Confidence Interval for the Mean

• Introduction to Predictive Modeling
• Types of Business problems – Mapping of Techniques
• Different Phases of Predictive Modeling

• Need of Data preparation
• Data Audit Report and Its importance
• Consolidation/Aggregation – Outlier treatment – Flat Liners – Missing values- Dummy creation – Variable Reduction
• Variable Reduction Techniques – Factor & PCA Analysis

• Introduction to Segmentation
• Types of Segmentation (Subjective Vs Objective, Heuristic Vs. Statistical)
• Heuristic Segmentation Techniques (Value Based, RFM Segmentation and Life Stage Segmentation)
• Behavioral Segmentation Techniques (K-Means Cluster Analysis)
• Cluster evaluation and profiling
• Interpretation of results – Implementation of new data

• Introduction – Applications
• Assumptions of Linear Regression
• Building a Linear Regression Model
• Understanding standard metrics (Variable significance, R-square/Adjusted R-square, Global hypothesis, etc)
• Validation of Models (Re-running Vs. Scoring)
• Standard Business Outputs (Decile Analysis, Error distribution (histogram), Model equation, drivers, etc.)
• Interpretation of Results – Business Validation – Implementation of new data

• Introduction – Applications
• Linear Regression Vs. Logistic Regression Vs. Generalized Linear Models
• Building a Logistic Regression Model
• Understanding standard model metrics (Concordance, Variable significance, Hosmer Lemeshov Test, Gini, KS, Misclassification, etc)
• Validation of Logistic Regression Models (Re-running Vs. Scoring)
• Standard Business Outputs (Decile Analysis, ROC Curve,
  Probability Cut-offs, Lift charts, Model equation, Drivers, etc)
• Interpretation of Results – Business Validation -Implementation of new data

• Introduction – Applications
• Time Series Components( Trend, Seasonality, Cyclicity, and Level) and Decomposition
• Classification of Techniques(Pattern-based – Patternless)
• Basic Techniques – Averages, Smoothening, etc
• Advanced Techniques – AR Models, ARIMA, etc
• Understanding Forecasting Accuracy – MAPE, MAD, MSE, etc

• Statistical learning vs. Machine learning
• Major Classes of Learning Algorithms -Supervised vs Unsupervised Learning
• Concept of Overfitting and Underfitting (Bias-Variance Tradeoff) & Performance Metrics
• Types of Cross-validation(Train & Test, Bootstrapping, K-Fold validation, etc)

• Recursive Partitioning(Decision Trees)
• Ensemble Models(Random Forest, Bagging & Boosting)
• K-Nearest neighbors

• What is Data Science?
• Why Python for data science?
• Relevance in industry and need of the hour
• How leading companies are harnessing the power of Data Science with Python?
• Different phases of a typical Analytics/Data Science projects and role of python
• Anaconda vs. Python

• Overview of Python- Starting with Python
• Introduction to installation of Python
• Introduction to Python Editors & IDE’s(Canopy, pycharm, Jupyter, Rodeo, Ipython etc…)
• Understand Jupyter notebook & Customize Settings
• Concept of Packages/Libraries – Important packages(NumPy, SciPy, scikit-learn, Pandas, Matplotlib, etc)
• Installing & loading Packages & Name Spaces
• Data Types & Data objects/structures (strings, Tuples, Lists, Dictionaries)
• List and Dictionary Comprehensions
• Variable & Value Labels –  Date & Time Values
• Basic Operations – Mathematical – string – date
• Reading and writing data
• Simple plotting
• Control flow & conditional statements
• Debugging & Code profiling
• How to create class and modules and how to call them?
• Scientific distributions used in python for Data Science – Numpy, scify, pandas, scikitlearn, statmodels, nltk etc

• Importing Data from various sources (Csv, txt, excel, access etc)
• Database Input (Connecting to database)
• Viewing Data objects – subsetting, methods
• Exporting Data to various formats
• Important python modules: Pandas, beautifulsoup

• Cleansing Data with Python
• Data Manipulation steps(Sorting, filtering, duplicates, merging, appending, subsetting, derived variables, sampling, Data type conversions, renaming, formatting etc)
• Data manipulation tools(Operators, Functions, Packages, control structures, Loops, arrays etc)
• Python Built-in Functions (Text, numeric, date, utility functions)
• Python User Defined Functions
• Stripping out extraneous information
• Normalizing data
• Formatting data
• Important Python modules for data manipulation (Pandas, Numpy, re, math, string, DateTime etc)

• Introduction exploratory data analysis
• Descriptive statistics, Frequency Tables and summarization
• Univariate Analysis (Distribution of data & Graphical Analysis)
• Bivariate Analysis(Cross Tabs, Distributions & Relationships, Graphical Analysis)
• Creating Graphs- Bar/pie/line chart/histogram/ boxplot/ scatter/ density etc)
• Important Packages for Exploratory Analysis(NumPy Arrays, Matplotlib, seaborn, Pandas and scipy.stats etc)

• Basic Statistics – Measures of Central Tendencies and Variance
• Building blocks – Probability Distributions – Normal distribution – Central Limit Theorem
• Inferential Statistics -Sampling – Concept of Hypothesis Testing
• Statistical Methods – Z/t-tests (One sample, independent, paired), Anova, Correlation, and Chi-square
• Important modules for statistical methods: Numpy, Scipy, Pandas

• Introduction to Machine Learning & Predictive Modeling
• Types of Business problems – Mapping of Techniques – Regression vs. classification vs. segmentation vs. Forecasting
• Major Classes of Learning Algorithms -Supervised vs Unsupervised Learning
• Different Phases of Predictive Modeling (Data Pre-processing, Sampling, Model Building, Validation)
• Overfitting (Bias-Variance Trade off) & Performance Metrics
• Feature engineering & dimension reduction
• Concept of optimization & cost function
• Concept of gradient descent algorithm
• Concept of Cross validation(Bootstrapping, K-Fold validation etc)
• Model performance metrics (R-square, RMSE, MAPE, AUC, ROC curve, recall, precision, sensitivity, specificity, confusion metrics)

• Linear & Logistic Regression
• Segmentation – Cluster Analysis (K-Means)
• Decision Trees (CART/CD 5.0)
• Ensemble Learning (Random Forest, Bagging & boosting)
• Artificial Neural Networks(ANN)
• Support Vector Machines(SVM)
• Other Techniques (KNN, Naïve Bayes, PCA)
• Introduction to Text Mining using NLTK
• Introduction to Time Series Forecasting (Decomposition & ARIMA)
• Important python modules for Machine Learning (SciKit Learn, stats models, scipy, nltk etc)
• Fine-tuning the models using Hyperparameters, grid search, piping, etc.

• Applying different algorithms to solve the business problems and bench mark the results

• Introduction and Relevance
• Uses of Big Data analytics in various industries like Telecom, E-commerce, Finance, and Insurance, etc.
• Problems with Traditional Large-Scale Systems

• Motivation for Hadoop
• Different types of projects by Apache
• Role of projects in the Hadoop Ecosystem
• Key technology foundations required for Big Data
• Limitations and Solutions of existing Data Analytics Architecture
• Comparison of traditional data management systems with Big Data management systems
• Evaluate key framework requirements for Big Data analytics
• Hadoop Ecosystem & Hadoop 2.x core components
• Explain the relevance of real-time data
• Explain how to use Big Data and real-time data as a Business planning tool

• Hadoop Master-Slave Architecture
• The Hadoop Distributed File System – Concept of data storage
• Explain different types of cluster setups(Fully distributed/Pseudo etc)
• Hadoop cluster set up – Installation
• Hadoop 2.x Cluster Architecture
• A Typical enterprise cluster – Hadoop Cluster Modes
• Understanding cluster management tools like Cloudera Manager/Apache ambari

• HDFS Overview & Data storage in HDFS
• Get the data into Hadoop from local machine(Data Loading Techniques) – vice versa
• Map Reduce Overview (Traditional way Vs. MapReduce way)
• Concept of Mapper & Reducer
• Understanding MapReduce program Framework
• Develop MapReduce Program using Java (Basic)
• Develop MapReduce program with streaming API) (Basic)

• Integrating Hadoop into an Existing Enterprise
• Loading Data from an RDBMS into HDFS by Using Sqoop
• Managing Real-Time Data Using Flume
• Accessing HDFS from Legacy Systems

• Introduction to Data Analysis Tools
• Apache PIG – MapReduce Vs Pig, Pig Use Cases
• PIG’s Data Model
• PIG Streaming
• Pig Latin Program & Execution
• Pig Latin : Relational Operators, File Loaders, Group Operator, COGROUP Operator, Joins and COGROUP, Union, Diagnostic Operators, Pig UDF
• Writing JAVA UDF’s
• Embedded PIG in JAVA
• PIG Macros
• Parameter Substitution
• Use Pig to automate the design and implementation of MapReduce applications
• Use Pig to apply structure to unstructured Big Data

• Apache Hive – Hive Vs. PIG – Hive Use Cases
• Discuss the Hive data storage principle
• Explain the File formats and Records formats supported by the Hive environment
• Perform operations with data in Hive
• Hive QL: Joining Tables, Dynamic Partitioning, Custom Map/Reduce Scripts
• Hive Script, Hive UDF
• Hive Persistence formats
• Loading data in Hive – Methods
• Serialization & Deserialization
• Handling Text data using Hive
• Integrating external BI tools with Hadoop Hive

• Impala & Architecture
• How Impala executes Queries and their importance
• Hive vs. PIG vs. Impala
• Extending Impala with User Defined functions

• NoSQL database – Hbase
• Introduction Oozie

• Introduction to Apache Spark
• Streaming Data Vs. In-Memory Data
• Map Reduce Vs. Spark
• Modes of Spark
• Spark Installation Demo
• Overview of Spark on a cluster
• Spark Standalone Cluster

• Invoking Spark Shell
• Creating the Spark Context
• Loading a File in Shell
• Performing Some Basic Operations on Files in Spark Shell
• Caching Overview
• Distributed Persistence
• Spark Streaming Overview(Example: Streaming Word Count)

• Analyze Hive and Spark SQL Architecture
• Analyze Spark SQL
• Context in Spark SQL
• Implement a sample example for Spark SQL
• Integrating hive and Spark SQL
• Support for JSON and Parquet File Formats Implement Data Visualization in Spark
• Loading of Data
• Hive Queries through Spark
• Performance Tuning Tips in Spark
• Shared Variables: Broadcast Variables & Accumulators

• Extract and analyze the data from Twitter using Spark streaming
• Comparison of Spark and Storm – Overview

• Overview of GraphX module in spark
• Creating graphs with GraphX

• Understand Machine learning framework
• Implement some of the ML algorithms using Spark MLLib

• Consolidate all the learnings
• Working on Big Data Project by integrating various key components

Note: Depends upon Trainers above projects may vary