Apache Spark in the Cloud培訓

課程代碼

sparkcloud

課程時長

21 時間：同常來說包括休息是 3天

最低要求

Programing skills (preferably python, scala)

SQL basics

概觀

Apache Spark的學習曲線在開始時逐漸增加，需要付出很多努力來獲得第一次回歸。本課程旨在突破第一個艱難的部分。參加本課程後，參與者將了解Apache Spark的基礎知識，他們將明確區分RDD和DataFrame，他們將學習Python和Scala API，他們將理解執行者和任務等。同樣遵循最佳實踐，本課程重點關注雲部署，Databricks和AWS。學生還將了解AWS EMR與AWS Glue之間的差異，AWS Glue是AWS最新的Spark服務之一。

聽眾：

數據工程師， DevOps ，數據科學家

Machine Translated

課程簡介

Introduction:

Apache Spark in Hadoop Ecosystem
Short intro for python, scala

Basics (theory):

Architecture
RDD
Transformation and Actions
Stage, Task, Dependencies

Using Databricks environment understand the basics (hands-on workshop):

Exercises using RDD API
Basic action and transformation functions
PairRDD
Join
Caching strategies
Exercises using DataFrame API
SparkSQL
DataFrame: select, filter, group, sort
UDF (User Defined Function)
Looking into DataSet API
Streaming

Using AWS environment understand the deployment (hands-on workshop):

Basics of AWS Glue
Understand differencies between AWS EMR and AWS Glue
Example jobs on both environment
Understand pros and cons

Extra:

Introduction to Apache Airflow orchestration

客戶評論

★★★★★

★★★★★

理查德非常冷靜和有條不紊，具有分析洞察力 - 正是提出這種課程所需的品質。

Kieran Mac Kenna

課程:Spark for Developers

Machine Translated

我們對整個環境了解得更多。

John Kidd

課程:Spark for Developers

Machine Translated

培訓師讓課堂變得有趣和有趣，這對全天培訓有很大幫助。

Ryan Speelman

課程:Spark for Developers

Machine Translated

Ernesto在解釋使用Spark及其各種模塊的高級概念方面做得很好。

Michael Nemerouf

課程:Spark for Developers

Machine Translated

我喜歡喬治所期望的方法論。

Experian Colombia S.A

課程:Spark for Developers

Machine Translated

當我們想要提出關於不在課程提綱上的事情的半相關問題時，理查德非常願意離題。解釋很清楚，他提出的任何建議都是關於警告的。

ARM Limited

課程:Spark for Developers

Machine Translated

我非常喜歡的虛擬機器老師對這個話題以及其他話題都很瞭解, 他很好, 也很友好。我喜歡迪拜的設施。

Safar Alqahtani - Elm Information Security

課程:Big Data Analytics in Health

Machine Translated

Small group (4 trainees) and we could progress together. Also the trainer could so help everybody.

ICE International Copyright Enterprise Germany GmbH

課程:Spark for Developers

Ajay非常友好，樂於助人，也對他正在討論的話題有所了解。

Biniam Guulay - ICE International Copyright Enterprise Germany GmbH

課程:Spark for Developers

Machine Translated

The lab exercises. Applying the theory from the first day in subsequent days.

Dell

課程:A Practical Introduction to Stream Processing

我認為培訓師具有將幽默和現實生活故事相結合的優秀風格，使手頭的主題非常平易近人。我強烈推薦這位教授。

課程:Spark for Developers

Machine Translated

The trainer was passionate and well-known what he said I appreciate his help and answers all our questions and suggested cases.

課程:A Practical Introduction to Stream Processing

課程分類

相關課程

促銷課程

ELK: Elasticsearch, Logstash and Kibana for Administrators

10/22/2019 - 09:30

The Hsinchu Wishun centre

更多

Artificial Intelligence Overview

10/29/2019 - 09:30

The Hsinchu Wishun centre

更多

Blockchain Development with Coinbase

10/30/2019 - 09:30

The Hsinchu Wishun centre

更多

Zeppelin for Interactive Data Analytics

01/09/2020 - 09:30

The Hsinchu Wishun centre

更多

Signavio Process Manager

01/30/2020 - 09:30

台北, Concord

更多

我們的客戶

ibm business consulting services

nexsan technologies canada

avid technology

toyota bank polska

santander consumer bank

european space agency (esa)

thomson reuters corporation

universal music publishing group

zf friedrichshafen

european organization for nuclear research (cern)

avon products, inc

royal dutch shell

procter & gamble (p&g)

the emirates group

environmental protection agency (epa) ireland

nokia siemens networks

starnet telecom

aviva commercial union

société générale

schneider electric

phoenix geophysics

ibm business consulting services

nexsan technologies canada

avid technology

toyota bank polska

santander consumer bank

european space agency (esa)

thomson reuters corporation

universal music publishing group

zf friedrichshafen

european organization for nuclear research (cern)

avon products, inc

royal dutch shell

procter & gamble (p&g)

the emirates group

environmental protection agency (epa) ireland

nokia siemens networks

starnet telecom

aviva commercial union

société générale

schneider electric

phoenix geophysics

is growing fast!

We are looking to expand our presence in Taiwan!

As a Business Development Manager you will:

expand business in Taiwan
recruit local talent (sales, agents, trainers, consultants)
recruit local trainers and consultants

We offer:

Artificial Intelligence and Big Data systems to support your local operation
high-tech automation
continuously upgraded course catalogue and content
good fun in international team

If you are interested in running a high-tech, high-quality training and consulting business.