Course Outline
Introduction to the Stratio Platform
- Overview of Stratio’s architecture and core components.
- The role of Rocket and Intelligence within the data lifecycle.
- Logging in and navigating the Stratio user interface.
Utilizing the Rocket Module
- Establishing data ingestion and pipeline creation.
- Integrating data sources and configuring transformations.
- Applying PySpark for preprocessing tasks within Rocket.
PySpark Essentials for Stratio Users
- Core PySpark data structures and operations.
- Implementing looping constructs: for, while, and if/else usage.
- Creating custom functions using def and applying them effectively.
Advanced Integration of Rocket with PySpark
- Handling streaming ingestion and transformations.
- Utilizing loops and functions in both batch and real-time scenarios.
- Best practices for optimizing PySpark pipeline performance.
Exploring the Intelligence Module
- Overview of data modeling and analytical capabilities.
- Feature selection, transformation, and exploratory analysis.
- The role of PySpark in generating custom analytics and insights.
Developing Advanced Analytics Workflows
- Creating user-defined functions (UDFs) within the Intelligence module.
- Applying conditionals and loops for complex data logic.
- Practical use cases: segmentation, aggregation, and prediction.
Deployment and Collaboration
- Saving, exporting, and reusing established workflows.
- Collaborating with team members on the Stratio platform.
- Reviewing outputs and integrating results with downstream tools.
Summary and Future Steps
Requirements
- Proficiency in Python programming.
- Familiarity with data analytics or big data processing concepts.
- Foundational understanding of Apache Spark and distributed computing principles.
Target Audience
- Data engineers working within Stratio-based environments.
- Analysts or developers utilizing the Rocket and Intelligence modules.
- Technical teams migrating to PySpark workflows within the Stratio platform.
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.