Key Responsibilities
• Data Pipeline Development
Assist in designing, building, and maintaining data pipelines using:
- Azure Databricks (ETL/ELT, Delta Lake)
- Azure Data Factory for orchestration and scheduling
• Data Integration
Contribute to integrating data from multiple sources, ensuring data quality and consistency. Support tasks related to data ingestion, transformation, and validation.
• Data Warehousing Support
Help develop and maintain data warehouse structures in Azure Synapse Analytics, supporting reporting and analytics teams.
• Collaboration & Support
Work closely with data engineers, data scientists, and analysts to understand requirements and implement data solutions under supervision.
• Performance & Cost Optimization (Foundational)
Learn to optimize pipelines and storage systems for performance, scalability, and cost efficiency.
• Security & Compliance Awareness
Follow established security practices for handling sensitive financial data and support compliance efforts.
• Monitoring & Troubleshooting
Assist in monitoring data jobs, identifying issues, and troubleshooting under the guidance of senior engineers.
