In Kotsovolos we embrace everything you have to offer. Join our team and let’s #beMORE together!
Responsibilities
Design, develop, and maintain scalable and reliable data pipelines using Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and others
Responsible for the Continuous Integration & Continuous Delivery for DWH and analytics processes
Designs, builds, operationalizes and monitors data processing systems with a particular emphasis on security, scalability and efficiency, reliability, flexibility and portability
Performs data extraction, ingestion, wrangling, data conversion, transformation and mapping
Performs complex data warehouse ETL processes and diagnoses business logic failures and data flows, to quickly resolve issues
Collaborates closely with the Data Governance & Architecture Tower (to determine appropriate data management systems) and Data Scientists (to determine data sets required for analysis)
Reassures technical specification documentation for all reports and processes exists and is maintained
Tracks trouble tickets, upcoming activity and maintains dashboards for operational stability and owns the DevOps pipeline for the application
Reassures all processes from the Data Science team is automated, abiding to all required principles before proceeding to deployment
Oversees the deployment of data and ML pipelines
Works with data scientists for the productionalization / automation using Spark packages of any new pipelines
Requirements
Microsoft Azure
Python
SQL
Degree in Computer Science, IT, or similar field; a Master’s is a plus
Data engineering certification (e.g Azure Certified) is a plus
Minimum 3 years of experience in SQL, Python
Strong experience in Microsoft Azure Stack (Azure Synapse Analytics, Data Factory, Databricks, Devops) and distributed computing frameworks (e.g. Apache Spark)
Hands-on experience with CI/CD pipelines and version control using Azure DevOps
Experience working with APIs
Experience with Agile and SCRUM processes and methodologies is a plus
Experience with PowerApps, Large Language Models (LLMs) and AI-driven data processing and creation is a plus
