O poziciji

C&I is announcing an opening for a Data Engineer within our dynamic data engineering team. This full-time position offers the opportunity to work on innovative projects in sports analytics, media, and sponsorship, serving top-tier football clubs, associations, and sports analysis providers. As a member of our team, you will contribute to our full-service football data platform that provides automatic deployment and maintenance of a user’s isolated data environment, integration of multiple football data sources into easy-to-use data tables, and creation of analytics reports.

Key Responsibilities:

• Data Management: Collect, cleanse, and integrate data from a wide array of sources for in-depth analysis.
• Pipeline Development: Design and implement ETL pipelines for new data sources.
• Data Transformation: Develop scripts to transform raw data and store it in formats like .json or .parquet.
• Data Integration: Load and transform data into SQL Databases and Delta Lakes.
• Error Handling: Implement systems to handle errors and send notifications.
• System Maintenance: Monitor and troubleshoot pipeline executions, update existing data transformation notebooks.
• Quality Assurance: Ensure data quality and consistency throughout all processes.
• Process Optimization: Innovate and improve current and future data processes.
• Collaboration: Work closely with clients and data scientists to optimize data utilization and infrastructure design.
• Platform Development: Join our team in developing a state-of-the-art football integration platform, collaborating with the data, API, deployment, and front-end teams.

Minimalne kvalifikacije

Required Skills:

• Proficiency in Python
• Proficiency in SQL
• Familiarity with object-oriented programming
• Experience with Git

Candidate Profile:

• Master of Science in Information and Communication Technology
• Master of Science in Computing
• Master’s degree in a related field
• min 1 year of work experience in a related field

Bonus kvalifikacije

What tools our teams also use (not required, not all teams use the same tools):

• Libraries and Packages: Pandas, Apache Spark, Delta Lake, Apache Iceberg, Docker
• Cloud Services: Azure Functions, AWS Lambda Functions, Databricks, Azure Synapse, AWS Glue, BigQuery
• Orchestration Tools: Azure Data Factory, AWS Glue, AWS Step Functions
• Container Management: AWS ECS, Azure Container Services

Očekivanja od tebe na ovoj poziciji

We expect our candidates to seamlessly integrate into our team, fostering creativity and a commitment to learning. We highly value the contribution of new ideas and actively encourage engagement.

Zašto je super raditi na ovoj poziciji

At C&I, our data engineering teams build and maintain large-scale big data infrastructures for major corporate clients, including leading football clubs and associations worldwide. Our teams are recognized for their high skill levels and industry reputation, tackling complex tasks with an agile approach. This role offers a unique chance to engage in cutting-edge sports data projects, fostering skill development and collaboration in a supportive environment. Our diverse client base and the variety of systems provide ample learning opportunities with numerous technologies.