Data EngineerSee all recent Jobs

We are looking for an experienced Data Engineer to join our team on behalf of one of our major clients in the banking industry.

The ideal candidate will be proficient in big data technologies and cloud platforms, ensuring the reliable and efficient processing of large datasets, with a focus on building scalable data pipelines, managing data quality, and optimizing data workflows.

Responsibilities:

• Utilize data management and processing capabilities in PySpark/SparkSQL/SQL to design, build, and optimize scalable data pipelines.
• Leverage the big data platforms for large-scale data processing, ensuring efficient data workflows and integration.
• Implement robust ETL processes to extract, transform, and load data from various sources into data lakes and warehouses.
• Identify, troubleshoot, and resolve data quality issues, ensuring the integrity and reliability of data across all pipelines.
• Collaborate with data scientists and analysts to enable advanced analytics and machine learning models through well-engineered data pipelines.
• Optimize data storage and retrieval for both batch and real-time data processing.
• Work with diverse datasets, ensuring data availability and consistency for stakeholders.

Requirements:

• Bachelor’s degree or higher in Computer Science, Information Technology, or a related field.
• 3-4 years of hands-on experience in data engineering and data pipeline development.
• Experience in working at Data Science projects and ability to collaborate with Data Scientists.
• Proficiency in PySpark/SparkSQL/SQL for big data processing and optimization.
• Familiarity with cloud platforms, particularly Azure, for deploying and managing data infrastructure.
• Solid understanding of ETL processes, data warehousing, and data lake architectures.

Nice to Have:

• Experience with version control systems (e.g. Git) and CI/CD pipelines for data engineering.
• Cluster Tuning experience, for optimization of performance
• Experience in banking industry will be highly appreciated

Benefits:

• Competitive remuneration package
• Hybrid way of working
• Private Health Insurance
• Unlimited free access to wellness workplace support platform
• A dynamic challenging environment resulting continuous learning / education / progression
• Ability to work with cutting edge technologies
• Pleasant working environment
• Ability to expand knowledge and responsibilities

UpcoMinds is a dynamic IT company with 25 years of experience that provides end-to-end web and mobile solutions helping businesses to reinvent themselves in the digital world. Our team’s skills and expertise will ensure the holistic digital transformation of any organization, which will considerably improve both business operations and customer’s experience.

Our goal is to always have our end products and services reflect our deep engineering skills and elegant progressive design aesthetic. We fundamentally believe deeply in developing long term strategic partnerships with our clients by exceeding expectations and maintaining a high level of transparency.

Find out more about us at www.upcominds.com

We commit to promote Inclusion & Diversity by creating a working environment where all employees are treated with dignity and respect and where individual differences are valued. We offer equal opportunity in all aspects of employment.

Our recruitment consultants will go through your Curriculum Vitae as soon as possible and get back to you to discuss the opportunity for which you apply. If you don’t hear from us in the coming ten (10) working days, you may consider that you have not been selected for the particular job.