Data Engineer
Data Engineer
Position Overview:
We are seeking a skilled and driven Data Engineer (Group 3) to join our team and play a key role in building and optimizing our data infrastructure. In this role, you will work on designing and implementing data pipelines, data storage solutions, and ensuring the availability and quality of data for various business teams. You will collaborate closely with data scientists, analysts, and business stakeholders to provide high-quality data that supports decision-making and drives business success. This is an exciting opportunity to work on cutting-edge technologies and shape the future of our data architecture.
Key Responsibilities:
Data Pipeline Development & Optimization:
• Design, build, and maintain scalable data pipelines to support the extraction, transformation, and loading (ETL) of data from various sources.
• Optimize and automate data workflows to enhance data processing efficiency and reliability.
• Collaborate with cross-functional teams to ensure that the data pipelines meet the business needs.
Data Infrastructure & Architecture:
• Work on the design and implementation of data storage and management solutions, ensuring data is organized and easily accessible.
• Build and manage data infrastructure to support high-performance data processing, including databases, data lakes, and cloud environments.
• Ensure the data architecture is scalable, secure, and reliable.
Data Quality & Integrity:
• Ensure the quality, integrity, and consistency of the data by implementing appropriate validation processes and monitoring systems.
• Identify data anomalies and work with stakeholders to resolve data issues.
• Perform data cleansing and pre-processing tasks to ensure accurate and consistent data for analysis.
Collaboration & Communication:
• Work closely with data analysts and business intelligence teams to understand data requirements and support their analytical needs.
• Collaborate with IT teams to ensure seamless integration of data systems and resolve technical challenges.
• Communicate complex data engineering concepts clearly to non-technical stakeholders.
Continuous Improvement & Innovation:
• Stay updated on the latest data engineering tools, technologies, and best practices.
• Recommend enhancements to data systems and processes to improve efficiency, scalability, and performance.
• Participate in the evaluation and adoption of new technologies that could optimize data workflows and infrastructure.
Qualifications:
• Bachelor’s degree in computer science, Information Technology, Data Engineering, or a related field.
• Proficiency in data engineering tools and technologies, such as ETL frameworks, SQL, Python, and cloud platforms (AWS, Azure, GCP).
• Experience with database management systems, data lakes, and data warehousing solutions.
• Strong understanding of data architecture principles and data modeling techniques.
• Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus.
• Strong problem-solving skills and ability to debug complex data-related issues.
• Excellent communication skills with the ability to convey technical information clearly to non-technical teams.
• Ability to work independently and collaboratively within a team-oriented environment.
As a Data Engineer you’ll have the opportunity to shape and optimize the data systems that support business intelligence and decision-making across the company. Join our team and contribute to building the future of data infrastructure while ensuring the delivery of high-quality, actionable data.