You are viewing a preview of this job. Log in or register to view more details about this job.

Data Engineer

Job Summary:

We are seeking an experienced Data Engineer to design, build, and optimize data pipelines, ETL processes, and scalable data solutions. The ideal candidate will have strong expertise in big data technologies, cloud platforms, and SQL/NoSQL databases, along with a solid understanding of data modeling and architecture.

Key Responsibilities:

Design, develop, and maintain ETL/ELT pipelines to ingest, transform, and load data from multiple sources.

Build and optimize data warehouses, data lakes, and real-time data streaming solutions.

Work with structured and unstructured datasets across cloud and on-premise platforms.

Ensure data quality, governance, and security standards are met.

Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.

Develop and maintain data models and schemas for analytics and reporting.

Optimize database performance and query efficiency.

Automate workflows using scripting languages (Python, Shell, etc.).

Deploy and manage data pipelines on cloud platforms (AWS, Azure, GCP).

Monitor, troubleshoot, and resolve issues in production data pipelines.

Required Skills & Qualifications:

Bachelor’s or Master’s degree in Computer Science, IT, or related field.

5–10+ years of professional experience in data engineering.

Proficiency in SQL and experience with relational (PostgreSQL, MySQL, Oracle) and NoSQL databases (MongoDB, Cassandra, DynamoDB).

Strong programming skills in Python, Java, or Scala.

Hands-on experience with Big Data tools (Hadoop, Spark, Hive, Kafka, Flink).

Experience with ETL tools (Informatica, Talend, Apache NiFi, dbt).

Cloud expertise with AWS (Redshift, Glue, S3, EMR), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).

Knowledge of CI/CD pipelines, Docker, Kubernetes is a plus.

Familiarity with data security, governance, and compliance (GDPR, HIPAA, etc.).

Preferred Certifications (Optional):

AWS Certified Data Analytics / Solutions Architect

Google Cloud Professional Data Engineer

Microsoft Azure Data Engineer Associate

Soft Skills:

Strong problem-solving and analytical skills.

Excellent communication and collaboration abilities.

Ability to work in agile, fast-paced environments.

Detail-oriented with a focus on data accuracy.