0
applicants
Data Engineer
at Annex It Solutions in Ontario
We are looking for a talented and detail-oriented Data Engineer to join our data team. In this role, you will design, build, and maintain scalable data pipelines and infrastructure that enable the organization to extract valuable insights from large volumes of structured and unstructured data. The ideal candidate will have a strong background in data architecture, ETL development, and cloud technologies.
Key Responsibilities:
Design and implement robust, scalable, and high-performance data pipelines (batch and real-time).
Develop and maintain ETL/ELT processes to ingest data from diverse sources into data warehouses or data lakes.
Collaborate with data scientists, analysts, and stakeholders to understand data needs and deliver optimized solutions.
Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
Ensure data quality, consistency, and security across all stages of the pipeline.
Create and maintain documentation for data architecture, processes, and best practices.
Stay up-to-date with emerging technologies in data engineering and recommend adoption where appropriate.
Required Skills & Technologies:
Strong proficiency in SQL, data modeling, and relational databases (e.g., PostgreSQL, MySQL, SQL Server).
Programming experience with Python, Scala, or Java.
Experience with ETL tools (e.g., Apache Airflow, Talend, dbt, Informatica).
Experience working with large-scale data warehouses (e.g., Snowflake, BigQuery, Redshift) and/or data lakes (e.g., S3, Delta Lake).
Familiarity with distributed data processing frameworks (e.g., Apache Spark, Hadoop).
Hands-on experience with cloud platforms (AWS, GCP, or Azure) and cloud-native data services.
Strong understanding of data governance, data quality, and security best practices.
Experience with containerization and orchestration tools like Docker and Kubernetes is a plus.
Qualifications:
Bachelors or Masters degree in Computer Science, Engineering, Data Science, or a related field.
[28+] years of experience in data engineering or a similar role.
Excellent analytical and problem-solving skills.
Strong communication and collaboration skills.
Reference : Data Engineer jobs
Reference : Data Engineer jobs
Published at 03-06-2025
Viewed: 2 times
Viewed: 2 times