Data Engineer Lead Jobs

Flexible working arrangements
Award winning business
Excellent package and benefits

Our client are seeking a highly experienced Data Engineer to join their technology team on a permanent basis. The role will play a pivotal part in the businesses data transformation initiative. The ideal candidate will possess a can-do attitude, be a team player and have a passion for making a significant impact.

Key responsibilities:
•Create and deploy data storage solutions on AWS platforms, including Amazon RDS, Amazon Redshift, and Amazon S3
•Establish and manage data pipelines for data extraction, transformation, and loading Enhance data systems for improved performance and scalability
•Work closely with internal analysts and business stakeholders to comprehend their data requirements
•Monitor and troubleshoot data systems and pipelines
•Develop and update documentation for data systems and processes
•Enforce best practices throughout the team to ensure data cleanliness
•Possess effective communication and collaboration skills to collaborate with cross-functional teams Supervise a support staff member and offer technical leadership and guidance Transition from the current BI tool to either PowerBI or Amazon QuickSight.

Requirements:
•Minimum of five years of experience in data engineering
•Proficient programming skills, particularly in Python or Java
•Proficiency in AWS services like AWS Glue, AWS Data Pipeline, Amazon RDS, Amazon Redshift, and Amazon S3
•Expertise in data warehousing, ETL processes, and data modeling
•Experience with Databricks
•Knowledge of big data technologies
•Experience with database management systems such as MySQL and PostgreSQL
•Understanding of data modeling and ETL best practices
•Strong analytical and problem-solving abilities
•Awareness of data privacy and security best practices
•Preferred experience in a collaborative, Agile development environment
•Experience in managing a data warehouse or data lake house is essential
•AWS certifications like AWS Certified Big Data – Specialty or AWS Certified Data Analytics – Specialty or equivalent are required

Please note, our client cannot sponsor candidates and as such only candidates with no work restrictions will be considered.