AWS Data Engineer

Description:

The AWS Data Engineer is responsible for designing, implementing, and maintaining data pipelines and infrastructure on Amazon Web Services (AWS). In this role, you will collaborate with cross-functional teams to understand data requirements, architect scalable solutions using AWS services such as S3, Glue, Redshift, and EMR, and optimize data workflows for performance and cost-efficiency. The engineer should have expertise in SQL, Python, and ETL processes, with a strong understanding of data warehousing concepts and cloud computing principles. They are expected to ensure data integrity, security, and compliance with regulatory standards, while also continuously evaluating and implementing improvements to enhance the reliability and scalability of data systems. Effective communication skills and the ability to troubleshoot and resolve technical issues are essential for success in this role.

Responsibilities:

• Collaborate with cross-functional teams to understand data requirements and business objectives.
• Design and implement data pipelines and infrastructure on AWS using services such as S3, Glue, Redshift, and EMR.
• Optimize data workflows for performance, scalability, and cost-efficiency.
• Develop and maintain ETL processes to extract, transform, and load data from various sources.
• Ensure data integrity, security, and compliance with regulatory standards.
• Continuously evaluate and implement improvements to enhance the reliability and scalability of data systems.
• Monitor data systems for performance and troubleshoot and resolve technical issues as they arise.
• Document data architecture, processes, and procedures.
• Provide technical guidance and support to other team members.

Skills:

• Proficiency in SQL, Python, and ETL processes.
• Experience with AWS services such as S3, Glue, Redshift, and EMR.
• Strong understanding of data warehousing concepts and cloud computing principles.
• Excellent problem-solving and troubleshooting skills.
• Effective communication and collaboration skills.
• Attention to detail and ability to work independently.
• Knowledge of data security and compliance standards.
• Experience with data visualization tools and techniques is a plus.
• Bachelor’s degree in Computer Science, Engineering, or related field preferred.