JOB DESCRIPTION
We are looking for a highly skilled Lead Data Engineer to design, build, and optimize
large-scale data pipelines and solutions on AWS. The ideal candidate should have strong
expertise in AWS services, Glue, Python, and PySpark, along with hands-on leadership in
managing end-to-end data engineering initiatives.
Experience
6 Years
Key Skills
- Experience with CI/CD for data pipelines.
- Knowledge of SQL performance tuning.
- Familiarity with containerization (Docker) or orchestration tools.
- AWS Certified
Responsibilities:
- Lead the design and development of scalable data pipelines and ETL/ELT workflows using AWS Glue, PySpark, and Python.
- Architect and maintain data platforms on AWS (S3, Lambda, Glue, EMR, Redshift, Athena, IAM, CloudWatch).
- Work closely with data analysts, data scientists, and cross-functional teams to deliver reliable and high-quality datasets.
- Optimize big data workflows for performance, cost efficiency, and scalability.
- Drive best practices in data modeling, data quality, and data governance.
- Mentor and guide junior data engineers and contribute to technical decision-making.
- Troubleshoot data pipeline issues and ensure high availability of data solutions
Required Skills & Qualifications
- 6+ years of experience as a Data Engineer with strong hands-on coding abilities.
- Mandatory experience with AWS Cloud—Glue, S3, Lambda, EMR, Redshift, Athena.
- Strong programming expertise in Python and PySpark.
- Experience building and optimizing large-scale ETL/ELT pipelines.
- Solid understanding of data modeling, data lakes, and distributed computing.
- Ability to take ownership, lead projects, and mentor team members.
Prama specializes in AI-powered and Generative AI solutions for Data, Cloud,and AI. We collaborate with businesses worldwide to develop platforms and AI-powered products that offer valuable insights and drive business growth.Our comprehensive services include architectural assessment, strategy development, and execution to create secure, reliable, and scalable systems.We are experts in creating innovative platforms for various industries. We help clients to overcome complex business challenges. Our team is dedicated
to delivering cutting-edge solutions that elevate digital experience for corporations. Prama is headquartered in Phoenix with offices in USA and India.
