job summary:
Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.
location: Malvern, Pennsylvania
job type: Contract
salary: $75 - 80 per hour
work hours: 8am to 4pm
education: No Degree Required
responsibilities:
Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.
qualifications:
skills:
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
About the Company:
Randstad USA
Looking for your next great opportunity but not sure where to find it? When you let Randstad US handle your job search, you get the support of one of the world's largest staffing firms partnering with you every step of the way. Our recruiters have the resources to find a job that's right for you. We combine our passion for people with the power of today's latest technologies to find opportunities that fit your skills in environments where you can thrive. Whether you're looking for a temporary or permanent position, our focus is on partnering with you to realize your true potential. And it all starts with your next great role.
Company Size:
10,000 employees or more
Industry:
Staffing/Employment Agencies
Founded:
0
Website:
At Vestas we are powered by the dream of changing the world. And to create a sustainable future, we are building a team of passioned visionaries. Would you like to join us? Vestas is the world's largest wind turbine manufacturing company with significant operations in...
...Become a Remote Travel Coordinator and turn your love for travel into a rewarding career.This role allows you to combine your love for travel with the freedom of working remotely. Have you been booking travel and not getting paid? Here's what you need to know...
...Aaran Therapy Center in Woodbury, MN is looking for EIDBI Level 2 Behavioral Therapist (immediate hire) to join our team. We are located... ...full potential. We are currently seeking passionate and dedicated ABA Therapists to join our team. Benefits Monday to Friday...
...SCI Public Trust/Other Required: SSBI (T5) Job Family: Security Adjudication Job Qualifications: Skills: Databasing,... ...opportunity to make a personal impact as a PERSONNEL SECURITY TIER II SAP ADJUDICATOR. Join a high optempo, mission critical team in...
Job Title: Family AssistantLocation: Garden City, NYHours: 20-25 hours per week (flexible schedule, 4-5 hours per day)Compensation:$35/hr after taxes, with reimbursement for gas and mileageJob Description:A busy family in Garden City, NY is seeking a reliable...