Data Engineer – Python
Data Engineer – Python
Philadelphia, Pennsylvania
|Direct (Permanent) Full Time
|$ 115,000 - $ 120,000 per year
Philadelphia, Pennsylvania
Direct (Permanent) Full Time
$ 115,000 - $ 120,000 per year
September 05, 2024
|Job ID: T1390632-PHI_1725543953
September 05, 2024
Job ID: T1390632-PHI_1725543953
Job Summary
To Apply for this Job Click Here
Location: Remote EST Hours
Salary: 115-120K with 20% bonus
We are seeking a highly skilled Senior Data Engineer This role involves extensive coding, infrastructure management, and automation, with a focus on building and maintaining robust ETL pipelines and tools. The ideal candidate will be a key individual contributor, working closely with the director and mentoring junior team members.
Key Responsibilities:
- ETL Pipeline Development: Build and manage ETL pipelines using Python, Kafka, Snowflake, and AWS, ensuring data is efficiently processed and delivered.
- Heavy Coding: Focus on Python development to implement data processing, analysis, and automation tasks.
- Infrastructure as Code (IaC): Utilize SQL-based IaC tools (CloudFormation, Serverless, Terraform) for infrastructure management.
- Automation & Optimization: Automate manual processes, optimize data delivery, and redesign infrastructure to enhance scalability and performance.
- End-to-End Development: Take ownership of all aspects of development, from application code to cloud deployment and ongoing observability.
- Testing & CI/CD: Develop automated unit and integration tests, and create and maintain CI/CD pipelines using GitHub Actions.
- Mentorship: Act as a go-to resource for junior team members, providing guidance and support.
- Collaboration: Work closely with the director to align on project goals and contribute to the overall success of the team.
Required Skills and Qualifications:
- Python Development: Extensive experience in Python coding, particularly for ETL and data processing.
- AWS & ETL Tools: Proficiency with AWS services, Kafka, Snowflake, and experience in building and managing ETL pipelines.
- Infrastructure as Code: Experience with Terraform, CloudFormation, and Serverless frameworks for infrastructure management.
- DevOps & CI/CD: Strong understanding of DevOps practices and experience with CI/CD pipelines, including GitHub Actions.
- SQL & Databases: Experience with relational databases, SQL, and building unit tests.
- Version Control: Advanced skills with Git or other version control systems.
- Docker & Linux/Unix: Experience with Docker and working in Linux/Unix environments.
T1390632-PHI_1725543953
To Apply for this Job Click Here
I want more jobs like this in my inbox weekly.
Other jobs you might like...
About Beacon Hill
Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.
Founded by industry leaders to set a new standard in search, career placement and flexible staffing, we deliver coordinated staffing solutions with unparalleled service, a commitment to project completion and success and a passion for innovation, creativity and continuous improvement.
Our niche brands offer a complete suite of staffing services to emerging growth companies and the Fortune 500 across market sectors, career specialties/disciplines and industries. Over time, office locations, specialty practice areas and service offerings will be added to address ever changing constituent needs.
We look forward to working with you.
Beacon Hill. Employing the Future™