Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
TVCDC is seeking experienced substitute teachers and teacher assistants with flexible schedules for Early Childhood classrooms. Candidates should possess or have the credentials to obtain an Early Childhood Teacher letter from the State of Colorado. All Substitutes must...
NO CDL Required- Train to be a Class A Truck Driver JobThe Morning Star Trucking Company provides transportation services for bulk tomato, freight and transplanting operations throughout the Central Valley of California, primarily during the summer months. Morning Star...
Job ID: 505934 Oldcastle APG, a CRH Company, is the leading provider of outdoor living solutions in North America with an award-winning portfolio that enables customers to Live Well Outside. Inspiring endless possibilities with enduring performance, its collection...
...a vital member of our patient care team and play a crucial role in... ...you serve. Subject to the medical protocols established by Association... ...Center, if any, Physician Assistant/ Nurse Practitioner shall... ...experience in occupational medicine, urgent care or an emergency setting...
...platform's AI Agents apply to jobs and internships on behalf of users 24/7, making job... ...Description This is a full-time role for a Software Engineer located in Houston, TX. The Software... ...skills Back-End Web Development experience Proficiency in Programming and...