Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
...Description:** **Position Overview:** UPS is seeking reliable and customer-focused individuals to join our team as Seasonal Package Delivery Drivers. In this role, you will be responsible for delivering packages efficiently and on time during our peak holiday season. Full-...
...the Development team.Operations SupportProvide level 3+ operations support as a crucial member of the Application Managed Service (AMS) team.Collaborate closely with AMS team members to ensure optimal and timely resolution of issues, thus facilitating smooth...
Advisory Compliance Officer - Fixed Income Business Line Compliance Country: United States of America Your Journey Starts Here: Santander is a global leader and innovator in the financial services industry. We believe that our employees are our greatest asset. Our focus...
...Monmouth University is seeking applications for an Assistant Curator for the Bruce Springsteen Archives and Center for American Music. This is a temporary position. This position will report to the Curator and will assist with exhibits and collection Assistant, Social...
...Job Description Job Description We are looking for a back office assistant that is a team player, self motivated, and is eager to learn new procedures. Skills: General Practice Eaglesoft Benefits: ~ Medical ~ Dental ~401k ~ PTO Compensation...