Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

Rk1VZ21RR2hqQ1hlUG4yMUZndjBZMVVBUUE9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

SmartStart Education, LLC

Math and ELA Tutors Job at SmartStart Education, LLC

 ...for you! The Job:SmartStart Education seeks a small group Math and ELA tutors to work with small groups of elementary and middle school students several times throughout the week . Each small group consists of 1-4 students. Each group consists of students who have been... 

L&R Distributors

Warehouse Outbound Supervisor Job at L&R Distributors

Job Summary The Outbound Supervisor is responsible for monitoring and maintaining Pick/Pack standards and getting orders out in a timely manner, consolidating customer orders and preparing them for shipping by specific carrier, and ensuring that E-Commerce order meet...

Afni, Inc.

Remote Customer Service Representative - Work at Home Job at Afni, Inc.

 ...customer service by responding to inbound calls; providing product knowledge,...  ...Representative, you get: Fully remote, work-from-home environment with paid training and ongoing...  ...role, with a minimum of 6 months in a call center virtual setting. Work at Home: A... 

TriStar Horizon Medical Center

RN Case Manager Wound Care Job at TriStar Horizon Medical Center

 ...insurance, identity theft protection, legal counseling, long-term care coverage, moving assistance, pet insurance and more. ~ Free...  ...Manager opportunity. Job Summary and Qualifications The Wound Care RN leads in the assessing, planning, implementing and... 

Gondola

Photographer Job at Gondola

 ...opportunity to start the next chapter of your career story and help create a one-of-a-kind fan experience at Honda Center.Job Title:PhotographerThe annual base salary range for this position in California is $75,000 to $100,000 per year. The starting pay for the...