PySpark Developer Job at Precision Technologies Corp, New York, NY

eGd1Y1hSZEg2bFpkZVhLTG90aTZkc1hLeEE9PQ==
  • Precision Technologies Corp
  • New York, NY

Job Description

Title: PySpark Developer

Location: NYC (Hybrid 3 days in a week)

Type: Long Term Contract

Our Challenge:

We are seeking a Pyspark Developer to build robust data processing solutions on Azure Cloud using PySpark to drive innovation within the financial services industry. Our challenge is to leverage extensive PySpark experience and hands-on expertise in Azure Cloud to navigate the complexities of big data, ensuring compliance with industry standards while delivering impactful results. We aim to rapidly adapt to evolving technologies and create scalable data solutions that enhance operational efficiency and decision-making.

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
  • Design and implement scalable data models and data architecture to support analytical and reporting needs.
  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
  • Implement best practices for data governance and security within Azure Cloud.
  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Experience:

  • Minimum of 8+ years of experience in PySpark development.
  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
  • Prior experience in the banking, investment banking, or financial services sector is mandatory.
  • Proficient in PySpark for data processing and ETL tasks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and tools.
  • Knowledge of Azure services related to big data and analytics.

Nice to have:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Contract work, Long term contract, 3 days per week,

Similar Jobs

Grove Nursing Center

Certified Medication Aide Job at Grove Nursing Center

 ...purpose of this position is to assist in the administering of medications to residents under the direction of the attending physician, Charge...  ...waste, diseases, conditions, etc., including TB and the AIDS and Hepatitis B viruses. May be subject to the handling of and... 

SAP

SAP NS2 Expert SAP Basis DevOps Engineer Job at SAP

 ...We help the world run better At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared...  ...transfer. Job Summary We are seeking an experiencedSAP Basis DevOps Engineer to design, implement, and optimize SAP... 

Northrop Grumman

Employee Relations and Labor Relations Job at Northrop Grumman

 ...Yes, 10% of the Time**Description**At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems...  ...provides advice, consultation, and guidance to create sustainable solutions for individual employee matters and organizational challenges.... 

Compass Group

BARISTA (FULL TIME) Job at Compass Group

 ...We are hiring immediately for full time BARISTA positions. Location : American Express Centurion Lounge - 17801 International Boulevard, Seatac, WA 98158. Note: online applications accepted only . Schedule : Full time schedule; open availability is preferred... 

Mt. Olympus Water & Theme Park Resort

Laundry Attendant Job at Mt. Olympus Water & Theme Park Resort

 ...Laundry Attendant The Laundry Attendant's responsibilities include cleaning, sorting, pressing, and folding and other textile articles. To be successful as a Laundry Attendant, you should demonstrate excellent organizational and interpersonal skills. This is a fantastic...