PySpark Developer Job at Precision Technologies Corp, New York, NY

eGd1Y1hSZEg2bFpkZVhLTG90aTZkc1hLeEE9PQ==
  • Precision Technologies Corp
  • New York, NY

Job Description

Title: PySpark Developer

Location: NYC (Hybrid 3 days in a week)

Type: Long Term Contract

Our Challenge:

We are seeking a Pyspark Developer to build robust data processing solutions on Azure Cloud using PySpark to drive innovation within the financial services industry. Our challenge is to leverage extensive PySpark experience and hands-on expertise in Azure Cloud to navigate the complexities of big data, ensuring compliance with industry standards while delivering impactful results. We aim to rapidly adapt to evolving technologies and create scalable data solutions that enhance operational efficiency and decision-making.

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
  • Design and implement scalable data models and data architecture to support analytical and reporting needs.
  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
  • Implement best practices for data governance and security within Azure Cloud.
  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Experience:

  • Minimum of 8+ years of experience in PySpark development.
  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
  • Prior experience in the banking, investment banking, or financial services sector is mandatory.
  • Proficient in PySpark for data processing and ETL tasks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and tools.
  • Knowledge of Azure services related to big data and analytics.

Nice to have:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Contract work, Long term contract, 3 days per week,

Similar Jobs

Stoner's Pizza Joint

General Manager Job at Stoner's Pizza Joint

The general manager will be responsible for directing the overall operations of the restaurant, ensuring a seamless and exceptional dining experience for guests. This includes recruiting, training, and overseeing a dedicated team of employees who are committed to delivering... 

Maxion Corp

Data Entry Clerk - Work From Home - Remote Job at Maxion Corp

 ...Join Our Team as a Work-From-Home Data Entry Research Panelist! Are you ready...  ...Flexibility at Its Best: Work part-time or full-time, from anywhere, and on a schedule...  ...folks, disabled people and anyone looking to learn how to make income online.... 

Hyatt

Restaurant Manager - Oystercatcher and The Nest Roof Top Bar Job at Hyatt

 ...coast of South Carolina, Wild Dunes Resort, the Resort, offers two top-ranked hotels, including the new coastal-modern Sweetgrass Inn, 1...  ..., and over 200 Homes and Villas, 1,600 acres of world-class golf, tennis, award-winning restaurants, Sweetgrass Spa, and 2 miles of... 

Sodexo

Intern - Culinary @ University of Michigan Job at Sodexo

 ...Job Listing: Intern - Culinary Are you ready to put your education in to action with on-the-job experience? The Sodexo Live! Intern Program offers an exciting opportunity for currently enrolled college students to turn their leadership potential into valuable... 

Kaiser Permanente

Compliance Consultant IV - Investigations Job at Kaiser Permanente

The Compliance Consultant IV - Investigations will provide understanding and evaluate ethics and compliance related situations, and they will field ethics questions from others, and build the active application of ethical standards within the business. They will evaluate...