Azure Data Engineer w/ Python/C# Job at Expert In Recruitment Solutions, Tampa, FL

Vzg4Znl2ZHpBeERmM1RQdkhnQ2plU2dXQXc9PQ==
  • Expert In Recruitment Solutions
  • Tampa, FL

Job Description

Title: Azure Data Engineer w/ Python/C#

Location: 100% Remote

Duration: long term

Interview Mode: Video

Need 12-13+ years candidate

" PySpark or Scala

" Spark SQL

" Delta lakes

* Python/C#

PRIMARY DUTIES AND ACCOUNTABILITIES

Item Accountability %

1 Create and maintain optimal data pipeline architecture 20

2 Assemble large, complex data sets that meet functional / non-functional business requirements. 20

3 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 20

4 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies. 20

5 Deliver automation & lean processes to ensure high quality throughput & performance of the entire data & analytics platform.? 10

6 Work with data and analytics experts to strive for greater functionality in our analytics platforms. 10

POSITION SPECIFICATIONS

Minimum: Preferred:

" Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using Azure

" Strong problem-solving skills with emphasis on optimization data pipelines

" Excellent written and verbal communication skills for coordinating across teams

" A drive to learn and master new technologies and techniques

" Experienced in DevOps and Agile

" Experience using Docker or Kubernetes is a plus

" Demonstrated capabilities with cloud infrastructures and multi-cloud environments such as Azure, AWS, IBM cloud environments and using CI/CD pipelines.

" Experience with Delta Lakes

" Experienced using Databricks & Apache Spark

" Experienced using Azure Data Factory or Synapse Analytics

Job Tags

Permanent employment, Remote job,

Similar Jobs

Spectrum Medical Imaging Co.

Inside Sales Representative Job at Spectrum Medical Imaging Co.

 ...Responsibilities: The ideal candidate will be responsible for managing all customer accounts, nurturing long-term relationships, and driving sales growth. You will act as the main point of contact for your customers, ensuring their needs are met and identifying opportunities for... 

Sumeru Solutions

QA Manual Tester Job at Sumeru Solutions

 ...unified system. The QA team will oversee all solutions. Retail experience is a mandatory requirement (not looking for eCommerce...  ...Lead to oversee and drive the quality assurance strategy for our software products. The QA Lead will be responsible for leading a team... 

Catalent Pharma Solutions

Internship - lab assistant product development Job at Catalent Pharma Solutions

 ...Op program. ~ This is a PART TIME, PAID, YEAR-ROUND student internship, and all students are required to commit 15-20 hours per week...  ...patient, consumer, and Catalent employee. The Role: Clean laboratory glassware Perform maintenance on designated laboratory... 

Caduceus Medical Logistics

Medical Courier Driver Job at Caduceus Medical Logistics

 ...Job Description Medical Courier driver needed, government work. Monday through Friday, plus on-call weekends. Good pay for good drivers...  ...work for responsible drivers. Perfect for the semi-retired and Uber/Lyft Drivers who can set their own schedules, veterans encouraged... 

McHale Landscape Design, Inc.

Assistant Landscape Designer Job at McHale Landscape Design, Inc.

 ...About McHale Landscape Design McHale Landscape Design is a single-source residential landscape design-build firm with a highly educated, experienced, passionate staff of designers, masons, carpenters, and landscape technicians. For 40 years, the focus has been the design...