Azure Data Engineer w/ Python/C# Job at Expert In Recruitment Solutions, Tampa, FL

Vzg4Znl2ZHpBeERmM1RQdkhnQ2plU2dXQXc9PQ==
  • Expert In Recruitment Solutions
  • Tampa, FL

Job Description

Title: Azure Data Engineer w/ Python/C#

Location: 100% Remote

Duration: long term

Interview Mode: Video

Need 12-13+ years candidate

" PySpark or Scala

" Spark SQL

" Delta lakes

* Python/C#

PRIMARY DUTIES AND ACCOUNTABILITIES

Item Accountability %

1 Create and maintain optimal data pipeline architecture 20

2 Assemble large, complex data sets that meet functional / non-functional business requirements. 20

3 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 20

4 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies. 20

5 Deliver automation & lean processes to ensure high quality throughput & performance of the entire data & analytics platform.? 10

6 Work with data and analytics experts to strive for greater functionality in our analytics platforms. 10

POSITION SPECIFICATIONS

Minimum: Preferred:

" Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using Azure

" Strong problem-solving skills with emphasis on optimization data pipelines

" Excellent written and verbal communication skills for coordinating across teams

" A drive to learn and master new technologies and techniques

" Experienced in DevOps and Agile

" Experience using Docker or Kubernetes is a plus

" Demonstrated capabilities with cloud infrastructures and multi-cloud environments such as Azure, AWS, IBM cloud environments and using CI/CD pipelines.

" Experience with Delta Lakes

" Experienced using Databricks & Apache Spark

" Experienced using Azure Data Factory or Synapse Analytics

Job Tags

Permanent employment, Remote job,

Similar Jobs

Belching Beaver Brewery Inc

Craft Brewery Canning Line Operator Job at Belching Beaver Brewery Inc

 ...~ Employee discounts ~ Health insurance ~ Paid time off ~ Training & development ~ Vision insurance Belching Beaver Brewery is a thriving craft beer brewery dedicated to producing high-quality and innovative products for our community. We take pride in our... 

Wise Staffing Group

Forklift Driver/Material Handler Job at Wise Staffing Group

Job Description Job Description Forklift Drivers Needed Yutaka Technologies 3+ years exp Pay based on exp. Please call (***) ***-**** if interested

Oakpoint

Oral Surgeon Job at Oakpoint

 ...Experienced Oral Surgeon opportunity - We have 4 current locations in Morganton, Hickory, Asheville and Statesville area. We have an exciting opportunity for an Oral Surgeon to join an established and growing practice. This is a turn-key practice that offers established... 

Auto Auction of New England

2 Car Hauler - Truck Driver Job at Auto Auction of New England

 ...Job Description Job Description Full Time 2 Car Hauler: We have an immediate opening for a full time, qualified 2 car hauler. Benefits Package available: ~ Health, dental and vision Insurance ~ Life/LTD Insurance ~ Voluntary Short Term Disability Insurance... 

CHS Inc

Seasonal Ops Specialist/CDL Driver Job at CHS Inc

CHS Inc. is a leading global agribusiness owned by farmers, ranchers and cooperatives across the United States that provides grain, food and energy resources to businesses and consumers around the world. We serve agriculture customers and consumers across the United States...