VetJobs - The Leading Military Job Board

Position SummaryAs an Azure Data Engineer II, you will be responsible for designing, implementing, and maintaining scalable data pipelines and data warehousing solutions on Microsoft Azure. You will collaborate closely with data analysts and business stakeholders to ensure the optimal performance and reliability of our data infrastructure.This role will also provide insight and guidance on how we build our new analytics platform and provide data from Salesforce CRM, D365 F&O, Ecommerce sites, and other required data sources.

This position can be remote, hybrid, or onsite in Ankeny, IA.

Salary range: $79,386 - 103,201

At this time, we're not considering applicants that require immigration sponsorship (additional work authorization or permanent work authorization) now or in the future to work in the United States. This includes, but IS NOT LIMITED TO: F1-OPT, F1-CPT, H-1B, TN, L-1, J-1, etc.Position Responsibilities may include, but not limited to

• Design, develop, and deploy end-to-end data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services

• Implement and optimize data ingestion processes from various sources, including databases, APIs, and streaming data sources

• Build and maintain data warehouses and data lakes on Azure, ensuring data integrity, reliability, and security

• Develop ETL processes to transform and cleanse raw data into usable formats for analytics and reporting purposes

• Collaborate with consultant groups and analysts to provide them with access to high-quality data for advanced analytics and machine learning

• Monitor and optimize the performance of data solutions to meet SLAs and business requirements

• Implement data governance and security best practices to ensure compliance with regulatory standards and company policies

• Stay updated on the latest Azure data technologies and best practices and provide recommendations for continuous improvement

• Be able to mentor and coach others that want to learn more about Azure data engineering

Required Skills and Experience

• Bachelor's degree in Computer Science, Information Systems, or a related field

• Minimum of 3 years' proven experience as a data engineer with a focus on Azure data services

• Strong proficiency in SQL, T-SQL, and experience working with relational databases (e.g., SQL Server, Azure SQL Database)

• Hands-on experience with Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics (formerly SQL Data Warehouse), Azure Blob Storage, and Azure Data Lake Storage

• Experience with data tools like dbt or Fivetran

• Experience with data modeling, schema design, and performance tuning in Azure environments

• Proficiency in programming languages such as Python, Scala, or Java

• Experience with version control systems (e.g., Git) and CI/CD pipelines

• Strong analytical and problem-solving skills, with a keen attention to detail

• Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment

• Strong communication skills

Preferred Skills and Experience

• Master's degree

• Microsoft Azure certifications such as Data Engineer Associate or Azure Solutions Architect Expert

• Experience with big data technologies such as Apache Spark, Hadoop, or Kafka

• Familiarity with data visualization tools such as Power BI or Tableau

• Familiarity with data linage and catalog tools such as Atlan, Alation, or Informatica

• Experience with Databricks Unity Catalog

Physical Requirements

• Repetitive motions that include the wrists, hands and/or fingers

• Sedentary work that primarily involves sitting, remaining in a stationary position for prolonged periods

• Visual perception to perform job including peripheral vision, depth perception, and the ability to adjust focus