Data Engineer II

• 5000 - 6000 USD per Month
• Full Time
• Posted : one year ago

The Data Engineer II will work closely with a multidisciplinary Agile team to build high-quality data pipelines supporting both our corporate and product divisions and will be key in supporting our current and future reporting and analytics solutions. This role requires deep understanding of data architecture, data engineering, data analysis, reporting, and a basic understanding of data science techniques and workflows. This role will work with software developers, architects and data analysts on expanding and optimizing our data and data pipeline architecture, as well as streamlining data flow and collection in support of our cross functional teams.

Key Responsibilities

• Work closely with business users to gather the requirements and translate business needs to technical specifications
• Builds and maintains Azure data platform including enterprise data lake and data warehouse
• Build data pipelines that conform to Coinstar’s architecture standards
• Collaborate with Cloud Solution Architects in implementing complex end-to-end Enterprise solutions on Microsoft Azure platform
• Implement mechanisms for data ingestion into Azure data platform from various sources
• Configure, validate, and implement various Azure tools such as but not limited to Databricks, Data Factory, Data Lake, Synapse Analytics, and Data Catalog as appropriate
• Responsible for developing technical specification documents and high-level solution design
• Actively collaborates with the business intelligence team, business teams, and project teams to understand data requirements, integration needs, constraints, and performance requirements
• Performs ETL, ELT operations and administration of data and systems securely and in accordance with enterprise data governance standards
• Works with Data Scientists and ML Engineers to understand mathematical models and optimize data solutions accordingly
• Developing and maintaining data lake and data warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and Advanced Analytics.
  
  

• Bachelor's degree required in Computer Science or a related field
• 4+ years’ experience, with 4+ years’ General Software Development experience, 3+ years’ SSRS development and 2+ years database/reporting architecture experience
• 3 years of relevant experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytics tools
• 3 years of experience in modern data platforms based on Azure including but not limited to Azure Data Lake, Azure Data Factory, Azure Databricks, Synapse Analytics
• Experience working with APIs
• Expertise in SQL, DAX languages & Power Query
• Experience working with geographically distributed development teams
• Experience working as part of Agile/Scrum teams
  
  

• Deep knowledge of Microsoft SQL Server and SSRS technologies
• Comfortable in an agile environment and working with a standardized task ingestion process.
• Expertise in dimensional data modeling and OLAP cubes
• Distributed data processing of big data batch or streaming pipelines
• Understanding of CI/CD processes and Azure DevOps
• Familiarity with Data Governance, Data Catalog, Master Data Management
• Excellent communication skills w/ the ability to communicate to broad audiences
  
  

• Position requires minimal to no travel

Skills

• Azure
• SQL
• api
• ETL
• ELT
• DevOps
• SSRS