Senior Data Engineer

Job DescriptionAre you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you!Position: Lead Data EngineerResponsibilities:Lead Data Management and Architecture: Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency.Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust data hub.Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices.Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration of new technologies into existing structures.Collaborate on Infrastructure Projects: Work closely with the infrastructure team to integrate advanced cloud solutions and ensure successful deployment of data services.Enhance Data Security and Compliance: Identify vulnerabilities, enhance security protocols, and ensure compliance with regulatory standards through regular audits.Technical Leadership and Support: Provide guidance and leadership to technical teams, developing comprehensive documentation and training materials for knowledge sharing.Stakeholder Engagement: Manage relationships with internal stakeholders and external vendors to design and deliver effective data solutions.Continuous Improvement: Proactively seek to improve processes for data intake, validation, mining, and engineering, implementing innovations to enhance data reliability, efficiency, and quality.Problem Resolution: Tackle significant technical issues, ensuring minimal disruption to operations and maintaining service continuity.Skills and Experience:Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight.Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases.Strong experience in designing, implementing, and managing ETL processes using Azure Data Factory and other relevant tools.Proficiency in building and managing data warehouses using Azure Synapse Analytics and other data warehousing solutions.Ability to create effective data models supporting business processes, including knowledge of dimensional modeling and normalization.Familiarity with big data technologies on Azure, such as Azure Databricks and Azure Stream Analytics.Knowledge of data security practices, cloud architecture principles, scripting languages for automation, data visualization tools, DevOps practices, machine learning frameworks, performance tuning, and data governance tools.Technical proficiency in Microsoft Azure SQL (PaaS & IaaS), CosmosDB, Snowflake Data Warehouse, Power Apps, Reporting Services, Tableau, T-SQL, Python Programming, and Azure Purview.If you're ready to join a dynamic team and drive innovation in data engineering, apply now! We offer competitive compensation and benefits packages, along with opportunities for professional growth and development.