Find up to date salary information for jobs in Australia, and compare with national average, city average, and other job positions.

Lead Data Engineer - Microsoft Azure , Synapse Data Engineering (Fabric)

Australia 25 days ago

Job Description

Location: Gurugram,Haryana,India About US:-  We turn customer challenges into growth opportunities.  Material is a global strategy partner to the world’s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.  We use deep human insights, design innovation and data to create experiences powered by modern technology. Our approaches speed engagement and growth for the companies we work with and transform relationships between businesses and the people they serve.  Srijan, a Material company, is a renowned global digital engineering firm with a reputation for solving complex technology problems using their deep technology expertise and leveraging strategic partnerships with top-tier technology partners. Be a part of an Awesome Tribe    Job Title:Lead Data Engineer (Microsoft Azure , Synapse Data Engineering (Fabric)) Job Responsibilities: Design and Develop Data Pipelines:Hands on with development, and optimisation of scalable and reusable - data pipelines inAzure Microsoft Fabric Synapse Data Engineering, leveraging bothbatchandreal-time processing techniques. Ensure smooth integration withAzure Data Factoryfor orchestration and workflow management. Cloud Data Architecture:Collaborate with theData Architecture teamto design and implement robust data architectures in theAzure environment, ensuring they align with business needs while optimising performance, scalability, and cost-efficiency. Pipeline Optimisation :Continuously monitor and optimise the performance, cost, and reliability of data pipelines, ensuring efficient processing, storage, and management of large datasets. Cross-functional Collaboration:Work closely withdata engineering teams,analysts, andbusiness stakeholdersto understand data requirements, developing solutions that enable self-service analytics and support the decision-making process. Documentation& Knowledge Sharing:Contribute to internal documentation, fostering a culture of knowledge-sharing. Providementorshipand guidance to junior engineers, helping to elevate team skills and improve overall team performance. Microsoft Fabric Experience:Apply your knowledge ofAzure Tech Stackon Data Engineering (or your willingness to learn)Fabric-based developmentto manage end-to-end data orchestration, governance, and security across cloud and on-premises systems, ensuring seamless data movement and integration across hybrid environments. Data Modelling Expertise:Leverage your deep expertise inAzureto design and implementdata models, create processing pipelines, and integrate with otherAzure serviceslikeData LakeandSynapseto support data storage and analytics needs.   Required Skills and Qualifications: Experience with Azure Ecosystem (Preferably Synapse):5+ years of hands-on experience withAzure Ecosystem, includingSynapse,Spark,OneLake, and other Fabric tools. Expertise in optimisingFabric notebooksand efficiently managing large-scale data workloads. Proficiency in Azure Data Factory:Strong experience with designing and orchestrating complex data pipelines usingAzure Data Factory, with an emphasis on seamless data flow integration across various Azure services. Familiarity with Microsoft Fabric:A working knowledge or eagerness to learnAzure Data Fabric, focusing on cross-platform data orchestration, governance, and security. Advanced Data Engineering Skills:Extensive experience in data engineering, including the design and implementation ofETL processesand working with large datasets. Proven expertise indata quality, monitoring, and testing practices. Cloud Architecture Design Expertise:Experience designing and implementingdata architecturesin theAzure ecosystem, including tools such asData Lake,Synapse, andAzure Storage. SQL and Data Modelling Expertise:Strong skills inSQLanddata modelling, with the ability to design optimised data structures, tables, and views. Knowledge of both transactional and analytical data modelling. Collaboration and Communication Skills:Strong ability to work cross-functionally with teams from various domains. Ability to communicate complex technical concepts to both technical and non-technical stakeholders. Cost Optimisation:Proven experience optimisingdata engineering processesandAzure resourcesfor both performance and cost, particularly in large-scale cloud environments.   Preferred Skills: Data Lakehouse Experience:Familiarity withData Lakehousearchitectures, particularly with tools likeDelta Lake,OneLake, etc. Azure Ecosystem Familiarity:Knowledge ofAzure’s full ecosystemfor end-to-end data integration and ETL processes. Proficiency in PySpark and Python:Expertise inPySparkfor data processing tasks, with a solid foundation inPython. Fabric Integration:Familiarity withFabricand how it integrates with other services within theAzure ecosystem. Databricks Experience:Experience withDatabricksis a plus.   Apply to this job

Electronic Technician II

Perth, Western Australia 20 hours ago
We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges,...

eCommerce Specialist: Optical

north sydney, Australia 20 hours ago
We are EssilorLuxottica, a global leader in the design, manufacture and distribution of ophthalmic lenses, frames and sunglasses. We bring together the expertise of two industry pioneers, one in advanced lens technologies and the other in the...

Mechanic Technician II

mooga, Australia 20 hours ago
We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges,...

Solution Architect

Canberra, New South Wales 20 hours ago
BAE Systems Digital Intelligence is home to 4,800 digital, cyber and intelligence experts. We work collaboratively across 16 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial...

HR Administrator

milton, Australia 20 hours ago
Founded in 1932, McLarens is a leading independent global insurance services provider with owned offices and operations strategically located in 45 countries around the world. With a focus on complex, commercial and specialty markets, McLarens...

M006:ESG:Mechanic Technician II

Adelaide, South Australia 20 hours ago
We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges,...

Operator Assistant I:Cementing

mooga, Australia 20 hours ago
We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges,...

Service Desk Consultant

Australia 20 hours ago
BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial...

Maintenance Coordinator

dora creek, Australia 20 hours ago
: Permanent full:time opportunity : Opportunity for growth and development : Eraringbased Delivering good energy starts from within It's an exciting time to join Origin. Creating a great place to work means together we're progressing our ambition to...

Support Engineer

Australia 20 hours ago
BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial...