-
Full Time
Working Type : Work From Office
Job Description :
Job Description
The Opportunity:
Flywire is seeking a motivated and skilled Data Engineer to contribute to the development and optimisation of our data platforms and pipelines. In this role, you will work closely with the data engineering, analytics engineering, and business intelligence teams to build, maintain, and enhance the infrastructure that supports Flywire’s data needs. You will have the opportunity to work with modern data technologies in a cloud-based environment while contributing to projects that have a direct impact on the business.
Key Responsibilities:
- Assist in the design, development, and maintenance of scalable and efficient data pipelines and ETL/ELT processes.
- Contribute to the optimisation of existing data workflows and applications for performance and resource efficiency.
- Write, test, and deploy data transformation jobs using tools like dbt.
- Work with streaming data frameworks and infrastructure to process real-time and near real-time data.
- Support the development and maintenance of data models within our cloud data warehouse (Big Query).
- Collaborate with data scientists, BI developers, analytics engineers, and other data engineers to understand data requirements and deliver reliable data solutions.
- Implement data quality checks and monitoring to ensure data accuracy and reliability.
- Participate in code reviews and contribute to the team & engineering standards and best practices.
- Troubleshoot and resolve issues related to data pipelines and data infrastructure.
- Learn and apply new technologies and techniques in the data engineering
Data Engineer
Zenith Leap Solution Pvt. Ltd- 6 - 7 yrs
- Not Mentioned
-
Full Time
Working Type : Work From Office
Job Description :
Egis
Job Description:-
Job Summary: The Data Engineer will be responsible for leveraging the data platform to create data products for business. This role involves the development of data products, data pipelines, data transformation, data cleansing, data normalization, deployment & support for various functions within EGIS.
Technologies: Azure Data Factory, Data Bricks, SQL, Azure DevOps, Azure Azure Devops, gitlab, Power BI
Key Responsibilities:
· Design and implement Extract, Transform, Load (ETL) processes to move data from various sources (on-premises, cloud, and third-party APIs) to Azure data platforms.
· Integrate data from diverse sources into Azure-based systems like Azure Data Lake/Azure SQL Database.
· Use Azure Data Factory or Data Bricks orchestration tools to automate and schedule data pipelines/Job workflows
· Design efficient data models (e.g., star or snowflake schema) for use in analytical applications and reporting systems.
· Optimize SQL queries and scripts for performance, ensuring low-latency and efficient data processing
· Continuously monitor the health of pipelines, jobs and infrastructure, ensuring they are running efficiently and securely
· Assist in building dashboards and reporting solutions using tools like Power BI, ensuring data is made available in an user-friendly format
· Address and resolve data issues, including failures in ETL pipelines, system performance problems, and data inconsistencies
· Ensure that all data engineering processes comply with industry security standards and best practices, including encryption, access controls, and data masking
Data Engineer
Zenith Leap Solution Pvt. Ltd- 0 - 5 yrs
- Not Mentioned
-
Full Time
Working Type : Work From Office
Job Description :
Coresight Research
Job description:-
We are seeking a talented and experienced Data Engineer to join the Coresight team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure and systems that enable efficient and accurate data collection, storage, processing, and analysis. You will collaborate closely with data scientists, analysts, and other stakeholders to understand thei