We are a recruitment company devoted to finding the best talents that suit our client's human resources needs. Our candidates have passed through carefully designed screening stages and have been certified fit to get the job done by professionals in the field. Whatever company goals you have, we are prepared to leverage our strengths and make your work easy for you.
Job Description:
- As a Data Engineer, you will play a critical role in transforming our data infrastructure. You will be responsible for designing, developing, and maintaining scalable data pipelines that facilitate the migration of our legacy mainframe applications to a modern cloud environment. Your expertise in Python, DBT, and SQL will be essential in ensuring the smooth transition and integration of our data systems.
Key Responsibilities:
- Data Pipeline Development: Design, build, and maintain scalable data pipelines using Python to support data migration and integration from mainframe systems to the cloud.
- Cloud Migration: Collaborate with cross-functional teams to plan and execute the migration of mainframe applications to cloud-based solutions.
- Data Transformation: Utilize DBT (Data Build Tool) to transform and model data, ensuring data quality and consistency throughout the migration process.
- Database Management: Develop and optimize SQL queries for data extraction, transformation, and loading (ETL) processes.
- Data Quality: Implement data validation and testing procedures to ensure data accuracy and integrity during and after migration.
- Collaboration: Work closely with data analysts, data scientists, and other engineering teams to understand data requirements and deliver solutions that meet business needs.
- Documentation: Maintain comprehensive documentation of data pipelines, ETL processes, and data models.
Qualifications:
- Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Experience: Proven experience as a Data Engineer, with a strong background in data pipeline development and cloud migration.
- Technical Skills:
- Proficiency in Python for data engineering tasks.
- Experience with DBT for data transformation and modeling.
- Strong SQL skills for database management and ETL processes.
- Cloud Platforms: Experience with cloud platforms such as AWS, Google Cloud, or Azure.
- Problem-Solving: Strong analytical and problem-solving skills with a keen attention to detail.
- Communication: Excellent communication skills with the ability to collaborate effectively with cross-functional teams.
- Adaptability: Ability to work in a fast-paced, dynamic environment and adapt to changing business needs.
Preferred Qualifications:
- Experience with mainframe systems and legacy application migration.
- Knowledge of data warehousing concepts and technologies.
- Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Method of Application
Signup to view application details.
Signup Now
