Revent Technologies Limited is a technology solutions provider for dynamic organizations, providing bespoke software design and development, developer outsourcing and technology advisory, etc. We are currently recruiting on behalf of our international client, a global digital cross-border payments service provider with operations in over 10 countries.
- As a Data Engineer, you will be accountable for designing, developing and deploying ETL jobs to process petabytes of data through our big data platform, to enable analytics initiatives and data science.
- You will be passionate about big data, working daily on data extraction, load and transformation in big data environments to ensure the successful, on-time, delivery of high-quality data.
ACCOUNTABILITIES
- Design and develop ETL jobs in big data environments to process petabytes of data.
- Build reusable frameworks or jobs which can be used in different projects.
- Developing code to automate jobs using real-time services, and flexible coding to remove dependencies.
- Manage Data Services and Data Quality transformations using SQL: Analyzing redundant and inconsistent data.
- Own continuous improvement and performance testing: Document ETL-related issues and perform RCA, identify long running jobs and optimization opportunities.
QUALIFICATIONS, EXPERIENCE & SKILLS
- 3 - 4 years’ experience
- Development experience in EITHER: Talend Big Data Edition on Hadoop or BODS
- Hands on experience in ETL design, source-target mapping, developing and performance tuning complex ETL code
- Experience with Infrastructure automation, build automation and deployment automation
- Experience in working with GIT, SVN or VSTS
- Experience in connecting to heterogeneous sources including SAP ECC, Hadoop, Hive, Amazon, Azure, Salesforce, SAP among others
- Experience with multiple file formats and file location objects including SFTP, FTP, local, HDFS, ADLS, BLOB, Amazon S3
- Good understanding of HDInsight cluster, Microsoft SQL Servers as well as RDBMS databases & No-SQL databases
- Knowledge of Slowly Changing Dimension, ABAP Data flow Extractions, Star Schema, Snowflake Schema, OLTP and OLAP
- Hands on experience of cloud platforms, especially Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP)
- BA/BS in Computer Science, Computer Engineering. Engineering, Statistics/Mathematics or similar
- Proficient in English, other languages beneficial
COMPETENCIES
- A true self-starter, who dreams big, and is motivated by a challenging and fast-paced environment
- Ability to manage conflicting priorities under pressure
- Strong relationship management, communication and collaboration skills: effectively working with technical audiences
Method of Application
Signup to view application details.
Signup Now
.jpg)
