datatrota
Signup Login
Home Jobs Blog

Data Engineer at Snapnet Limited

Snapnet LimitedLagos, Nigeria Data and Artificial Intelligence
Full Time
Snapnet is a fast growing firm focused in developing industry specific solutions, Business consulting and Systems Integration with offices in Lagos and Abuja, Nigeria. We are committed to delivering first class innovation, quality and state of the art technology solutions to discerning clients both in the private and public sector. Our focus is the provision of Business and Information Technology solutions to drive the operations of organizations for growth and effectiveness. We have assisted our various clients improve organizational performance by combining the innovative use of technology with extensive business process experience in a range of industries to deliver solutions that help our clients achieve rapid and sustainable business advantage.

Job Description

  • We are seeking a talented Python Expert with expertise in Azure Databricks to join our team as a Data Transformation Developer.
  • As a Python Expert, you will be responsible for developing solutions using Azure Databricks to transform and manipulate data efficiently and accurately.
  • You will work closely with our data engineering and data science teams to design and implement data transformation processes that meet the needs of our organization.

Responsibilities:

  • Develop and maintain Python-based data transformation solutions using Azure Databricks.
  • Collaborate with data engineering and data science teams to understand data requirements and design effective data transformation processes.
  • Analyze and profile data to identify patterns, inconsistencies, and data quality issues that may impact data transformation processes.
  • Implement data transformation logic and algorithms using Python programming language and/PySpark, ensuring efficiency, scalability, and maintainability.
  • Optimize data transformation processes to enhance performance and minimize processing time.
  • Develop and maintain Jupyter notebooks within Azure Databricks, ensuring smooth and reliable execution of data transformation tasks.
  • Conduct thorough testing and debugging of data transformation code to ensure accuracy and reliability of results.
  • Collaborate with cross-functional teams to ensure seamless integration of data transformation processes with downstream systems and applications.
  • Stay updated with the latest advancements in Azure Databricks and other relevant technologies to continuously enhance data transformation capabilities.
  • Provide technical guidance and mentorship to junior team members, fostering a culture of learning and growth.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field. Equivalent work experience may be considered.
  • Proven experience as a Python Developer, with expertise in Python programming language.
  • Strong knowledge and hands-on experience with Azure Databricks for data transformation and analytics.
  • Solid understanding of data transformation techniques, algorithms, and best practices.
  • Proficiency in working with large datasets and utilizing distributed computing frameworks.
  • Experience with data profiling, data quality assessment, and data cleansing techniques.
  • Familiarity with SQL and relational databases, including data modeling concepts.
  • Strong analytical and problem-solving skills, with the ability to analyze complex data and develop effective transformation strategies.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
  • Self-motivated and proactive, with the ability to prioritize tasks and manage time effectively.
  • Relevant certifications in Azure Databricks or related technologies are highly desirable.

Method of Application

Signup to view application details. Signup Now

More jobs like this

X

Send this job to a friend