Python Developer – Azure Databricks
- Job Type Full Time
- Qualification BA/BSc/HND
- Experience
- Location Lagos
- Job Field ICT / Computer 
Job Description
- We are seeking a talented Python Expert with expertise in Azure Databricks to join our team as a Data Transformation Developer.
- As a Python Expert, you will be responsible for developing solutions using Azure Databricks to transform and manipulate data efficiently and accurately.
- You will work closely with our data engineering and data science teams to design and implement data transformation processes that meet the needs of our organization.
Responsibilities:
- Develop and maintain Python-based data transformation solutions using Azure Databricks.
- Collaborate with data engineering and data science teams to understand data requirements and design effective data transformation processes.
- Analyze and profile data to identify patterns, inconsistencies, and data quality issues that may impact data transformation processes.
- Implement data transformation logic and algorithms using Python programming language and/PySpark, ensuring efficiency, scalability, and maintainability.
- Optimize data transformation processes to enhance performance and minimize processing time.
- Develop and maintain Jupyter notebooks within Azure Databricks, ensuring smooth and reliable execution of data transformation tasks.
- Conduct thorough testing and debugging of data transformation code to ensure accuracy and reliability of results.
- Collaborate with cross-functional teams to ensure seamless integration of data transformation processes with downstream systems and applications.
- Stay updated with the latest advancements in Azure Databricks and other relevant technologies to continuously enhance data transformation capabilities.
- Provide technical guidance and mentorship to junior team members, fostering a culture of learning and growth.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field. Equivalent work experience may be considered.
- Proven experience as a Python Developer, with expertise in Python programming language.
- Strong knowledge and hands-on experience with Azure Databricks for data transformation and analytics.
- Solid understanding of data transformation techniques, algorithms, and best practices.
- Proficiency in working with large datasets and utilizing distributed computing frameworks.
- Experience with data profiling, data quality assessment, and data cleansing techniques.
- Familiarity with SQL and relational databases, including data modeling concepts.
- Strong analytical and problem-solving skills, with the ability to analyze complex data and develop effective transformation strategies.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
- Self-motivated and proactive, with the ability to prioritize tasks and manage time effectively.
- Relevant certifications in Azure Databricks or related technologies are highly desirable.
go to method of application »
Method of Application
Leave a Comment