Andishi logo

Data Engineer( DataBricks & Snowflake)

Andishi

Nairobi, KenyaPosted Posted 3 days ago
python
go
sql
aws
azure
gcp

You'll apply on the employer's website. Applying is always free.

Job description

We're looking for a skilled Data Engineer with strong Databricks administration experience to help build, manage, and improve cloud-based data solutions. The project involves maintaining Databricks environments, developing scalable data pipelines, integrating data platforms, and improving overall data processing performance and reliability. We need someone who is comfortable owning technical deliverables from start to finish, making sound engineering decisions, and solving problems independently. What You'll Be Working On Managing and optimizing Databricks workspaces, configurations, permissions, and performance. Developing and maintaining reliable ETL/ELT workflows and data processing pipelines. Working with Snowflake to support data integration, transformation, and storage. Designing scalable data architectures for efficient processing and analytics. Handling data migrations between platforms while maintaining data integrity. Identifying and resolving pipeline failures, performance issues, and data quality problems. Improving automation, monitoring, and operational efficiency. Testing solutions, documenting implementations, and delivering production-ready work. Technical Requirements Must Have: Strong hands-on Databricks administration experience Python and advanced SQL Apache Spark / PySpark Snowflake Data engineering and ETL/ELT development Data migration and pipeline optimization Experience with AWS, Azure, or GCP Troubleshooting and performance tuning Nice to Have: Apache Airflow or Kafka Terraform and CI/CD Docker or Kubernetes Scala Data governance and access control Cloud infrastructure automation Expected Deliverables Configured and optimized Databricks environments Functional and tested data pipelines Reliable integrations with required data platforms Completed data migration tasks with validation Resolved performance and reliability issues Documented architecture, configurations, and workflows Source code, test results, and deployment instructions Final technical handover Who We're Looking For You should have at least 4 years of relevant experience and a strong background in production data engineering. We're especially interested in developers who have worked with complex data environments, can troubleshoot independently, and understand how to build maintainable, high-performance solutions. You should be comfortable working remotely, communicating progress clearly, and delivering agreed milestones without constant supervision.

Similar jobs