Mid Data Platform Engineer

• Fluent in written and spoken Portuguese and English.

• 30 days’ notice period for termination

• The candidate can work remotely from any Portuguese region

What you will be doing

• We're looking for a Data Engineer to support and develop a data platform within a large-scale international energy provider.

• Provide user support for the data platform, troubleshooting and fixing issues

• Support data pipelines and ETL/ELT processes to enable reliable and scalable data flows

• Collaborate with platform architects to ensure the data platform is efficient, secure, and highly available

• Improve data processes, monitoring, performance and platform efficiency

• Support data quality frameworks and monitoring to ensure accuracy, consistency, and completeness of data pipelines

• Support for data lakes, data warehouses, and data streaming solutions

• Work with stakeholders (data scientists, analysts, business users) to solve issues in the data platform

• Automate repeatable tasks and improve the data ingestion, transformation, and delivery processes

• Troubleshoot and optimize data workflows and SQL queries for performance and cost efficiency

• Document data platform changes, processes, and best practices

• Review, evaluate and approve data product releases to production.

What we are looking for

• Experience with data pipelines in a production environment

• Strong hands-on knowledge of SQL and experience with distributed data processing (e.g., Apache Spark)

• Proficiency and knowledge of troubleshooting dbt, Apache Kafka, Apache Ignite, Apache NiFi and Apache AirFlow

• Proficiency in a programming language such as Python or Scala for data engineering tasks

• Experience with cloud data services (AWS)

• Familiarity with Grafana tools

• Knowledge of data governance, security, and compliance in a cloud environment

• Experience implementing CI/CD and testing frameworks for data workflows

• Strong problem-solving skills, communication skills, and passion for collaboration.

What can you expect from us?

Mind-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team.

100% Remote opportunities

We want you to have the flexibility to work where you feel most comfortable and productive.

International Career

• You can expect professional growth and to be connect with the world.

• We are represented in Portugal, Belgium, Luxembourg, and Denmark.

• And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…)

Extra Benefits & Perks

If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help!

As a plus, we provide Health and Life Insurance.

Originally posted on Himalayas